Search log sample: htdig
The Direct Marketing Association's Rob Blakeley has kindly provided sample queries from htdig, a free search engine. DMA uses htdig to make their public site searchable. Here's the legend:
XXX.XXX.X.23: Searcher's IP address (partially masked to protect privacy)
[19/Jul/2006:04:04:14 -0400]: Query's time/date stamp in Greenwich Mean Time (-0400 is the zone, in this case Eastern Time)
GET /search: request for a search
/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house: The page/application requested. In this case the request is to the DMA site search engine and includes the search words "project" and "house"
HTTP/1.1": Version of Hypertext Transport Protocall used
200: Return code (200 means OK)
12283: The size of the file returned in bytes
http://www.the-dma.org/: Where the request came from, in this case, the DMA site.
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727): The description of the browser used and information about the computer. In this case, IE6 and and IBM compatible running Windows NT version 5.0.
thedmaserve=81.215.216.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1" thedmaserve=81.215.216.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1: Two cookies set by the DMA server with information about log in.
Log sample follows:
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:14 -0400] "GET /cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house HTTP/1.1" 200 12283 "http://www.the-dma.org/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1" thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:15 -0400] "GET /cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+ HTTP/1.1" 200 12283 "http://www.the-dma.org/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1" thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1
XX.XX.XXX.216 - - [19/Jul/2006:04:04:15 -0400] "GET /conferences/dma06/dma06brochure.pdf HTTP/1.1" 206 39617 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "marketinglong=uid=003w#^8&prodcode=ANN0107; marketingshort=uid=003w#^8&prodcode=ANN0107; thedmaserve=XX.XX.XXX.216.207501153296213835" -
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:15 -0400] "GET /includes/navigationheader.js HTTP/1.1" 200 3159 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2" -
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:16 -0400] "GET /cgi/adremotedisp?pos=2&pageset=DMAIB HTTP/1.1" 200 61 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2" thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:17 -0400] "GET /includes/tellafriend.js HTTP/1.1" 200 796 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2" -
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:17 -0400] "GET /includes/pi_blank.js HTTP/1.1" 200 0 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2; lastadserved1=adid=475; lastadserved2=adid=" -
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:17 -0400] "GET /cgi/adremotedisp?pos=3&pageset=DMAB+ HTTP/1.1" 200 6488 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2" thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:17 -0400] "GET /cgi/adremotedisp?pos=1&pageset=PAIDB HTTP/1.1" 200 20217 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2" thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:18 -0400] "GET /includes/searchbar.js HTTP/1.1" 200 1138 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2; lastadserved1=adid=475; lastadserved2=adid=; lastadserved3=adid=544" -
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:19 -0400] "GET /includes/footertext.js HTTP/1.1" 200 252 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2; lastadserved1=adid=475; lastadserved2=adid=; lastadserved3=adid=544; lastadserved4=adid=517" -
XX.XXX.XXX.23 - - [19/Jul/2006:04:04:19 -0400] "GET /cgi/adremotedisp?pos=4&pageset=PAIDF HTTP/1.1" 200 32698 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=project+house&searchgo=+GO%21+" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" "thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2; lastadserved1=adid=475; lastadserved2=adid=; lastadserved3=adid=544" thedmaserve=XX.XXX.XXX.23.319311153295772299; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2; lastadserved1=adid=475; lastadserved2=adid=; lastadserved3=adid=544
XX.XX.XX.98 - - [19/Jul/2006:15:32:56 -0400] "GET /cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=integrated+communications HTTP/1.1" 200 13247 "http://www.the-dma.org/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727)" "thedmaserve=XX.XX.XX.98.229201153337424518; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1" thedmaserve=XX.XX.XX.98.229201153337424518; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=1
XX.XXX.XXX.183 - - [19/Jul/2006:15:32:56 -0400] "GET /mt/descs/UAT1002 HTTP/1.0" 301 316 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)" "-" -
XX.XX.XX.98 - - [19/Jul/2006:15:32:57 -0400] "GET /includes/navigationheader.js HTTP/1.1" 200 3159 "http://www.the-dma.org/cgi2/htsearch?config=the-dmahtdigwhole&restrict=&method=and&words=integrated+communications" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727)" "thedmaserve=XX.XX.XX.98.229201153337424518; pmmcxLB0UT0POB13V8M2B78CVG78KJ4=2" -