91 different robots | Hits | Bandwidth | Last visit |
Googlebot | 95569+322 | 60.19 GB | 31 Jan 2006 - 23:59 |
Yahoo Slurp | 13346+1539 | 7.95 GB | 31 Jan 2006 - 23:53 |
MSNBot | 10913+357 | 16.34 GB | 31 Jan 2006 - 22:45 |
Unknown robot (identified by 'crawl') | 8621+582 | 2.62 GB | 31 Jan 2006 - 23:48 |
Ask | 7920+180 | 119.33 MB | 31 Jan 2006 - 23:59 |
WGet tools | 3991+1633 | 10.19 GB | 30 Jan 2006 - 14:26 |
Nutch | 4180+17 | 36.07 MB | 26 Jan 2006 - 21:41 |
ZyBorg | 2025+5 | 18.05 MB | 31 Jan 2006 - 22:35 |
noxtrumbot | 1412+4 | 170.54 MB | 30 Jan 2006 - 06:20 |
ConveraCrawler | 1063+5 | 2.07 GB | 30 Jan 2006 - 22:11 |
Voyager | 702+22 | 7.46 MB | 31 Jan 2006 - 22:04 |
GigaBot | 599+100 | 40.06 MB | 26 Jan 2006 - 14:33 |
MJ12bot | 603+7 | 51.43 MB | 23 Jan 2006 - 03:19 |
Unknown robot (identified by empty user agent string) | 389+25 | 23.89 MB | 31 Jan 2006 - 22:22 |
Unknown robot (identified by 'robot') | 386+2 | 850.60 MB | 31 Jan 2006 - 21:15 |
Turn It In | 293+2 | 33.68 MB | 13 Jan 2006 - 00:02 |
BecomeBot | 111+80 | 1.76 MB | 29 Jan 2006 - 14:11 |
psbot | 114+31 | 970.67 KB | 31 Jan 2006 - 13:27 |
zspider | 141 | 48.90 MB | 11 Jan 2006 - 01:32 |
Unknown robot (identified by 'bot*') | 115+20 | 43.20 MB | 31 Jan 2006 - 22:33 |
Harvest | 124 | 18.00 MB | 29 Jan 2006 - 12:02 |
Jakarta commons-httpclient | 57+44 | 57.54 MB | 27 Jan 2006 - 01:55 |
Perl tool | 101 | 9.14 MB | 30 Jan 2006 - 12:23 |
Ocelli | 85+1 | 8.04 MB | 25 Jan 2006 - 10:50 |
SBIder | 72+13 | 371.96 KB | 19 Jan 2006 - 05:59 |
BaiDuSpider | 74+7 | 14.21 MB | 31 Jan 2006 - 18:55 |
Java (Often spam bot) | 68+6 | 12.67 MB | 31 Jan 2006 - 04:07 |
IBM Almaden Research Center WebFountain™ | 49+20 | 80.20 MB | 29 Jan 2006 - 16:18 |
Unknown robot (identified by hit on 'robots.txt') | 0+68 | 4.57 KB | 31 Jan 2006 - 21:16 |
nicebot | 66 | 1.19 MB | 30 Jan 2006 - 13:59 |
Alexa (IA Archiver) | 49+15 | 30.61 MB | 29 Jan 2006 - 03:07 |
Argus | 26+13 | 1.83 MB | 28 Jan 2006 - 23:56 |
Exabot | 35+3 | 47.47 MB | 27 Jan 2006 - 09:36 |
Findlinks | 17+16 | 124.10 KB | 31 Jan 2006 - 09:19 |
larbin | 20+11 | 193.83 KB | 30 Jan 2006 - 00:18 |
MSIECrawler | 24+6 | 6.16 MB | 29 Jan 2006 - 02:53 |
Yahoo-MMCrawler | 7+22 | 4.62 KB | 31 Jan 2006 - 13:01 |
Combine System | 16+12 | 124.29 KB | 31 Jan 2006 - 19:11 |
Custo | 26 | 14.41 MB | 31 Jan 2006 - 10:41 |
NutchCVS | 14+11 | 2.57 MB | 30 Jan 2006 - 11:19 |
ichiro | 15+9 | 150.98 KB | 31 Jan 2006 - 11:07 |
Unknown robot (identified by 'spider') | 11+11 | 2.27 KB | 31 Jan 2006 - 17:52 |
NG 2.x (Exalead) | 18+3 | 149.57 KB | 14 Jan 2006 - 19:13 |
Voila | 10+11 | 715.49 KB | 30 Jan 2006 - 04:43 |
Google AdSense | 18 | 912.10 KB | 31 Jan 2006 - 01:54 |
UdmSearch | 15+2 | 1.34 MB | 24 Jan 2006 - 09:06 |
MSRBOT | 16+1 | 156.79 KB | 12 Jan 2006 - 09:43 |
Unknown robot (identified by 'discovery') | 15 | 0 | 24 Jan 2006 - 20:31 |
CFNetwork | 13 | 121.22 MB | 27 Jan 2006 - 02:22 |
WebCollage | 13 | 3.16 MB | 11 Jan 2006 - 09:19 |
Girafabot | 8+5 | 1.26 MB | 16 Jan 2006 - 14:47 |
NetSprint | 12 | 197.55 KB | 29 Jan 2006 - 18:40 |
Geniebot | 5+5 | 317.01 KB | 26 Jan 2006 - 11:46 |
BBot | 10 | 13.60 MB | 30 Jan 2006 - 11:41 |
Spiderman | 9 | 48.77 KB | 29 Jan 2006 - 20:25 |
Vagabondo | 5+4 | 474.66 KB | 29 Jan 2006 - 08:49 |
Openfind data gatherer | 5+3 | 38.02 KB | 30 Jan 2006 - 04:16 |
lwp-trivial | 8 | 64.39 KB | 29 Jan 2006 - 18:30 |
Accoona-AI-Agent | 6+1 | 4.01 MB | 26 Jan 2006 - 03:28 |
Ingrid | 3+3 | 47.16 KB | 26 Jan 2006 - 11:19 |
NimbleCrawler | 4+2 | 7.47 KB | 30 Jan 2006 - 04:56 |
RufusBot Rufus Web Miner | 5+1 | 44.33 KB | 25 Jan 2006 - 01:37 |
Unknown robot (identified by 'checker') | 6 | 170.80 KB | 26 Jan 2006 - 11:17 |
archive.org bot | 4+2 | 1.23 MB | 28 Jan 2006 - 01:46 |
Sogou Spider | 6 | 1.86 MB | 13 Jan 2006 - 19:39 |
HTTrack off-line browser | 4+1 | 12.70 KB | 21 Jan 2006 - 08:11 |
Powermarks | 5 | 0 | 30 Jan 2006 - 00:47 |
Pompos | 2+3 | 1.09 MB | 28 Jan 2006 - 00:21 |
Sina Iask Spider | 4 | 20.62 KB | 17 Jan 2006 - 09:38 |
miniRank | 2+2 | 422 Bytes | 04 Jan 2006 - 03:00 |
IRLbot | 2+2 | 7.86 KB | 27 Jan 2006 - 23:38 |
Walhello appie | 2+2 | 31.49 KB | 25 Jan 2006 - 02:01 |
SuperBot | 3 | 548.14 KB | 23 Jan 2006 - 05:05 |
Python-urllib | 3 | 4.94 MB | 26 Jan 2006 - 07:38 |
HTMLParser | 3 | 2.14 MB | 28 Jan 2006 - 01:26 |
Everest-Vulcan | 1+1 | 7.57 KB | 15 Jan 2006 - 11:23 |
Cursor | 2 | 1.05 MB | 31 Jan 2006 - 10:41 |
InfoSeek Robot 1.0 | 1+1 | 9.64 KB | 12 Jan 2006 - 15:19 |
plinki | 1+1 | 211 Bytes | 10 Jan 2006 - 21:42 |
Netcraft | 2 | 0 | 17 Jan 2006 - 01:25 |
Cfetch | 2 | 0 | 10 Jan 2006 - 02:14 |
EasyDL | 2 | 17.54 KB | 13 Jan 2006 - 06:09 |
MapoftheInternet.com | 1+1 | 211 Bytes | 25 Jan 2006 - 12:32 |
W3C Link Checker | 1+1 | 72 Bytes | 30 Jan 2006 - 00:31 |
Speedy Spider | 1+1 | 211 Bytes | 08 Jan 2006 - 22:06 |
Unknown robot (identified by '*bot') | 1 | 139 Bytes | 25 Jan 2006 - 12:13 |
Scooter | 0+1 | 72 Bytes | 10 Jan 2006 - 05:01 |
VORTEX | 1 | 139 Bytes | 01 Jan 2006 - 03:41 |
Others | 0 | 3.20 KB | |