78 different robots | Hits | Bandwidth | Last visit |
Googlebot | 292462+302 | 68.16 GB | 31 Mar 2006 - 23:59 |
Yahoo Slurp | 41026+2888 | 20.79 GB | 31 Mar 2006 - 23:58 |
Unknown robot (identified by 'crawl') | 39426+557 | 66.58 GB | 31 Mar 2006 - 23:55 |
MSNBot | 14395+825 | 31.82 GB | 31 Mar 2006 - 23:58 |
Ask | 5729+130 | 87.75 MB | 31 Mar 2006 - 22:05 |
Python-urllib | 2567+2 | 16.70 MB | 31 Mar 2006 - 12:35 |
Unknown robot (identified by empty user agent string) | 2161+57 | 9.62 GB | 31 Mar 2006 - 23:58 |
Nutch | 1734+22 | 14.94 MB | 31 Mar 2006 - 21:50 |
larbin | 346+148 | 30.16 MB | 26 Mar 2006 - 19:30 |
aipbot | 466+5 | 3.89 MB | 30 Mar 2006 - 11:21 |
Java (Often spam bot) | 443+8 | 49.86 MB | 31 Mar 2006 - 17:32 |
Unknown robot (identified by 'bot*') | 387+56 | 21.11 MB | 31 Mar 2006 - 19:44 |
MJ12bot | 328+14 | 5.03 MB | 30 Mar 2006 - 05:55 |
Fast-Webcrawler | 297 | 40.01 MB | 14 Mar 2006 - 06:17 |
Voyager | 282+15 | 3.88 MB | 31 Mar 2006 - 23:57 |
GigaBot | 144+133 | 292.37 MB | 21 Mar 2006 - 23:07 |
ConveraCrawler | 237+2 | 817.04 MB | 08 Mar 2006 - 09:04 |
ZyBorg | 212+13 | 2.21 MB | 31 Mar 2006 - 23:02 |
BecomeBot | 123+88 | 2.07 MB | 31 Mar 2006 - 23:48 |
Harvest | 131 | 19.61 MB | 31 Mar 2006 - 10:26 |
psbot | 74+56 | 641.46 KB | 31 Mar 2006 - 10:35 |
Unknown robot (identified by hit on 'robots.txt') | 0+120 | 8.16 KB | 31 Mar 2006 - 22:13 |
Combine System | 58+55 | 383.24 KB | 31 Mar 2006 - 22:59 |
Exabot | 96+15 | 839.70 KB | 29 Mar 2006 - 19:03 |
Perl tool | 108+1 | 82.98 MB | 31 Mar 2006 - 02:34 |
Jakarta commons-httpclient | 98 | 175.09 MB | 16 Mar 2006 - 07:17 |
ichiro | 58+21 | 559.57 KB | 31 Mar 2006 - 19:47 |
NutchCVS | 46+22 | 28.02 MB | 31 Mar 2006 - 22:43 |
BaiDuSpider | 55+11 | 14.55 MB | 29 Mar 2006 - 19:32 |
Custo | 47 | 58.09 MB | 30 Mar 2006 - 00:45 |
IBM Almaden Research Center WebFountain™ | 29+16 | 2.52 MB | 28 Mar 2006 - 07:41 |
WGet tools | 42+1 | 68.66 MB | 31 Mar 2006 - 14:44 |
Findlinks | 31+9 | 111.41 KB | 30 Mar 2006 - 15:38 |
CFNetwork | 30 | 208.10 MB | 31 Mar 2006 - 12:44 |
Alexa (IA Archiver) | 25+3 | 15.07 MB | 09 Mar 2006 - 16:43 |
nicebot | 27 | 237.02 KB | 29 Mar 2006 - 23:26 |
KnowItAll | 2+25 | 20.77 KB | 14 Mar 2006 - 20:36 |
Sina Iask Spider | 23 | 2.53 MB | 30 Mar 2006 - 02:17 |
MSIECrawler | 16+7 | 1.84 MB | 30 Mar 2006 - 14:15 |
Walhello appie | 10+10 | 72.84 KB | 31 Mar 2006 - 17:37 |
Unknown robot (identified by 'spider') | 9+10 | 1.92 KB | 30 Mar 2006 - 17:46 |
Unknown robot (identified by 'robot') | 19 | 42.29 KB | 31 Mar 2006 - 19:30 |
Voila | 8+10 | 44.86 KB | 28 Mar 2006 - 02:02 |
WebCollage | 15 | 3.96 MB | 23 Mar 2006 - 22:28 |
W3C Link Checker | 7+7 | 504 Bytes | 15 Mar 2006 - 23:08 |
Yahoo-MMCrawler | 4+10 | 720 Bytes | 21 Mar 2006 - 18:22 |
Vagabondo | 7+6 | 500.37 KB | 31 Mar 2006 - 06:58 |
Girafabot | 8+5 | 1.33 MB | 11 Mar 2006 - 20:23 |
Unknown robot (identified by 'discovery') | 10 | 0 | 29 Mar 2006 - 10:23 |
Scumbot | 4+6 | 1.53 KB | 11 Mar 2006 - 19:46 |
Shim-Crawler | 5+4 | 243.52 KB | 20 Mar 2006 - 03:05 |
The web archive (IA Archiver) | 0+9 | 648 Bytes | 31 Mar 2006 - 02:00 |
Sogou Spider | 9 | 1.97 MB | 21 Mar 2006 - 15:25 |
Openfind data gatherer | 7+1 | 28.11 KB | 30 Mar 2006 - 01:54 |
Unknown robot (identified by 'checker') | 7+1 | 286.36 KB | 30 Mar 2006 - 05:26 |
Scooter | 0+8 | 576 Bytes | 18 Mar 2006 - 13:07 |
Google AdSense | 8 | 67.83 KB | 22 Mar 2006 - 01:48 |
HTTrack off-line browser | 5+2 | 1.10 MB | 18 Mar 2006 - 05:00 |
Turn It In | 4+1 | 63.92 KB | 18 Mar 2006 - 16:31 |
ComputingSite Robi/1.0 | 4 | 31.62 KB | 01 Mar 2006 - 12:35 |
Fish search | 4 | 28.05 KB | 08 Mar 2006 - 00:52 |
LinkChecker | 2+2 | 667.37 KB | 20 Mar 2006 - 14:55 |
Web Core / Roots | 2+1 | 542.20 KB | 14 Mar 2006 - 16:19 |
IRLbot | 3 | 417 Bytes | 14 Mar 2006 - 22:40 |
W3C Validator | 2 | 9.82 KB | 17 Mar 2006 - 09:27 |
Cursor | 2 | 12.70 KB | 20 Mar 2006 - 21:35 |
Spiderman | 2 | 34.05 KB | 27 Mar 2006 - 14:49 |
Netcraft | 2 | 0 | 31 Mar 2006 - 23:07 |
Powermarks | 2 | 215.98 KB | 24 Mar 2006 - 12:55 |
Antibot | 1+1 | 211 Bytes | 05 Mar 2006 - 17:06 |
Gaisbot | 1+1 | 5.49 KB | 17 Mar 2006 - 15:25 |
DoCoMo | 1 | 6.51 KB | 23 Mar 2006 - 00:40 |
StackRambler | 0+1 | 72 Bytes | 05 Mar 2006 - 16:26 |
Cfetch | 1 | 0 | 11 Mar 2006 - 23:56 |
PyQuery | 1 | 7.59 KB | 20 Mar 2006 - 19:45 |
boitho.com-dc | 0+1 | 72 Bytes | 24 Mar 2006 - 08:40 |
HTMLParser | 1 | 11.12 KB | 23 Mar 2006 - 02:22 |
Others | 0 | 175 Bytes | |