88 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 31888+718 | 31.32 GB | 30 Nov 2006 - 23:46 |
Yahoo Slurp | 29703+2325 | 15.86 GB | 30 Nov 2006 - 23:58 |
Googlebot | 23036+92 | 41.40 GB | 30 Nov 2006 - 23:59 |
Ask | 11385+134 | 181.09 MB | 30 Nov 2006 - 23:06 |
MSNBot | 5192+628 | 7.43 GB | 30 Nov 2006 - 23:28 |
noxtrumbot | 4916+12 | 3.48 GB | 30 Nov 2006 - 02:21 |
NutchCVS | 4798+17 | 1.79 GB | 30 Nov 2006 - 20:38 |
Python-urllib | 4661 | 8.54 MB | 30 Nov 2006 - 23:59 |
MSNBot-media | 3319+85 | 813.04 MB | 30 Nov 2006 - 22:50 |
INFOMINE VLCrawler | 3034+1 | 26.10 MB | 27 Nov 2006 - 01:00 |
Accoona-AI-Agent | 2762+3 | 63.37 MB | 19 Nov 2006 - 20:41 |
Alexa (IA Archiver) | 2215+31 | 3.96 GB | 30 Nov 2006 - 20:22 |
ichiro | 1854+10 | 98.05 MB | 29 Nov 2006 - 13:19 |
ConveraCrawler | 1635+6 | 5.48 GB | 25 Nov 2006 - 00:05 |
MJ12bot | 1316+9 | 16.49 MB | 28 Nov 2006 - 22:58 |
Unknown robot (identified by 'bot*') | 962+62 | 38.71 MB | 30 Nov 2006 - 23:08 |
Unknown robot (identified by empty user agent string) | 867+24 | 327.55 MB | 30 Nov 2006 - 23:09 |
Harvest | 834 | 99.90 MB | 28 Nov 2006 - 12:17 |
BecomeBot | 537+26 | 5.62 MB | 28 Nov 2006 - 17:28 |
Turn It In | 495+2 | 638.53 MB | 28 Nov 2006 - 05:07 |
Unknown robot (identified by hit on 'robots.txt') | 0+346 | 22.92 KB | 30 Nov 2006 - 21:54 |
Perl tool | 255+22 | 11.83 MB | 30 Nov 2006 - 23:45 |
ZyBorg | 257+11 | 3.27 MB | 30 Nov 2006 - 06:32 |
Exabot | 148+26 | 1.20 MB | 30 Nov 2006 - 15:42 |
Speedy Spider | 156+8 | 80.45 MB | 20 Nov 2006 - 14:25 |
Voyager | 135+16 | 1.24 MB | 26 Nov 2006 - 12:36 |
Sogou Spider | 105+18 | 49.45 MB | 30 Nov 2006 - 23:36 |
Nutch | 81+34 | 30.29 MB | 27 Nov 2006 - 13:56 |
BaiDuSpider | 105+9 | 10.81 MB | 30 Nov 2006 - 16:22 |
Voila | 41+50 | 2.77 MB | 30 Nov 2006 - 19:01 |
HTTrack off-line browser | 64+24 | 16.49 MB | 30 Nov 2006 - 23:36 |
lanshanbot | 51+34 | 8.73 MB | 22 Nov 2006 - 15:14 |
WordPress | 78 | 422.47 KB | 12 Nov 2006 - 22:12 |
Sina Iask Spider | 69+2 | 8.79 MB | 30 Nov 2006 - 07:59 |
GigaBot | 26+32 | 2.60 MB | 30 Nov 2006 - 06:28 |
ASpider (Associative Spider) | 36+21 | 174.04 KB | 30 Nov 2006 - 23:05 |
Unknown robot (identified by 'spider') | 41+11 | 7.89 MB | 29 Nov 2006 - 10:10 |
CFNetwork | 51 | 419.80 MB | 30 Nov 2006 - 15:57 |
nicebot | 49 | 2.04 MB | 29 Nov 2006 - 03:19 |
KnowItAll | 29+19 | 94.61 MB | 30 Nov 2006 - 16:34 |
Unknown robot (identified by 'robot') | 24+21 | 181.54 KB | 30 Nov 2006 - 01:02 |
Java (Often spam bot) | 35+9 | 16.38 MB | 30 Nov 2006 - 23:16 |
psbot | 26+17 | 466.31 KB | 30 Nov 2006 - 12:29 |
Jakarta commons-httpclient | 40+1 | 98.22 MB | 30 Nov 2006 - 09:36 |
Findlinks | 4+30 | 15.09 KB | 30 Nov 2006 - 10:52 |
WGet tools | 30+2 | 30.58 MB | 30 Nov 2006 - 14:59 |
Heritrix | 28+4 | 138.86 MB | 29 Nov 2006 - 01:35 |
YahooSeeker Yahoo! Blog crawler | 29+1 | 22.85 MB | 26 Nov 2006 - 20:46 |
Combine System | 16+7 | 4.30 MB | 30 Nov 2006 - 00:56 |
Custo | 20 | 44.87 MB | 30 Nov 2006 - 07:14 |
Yandex bot | 8+12 | 1.93 KB | 30 Nov 2006 - 13:10 |
Unknown robot (identified by 'discovery') | 17 | 0 | 28 Nov 2006 - 16:07 |
BBot | 17 | 15.41 MB | 30 Nov 2006 - 03:00 |
larbin | 8+6 | 1.39 MB | 20 Nov 2006 - 17:17 |
Girafabot | 8+5 | 1.08 MB | 26 Nov 2006 - 00:17 |
NG 1.x (Exalead) | 12 | 107.69 KB | 13 Nov 2006 - 13:06 |
UCSD Crawl | 12 | 17.96 MB | 30 Nov 2006 - 16:21 |
aipbot | 7+5 | 55.08 KB | 24 Nov 2006 - 05:51 |
MSIECrawler | 7+5 | 1.59 MB | 22 Nov 2006 - 14:13 |
WebCollage | 11 | 903.14 KB | 14 Nov 2006 - 09:43 |
Krugle | 7+2 | 35.98 KB | 17 Nov 2006 - 19:50 |
Gaisbot | 5+4 | 32.85 KB | 30 Nov 2006 - 23:43 |
lwp-trivial | 8 | 13.84 MB | 30 Nov 2006 - 00:12 |
Powermarks | 5 | 0 | 29 Nov 2006 - 00:47 |
The web archive (IA Archiver) | 1+4 | 111.42 KB | 23 Nov 2006 - 11:27 |
Checkbot | 5 | 0 | 13 Nov 2006 - 09:50 |
Google AdSense | 5 | 87.93 KB | 08 Nov 2006 - 02:45 |
Openfind data gatherer | 4 | 31.83 KB | 26 Nov 2006 - 08:48 |
archive.org bot | 2+2 | 4.07 MB | 10 Nov 2006 - 10:18 |
Netcraft | 3 | 0 | 05 Nov 2006 - 16:56 |
Shim-Crawler | 1+1 | 5.49 KB | 23 Nov 2006 - 11:08 |
Asterias | 1+1 | 211 Bytes | 22 Nov 2006 - 00:52 |
Unknown robot (identified by 'checker') | 2 | 169.03 KB | 20 Nov 2006 - 09:22 |
Fish search | 2 | 776.11 KB | 22 Nov 2006 - 00:52 |
The World Wide Web Worm | 2 | 15.77 KB | 29 Nov 2006 - 06:12 |
PyQuery | 2 | 15.27 KB | 12 Nov 2006 - 07:54 |
Pompos | 0+2 | 144 Bytes | 21 Nov 2006 - 00:49 |
Scooter | 0+2 | 144 Bytes | 12 Nov 2006 - 06:27 |
MojeekBot | 1+1 | 4.31 KB | 20 Nov 2006 - 09:51 |
W3C Link Checker | 1+1 | 72 Bytes | 03 Nov 2006 - 13:34 |
WebCopy | 1 | 3.92 MB | 01 Nov 2006 - 02:52 |
Holmes | 0+1 | 72 Bytes | 01 Nov 2006 - 23:29 |
W3C Validator | 1 | 9.68 KB | 25 Nov 2006 - 08:10 |
twiceler | 0+1 | 72 Bytes | 30 Nov 2006 - 21:51 |
InfoSeek Robot 1.0 | 1 | 1.62 MB | 21 Nov 2006 - 23:06 |
EARTHCOM.info | 1 | 139 Bytes | 03 Nov 2006 - 19:12 |
EasyDL | 1 | 239.98 KB | 24 Nov 2006 - 13:22 |
HTMLParser | 1 | 10.83 KB | 20 Nov 2006 - 12:46 |
Others | 0 | 0 | |