84 different robots | Hits | Bandwidth | Last visit |
Googlebot | 337299+69 | 24.76 GB | 30 Apr 2006 - 02:57 |
Yahoo Slurp | 32065+2762 | 27.18 GB | 30 Apr 2006 - 03:07 |
Unknown robot (identified by 'crawl') | 17890+557 | 10.26 GB | 30 Apr 2006 - 02:59 |
MSNBot | 16186+711 | 31.95 GB | 30 Apr 2006 - 02:49 |
Ask | 10989+142 | 340.49 MB | 30 Apr 2006 - 02:18 |
Heritrix | 3123+4 | 2.72 GB | 26 Apr 2006 - 03:04 |
Python-urllib | 2571 | 16.40 MB | 09 Apr 2006 - 12:22 |
Ocelli | 2528+2 | 1.62 GB | 29 Apr 2006 - 17:55 |
BecomeBot | 2273+144 | 24.24 MB | 29 Apr 2006 - 02:42 |
Nutch | 1681+20 | 14.45 MB | 29 Apr 2006 - 23:43 |
UdmSearch | 1587 | 1.65 MB | 04 Apr 2006 - 19:28 |
GigaBot | 945+602 | 232.82 MB | 29 Apr 2006 - 01:14 |
ZyBorg | 1324+9 | 12.66 MB | 20 Apr 2006 - 21:05 |
Voyager | 1011+20 | 10.47 MB | 25 Apr 2006 - 21:41 |
Unknown robot (identified by empty user agent string) | 548+75 | 330.72 MB | 30 Apr 2006 - 01:01 |
Unknown robot (identified by 'robot') | 519+4 | 53.35 MB | 29 Apr 2006 - 11:00 |
Unknown robot (identified by 'bot*') | 343+48 | 39.13 MB | 29 Apr 2006 - 12:13 |
Harvest | 326 | 99.95 MB | 29 Apr 2006 - 03:51 |
MJ12bot | 304+13 | 47.79 MB | 25 Apr 2006 - 21:49 |
WGet tools | 264+2 | 190.26 MB | 29 Apr 2006 - 23:06 |
SBIder | 95+82 | 363.46 KB | 29 Apr 2006 - 15:01 |
Java (Often spam bot) | 158+7 | 865.19 KB | 29 Apr 2006 - 23:07 |
ConveraCrawler | 153+5 | 229.51 MB | 29 Apr 2006 - 01:58 |
Unknown robot (identified by hit on 'robots.txt') | 0+152 | 10.62 KB | 29 Apr 2006 - 14:21 |
Turn It In | 132+2 | 7.22 MB | 29 Apr 2006 - 19:37 |
ichiro | 103+25 | 847.20 KB | 29 Apr 2006 - 20:16 |
Exabot | 95+14 | 843.38 KB | 25 Apr 2006 - 16:14 |
Combine System | 41+41 | 266.82 KB | 29 Apr 2006 - 20:56 |
NutchCVS | 42+28 | 38.30 MB | 28 Apr 2006 - 08:19 |
Spiderman | 67 | 584.20 KB | 29 Apr 2006 - 16:04 |
Perl tool | 67 | 63.84 MB | 30 Apr 2006 - 02:19 |
Unknown robot (identified by 'discovery') | 57 | 0 | 28 Apr 2006 - 17:13 |
IBM Almaden Research Center WebFountain™ | 29+26 | 2.50 MB | 29 Apr 2006 - 22:37 |
BaiDuSpider | 43+11 | 9.90 MB | 29 Apr 2006 - 14:24 |
psbot | 28+22 | 121.27 KB | 29 Apr 2006 - 01:30 |
noxtrumbot | 41+5 | 349.96 KB | 30 Apr 2006 - 00:35 |
lanshanbot | 25+19 | 3.41 MB | 27 Apr 2006 - 05:48 |
Findlinks | 33+10 | 108.76 KB | 28 Apr 2006 - 20:46 |
Voila | 15+17 | 836.89 KB | 29 Apr 2006 - 00:28 |
Cursor | 26 | 3.16 MB | 24 Apr 2006 - 15:44 |
Girafabot | 16+10 | 2.71 MB | 16 Apr 2006 - 22:15 |
Jakarta commons-httpclient | 25 | 23.78 MB | 29 Apr 2006 - 10:08 |
Custo | 23 | 50.78 MB | 28 Apr 2006 - 12:10 |
nicebot | 20 | 190.13 KB | 28 Apr 2006 - 09:43 |
Sogou Spider | 20 | 5.24 MB | 18 Apr 2006 - 04:50 |
Geniebot | 9+10 | 387.95 KB | 28 Apr 2006 - 12:30 |
WebCollage | 18 | 6.71 MB | 26 Apr 2006 - 08:41 |
CFNetwork | 17 | 127.73 MB | 28 Apr 2006 - 14:24 |
Google AdSense | 15 | 2.09 MB | 27 Apr 2006 - 16:39 |
Unknown robot (identified by 'spider') | 6+6 | 210.36 KB | 29 Apr 2006 - 23:32 |
aipbot | 6+6 | 68.23 KB | 28 Apr 2006 - 05:29 |
Unknown robot (identified by 'checker') | 9+2 | 185.31 KB | 25 Apr 2006 - 10:13 |
UCSD Crawl | 11 | 735.34 KB | 20 Apr 2006 - 14:13 |
Yahoo-MMCrawler | 5+6 | 432 Bytes | 28 Apr 2006 - 09:17 |
NPBot | 6+2 | 54.70 KB | 23 Apr 2006 - 22:14 |
Sina Iask Spider | 8 | 921.68 KB | 19 Apr 2006 - 13:06 |
Shim-Crawler | 4+3 | 243.32 KB | 24 Apr 2006 - 17:51 |
Web Core / Roots | 5+1 | 30.67 KB | 18 Apr 2006 - 15:06 |
Vagabondo | 3+2 | 18.41 KB | 23 Apr 2006 - 09:57 |
Krugle | 2+2 | 19.28 KB | 24 Apr 2006 - 21:57 |
HTTrack off-line browser | 3+1 | 72.33 KB | 21 Apr 2006 - 07:40 |
BBot | 4 | 48.94 KB | 14 Apr 2006 - 00:55 |
Powermarks | 4 | 0 | 25 Apr 2006 - 00:36 |
Esther | 2+2 | 22.01 MB | 25 Apr 2006 - 10:07 |
Unknown robot (identified by '*bot') | 2+2 | 350 Bytes | 26 Apr 2006 - 22:11 |
larbin | 2+2 | 33.38 KB | 24 Apr 2006 - 05:01 |
Kevin | 3 | 26.87 KB | 04 Apr 2006 - 07:54 |
Openfind data gatherer | 3 | 21.91 KB | 20 Apr 2006 - 05:34 |
Scooter | 0+3 | 216 Bytes | 26 Apr 2006 - 01:23 |
Ingrid | 1+1 | 15.72 KB | 06 Apr 2006 - 23:59 |
InfoSeek Robot 1.0 | 1+1 | 9.64 KB | 11 Apr 2006 - 09:23 |
Netcraft | 2 | 0 | 07 Apr 2006 - 23:55 |
Fast-Webcrawler | 0+2 | 144 Bytes | 06 Apr 2006 - 11:38 |
The web archive (IA Archiver) | 0+2 | 144 Bytes | 10 Apr 2006 - 02:17 |
Scumbot | 1+1 | 211 Bytes | 15 Apr 2006 - 13:48 |
MSIECrawler | 0+2 | 144 Bytes | 21 Apr 2006 - 12:07 |
Robozilla | 1 | 139 Bytes | 28 Apr 2006 - 15:09 |
StackRambler | 0+1 | 72 Bytes | 26 Apr 2006 - 03:07 |
boitho.com-dc | 1 | 1.87 KB | 03 Apr 2006 - 20:33 |
HTMLParser | 1 | 9.05 KB | 02 Apr 2006 - 12:30 |
LinkChecker | 1 | 0 | 16 Apr 2006 - 04:49 |
Others | 0 | 159 Bytes | |