73 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 83057+2424 | 110.68 GB | 30 Apr 2008 - 23:56 |
Unknown robot (identified by 'crawl') | 40817+1039 | 23.36 GB | 30 Apr 2008 - 23:59 |
Googlebot | 33081+78 | 26.60 GB | 30 Apr 2008 - 23:57 |
MSNBot | 30863+834 | 3.55 GB | 30 Apr 2008 - 23:59 |
BaiDuSpider | 13559+46 | 755.72 MB | 30 Apr 2008 - 23:56 |
MSNBot-media | 8042+98 | 691.27 MB | 30 Apr 2008 - 22:23 |
Ocelli | 7429+7 | 3.80 GB | 30 Apr 2008 - 14:14 |
Ask | 5727+125 | 121.72 MB | 30 Apr 2008 - 23:12 |
Nutch | 5572+94 | 10.60 GB | 30 Apr 2008 - 22:35 |
Unknown robot (identified by hit on 'robots.txt') | 0+3332 | 417.95 KB | 30 Apr 2008 - 22:43 |
Unknown robot (identified by 'bot*') | 2719+105 | 404.12 MB | 30 Apr 2008 - 21:56 |
GigaBot | 1499+146 | 837.26 MB | 30 Apr 2008 - 23:56 |
twiceler | 1005+100 | 16.48 MB | 30 Apr 2008 - 15:05 |
Unknown robot (identified by empty user agent string) | 454+265 | 176.45 MB | 30 Apr 2008 - 22:24 |
WGet tools | 699+2 | 1.31 GB | 30 Apr 2008 - 19:01 |
Harvest | 639 | 226.08 MB | 27 Apr 2008 - 12:59 |
Voila | 302+324 | 175.40 MB | 30 Apr 2008 - 19:26 |
Java (Often spam bot) | 486+7 | 50.59 MB | 30 Apr 2008 - 21:53 |
MJ12bot | 417+22 | 4.02 MB | 30 Apr 2008 - 09:38 |
Exabot | 344+35 | 12.47 MB | 30 Apr 2008 - 22:09 |
Unknown robot (identified by 'spider') | 32+295 | 27.15 MB | 29 Apr 2008 - 07:39 |
Unknown robot (identified by 'discovery') | 291+10 | 4.07 MB | 30 Apr 2008 - 20:22 |
Unknown robot (identified by 'robot') | 225+48 | 6.92 MB | 30 Apr 2008 - 23:37 |
OutfoxBot/YodaoBot | 195+73 | 28.89 MB | 30 Apr 2008 - 18:23 |
Turn It In | 264+2 | 19.12 MB | 26 Apr 2008 - 16:00 |
Alexa (IA Archiver) | 242+20 | 69.49 MB | 30 Apr 2008 - 23:28 |
Perl tool | 220+1 | 77.44 MB | 30 Apr 2008 - 19:03 |
Mail.ru bot | 210+1 | 4.65 MB | 02 Apr 2008 - 21:35 |
Jakarta commons-httpclient | 144+22 | 1.80 MB | 30 Apr 2008 - 16:26 |
BecomeBot | 147+19 | 1.63 MB | 17 Apr 2008 - 17:03 |
CFNetwork | 139 | 1.39 GB | 30 Apr 2008 - 10:40 |
noxtrumbot | 133+4 | 54.79 MB | 22 Apr 2008 - 20:31 |
Python-urllib | 81+21 | 91.07 MB | 30 Apr 2008 - 15:31 |
Sogou Spider | 68+7 | 30.53 MB | 30 Apr 2008 - 23:37 |
yacy | 57+14 | 15.29 MB | 29 Apr 2008 - 02:01 |
Speedy Spider | 33+9 | 54.57 MB | 30 Apr 2008 - 04:22 |
WordPress | 40 | 126.60 KB | 18 Apr 2008 - 22:07 |
FaceBook bot | 32 | 55.07 MB | 22 Apr 2008 - 18:23 |
NG 2.x (Exalead) | 0+27 | 3.45 KB | 30 Apr 2008 - 22:03 |
The web archive (IA Archiver) | 0+24 | 3.07 KB | 29 Apr 2008 - 09:27 |
Web Core / Roots | 15 | 4.80 MB | 29 Apr 2008 - 13:37 |
BBot | 15 | 22.98 MB | 30 Apr 2008 - 16:58 |
UCSD Crawl | 9+6 | 28.02 KB | 27 Apr 2008 - 02:25 |
Grub.org | 7+7 | 370.74 KB | 19 Apr 2008 - 20:32 |
Holmes | 1+11 | 10.71 KB | 28 Apr 2008 - 18:36 |
Heritrix | 6+6 | 15.96 MB | 28 Apr 2008 - 18:29 |
MSIECrawler | 4+8 | 110.05 KB | 28 Apr 2008 - 22:43 |
Custo | 11 | 47.29 MB | 30 Apr 2008 - 00:09 |
psbot | 8+3 | 74.77 KB | 17 Apr 2008 - 16:11 |
archive.org bot | 5+5 | 11.54 MB | 18 Apr 2008 - 17:24 |
larbin | 6+3 | 45.07 KB | 29 Apr 2008 - 03:35 |
QihooBot | 8 | 2.99 MB | 11 Apr 2008 - 08:45 |
Gaisbot | 4+4 | 3.02 MB | 18 Apr 2008 - 10:44 |
Yandex bot | 5+1 | 270 Bytes | 30 Apr 2008 - 16:16 |
EasyDL | 6 | 65.52 KB | 20 Apr 2008 - 05:11 |
boitho.com-dc | 4+2 | 15.82 KB | 30 Apr 2008 - 13:43 |
Unknown robot (identified by 'hunter') | 5 | 1.75 MB | 16 Apr 2008 - 21:21 |
BSpider | 0+5 | 655 Bytes | 22 Apr 2008 - 22:27 |
IRLbot | 2+2 | 45.48 KB | 20 Apr 2008 - 01:57 |
The World Wide Web Worm | 4 | 15.77 KB | 22 Apr 2008 - 23:47 |
DoCoMo | 3 | 39.31 KB | 29 Apr 2008 - 13:58 |
Internet Shinchakubin | 3 | 27.67 KB | 21 Apr 2008 - 08:44 |
Checkbot | 3 | 0 | 24 Apr 2008 - 03:26 |
Scooter | 3 | 28.94 KB | 30 Apr 2008 - 22:34 |
Unknown robot (identified by 'checker') | 2 | 0 | 27 Apr 2008 - 12:50 |
Fish search | 2 | 22.93 KB | 25 Apr 2008 - 09:19 |
lwp-trivial | 2 | 278 Bytes | 08 Apr 2008 - 12:34 |
SuperBot | 1 | 139 Bytes | 03 Apr 2008 - 21:56 |
WebCollage | 1 | 15.77 KB | 27 Apr 2008 - 12:21 |
lwp-request | 1 | 0 | 09 Apr 2008 - 17:12 |
Powermarks | 1 | 0 | 21 Apr 2008 - 00:53 |
HTMLParser | 1 | 17.84 KB | 09 Apr 2008 - 12:24 |
WebMiner | 0+1 | 131 Bytes | 07 Apr 2008 - 04:57 |
Others | 0 | 0 | |