65 different robots | Hits | Bandwidth | Last visit |
Googlebot | 85508+92 | 37.85 GB | 31 Mar 2011 - 23:59 |
Yahoo Slurp | 33551+289 | 10.29 GB | 31 Mar 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 31515+1829 | 17.98 GB | 31 Mar 2011 - 23:56 |
Yandex bot | 15795+60 | 8.29 GB | 31 Mar 2011 - 23:59 |
Unknown robot (identified by 'discovery') | 11382+102 | 25.32 GB | 31 Mar 2011 - 23:59 |
Unknown robot (identified by 'robot') | 10526+127 | 1.15 GB | 31 Mar 2011 - 12:18 |
Unknown robot (identified by 'crawl') | 6436+284 | 438.89 MB | 31 Mar 2011 - 23:31 |
Feedfetcher-Google | 2534 | 86.05 MB | 31 Mar 2011 - 23:58 |
Sogou Spider | 2248+7 | 672.67 MB | 31 Mar 2011 - 23:10 |
Unknown robot (identified by empty user agent string) | 2159+80 | 3.66 GB | 31 Mar 2011 - 23:48 |
MSNBot-media | 1200+527 | 80.18 MB | 31 Mar 2011 - 23:07 |
BaiDuSpider | 1478+155 | 3.14 GB | 31 Mar 2011 - 20:25 |
Exabot | 1287+68 | 21.23 MB | 31 Mar 2011 - 23:16 |
Unknown robot (identified by hit on 'robots.txt') | 0+722 | 21.92 KB | 31 Mar 2011 - 23:06 |
ichiro | 641+24 | 30.25 MB | 31 Mar 2011 - 23:34 |
Unknown robot (identified by 'spider') | 342+38 | 99.34 MB | 31 Mar 2011 - 15:08 |
Speedy Spider | 216+118 | 18.21 MB | 31 Mar 2011 - 20:03 |
Java (Often spam bot) | 322+11 | 450.31 MB | 31 Mar 2011 - 19:46 |
Unknown robot (identified by '*bot') | 100+222 | 1.59 MB | 31 Mar 2011 - 23:43 |
MJ12bot | 227+54 | 5.37 MB | 31 Mar 2011 - 11:07 |
MSNBot | 254+19 | 3.22 MB | 31 Mar 2011 - 19:10 |
Alexa (IA Archiver) | 186+77 | 75.12 MB | 31 Mar 2011 - 19:17 |
bender focused_crawler | 226+17 | 1.03 GB | 31 Mar 2011 - 19:01 |
yacy | 237+2 | 87.46 MB | 28 Mar 2011 - 00:32 |
WGet tools | 152 | 562.59 MB | 31 Mar 2011 - 23:04 |
CFNetwork | 114 | 462.10 MB | 31 Mar 2011 - 08:02 |
Motor | 111 | 23.30 MB | 26 Mar 2011 - 15:30 |
Fish search | 76 | 2.76 MB | 26 Mar 2011 - 01:00 |
FaceBook bot | 62+3 | 2.25 MB | 31 Mar 2011 - 19:49 |
Jakarta commons-httpclient | 59 | 32.39 MB | 31 Mar 2011 - 19:42 |
Harvest | 55 | 12.49 MB | 25 Mar 2011 - 17:17 |
Nutch | 20+25 | 192.02 KB | 28 Mar 2011 - 01:19 |
NG 2.x (Exalead) | 14+30 | 419.87 KB | 23 Mar 2011 - 10:25 |
Ask | 31+10 | 2.25 MB | 23 Mar 2011 - 02:16 |
WordPress | 37 | 49.66 MB | 31 Mar 2011 - 20:30 |
Findlinks | 13+18 | 147.14 KB | 31 Mar 2011 - 19:52 |
larbin | 28+1 | 227.38 KB | 27 Mar 2011 - 14:59 |
EasyDL | 27 | 1.55 MB | 16 Mar 2011 - 18:24 |
OutfoxBot/YodaoBot | 23+1 | 414.42 KB | 25 Mar 2011 - 14:34 |
Perl tool | 24 | 325.80 KB | 30 Mar 2011 - 19:10 |
Python-urllib | 22 | 540.22 KB | 25 Mar 2011 - 08:30 |
DoCoMo | 4+17 | 35.45 KB | 31 Mar 2011 - 22:46 |
The web archive (IA Archiver) | 0+18 | 558 Bytes | 29 Mar 2011 - 20:22 |
VORTEX | 13 | 696.67 KB | 30 Mar 2011 - 17:45 |
Unknown robot (identified by 'hunter') | 10 | 1.98 MB | 19 Mar 2011 - 00:03 |
Powermarks | 9 | 161.92 KB | 25 Mar 2011 - 20:16 |
NutchCVS | 9 | 335.54 KB | 04 Mar 2011 - 21:21 |
archive.org bot | 8+1 | 24.49 MB | 31 Mar 2011 - 18:22 |
BSpider | 3+5 | 8.60 MB | 29 Mar 2011 - 00:28 |
WebCollage | 8 | 14.71 MB | 23 Mar 2011 - 03:55 |
MSIECrawler | 0+8 | 217 Bytes | 21 Mar 2011 - 08:18 |
Web Core / Roots | 7 | 64.90 KB | 08 Mar 2011 - 19:16 |
Netcraft | 7 | 49.49 KB | 28 Mar 2011 - 15:18 |
Custo | 3+3 | 11.20 MB | 30 Mar 2011 - 14:06 |
LinkChecker | 4+2 | 14.20 KB | 13 Mar 2011 - 11:14 |
legs | 3+3 | 115.68 MB | 29 Mar 2011 - 17:32 |
Checkbot | 5 | 0 | 31 Mar 2011 - 03:45 |
GigaBot | 1+4 | 7.22 KB | 31 Mar 2011 - 12:03 |
Google AdSense | 4 | 96.66 KB | 28 Mar 2011 - 06:29 |
Unknown robot (identified by 'scanner') | 1+2 | 7.13 KB | 01 Mar 2011 - 21:22 |
Y!J Yahoo Japan | 2+1 | 53.95 KB | 22 Mar 2011 - 02:52 |
Heritrix | 1+1 | 7.10 KB | 13 Mar 2011 - 16:54 |
BBot | 2 | 27.67 KB | 06 Mar 2011 - 10:24 |
HTMLParser | 1 | 7.07 KB | 31 Mar 2011 - 12:22 |
QihooBot | 1 | 7.07 KB | 18 Mar 2011 - 05:18 |