64 different robots | Hits | Bandwidth | Last visit |
Googlebot | 72883+103 | 27.18 GB | 31 Jul 2011 - 23:59 |
Yahoo Slurp | 39613+226 | 8.00 GB | 31 Jul 2011 - 23:57 |
Unknown robot (identified by 'bot*') | 31143+1095 | 16.85 GB | 31 Jul 2011 - 23:51 |
Unknown robot (identified by 'crawl') | 20698+813 | 7.38 GB | 31 Jul 2011 - 23:59 |
DoCoMo | 9165+41 | 215.12 MB | 31 Jul 2011 - 20:23 |
Yandex bot | 8803+65 | 5.90 GB | 31 Jul 2011 - 23:53 |
BaiDuSpider | 8501+44 | 398.84 MB | 31 Jul 2011 - 23:36 |
Unknown robot (identified by 'robot') | 5035+47 | 892.36 MB | 31 Jul 2011 - 23:55 |
Sogou Spider | 4768+9 | 772.74 MB | 31 Jul 2011 - 23:29 |
MSNBot-media | 3080+1244 | 72.81 MB | 31 Jul 2011 - 23:35 |
Feedfetcher-Google | 3840 | 27.60 MB | 31 Jul 2011 - 23:41 |
Nutch | 3337+118 | 200.89 MB | 31 Jul 2011 - 22:42 |
bender focused_crawler | 1675+27 | 5.60 GB | 31 Jul 2011 - 08:28 |
Java (Often spam bot) | 1517+12 | 394.72 MB | 31 Jul 2011 - 12:35 |
Unknown robot (identified by 'spider') | 1069+177 | 72.28 MB | 31 Jul 2011 - 23:53 |
Unknown robot (identified by empty user agent string) | 1137+85 | 644.94 MB | 31 Jul 2011 - 23:56 |
Exabot | 1021+59 | 17.83 MB | 31 Jul 2011 - 19:48 |
Unknown robot (identified by hit on 'robots.txt') | 0+535 | 16.20 KB | 31 Jul 2011 - 23:55 |
MJ12bot | 220+182 | 5.18 MB | 31 Jul 2011 - 14:24 |
legs | 233+147 | 4.37 MB | 30 Jul 2011 - 14:23 |
Unknown robot (identified by '*bot') | 217+140 | 13.28 MB | 31 Jul 2011 - 18:26 |
Speedy Spider | 202+122 | 14.41 MB | 29 Jul 2011 - 19:32 |
Alexa (IA Archiver) | 128+66 | 8.98 MB | 31 Jul 2011 - 23:15 |
WordPress | 162 | 53.75 MB | 29 Jul 2011 - 18:38 |
WGet tools | 156+2 | 305.19 MB | 31 Jul 2011 - 23:50 |
FaceBook bot | 133 | 2.42 MB | 31 Jul 2011 - 09:45 |
OutfoxBot/YodaoBot | 98+1 | 945.10 KB | 31 Jul 2011 - 20:45 |
Motor | 93 | 17.33 MB | 23 Jul 2011 - 13:11 |
archive.org bot | 74+3 | 26.92 MB | 19 Jul 2011 - 09:55 |
yacy | 64+1 | 77.27 MB | 30 Jul 2011 - 10:04 |
Findlinks | 23+29 | 353.48 KB | 31 Jul 2011 - 22:50 |
CFNetwork | 47 | 335.55 MB | 31 Jul 2011 - 19:38 |
Harvest | 47 | 7.42 MB | 30 Jul 2011 - 02:57 |
larbin | 28+6 | 241.12 KB | 19 Jul 2011 - 13:53 |
Unknown robot (identified by 'discovery') | 25+8 | 7.31 KB | 30 Jul 2011 - 08:08 |
Perl tool | 31 | 14.78 MB | 29 Jul 2011 - 08:10 |
Ask | 22+8 | 1.83 MB | 12 Jul 2011 - 16:29 |
Jakarta commons-httpclient | 28 | 5.55 MB | 31 Jul 2011 - 23:20 |
BSpider | 1+25 | 1.67 MB | 31 Jul 2011 - 01:53 |
Python-urllib | 19 | 46.38 MB | 29 Jul 2011 - 09:49 |
Web Core / Roots | 16 | 382.79 KB | 22 Jul 2011 - 17:02 |
psbot | 8+7 | 178.51 KB | 31 Jul 2011 - 23:49 |
NG 1.x (Exalead) | 12 | 376.50 KB | 14 Jul 2011 - 12:32 |
GigaBot | 1+7 | 7.28 KB | 29 Jul 2011 - 14:06 |
MagpieRSS | 4+4 | 83.44 KB | 18 Jul 2011 - 13:29 |
Netcraft | 8 | 56.74 KB | 28 Jul 2011 - 21:01 |
EasyDL | 6 | 134.39 KB | 04 Jul 2011 - 03:39 |
MSNBot | 4+2 | 83.32 KB | 01 Jul 2011 - 07:58 |
Checkbot | 5 | 0 | 28 Jul 2011 - 03:58 |
Unknown robot (identified by 'hunter') | 4 | 325.30 KB | 29 Jul 2011 - 16:53 |
BBot | 4 | 2.63 MB | 30 Jul 2011 - 01:26 |
Unknown robot (identified by 'checker') | 3 | 6.11 MB | 26 Jul 2011 - 21:20 |
MSIECrawler | 1+2 | 33.13 KB | 27 Jul 2011 - 19:36 |
ichiro | 1+2 | 7.13 KB | 31 Jul 2011 - 08:13 |
Custo | 1+1 | 7.10 KB | 19 Jul 2011 - 21:28 |
W3C Link Checker | 1+1 | 31 Bytes | 06 Jul 2011 - 14:10 |
Powermarks | 1 | 41.29 KB | 28 Jul 2011 - 08:22 |
UCSD Crawl | 1 | 618.74 KB | 28 Jul 2011 - 13:08 |
Unknown robot (identified by 'sucker') | 1 | 23.93 KB | 07 Jul 2011 - 10:03 |
Unknown robot (identified by 'scanner') | 0+1 | 31 Bytes | 31 Jul 2011 - 22:29 |
WebCollage | 1 | 12.83 KB | 13 Jul 2011 - 23:18 |
HTTrack off-line browser | 0+1 | 31 Bytes | 26 Jul 2011 - 10:10 |
FavIconizer | 1 | 7.12 KB | 30 Jul 2011 - 09:20 |
QihooBot | 1 | 8.22 KB | 08 Jul 2011 - 03:50 |