71 different robots | Hits | Bandwidth | Last visit |
MSNBot | 63740+2159 | 72.21 GB | 31 Jul 2009 - 23:59 |
Ask | 9413+134 | 5.34 GB | 31 Jul 2009 - 23:59 |
Unknown robot (identified by 'crawl') | 429783+871 | 17.32 GB | 31 Jul 2009 - 23:59 |
Unknown robot (identified by hit on 'robots.txt') | 0+464 | 59.36 KB | 31 Jul 2009 - 23:58 |
Yahoo Slurp | 42835+403 | 72.30 GB | 31 Jul 2009 - 23:56 |
Alexa (IA Archiver) | 333+75 | 250.70 MB | 31 Jul 2009 - 23:49 |
BaiDuSpider | 2932+69 | 450.05 MB | 31 Jul 2009 - 23:48 |
Googlebot | 40654+106 | 99.44 GB | 31 Jul 2009 - 23:31 |
Python-urllib | 138+22 | 318.82 MB | 31 Jul 2009 - 23:29 |
HTTrack off-line browser | 8 | 149.11 KB | 31 Jul 2009 - 23:27 |
Yandex bot | 28+29 | 9.36 MB | 31 Jul 2009 - 23:13 |
Unknown robot (identified by empty user agent string) | 717+310 | 701.92 MB | 31 Jul 2009 - 23:12 |
Checkbot | 11 | 0 | 31 Jul 2009 - 23:04 |
Custo | 113+51 | 25.17 MB | 31 Jul 2009 - 22:59 |
Java (Often spam bot) | 446+47 | 54.80 MB | 31 Jul 2009 - 22:45 |
twiceler | 11146+88 | 129.42 MB | 31 Jul 2009 - 22:43 |
Voila | 760+46 | 191.10 MB | 31 Jul 2009 - 22:39 |
Sogou Spider | 2850 | 171.10 MB | 31 Jul 2009 - 21:48 |
Unknown robot (identified by 'spider') | 13+72 | 3.11 MB | 31 Jul 2009 - 21:42 |
Exabot | 587+43 | 1019.04 MB | 31 Jul 2009 - 21:28 |
Unknown robot (identified by 'bot*') | 294+71 | 44.14 MB | 31 Jul 2009 - 19:30 |
Unknown robot (identified by 'robot') | 338+51 | 458.43 MB | 31 Jul 2009 - 18:50 |
GigaBot | 66+51 | 13.58 MB | 31 Jul 2009 - 17:00 |
yacy | 106+23 | 13.93 MB | 31 Jul 2009 - 16:26 |
Harvest | 458 | 142.27 MB | 31 Jul 2009 - 16:07 |
The web archive (IA Archiver) | 0+49 | 6.27 KB | 31 Jul 2009 - 15:33 |
Perl tool | 204+1 | 20.62 MB | 31 Jul 2009 - 11:58 |
Unknown robot (identified by 'discovery') | 2250+103 | 167.87 MB | 31 Jul 2009 - 11:25 |
CFNetwork | 71 | 631.43 MB | 31 Jul 2009 - 09:32 |
NG 2.x (Exalead) | 0+23 | 2.94 KB | 31 Jul 2009 - 08:48 |
larbin | 39+25 | 342.94 KB | 31 Jul 2009 - 08:45 |
WordPress | 87 | 26.84 MB | 31 Jul 2009 - 07:35 |
Nutch | 2242+37 | 32.58 MB | 31 Jul 2009 - 03:56 |
Speedy Spider | 52+42 | 19.76 MB | 30 Jul 2009 - 22:13 |
Yahoo-MMCrawler | 3+3 | 32.22 KB | 30 Jul 2009 - 15:13 |
Feedfetcher-Google | 17 | 151.93 MB | 30 Jul 2009 - 14:44 |
MSIECrawler | 14+9 | 7.44 MB | 30 Jul 2009 - 11:35 |
Google AdSense | 28+1 | 782.81 KB | 30 Jul 2009 - 03:21 |
WGet tools | 34+4 | 163.76 MB | 30 Jul 2009 - 01:22 |
Heritrix | 29+3 | 2.42 MB | 30 Jul 2009 - 00:55 |
Jakarta commons-httpclient | 1028 | 448.75 MB | 29 Jul 2009 - 18:43 |
psbot | 3923+80 | 38.05 MB | 29 Jul 2009 - 17:16 |
W3C Validator | 2 | 19.46 KB | 29 Jul 2009 - 16:19 |
FaceBook bot | 24 | 3.83 MB | 29 Jul 2009 - 12:45 |
BBot | 44 | 89.45 MB | 28 Jul 2009 - 03:41 |
Fish search | 4 | 2.68 MB | 28 Jul 2009 - 01:45 |
WebCollage | 2 | 1.33 MB | 27 Jul 2009 - 19:39 |
Gaisbot | 4+5 | 3.23 MB | 27 Jul 2009 - 08:30 |
Spiderman | 4+1 | 981.28 KB | 27 Jul 2009 - 07:37 |
Web Core / Roots | 3+2 | 13.85 KB | 26 Jul 2009 - 01:21 |
BSpider | 14+4 | 64.54 MB | 26 Jul 2009 - 00:29 |
HTMLParser | 1 | 8.17 KB | 25 Jul 2009 - 03:19 |
lwp-trivial | 8 | 2.76 MB | 23 Jul 2009 - 01:26 |
MJ12bot | 82+6 | 1011.64 KB | 22 Jul 2009 - 18:59 |
ichiro | 3+4 | 6.20 KB | 22 Jul 2009 - 15:47 |
legs | 53+9 | 18.83 MB | 22 Jul 2009 - 12:12 |
Ocelli | 130+4 | 14.93 MB | 21 Jul 2009 - 20:10 |
The World Wide Web Worm | 1 | 15.77 KB | 18 Jul 2009 - 05:29 |
MSNBot-media | 140+56 | 127.44 MB | 18 Jul 2009 - 03:02 |
Mail.ru bot | 1+1 | 270 Bytes | 16 Jul 2009 - 11:22 |
Turn It In | 436+4 | 10.25 MB | 15 Jul 2009 - 17:20 |
OutfoxBot/YodaoBot | 6+2 | 262 Bytes | 14 Jul 2009 - 09:35 |
Powermarks | 5 | 2.14 MB | 13 Jul 2009 - 00:17 |
Netcraft | 4 | 784.22 KB | 10 Jul 2009 - 19:22 |
SuperBot | 1 | 139 Bytes | 09 Jul 2009 - 02:22 |
MagpieRSS | 2 | 20.00 KB | 07 Jul 2009 - 03:48 |
Sunrise | 22 | 127.71 KB | 07 Jul 2009 - 02:10 |
QihooBot | 2 | 597.39 KB | 05 Jul 2009 - 20:18 |
Y!J Yahoo Japan | 2 | 250.23 KB | 03 Jul 2009 - 04:14 |
GoForIt.com | 1+1 | 270 Bytes | 01 Jul 2009 - 20:28 |
FavOrg | 1 | 1.49 KB | 01 Jul 2009 - 09:51 |