69 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 463381+719 | 31.64 GB | 31 Aug 2009 - 23:58 |
MSNBot | 79879+2918 | 105.19 GB | 31 Aug 2009 - 23:56 |
Yahoo Slurp | 31974+370 | 49.83 GB | 31 Aug 2009 - 23:57 |
Googlebot | 27189+113 | 97.93 GB | 31 Aug 2009 - 23:59 |
WGet tools | 13134+4 | 719.65 MB | 31 Aug 2009 - 17:23 |
Nutch | 7253+60 | 96.48 MB | 31 Aug 2009 - 12:52 |
Ask | 6685+127 | 15.10 GB | 31 Aug 2009 - 23:59 |
twiceler | 5109+72 | 60.80 MB | 31 Aug 2009 - 22:25 |
Sogou Spider | 3200 | 179.73 MB | 31 Aug 2009 - 22:34 |
BaiDuSpider | 2852+136 | 986.97 MB | 31 Aug 2009 - 23:04 |
Jakarta commons-httpclient | 2007 | 3.27 GB | 31 Aug 2009 - 22:04 |
Unknown robot (identified by empty user agent string) | 780+337 | 267.21 MB | 31 Aug 2009 - 23:48 |
Exabot | 790+49 | 637.72 MB | 31 Aug 2009 - 23:55 |
Unknown robot (identified by 'bot*') | 681+128 | 176.61 MB | 31 Aug 2009 - 10:52 |
Voila | 625+37 | 185.26 MB | 31 Aug 2009 - 23:35 |
Unknown robot (identified by hit on 'robots.txt') | 0+532 | 68.06 KB | 31 Aug 2009 - 20:50 |
Feedfetcher-Google | 521 | 875.98 MB | 31 Aug 2009 - 11:26 |
Alexa (IA Archiver) | 323+88 | 78.25 MB | 31 Aug 2009 - 11:20 |
Unknown robot (identified by 'robot') | 193+43 | 411.20 MB | 31 Aug 2009 - 19:40 |
Turn It In | 224+2 | 12.51 MB | 21 Aug 2009 - 18:33 |
Python-urllib | 201+19 | 276.10 MB | 31 Aug 2009 - 13:39 |
Unknown robot (identified by 'spider') | 135+79 | 18.67 MB | 31 Aug 2009 - 19:40 |
Harvest | 202 | 66.01 MB | 29 Aug 2009 - 18:10 |
Custo | 112+60 | 92.88 MB | 30 Aug 2009 - 12:57 |
Perl tool | 123+1 | 20.74 MB | 30 Aug 2009 - 11:02 |
Java (Often spam bot) | 80+42 | 76.30 MB | 31 Aug 2009 - 14:47 |
WordPress | 115 | 72.49 MB | 30 Aug 2009 - 22:15 |
Speedy Spider | 53+40 | 14.57 MB | 25 Aug 2009 - 14:36 |
Unknown robot (identified by 'discovery') | 86 | 0 | 31 Aug 2009 - 23:49 |
Ocelli | 79+4 | 12.56 MB | 20 Aug 2009 - 19:39 |
GigaBot | 45+35 | 5.30 MB | 30 Aug 2009 - 08:14 |
CFNetwork | 77 | 429.40 MB | 31 Aug 2009 - 15:04 |
The web archive (IA Archiver) | 0+66 | 8.44 KB | 30 Aug 2009 - 20:56 |
Yandex bot | 35+30 | 10.65 MB | 31 Aug 2009 - 11:05 |
larbin | 32+16 | 214.83 KB | 31 Aug 2009 - 19:30 |
BBot | 41 | 117.23 MB | 31 Aug 2009 - 11:17 |
Unknown robot (identified by 'hunter') | 28 | 6.44 MB | 31 Aug 2009 - 05:45 |
Google AdSense | 28 | 728.39 KB | 30 Aug 2009 - 18:55 |
MJ12bot | 22+4 | 251.48 KB | 31 Aug 2009 - 22:20 |
NG 2.x (Exalead) | 0+24 | 3.07 KB | 31 Aug 2009 - 15:28 |
Yahoo-MMCrawler | 17+6 | 332.34 KB | 31 Aug 2009 - 16:08 |
MSIECrawler | 14+8 | 1.64 MB | 31 Aug 2009 - 11:09 |
LinkChecker | 12+6 | 7.99 MB | 14 Aug 2009 - 08:41 |
Heritrix | 6+10 | 13.93 KB | 31 Aug 2009 - 13:05 |
FaceBook bot | 14 | 1.34 MB | 25 Aug 2009 - 22:01 |
yacy | 8+4 | 4.04 MB | 29 Aug 2009 - 22:12 |
Gaisbot | 6+6 | 1.09 MB | 22 Aug 2009 - 06:01 |
psbot | 7+4 | 18.79 KB | 27 Aug 2009 - 05:20 |
Mail.ru bot | 5+5 | 1.32 KB | 17 Aug 2009 - 20:33 |
Checkbot | 10 | 0 | 31 Aug 2009 - 23:18 |
Voyager | 0+10 | 1.28 KB | 18 Aug 2009 - 15:16 |
OutfoxBot/YodaoBot | 3+4 | 524 Bytes | 31 Aug 2009 - 02:43 |
Spiderman | 6 | 1.40 MB | 09 Aug 2009 - 21:17 |
Fish search | 6 | 77.80 KB | 22 Aug 2009 - 05:02 |
Web Core / Roots | 4+1 | 82.03 KB | 30 Aug 2009 - 01:12 |
WebCollage | 4 | 2.67 MB | 10 Aug 2009 - 06:09 |
Motor | 4 | 28.31 KB | 15 Aug 2009 - 16:09 |
Findlinks | 1+3 | 532 Bytes | 31 Aug 2009 - 22:03 |
HTTrack off-line browser | 3+1 | 6.42 MB | 22 Aug 2009 - 10:12 |
QihooBot | 4 | 608.37 KB | 14 Aug 2009 - 19:18 |
Netcraft | 4 | 812.22 KB | 06 Aug 2009 - 09:44 |
BSpider | 1+3 | 10.24 KB | 11 Aug 2009 - 00:07 |
legs | 1+2 | 537.56 KB | 21 Aug 2009 - 15:03 |
FavOrg | 2 | 2.99 KB | 19 Aug 2009 - 11:16 |
DoCoMo | 2 | 35.10 KB | 29 Aug 2009 - 23:51 |
W3C Validator | 2 | 19.46 KB | 15 Aug 2009 - 21:55 |
mnoGoSearch search engine software | 1+1 | 2.41 MB | 29 Aug 2009 - 10:59 |
Susie | 1 | 5.41 KB | 19 Aug 2009 - 03:10 |
Powermarks | 1 | 0 | 28 Aug 2009 - 05:06 |