42 different robots | Hits | Bandwidth | Last visit |
Googlebot | 43744+32 | 36.81 GB | 30 Nov 2009 - 23:59 |
MSNBot | 5604+405 | 3.36 GB | 30 Nov 2009 - 23:59 |
Yahoo Slurp | 35668+97 | 3.68 GB | 30 Nov 2009 - 23:58 |
Unknown robot (identified by empty user agent string) | 857+53 | 78.69 MB | 30 Nov 2009 - 23:35 |
Exabot | 2232+36 | 360.12 MB | 30 Nov 2009 - 23:30 |
Ask | 1603+114 | 973.80 MB | 30 Nov 2009 - 23:30 |
Sogou Spider | 4482 | 85.41 MB | 30 Nov 2009 - 23:20 |
Unknown robot (identified by hit on 'robots.txt') | 0+392 | 11.87 KB | 30 Nov 2009 - 22:32 |
Unknown robot (identified by 'bot*') | 23633+131 | 880.99 MB | 30 Nov 2009 - 22:29 |
Yandex bot | 13+10 | 248.57 KB | 30 Nov 2009 - 21:15 |
BaiDuSpider | 432+50 | 30.80 MB | 30 Nov 2009 - 20:34 |
Unknown robot (identified by 'robot') | 154+31 | 2.76 MB | 30 Nov 2009 - 17:50 |
Jakarta commons-httpclient | 37 | 93.06 MB | 30 Nov 2009 - 17:29 |
Python-urllib | 31+6 | 21.53 MB | 30 Nov 2009 - 17:16 |
Unknown robot (identified by 'spider') | 685+45 | 12.59 MB | 30 Nov 2009 - 16:13 |
Alexa (IA Archiver) | 116+60 | 10.61 MB | 30 Nov 2009 - 16:00 |
Java (Often spam bot) | 68 | 2.38 MB | 30 Nov 2009 - 13:05 |
larbin | 3+3 | 20.70 KB | 30 Nov 2009 - 11:28 |
twiceler | 6165+27 | 132.72 MB | 30 Nov 2009 - 10:37 |
Mail.ru bot | 14+14 | 96.58 KB | 30 Nov 2009 - 07:05 |
Unknown robot (identified by 'crawl') | 411017+300 | 5.60 GB | 30 Nov 2009 - 06:31 |
CFNetwork | 48 | 375.21 MB | 29 Nov 2009 - 09:25 |
WGet tools | 18 | 36.06 MB | 28 Nov 2009 - 20:40 |
Findlinks | 1 | 6.87 KB | 28 Nov 2009 - 17:24 |
OutfoxBot/YodaoBot | 1+1 | 258.88 KB | 28 Nov 2009 - 08:24 |
FaceBook bot | 9 | 240.91 KB | 26 Nov 2009 - 21:35 |
legs | 1+1 | 6.90 KB | 26 Nov 2009 - 12:38 |
Heritrix | 4779+13 | 184.61 MB | 26 Nov 2009 - 06:33 |
Unknown robot (identified by 'discovery') | 7 | 20.60 KB | 23 Nov 2009 - 23:10 |
Perl tool | 5 | 89.41 KB | 23 Nov 2009 - 09:32 |
Powermarks | 1 | 28.59 KB | 22 Nov 2009 - 22:37 |
The web archive (IA Archiver) | 0+3 | 93 Bytes | 19 Nov 2009 - 19:53 |
Nutch | 4+3 | 8.88 MB | 19 Nov 2009 - 18:30 |
MJ12bot | 9+2 | 148.30 KB | 18 Nov 2009 - 08:37 |
Cursor | 11 | 359.49 KB | 18 Nov 2009 - 04:02 |
WordPress | 14 | 310.25 KB | 17 Nov 2009 - 15:20 |
Custo | 76 | 43.56 MB | 17 Nov 2009 - 00:51 |
yacy | 5+2 | 67.31 KB | 16 Nov 2009 - 17:17 |
HTMLParser | 4 | 27.47 KB | 13 Nov 2009 - 14:57 |
Web Core / Roots | 12 | 32.72 MB | 09 Nov 2009 - 16:23 |
Fish search | 1 | 18.26 KB | 02 Nov 2009 - 04:06 |
Speedy Spider | 2+2 | 13.80 KB | 02 Nov 2009 - 02:01 |