61 different robots | Hits | Bandwidth | Last visit |
Googlebot | 90654+97 | 66.98 GB | 31 Aug 2011 - 23:59 |
Yahoo Slurp | 39213+213 | 9.87 GB | 31 Aug 2011 - 23:58 |
Unknown robot (identified by 'bot*') | 33330+1056 | 14.30 GB | 31 Aug 2011 - 23:57 |
Unknown robot (identified by 'crawl') | 16254+650 | 6.18 GB | 31 Aug 2011 - 23:33 |
Unknown robot (identified by 'robot') | 12794+45 | 964.37 MB | 31 Aug 2011 - 21:05 |
MSNBot-media | 5286+1977 | 125.43 MB | 31 Aug 2011 - 23:47 |
Yandex bot | 6614+51 | 6.33 GB | 31 Aug 2011 - 23:58 |
Feedfetcher-Google | 3218 | 22.70 MB | 31 Aug 2011 - 23:58 |
BaiDuSpider | 2676+42 | 961.78 MB | 31 Aug 2011 - 23:28 |
Unknown robot (identified by empty user agent string) | 2621+76 | 2.26 GB | 31 Aug 2011 - 23:55 |
Sogou Spider | 2089+9 | 840.44 MB | 31 Aug 2011 - 23:47 |
DoCoMo | 1486+11 | 180.32 MB | 30 Aug 2011 - 14:48 |
Unknown robot (identified by 'spider') | 1212+178 | 520.82 MB | 31 Aug 2011 - 22:51 |
Heritrix | 1286+3 | 14.62 MB | 29 Aug 2011 - 17:50 |
Exabot | 838+53 | 105.85 MB | 31 Aug 2011 - 22:07 |
Unknown robot (identified by hit on 'robots.txt') | 0+744 | 22.52 KB | 31 Aug 2011 - 23:49 |
Nutch | 498+155 | 41.98 MB | 31 Aug 2011 - 13:04 |
MJ12bot | 442+200 | 31.76 MB | 31 Aug 2011 - 21:20 |
Speedy Spider | 363+142 | 63.95 MB | 31 Aug 2011 - 05:32 |
Unknown robot (identified by '*bot') | 218+137 | 112.33 MB | 31 Aug 2011 - 21:42 |
Java (Often spam bot) | 348+7 | 190.76 MB | 31 Aug 2011 - 14:31 |
psbot | 306+24 | 5.68 MB | 23 Aug 2011 - 18:23 |
Unknown robot (identified by 'discovery') | 194+121 | 124.79 MB | 31 Aug 2011 - 18:42 |
legs | 141+102 | 21.97 MB | 31 Aug 2011 - 21:22 |
bender focused_crawler | 193+5 | 411.82 MB | 31 Aug 2011 - 21:09 |
WordPress | 188 | 256.33 MB | 31 Aug 2011 - 22:38 |
CFNetwork | 134 | 248.77 MB | 31 Aug 2011 - 21:45 |
FaceBook bot | 129 | 1.90 MB | 31 Aug 2011 - 23:58 |
OutfoxBot/YodaoBot | 96 | 680.48 KB | 31 Aug 2011 - 23:25 |
Harvest | 89 | 22.14 MB | 28 Aug 2011 - 01:29 |
Alexa (IA Archiver) | 52+23 | 30.12 MB | 31 Aug 2011 - 13:12 |
Findlinks | 26+29 | 423.48 KB | 31 Aug 2011 - 17:32 |
Jakarta commons-httpclient | 47 | 21.01 MB | 31 Aug 2011 - 14:29 |
archive.org bot | 34+5 | 31.55 MB | 26 Aug 2011 - 02:08 |
WGet tools | 35+1 | 139.36 MB | 31 Aug 2011 - 08:47 |
Motor | 31 | 7.35 MB | 29 Aug 2011 - 15:23 |
yacy | 23+6 | 22.03 MB | 27 Aug 2011 - 15:54 |
Perl tool | 20 | 217.75 KB | 31 Aug 2011 - 19:03 |
VORTEX | 15 | 644.24 KB | 23 Aug 2011 - 22:02 |
BBot | 13 | 4.61 MB | 28 Aug 2011 - 19:21 |
larbin | 7+4 | 96.37 KB | 27 Aug 2011 - 05:23 |
UCSD Crawl | 10 | 327.93 KB | 23 Aug 2011 - 13:48 |
Python-urllib | 9 | 14.16 MB | 31 Aug 2011 - 08:44 |
Checkbot | 6 | 0 | 31 Aug 2011 - 12:28 |
GigaBot | 0+6 | 186 Bytes | 28 Aug 2011 - 18:46 |
Powermarks | 5 | 127.60 KB | 10 Aug 2011 - 08:37 |
Custo | 2+2 | 14.25 KB | 11 Aug 2011 - 08:29 |
BSpider | 1+3 | 137.25 KB | 22 Aug 2011 - 11:45 |
MSIECrawler | 4 | 69.75 KB | 30 Aug 2011 - 03:09 |
Netcraft | 4 | 28.29 KB | 25 Aug 2011 - 00:48 |
Unknown robot (identified by 'hunter') | 3 | 10.90 MB | 24 Aug 2011 - 15:54 |
W3C Link Checker | 2+1 | 31 Bytes | 30 Aug 2011 - 09:35 |
FavIconizer | 3 | 21.22 KB | 23 Aug 2011 - 15:01 |
VSE | 1+1 | 6.65 MB | 05 Aug 2011 - 18:31 |
Web Core / Roots | 2 | 0 | 31 Aug 2011 - 21:44 |
Unknown robot (identified by 'checker') | 2 | 0 | 31 Aug 2011 - 13:34 |
Fish search | 2 | 39.07 KB | 28 Aug 2011 - 20:08 |
Digger | 1 | 43.38 KB | 15 Aug 2011 - 10:31 |
BlogSearch | 1 | 7.07 KB | 22 Aug 2011 - 10:47 |
HTTrack off-line browser | 0+1 | 31 Bytes | 28 Aug 2011 - 11:37 |
Ask | 1 | 29.99 KB | 21 Aug 2011 - 05:00 |