69 different robots | Hits | Bandwidth | Last visit |
Googlebot | 80358+111 | 53.89 GB | 30 Nov 2010 - 23:58 |
Unknown robot (identified by 'bot*') | 37344+2585 | 6.30 GB | 30 Nov 2010 - 23:59 |
Yahoo Slurp | 28108+270 | 9.27 GB | 30 Nov 2010 - 23:58 |
Unknown robot (identified by 'crawl') | 21924+493 | 2.63 GB | 30 Nov 2010 - 22:37 |
MSNBot-media | 3883+1332 | 485.03 MB | 30 Nov 2010 - 23:53 |
Heritrix | 4359+11 | 765.61 MB | 25 Nov 2010 - 15:51 |
Yandex bot | 3429+50 | 2.92 GB | 30 Nov 2010 - 21:42 |
Unknown robot (identified by 'spider') | 2486+67 | 72.19 MB | 30 Nov 2010 - 22:21 |
Feedfetcher-Google | 2072 | 14.34 MB | 30 Nov 2010 - 23:37 |
BaiDuSpider | 1825+194 | 2.54 GB | 30 Nov 2010 - 22:21 |
Sogou Spider | 1711+3 | 105.79 MB | 30 Nov 2010 - 23:10 |
Unknown robot (identified by empty user agent string) | 1477+59 | 1.74 GB | 30 Nov 2010 - 23:36 |
Exabot | 1414+90 | 31.65 MB | 30 Nov 2010 - 23:22 |
Ask | 1446+57 | 3.77 GB | 30 Nov 2010 - 23:24 |
DoCoMo | 976+73 | 49.41 MB | 30 Nov 2010 - 18:06 |
MJ12bot | 792+112 | 27.43 MB | 30 Nov 2010 - 19:55 |
Unknown robot (identified by hit on 'robots.txt') | 0+604 | 18.29 KB | 30 Nov 2010 - 22:58 |
Bloglines | 306 | 2.17 MB | 30 Nov 2010 - 21:30 |
MSNBot | 150+84 | 4.35 MB | 26 Nov 2010 - 08:17 |
Unknown robot (identified by 'discovery') | 99+110 | 24.11 MB | 30 Nov 2010 - 21:43 |
Alexa (IA Archiver) | 158+43 | 28.97 MB | 28 Nov 2010 - 00:19 |
Unknown robot (identified by 'robot') | 131+34 | 91.64 MB | 29 Nov 2010 - 08:53 |
CFNetwork | 156 | 2.00 GB | 30 Nov 2010 - 18:53 |
Motor | 120 | 4.45 MB | 30 Nov 2010 - 06:38 |
Jakarta commons-httpclient | 116 | 94.06 MB | 30 Nov 2010 - 20:03 |
Java (Often spam bot) | 106+10 | 40.74 MB | 30 Nov 2010 - 19:23 |
Speedy Spider | 27+56 | 17.79 MB | 30 Nov 2010 - 18:59 |
FaceBook bot | 81 | 1.62 MB | 30 Nov 2010 - 16:22 |
Nutch | 31+38 | 415.23 KB | 30 Nov 2010 - 20:47 |
Fish search | 50 | 10.11 MB | 30 Nov 2010 - 23:09 |
GigaBot | 11+31 | 147.21 KB | 30 Nov 2010 - 23:47 |
Harvest | 33 | 5.81 MB | 26 Nov 2010 - 16:10 |
WordPress | 32 | 30.97 MB | 28 Nov 2010 - 08:17 |
The web archive (IA Archiver) | 2+30 | 54.04 KB | 29 Nov 2010 - 22:59 |
Perl tool | 31 | 3.76 MB | 29 Nov 2010 - 17:54 |
EasyDL | 26 | 773.28 KB | 28 Nov 2010 - 19:31 |
Custo | 22+1 | 5.85 MB | 26 Nov 2010 - 13:48 |
Python-urllib | 23 | 28.71 MB | 25 Nov 2010 - 18:51 |
WGet tools | 21 | 214.53 MB | 30 Nov 2010 - 22:56 |
Web Core / Roots | 20 | 809.16 KB | 30 Nov 2010 - 16:36 |
yacy | 12+2 | 13.96 MB | 30 Nov 2010 - 08:19 |
NG 2.x (Exalead) | 0+14 | 434 Bytes | 30 Nov 2010 - 10:02 |
larbin | 7+4 | 97.96 KB | 30 Nov 2010 - 16:16 |
Spiderman | 6+3 | 295.16 KB | 15 Nov 2010 - 11:18 |
Google AdSense | 9 | 237.05 KB | 27 Nov 2010 - 10:00 |
Findlinks | 2+5 | 46.46 KB | 28 Nov 2010 - 20:00 |
WebCollage | 6 | 4.84 MB | 22 Nov 2010 - 04:00 |
Powermarks | 5 | 82.11 KB | 27 Nov 2010 - 05:45 |
Mail.ru bot | 0+4 | 124 Bytes | 25 Nov 2010 - 08:29 |
OutfoxBot/YodaoBot | 2+2 | 266.61 KB | 15 Nov 2010 - 07:07 |
Feedburner | 4 | 0 | 05 Nov 2010 - 09:01 |
Netcraft | 4 | 28.28 KB | 03 Nov 2010 - 22:10 |
Unknown robot (identified by '*bot') | 2+2 | 14.20 KB | 17 Nov 2010 - 20:02 |
Gaisbot | 1+2 | 7.13 KB | 29 Nov 2010 - 17:40 |
Netluchs | 1+1 | 7.10 KB | 19 Nov 2010 - 20:41 |
Allrati | 2 | 14.14 KB | 29 Nov 2010 - 02:35 |
BBot | 2 | 39.23 KB | 03 Nov 2010 - 17:37 |
QihooBot | 2 | 15.29 KB | 14 Nov 2010 - 00:52 |
Unknown robot (identified by 'sucker') | 1+1 | 23.80 KB | 30 Nov 2010 - 02:40 |
Unknown robot (identified by 'scanner') | 1+1 | 7.10 KB | 08 Nov 2010 - 11:15 |
arks | 2 | 5.48 MB | 10 Nov 2010 - 00:50 |
HTTrack off-line browser | 0+1 | 31 Bytes | 29 Nov 2010 - 13:44 |
FavIconizer | 1 | 7.07 KB | 06 Nov 2010 - 01:18 |
Snooper | 1 | 41.89 MB | 26 Nov 2010 - 03:36 |
Checkbot | 1 | 0 | 20 Nov 2010 - 03:37 |
UCSD Crawl | 1 | 3.99 MB | 20 Nov 2010 - 12:38 |
Unknown robot (identified by 'hunter') | 1 | 17.01 KB | 18 Nov 2010 - 10:54 |
Y!J Yahoo Japan | 0+1 | 31 Bytes | 17 Nov 2010 - 02:35 |
lwp-trivial | 1 | 18.68 KB | 02 Nov 2010 - 22:19 |