66 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 1715174+3585 | 35.82 GB | 31 Mar 2009 - 23:55 |
Googlebot | 55198+101 | 113.87 GB | 31 Mar 2009 - 23:59 |
Yahoo Slurp | 39690+557 | 88.79 GB | 31 Mar 2009 - 23:59 |
Unknown robot (identified by empty user agent string) | 21663+370 | 2.45 GB | 31 Mar 2009 - 21:38 |
MSNBot | 19229+875 | 50.93 GB | 31 Mar 2009 - 23:59 |
WGet tools | 10362+9 | 216.58 MB | 31 Mar 2009 - 04:44 |
Ask | 7302+162 | 5.36 GB | 31 Mar 2009 - 23:59 |
Nutch | 6980+90 | 123.34 MB | 31 Mar 2009 - 13:51 |
twiceler | 5469+30 | 85.34 MB | 31 Mar 2009 - 22:52 |
MSNBot-media | 5255+151 | 211.43 MB | 31 Mar 2009 - 22:39 |
BaiDuSpider | 3227+33 | 102.26 MB | 31 Mar 2009 - 23:26 |
HTTrack off-line browser | 2946+1 | 10.24 GB | 31 Mar 2009 - 12:24 |
Unknown robot (identified by hit on 'robots.txt') | 0+1640 | 209.80 KB | 31 Mar 2009 - 23:44 |
Java (Often spam bot) | 1420+47 | 147.70 MB | 31 Mar 2009 - 21:23 |
Exabot | 1181+61 | 1001.37 MB | 31 Mar 2009 - 23:59 |
Sogou Spider | 1146 | 83.45 MB | 31 Mar 2009 - 21:07 |
Harvest | 758 | 271.58 MB | 29 Mar 2009 - 18:46 |
Voila | 625+32 | 322.72 MB | 31 Mar 2009 - 23:26 |
Voyager | 601+9 | 41.05 MB | 27 Mar 2009 - 13:25 |
Alexa (IA Archiver) | 434+90 | 13.72 MB | 31 Mar 2009 - 14:06 |
Turn It In | 446+3 | 36.22 MB | 05 Mar 2009 - 22:52 |
Unknown robot (identified by 'robot') | 272+68 | 189.91 MB | 31 Mar 2009 - 23:39 |
Custo | 191+57 | 61.46 MB | 31 Mar 2009 - 13:08 |
Unknown robot (identified by 'bot*') | 178+35 | 81.29 MB | 31 Mar 2009 - 14:58 |
MJ12bot | 152+7 | 1.50 MB | 29 Mar 2009 - 05:04 |
Unknown robot (identified by 'discovery') | 139+3 | 16.15 KB | 31 Mar 2009 - 19:59 |
Perl tool | 119+1 | 17.71 MB | 31 Mar 2009 - 02:38 |
Unknown robot (identified by 'spider') | 92+18 | 13.01 MB | 31 Mar 2009 - 09:41 |
larbin | 102+8 | 1.68 MB | 26 Mar 2009 - 19:39 |
Mail.ru bot | 104+4 | 1001.81 KB | 23 Mar 2009 - 12:59 |
Speedy Spider | 41+43 | 15.56 MB | 31 Mar 2009 - 18:12 |
CFNetwork | 55 | 380.55 MB | 31 Mar 2009 - 00:36 |
BBot | 53 | 131.36 MB | 31 Mar 2009 - 11:54 |
Jakarta commons-httpclient | 47+4 | 20.02 MB | 31 Mar 2009 - 21:34 |
Heritrix | 26+23 | 8.66 MB | 31 Mar 2009 - 17:50 |
yacy | 36+6 | 29.65 MB | 29 Mar 2009 - 23:38 |
Yanga WorldSearch Bot | 32+8 | 3.73 MB | 31 Mar 2009 - 13:40 |
The web archive (IA Archiver) | 0+31 | 3.97 KB | 31 Mar 2009 - 11:44 |
FaceBook bot | 29 | 436.13 KB | 30 Mar 2009 - 00:06 |
WebCollage | 23 | 21.83 MB | 31 Mar 2009 - 19:50 |
psbot | 13+9 | 599.80 KB | 20 Mar 2009 - 15:15 |
NG 2.x (Exalead) | 0+22 | 2.81 KB | 31 Mar 2009 - 09:39 |
MSIECrawler | 15+5 | 7.79 MB | 27 Mar 2009 - 12:59 |
Yandex bot | 7+7 | 11.28 KB | 31 Mar 2009 - 16:12 |
Gaisbot | 9+4 | 1.21 MB | 30 Mar 2009 - 04:59 |
Grub.org | 6+5 | 4.32 MB | 12 Mar 2009 - 05:39 |
Checkbot | 11 | 0 | 31 Mar 2009 - 23:08 |
WordPress | 10 | 5.04 MB | 25 Mar 2009 - 02:41 |
Unknown robot (identified by 'hunter') | 10 | 3.61 MB | 26 Mar 2009 - 01:42 |
SuperBot | 9 | 2.21 MB | 15 Mar 2009 - 23:16 |
Feedfetcher-Google | 9 | 8.94 MB | 30 Mar 2009 - 13:07 |
UCSD Crawl | 6+3 | 27.17 KB | 25 Mar 2009 - 14:27 |
Web Core / Roots | 5+1 | 9.15 MB | 26 Mar 2009 - 08:48 |
archive.org bot | 3+3 | 4.41 MB | 26 Mar 2009 - 15:38 |
GigaBot | 3+2 | 256.29 KB | 02 Mar 2009 - 10:41 |
OutfoxBot/YodaoBot | 0+4 | 524 Bytes | 30 Mar 2009 - 17:28 |
Python-urllib | 2+2 | 20.99 KB | 07 Mar 2009 - 11:49 |
Netcraft | 4 | 816.22 KB | 10 Mar 2009 - 23:50 |
Powermarks | 4 | 598.02 KB | 24 Mar 2009 - 01:24 |
T-H-U-N-D-E-R-S-T-O-N-E | 4 | 29.83 KB | 28 Mar 2009 - 08:11 |
BSpider | 0+4 | 524 Bytes | 08 Mar 2009 - 12:54 |
MojeekBot | 2+2 | 10.93 KB | 21 Mar 2009 - 20:37 |
Fish search | 3 | 25.18 KB | 18 Mar 2009 - 08:38 |
lwp-trivial | 3 | 14.53 MB | 30 Mar 2009 - 14:52 |
W3C Validator | 1 | 139 Bytes | 12 Mar 2009 - 14:05 |
lwp-request | 1 | 0 | 03 Mar 2009 - 12:29 |
Others | 0 | 0 | |