71 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 49809+920 | 17.39 GB | 31 Jan 2009 - 23:18 |
Googlebot | 45890+89 | 96.15 GB | 31 Jan 2009 - 23:59 |
Yahoo Slurp | 43350+620 | 52.75 GB | 31 Jan 2009 - 23:56 |
MSNBot | 14242+823 | 15.14 GB | 31 Jan 2009 - 23:57 |
HTTrack off-line browser | 6292+1 | 18.00 GB | 31 Jan 2009 - 16:25 |
Ask | 4215+127 | 5.39 GB | 31 Jan 2009 - 23:54 |
Nutch | 2348+104 | 222.90 MB | 31 Jan 2009 - 23:36 |
BaiDuSpider | 2181+22 | 91.25 MB | 31 Jan 2009 - 23:58 |
Unknown robot (identified by hit on 'robots.txt') | 0+1892 | 240.12 KB | 31 Jan 2009 - 22:35 |
Exabot | 1051+49 | 456.09 MB | 31 Jan 2009 - 23:23 |
Unknown robot (identified by empty user agent string) | 553+359 | 332.59 MB | 31 Jan 2009 - 22:53 |
MSNBot-media | 719+182 | 356.34 MB | 31 Jan 2009 - 22:12 |
Harvest | 748 | 267.47 MB | 31 Jan 2009 - 16:09 |
Voyager | 723+5 | 2.04 GB | 20 Jan 2009 - 20:36 |
Voila | 659+48 | 316.09 MB | 31 Jan 2009 - 13:45 |
DoCoMo | 644 | 7.63 MB | 30 Jan 2009 - 23:27 |
Unknown robot (identified by 'robot') | 401+200 | 202.78 MB | 31 Jan 2009 - 12:33 |
Java (Often spam bot) | 499+83 | 107.29 MB | 31 Jan 2009 - 22:00 |
twiceler | 529+30 | 7.58 MB | 28 Jan 2009 - 00:01 |
Sogou Spider | 552 | 38.10 MB | 31 Jan 2009 - 15:05 |
GigaBot | 297+54 | 1.11 GB | 31 Jan 2009 - 22:57 |
Unknown robot (identified by 'bot*') | 128+38 | 112.95 MB | 31 Jan 2009 - 20:18 |
Ocelli | 129+4 | 12.84 MB | 31 Jan 2009 - 07:26 |
Unknown robot (identified by 'spider') | 91+37 | 9.51 MB | 31 Jan 2009 - 13:01 |
Custo | 95+33 | 122.91 MB | 31 Jan 2009 - 13:05 |
Mail.ru bot | 111+2 | 9.44 MB | 19 Jan 2009 - 04:41 |
Speedy Spider | 54+56 | 15.83 MB | 31 Jan 2009 - 21:32 |
BSpider | 53+46 | 6.49 MB | 31 Jan 2009 - 22:27 |
yacy | 88+7 | 2.19 MB | 30 Jan 2009 - 06:16 |
Unknown robot (identified by 'discovery') | 92+2 | 16.03 KB | 31 Jan 2009 - 12:19 |
Perl tool | 46+1 | 9.13 MB | 31 Jan 2009 - 02:42 |
WGet tools | 46 | 129.41 MB | 29 Jan 2009 - 22:07 |
CFNetwork | 45 | 363.64 MB | 30 Jan 2009 - 22:39 |
Jakarta commons-httpclient | 36+5 | 19.66 MB | 29 Jan 2009 - 23:08 |
Alexa (IA Archiver) | 25+15 | 18.51 MB | 31 Jan 2009 - 20:05 |
The web archive (IA Archiver) | 0+35 | 4.48 KB | 31 Jan 2009 - 00:37 |
BBot | 30 | 52.58 MB | 31 Jan 2009 - 21:49 |
MJ12bot | 25+2 | 870.04 KB | 30 Jan 2009 - 15:47 |
NG 2.x (Exalead) | 1+21 | 5.56 MB | 30 Jan 2009 - 23:16 |
Python-urllib | 13+7 | 5.43 MB | 31 Jan 2009 - 08:45 |
Yanga WorldSearch Bot | 12+2 | 1.38 MB | 31 Jan 2009 - 01:35 |
Grub.org | 7+6 | 2.17 MB | 30 Jan 2009 - 12:17 |
UCSD Crawl | 8+5 | 36.83 KB | 28 Jan 2009 - 15:43 |
Fish search | 12 | 1.35 MB | 27 Jan 2009 - 20:52 |
MojeekBot | 9+3 | 105.06 KB | 18 Jan 2009 - 16:19 |
Checkbot | 9 | 0 | 29 Jan 2009 - 03:19 |
larbin | 4+5 | 15.79 KB | 23 Jan 2009 - 23:59 |
ichiro | 7+1 | 806.35 KB | 30 Jan 2009 - 23:29 |
Gaisbot | 3+5 | 948.89 KB | 31 Jan 2009 - 05:16 |
Powermarks | 7 | 1.15 MB | 28 Jan 2009 - 16:43 |
BecomeBot | 2+4 | 648.46 KB | 27 Jan 2009 - 11:57 |
Combine System | 3+3 | 5.57 MB | 30 Jan 2009 - 20:30 |
MSIECrawler | 2+3 | 834.46 KB | 30 Jan 2009 - 04:54 |
FaceBook bot | 4 | 54.76 KB | 06 Jan 2009 - 05:12 |
OutfoxBot/YodaoBot | 2+2 | 7.05 KB | 09 Jan 2009 - 18:38 |
QihooBot | 4 | 644.37 KB | 26 Jan 2009 - 00:39 |
Yandex bot | 3+1 | 368.38 KB | 19 Jan 2009 - 18:34 |
Netcraft | 4 | 816.22 KB | 06 Jan 2009 - 11:58 |
Web Core / Roots | 2+1 | 9.13 KB | 25 Jan 2009 - 01:42 |
Feedfetcher-Google | 3 | 26.81 MB | 28 Jan 2009 - 04:37 |
Webdup | 3 | 64.94 KB | 10 Jan 2009 - 01:02 |
Unknown robot (identified by 'hunter') | 3 | 30.74 KB | 31 Jan 2009 - 11:39 |
lwp-trivial | 3 | 26.16 MB | 16 Jan 2009 - 05:59 |
WordPress | 2 | 12.36 KB | 28 Jan 2009 - 08:14 |
T-H-U-N-D-E-R-S-T-O-N-E | 2 | 14.92 KB | 31 Jan 2009 - 11:57 |
Girafabot | 0+2 | 262 Bytes | 24 Jan 2009 - 19:22 |
WebCollage | 1 | 15.77 KB | 07 Jan 2009 - 16:49 |
Cursor | 1 | 9.82 KB | 06 Jan 2009 - 13:29 |
arks | 0+1 | 131 Bytes | 07 Jan 2009 - 18:21 |
VORTEX | 1 | 139 Bytes | 18 Jan 2009 - 00:57 |
Others | 0 | 0 | |