75 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 72599+979 | 170.44 GB | 31 Dec 2008 - 23:59 |
Yahoo Slurp | 53538+997 | 55.28 GB | 31 Dec 2008 - 23:59 |
Googlebot | 52851+106 | 107.67 GB | 31 Dec 2008 - 23:57 |
WGet tools | 17186+2 | 208.49 MB | 31 Dec 2008 - 15:36 |
MSNBot | 13061+806 | 12.37 GB | 31 Dec 2008 - 23:56 |
Perl tool | 7847+1 | 51.92 GB | 30 Dec 2008 - 23:24 |
Nutch | 6671+126 | 1.43 GB | 31 Dec 2008 - 19:25 |
HTTrack off-line browser | 4970+3 | 15.28 GB | 31 Dec 2008 - 22:16 |
Ask | 3726+140 | 4.93 GB | 31 Dec 2008 - 22:51 |
MSNBot-media | 3460+206 | 1.48 GB | 31 Dec 2008 - 20:12 |
Unknown robot (identified by 'discovery') | 2447+2 | 30.64 MB | 31 Dec 2008 - 05:01 |
BaiDuSpider | 2139+21 | 92.87 MB | 31 Dec 2008 - 18:45 |
Unknown robot (identified by empty user agent string) | 868+423 | 689.68 MB | 31 Dec 2008 - 23:16 |
Exabot | 925+57 | 613.02 MB | 31 Dec 2008 - 23:39 |
Unknown robot (identified by 'robot') | 497+362 | 161.11 MB | 31 Dec 2008 - 21:34 |
Voila | 693+76 | 348.56 MB | 31 Dec 2008 - 21:58 |
Sogou Spider | 678 | 10.87 MB | 31 Dec 2008 - 23:03 |
Turn It In | 657+3 | 1.11 GB | 05 Dec 2008 - 09:13 |
GigaBot | 560+79 | 235.00 MB | 31 Dec 2008 - 18:26 |
Java (Often spam bot) | 574+36 | 149.16 MB | 31 Dec 2008 - 19:46 |
Unknown robot (identified by hit on 'robots.txt') | 0+600 | 38.76 KB | 31 Dec 2008 - 23:17 |
Alexa (IA Archiver) | 526+28 | 30.19 MB | 31 Dec 2008 - 17:07 |
Harvest | 547 | 197.00 MB | 28 Dec 2008 - 14:36 |
INFOMINE VLCrawler | 538 | 4.56 MB | 30 Dec 2008 - 15:18 |
BSpider | 483+8 | 60.95 MB | 31 Dec 2008 - 20:38 |
Voyager | 455+3 | 5.71 MB | 23 Dec 2008 - 15:00 |
Unknown robot (identified by 'bot*') | 183+70 | 135.50 MB | 31 Dec 2008 - 08:50 |
twiceler | 199+37 | 4.89 MB | 31 Dec 2008 - 13:21 |
Unknown robot (identified by 'spider') | 103+83 | 25.03 MB | 31 Dec 2008 - 01:44 |
The web archive (IA Archiver) | 0+138 | 17.65 KB | 30 Dec 2008 - 19:44 |
Ocelli | 129+3 | 12.63 MB | 21 Dec 2008 - 08:07 |
Speedy Spider | 70+49 | 39.12 MB | 29 Dec 2008 - 14:34 |
Jakarta commons-httpclient | 79+8 | 59.95 MB | 30 Dec 2008 - 18:41 |
Python-urllib | 65+2 | 225.35 MB | 26 Dec 2008 - 00:41 |
CFNetwork | 63 | 520.08 MB | 30 Dec 2008 - 02:12 |
BBot | 38 | 51.36 MB | 29 Dec 2008 - 12:12 |
NG 2.x (Exalead) | 0+37 | 4.73 KB | 31 Dec 2008 - 23:19 |
yacy | 26+1 | 13.73 MB | 28 Dec 2008 - 04:47 |
larbin | 10+10 | 74.25 KB | 23 Dec 2008 - 06:27 |
Steeler | 18+1 | 18.43 MB | 31 Dec 2008 - 15:53 |
MJ12bot | 13+4 | 138.24 KB | 23 Dec 2008 - 21:09 |
psbot | 9+7 | 602.43 KB | 11 Dec 2008 - 16:08 |
Custo | 10+4 | 28.73 MB | 30 Dec 2008 - 06:06 |
Gaisbot | 6+7 | 32.34 KB | 26 Dec 2008 - 04:58 |
UCSD Crawl | 6+6 | 48.27 MB | 31 Dec 2008 - 14:19 |
MSIECrawler | 8+3 | 2.42 MB | 25 Dec 2008 - 07:44 |
Checkbot | 8 | 0 | 26 Dec 2008 - 16:44 |
OutfoxBot/YodaoBot | 4+3 | 38.31 KB | 25 Dec 2008 - 15:25 |
Fish search | 7 | 64.07 KB | 23 Dec 2008 - 20:14 |
Grub.org | 3+3 | 33.30 KB | 23 Dec 2008 - 14:34 |
Yanga WorldSearch Bot | 3+3 | 810 Bytes | 25 Dec 2008 - 09:37 |
Yandex bot | 4+1 | 405.37 KB | 09 Dec 2008 - 20:40 |
FaceBook bot | 4 | 9.43 MB | 24 Dec 2008 - 12:25 |
Heritrix | 2+2 | 540 Bytes | 04 Dec 2008 - 00:03 |
Netcraft | 4 | 824.22 KB | 11 Dec 2008 - 11:09 |
Scooter | 4 | 26.60 KB | 31 Dec 2008 - 09:44 |
Powermarks | 3 | 1.24 MB | 14 Dec 2008 - 17:13 |
EasyDL | 3 | 245.77 KB | 20 Dec 2008 - 16:49 |
BecomeBot | 1+2 | 401 Bytes | 27 Dec 2008 - 08:54 |
Unknown robot (identified by 'hunter') | 3 | 37.17 KB | 06 Dec 2008 - 11:16 |
DoCoMo | 1+1 | 6.74 KB | 24 Dec 2008 - 18:42 |
Web Core / Roots | 1+1 | 270 Bytes | 21 Dec 2008 - 01:44 |
Cursor | 2 | 19.67 KB | 19 Dec 2008 - 19:06 |
QihooBot | 2 | 626.82 KB | 06 Dec 2008 - 09:33 |
YahooSeeker Yahoo! Blog crawler | 1+1 | 47.43 KB | 17 Dec 2008 - 01:51 |
Girafabot | 0+2 | 262 Bytes | 29 Dec 2008 - 09:09 |
arks | 0+2 | 262 Bytes | 23 Dec 2008 - 12:40 |
archive.org bot | 1+1 | 2.04 MB | 17 Dec 2008 - 01:07 |
WebCollage | 1 | 15.77 KB | 17 Dec 2008 - 05:59 |
Feedfetcher-Google | 1 | 8.94 MB | 31 Dec 2008 - 15:39 |
Pioneer | 1 | 7.95 KB | 03 Dec 2008 - 22:41 |
T-H-U-N-D-E-R-S-T-O-N-E | 1 | 7.46 KB | 05 Dec 2008 - 01:40 |
boitho.com-dc | 0+1 | 131 Bytes | 25 Dec 2008 - 10:24 |
lwp-trivial | 1 | 8.20 MB | 22 Dec 2008 - 23:38 |
Others | 0 | 0 | |