74 different robots | Hits | Bandwidth | Last visit |
Googlebot | 38296+82 | 29.00 GB | 31 Aug 2008 - 23:59 |
Yahoo Slurp | 58564+477 | 80.08 GB | 31 Aug 2008 - 23:59 |
MSNBot | 35086+1221 | 4.64 GB | 31 Aug 2008 - 23:58 |
Unknown robot (identified by hit on 'robots.txt') | 0+1946 | 243.45 KB | 31 Aug 2008 - 23:52 |
Java (Often spam bot) | 52+37 | 61.65 MB | 31 Aug 2008 - 23:47 |
Unknown robot (identified by 'robot') | 460+98 | 119.13 MB | 31 Aug 2008 - 23:44 |
Ask | 682+82 | 291.04 MB | 31 Aug 2008 - 23:43 |
Sogou Spider | 2803+2 | 104.19 MB | 31 Aug 2008 - 23:36 |
Unknown robot (identified by empty user agent string) | 2517+333 | 435.70 MB | 31 Aug 2008 - 22:34 |
Gaisbot | 3436+7 | 36.04 MB | 31 Aug 2008 - 22:33 |
Alexa (IA Archiver) | 376+45 | 132.33 MB | 31 Aug 2008 - 21:59 |
Nutch | 1772+71 | 168.63 MB | 31 Aug 2008 - 21:52 |
WGet tools | 88+1 | 53.01 MB | 31 Aug 2008 - 21:39 |
Python-urllib | 8 | 6.97 MB | 31 Aug 2008 - 20:41 |
Robozilla | 1 | 139 Bytes | 31 Aug 2008 - 20:06 |
BaiDuSpider | 6105+19 | 560.41 MB | 31 Aug 2008 - 19:23 |
The web archive (IA Archiver) | 0+40 | 5.12 KB | 31 Aug 2008 - 17:39 |
MSNBot-media | 8972+276 | 2.63 GB | 31 Aug 2008 - 16:43 |
Jakarta commons-httpclient | 11+9 | 9.27 MB | 31 Aug 2008 - 16:28 |
Speedy Spider | 367+79 | 2.60 GB | 31 Aug 2008 - 15:59 |
psbot | 39+13 | 590.37 MB | 31 Aug 2008 - 13:56 |
Harvest | 292 | 89.58 MB | 31 Aug 2008 - 13:27 |
lwp-request | 1 | 0 | 31 Aug 2008 - 11:48 |
Unknown robot (identified by 'crawl') | 59774+1160 | 80.73 GB | 31 Aug 2008 - 11:35 |
Voila | 342+53 | 199.51 MB | 31 Aug 2008 - 08:10 |
Unknown robot (identified by 'discovery') | 1265+1 | 20.15 MB | 31 Aug 2008 - 06:59 |
CFNetwork | 69 | 528.36 MB | 31 Aug 2008 - 06:54 |
Perl tool | 180+2 | 37.02 MB | 31 Aug 2008 - 05:42 |
OutfoxBot/YodaoBot | 135+37 | 4.12 MB | 31 Aug 2008 - 05:01 |
twiceler | 312+33 | 89.57 MB | 31 Aug 2008 - 03:23 |
EasyDL | 26 | 824.88 KB | 30 Aug 2008 - 22:51 |
Unknown robot (identified by 'bot*') | 597+112 | 138.51 MB | 30 Aug 2008 - 22:24 |
BBot | 47 | 133.68 MB | 30 Aug 2008 - 20:43 |
yacy | 13 | 729.77 KB | 30 Aug 2008 - 07:24 |
arks | 2+1 | 131 Bytes | 30 Aug 2008 - 07:12 |
BSpider | 5+10 | 1.22 MB | 30 Aug 2008 - 06:31 |
WordPress | 39 | 326.22 MB | 29 Aug 2008 - 21:47 |
boitho.com-dc | 6+5 | 1.23 MB | 29 Aug 2008 - 21:24 |
Exabot | 46+2 | 2.75 MB | 29 Aug 2008 - 18:22 |
MSIECrawler | 3+8 | 34.69 KB | 29 Aug 2008 - 17:25 |
GigaBot | 3502+159 | 1.91 GB | 29 Aug 2008 - 16:26 |
The World Wide Web Worm | 7 | 0 | 29 Aug 2008 - 14:45 |
Motor | 2 | 18.76 KB | 29 Aug 2008 - 13:55 |
HTMLParser | 17 | 759.00 KB | 29 Aug 2008 - 13:45 |
Unknown robot (identified by 'spider') | 131+7 | 10.59 MB | 29 Aug 2008 - 11:26 |
Checkbot | 9 | 0 | 29 Aug 2008 - 04:23 |
Turn It In | 761+10 | 1.42 GB | 29 Aug 2008 - 01:47 |
Web Core / Roots | 3+1 | 608.21 KB | 28 Aug 2008 - 19:38 |
Powermarks | 1 | 55.09 KB | 28 Aug 2008 - 17:13 |
larbin | 6+5 | 44.47 KB | 28 Aug 2008 - 10:54 |
HTTrack off-line browser | 6+2 | 5.07 MB | 28 Aug 2008 - 08:29 |
Yandex bot | 6 | 17.24 KB | 27 Aug 2008 - 18:32 |
Combine System | 5+2 | 2.22 MB | 27 Aug 2008 - 14:33 |
BecomeBot | 1216+7 | 16.16 MB | 27 Aug 2008 - 08:36 |
ichiro | 2777+1 | 487.67 MB | 27 Aug 2008 - 05:13 |
Custo | 32 | 159.90 MB | 27 Aug 2008 - 02:58 |
UCSD Crawl | 13+7 | 24.43 MB | 26 Aug 2008 - 18:54 |
Dumbot | 44+1 | 676.34 KB | 25 Aug 2008 - 11:12 |
FaceBook bot | 1 | 2.58 MB | 24 Aug 2008 - 23:00 |
DoCoMo | 1889+1 | 22.56 MB | 24 Aug 2008 - 21:40 |
NG 2.x (Exalead) | 0+6 | 786 Bytes | 24 Aug 2008 - 06:38 |
Heritrix | 2+2 | 2.04 MB | 22 Aug 2008 - 13:08 |
Ocelli | 62+2 | 6.40 MB | 22 Aug 2008 - 05:55 |
archive.org bot | 1+1 | 705.44 KB | 21 Aug 2008 - 19:33 |
Biglotron | 2+2 | 13.48 KB | 21 Aug 2008 - 18:45 |
MJ12bot | 700+16 | 498.95 MB | 21 Aug 2008 - 04:36 |
Pioneer | 2 | 19.04 KB | 19 Aug 2008 - 17:45 |
Hylanda | 10 | 115.01 KB | 16 Aug 2008 - 20:18 |
Unknown robot (identified by 'hunter') | 2 | 19.80 KB | 12 Aug 2008 - 05:08 |
Fish search | 2 | 22.72 KB | 10 Aug 2008 - 17:41 |
Unknown robot (identified by '*bot') | 4+1 | 30.55 KB | 10 Aug 2008 - 09:16 |
Internet Shinchakubin | 3 | 35.59 KB | 07 Aug 2008 - 10:12 |
NutchCVS | 1+1 | 270 Bytes | 06 Aug 2008 - 18:47 |
Holmes | 5+3 | 46.28 KB | 05 Aug 2008 - 05:17 |