79 different robots | Hits | Bandwidth | Last visit |
Googlebot | 43921+87 | 38.99 GB | 31 Jan 2008 - 23:56 |
Yahoo Slurp | 34565+408 | 28.26 GB | 31 Jan 2008 - 23:59 |
Unknown robot (identified by 'crawl') | 33546+852 | 17.92 GB | 31 Jan 2008 - 23:56 |
MSNBot | 21530+1149 | 30.98 GB | 31 Jan 2008 - 23:59 |
MSNBot-media | 6676+118 | 1.78 GB | 31 Jan 2008 - 12:45 |
Nutch | 5131+124 | 3.62 GB | 31 Jan 2008 - 23:56 |
Ocelli | 4869+3 | 2.52 GB | 30 Jan 2008 - 07:45 |
psbot | 4013+113 | 41.25 MB | 31 Jan 2008 - 23:04 |
Ask | 2369+179 | 84.82 MB | 31 Jan 2008 - 23:54 |
BaiDuSpider | 2376+54 | 183.90 MB | 31 Jan 2008 - 17:38 |
twiceler | 2135+76 | 23.38 MB | 28 Jan 2008 - 18:10 |
WGet tools | 2158+1 | 9.31 GB | 31 Jan 2008 - 20:03 |
Unknown robot (identified by hit on 'robots.txt') | 0+1291 | 165.16 KB | 31 Jan 2008 - 19:17 |
Unknown robot (identified by empty user agent string) | 722+319 | 218.15 MB | 31 Jan 2008 - 23:55 |
Java (Often spam bot) | 898 | 398.28 MB | 31 Jan 2008 - 23:21 |
Harvest | 825 | 259.78 MB | 31 Jan 2008 - 07:03 |
Speedy Spider | 695+66 | 3.58 GB | 31 Jan 2008 - 23:59 |
Unknown robot (identified by 'bot*') | 471+135 | 952.49 MB | 31 Jan 2008 - 23:27 |
Turn It In | 433+2 | 21.91 MB | 13 Jan 2008 - 11:01 |
Voila | 185+202 | 13.45 MB | 31 Jan 2008 - 19:10 |
BecomeBot | 296+74 | 4.14 MB | 31 Jan 2008 - 23:42 |
Unknown robot (identified by 'spider') | 335+4 | 301.54 MB | 31 Jan 2008 - 21:25 |
Unknown robot (identified by 'robot') | 134+137 | 21.75 MB | 31 Jan 2008 - 14:41 |
Exabot | 243+25 | 8.48 MB | 31 Jan 2008 - 21:09 |
larbin | 191+33 | 1.75 MB | 29 Jan 2008 - 07:17 |
Python-urllib | 7+207 | 17.35 MB | 31 Jan 2008 - 21:25 |
Jakarta commons-httpclient | 202 | 1.93 MB | 31 Jan 2008 - 21:36 |
Alexa (IA Archiver) | 160+32 | 208.54 MB | 31 Jan 2008 - 20:28 |
MJ12bot | 174+12 | 18.19 MB | 28 Jan 2008 - 03:56 |
GigaBot | 139+36 | 205.13 MB | 27 Jan 2008 - 07:20 |
OutfoxBot/YodaoBot | 82+33 | 15.09 MB | 31 Jan 2008 - 08:01 |
Perl tool | 83+1 | 38.28 MB | 30 Jan 2008 - 22:50 |
MSIECrawler | 59+12 | 4.64 MB | 31 Jan 2008 - 20:53 |
Sogou Spider | 55+6 | 21.28 MB | 31 Jan 2008 - 21:47 |
CFNetwork | 55 | 252.27 MB | 31 Jan 2008 - 22:48 |
NG 2.x (Exalead) | 0+22 | 2.81 KB | 31 Jan 2008 - 07:53 |
The web archive (IA Archiver) | 0+22 | 2.81 KB | 31 Jan 2008 - 16:49 |
Grub.org | 11+10 | 427.89 KB | 22 Jan 2008 - 14:46 |
Heritrix | 18+1 | 40.85 MB | 29 Jan 2008 - 22:55 |
Custo | 18 | 8.18 MB | 28 Jan 2008 - 08:07 |
BSpider | 18 | 170.38 KB | 03 Jan 2008 - 02:04 |
Yandex bot | 11+6 | 1.58 KB | 31 Jan 2008 - 15:53 |
Yahoo-MMCrawler | 10+7 | 917 Bytes | 31 Jan 2008 - 15:11 |
Holmes | 11+5 | 208.33 KB | 31 Jan 2008 - 15:16 |
QihooBot | 14 | 1.49 MB | 09 Jan 2008 - 19:58 |
YahooSeeker Yahoo! Blog crawler | 8+5 | 60.52 KB | 23 Jan 2008 - 13:13 |
UCSD Crawl | 7+6 | 24.13 MB | 28 Jan 2008 - 22:46 |
Fish search | 12 | 2.79 MB | 31 Jan 2008 - 23:22 |
Unknown robot (identified by 'discovery') | 11 | 0 | 31 Jan 2008 - 09:03 |
Feedfetcher-Google | 9 | 1.22 KB | 30 Jan 2008 - 19:20 |
ichiro | 4+3 | 9.11 KB | 15 Jan 2008 - 20:19 |
Unknown robot (identified by '*bot') | 0+7 | 917 Bytes | 27 Jan 2008 - 18:24 |
DoCoMo | 5+1 | 61.50 KB | 26 Jan 2008 - 18:47 |
EasyDL | 6 | 52.29 KB | 27 Jan 2008 - 08:41 |
ASPseek | 5 | 95.05 KB | 13 Jan 2008 - 11:42 |
Web Core / Roots | 5 | 1.81 MB | 10 Jan 2008 - 17:28 |
WordPress | 5 | 979.44 KB | 09 Jan 2008 - 07:30 |
Checkbot | 5 | 0 | 31 Jan 2008 - 03:27 |
Powermarks | 4 | 0 | 28 Jan 2008 - 02:02 |
Girafabot | 0+4 | 524 Bytes | 14 Jan 2008 - 18:59 |
Emacs-w3 Search Engine | 4 | 1.07 MB | 10 Jan 2008 - 03:16 |
WebCollage | 2 | 1.07 MB | 31 Jan 2008 - 06:50 |
The World Wide Web Worm | 2 | 15.77 KB | 27 Jan 2008 - 21:48 |
noxtrumbot | 0+2 | 262 Bytes | 10 Jan 2008 - 00:49 |
NutchCVS | 1+1 | 5.54 KB | 25 Jan 2008 - 03:10 |
Unknown robot (identified by 'hunter') | 2 | 3.63 MB | 27 Jan 2008 - 11:57 |
W3C Link Checker | 1+1 | 131 Bytes | 31 Jan 2008 - 16:58 |
lwp-trivial | 2 | 20.86 KB | 14 Jan 2008 - 03:01 |
FaceBook bot | 1 | 1.29 MB | 20 Jan 2008 - 11:59 |
NimbleCrawler | 0+1 | 131 Bytes | 31 Jan 2008 - 14:29 |
W3C Validator | 1 | 139 Bytes | 20 Jan 2008 - 00:11 |
yacy | 1 | 10.23 KB | 30 Jan 2008 - 03:56 |
HTTrack off-line browser | 1 | 1.29 MB | 19 Jan 2008 - 18:54 |
Cfetch | 1 | 0 | 18 Jan 2008 - 05:53 |
boitho.com-dc | 1 | 11.50 KB | 03 Jan 2008 - 00:59 |
HTMLParser | 1 | 10.74 KB | 31 Jan 2008 - 01:14 |
arks | 1 | 1.29 MB | 29 Jan 2008 - 15:14 |
Others | 0 | 18 Bytes | |