89 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 50389+3337 | 35.05 GB | 31 Mar 2007 - 23:58 |
Googlebot | 34925+90 | 72.18 GB | 31 Mar 2007 - 23:57 |
Unknown robot (identified by 'crawl') | 31099+884 | 11.76 GB | 31 Mar 2007 - 23:47 |
MSNBot | 17478+2010 | 34.93 GB | 31 Mar 2007 - 23:59 |
MSNBot-media | 13317+189 | 647.70 MB | 31 Mar 2007 - 19:49 |
Ask | 9762+127 | 165.02 MB | 31 Mar 2007 - 14:50 |
INFOMINE VLCrawler | 3863+3 | 33.13 MB | 31 Mar 2007 - 20:26 |
Nutch | 3603+75 | 33.45 MB | 31 Mar 2007 - 22:53 |
noxtrumbot | 2996+3 | 49.35 MB | 03 Mar 2007 - 09:11 |
BecomeBot | 2447+215 | 33.19 MB | 31 Mar 2007 - 23:27 |
ASPseek | 2657+1 | 29.14 MB | 25 Mar 2007 - 00:54 |
Ocelli | 2600+3 | 1.33 GB | 31 Mar 2007 - 11:09 |
RufusBot Rufus Web Miner | 1732+94 | 31.75 MB | 30 Mar 2007 - 14:56 |
Unknown robot (identified by 'bot*') | 1555+209 | 97.71 MB | 31 Mar 2007 - 23:11 |
Unknown robot (identified by empty user agent string) | 1294+47 | 291.00 MB | 31 Mar 2007 - 23:55 |
IRLbot | 824+25 | 16.06 MB | 31 Mar 2007 - 19:08 |
RoboCrawl Spider | 843+1 | 1.97 MB | 30 Mar 2007 - 11:58 |
MJ12bot | 662+12 | 55.65 MB | 22 Mar 2007 - 14:49 |
Harvest | 664 | 119.85 MB | 30 Mar 2007 - 16:03 |
ConveraCrawler | 591+7 | 2.41 GB | 24 Mar 2007 - 22:59 |
Sina Iask Spider | 546 | 53.41 MB | 31 Mar 2007 - 19:55 |
Voila | 218+255 | 37.45 MB | 28 Mar 2007 - 22:20 |
Java (Often spam bot) | 368+9 | 45.89 MB | 31 Mar 2007 - 15:58 |
Alexa (IA Archiver) | 283+40 | 417.20 MB | 31 Mar 2007 - 22:54 |
Unknown robot (identified by hit on 'robots.txt') | 0+320 | 22.50 KB | 31 Mar 2007 - 22:24 |
Perl tool | 295+1 | 37.02 MB | 30 Mar 2007 - 22:58 |
Seekbot | 257+9 | 613.75 MB | 30 Mar 2007 - 13:38 |
OutfoxBot/YodaoBot | 147+91 | 69.64 MB | 31 Mar 2007 - 22:58 |
Sogou Spider | 199+31 | 83.86 MB | 30 Mar 2007 - 12:17 |
Exabot | 194+30 | 26.04 MB | 31 Mar 2007 - 20:59 |
Jakarta commons-httpclient | 187 | 13.80 MB | 31 Mar 2007 - 23:09 |
WGet tools | 150+2 | 59.47 MB | 30 Mar 2007 - 06:53 |
psbot | 47+41 | 1.47 MB | 30 Mar 2007 - 17:09 |
CFNetwork | 77 | 411.91 MB | 31 Mar 2007 - 22:46 |
Speedy Spider | 32+35 | 6.80 KB | 22 Mar 2007 - 00:59 |
Custo | 66 | 61.74 MB | 31 Mar 2007 - 05:45 |
Unknown robot (identified by 'spider') | 44+17 | 13.22 MB | 31 Mar 2007 - 19:18 |
nicebot | 48+6 | 1.34 MB | 31 Mar 2007 - 17:43 |
Accoona-AI-Agent | 53+1 | 151.74 MB | 19 Mar 2007 - 09:59 |
ichiro | 46+2 | 847.43 KB | 30 Mar 2007 - 14:03 |
Unknown robot (identified by 'discovery') | 46 | 0 | 27 Mar 2007 - 20:15 |
QihooBot | 46 | 2.26 MB | 27 Mar 2007 - 13:41 |
BaiDuSpider | 42+1 | 72 Bytes | 29 Mar 2007 - 09:24 |
Unknown robot (identified by 'robot') | 25+14 | 649.56 KB | 29 Mar 2007 - 13:03 |
Python-urllib | 37+1 | 20.87 MB | 21 Mar 2007 - 12:06 |
MSIECrawler | 14+24 | 9.05 MB | 30 Mar 2007 - 11:24 |
GigaBot | 13+13 | 28.70 MB | 31 Mar 2007 - 11:19 |
Yahoo-MMCrawler | 14+10 | 1022 Bytes | 29 Mar 2007 - 04:32 |
Voyager | 12+9 | 4.11 MB | 31 Mar 2007 - 17:09 |
WebCollage | 20 | 223.45 KB | 25 Mar 2007 - 04:39 |
The web archive (IA Archiver) | 0+19 | 1.34 KB | 27 Mar 2007 - 14:33 |
BBot | 18 | 52.64 MB | 31 Mar 2007 - 03:58 |
Holmes | 5+10 | 46.05 KB | 27 Mar 2007 - 09:51 |
Findlinks | 5+10 | 1.38 KB | 27 Mar 2007 - 12:51 |
arianna.libero.it | 15 | 2.04 KB | 26 Mar 2007 - 12:57 |
larbin | 7+8 | 1.52 MB | 20 Mar 2007 - 15:28 |
Heritrix | 7+5 | 4.11 MB | 29 Mar 2007 - 09:28 |
W3C Link Checker | 6+6 | 432 Bytes | 26 Mar 2007 - 23:07 |
YahooSeeker Yahoo! Blog crawler | 6+4 | 1.69 MB | 26 Mar 2007 - 09:06 |
Combine System | 5+5 | 58.76 KB | 28 Mar 2007 - 20:10 |
MSRBOT | 6+3 | 1.75 MB | 29 Mar 2007 - 23:35 |
bender focused_crawler | 5+3 | 48.20 KB | 12 Mar 2007 - 02:56 |
Web Core / Roots | 6+2 | 7.93 MB | 25 Mar 2007 - 11:37 |
Unknown robot (identified by 'checker') | 7+1 | 7.44 KB | 24 Mar 2007 - 09:26 |
LinkChecker | 4+4 | 42.70 KB | 28 Mar 2007 - 08:59 |
Girafabot | 0+8 | 576 Bytes | 17 Mar 2007 - 23:34 |
Krugle | 6+1 | 13.75 MB | 23 Mar 2007 - 03:22 |
Geniebot | 3+4 | 13.20 KB | 31 Mar 2007 - 17:47 |
Kevin | 6 | 2.76 MB | 15 Mar 2007 - 05:04 |
Unknown robot (identified by '*bot') | 2+4 | 16.17 KB | 28 Mar 2007 - 03:55 |
yacy | 1+4 | 411.90 KB | 22 Mar 2007 - 16:56 |
boitho.com-dc | 3+2 | 2.04 MB | 31 Mar 2007 - 19:54 |
NutchCVS | 4+1 | 29.58 KB | 04 Mar 2007 - 19:25 |
TailRank | 4 | 0 | 15 Mar 2007 - 17:36 |
Digger | 2+2 | 7.73 KB | 18 Mar 2007 - 23:51 |
The World Wide Web Worm | 4 | 0 | 25 Mar 2007 - 14:17 |
Google AdSense | 4 | 8.06 MB | 21 Mar 2007 - 15:49 |
Cfetch | 3 | 0 | 30 Mar 2007 - 00:00 |
EasyDL | 3 | 38.61 MB | 31 Mar 2007 - 23:29 |
UCSD Crawl | 3 | 27.75 KB | 01 Mar 2007 - 08:14 |
GoForIt.com | 1+1 | 211 Bytes | 07 Mar 2007 - 01:06 |
HTTrack off-line browser | 2 | 143.69 KB | 17 Mar 2007 - 04:29 |
Powermarks | 2 | 0 | 20 Mar 2007 - 05:18 |
HTMLParser | 2 | 278 Bytes | 22 Mar 2007 - 13:37 |
Hylanda | 1+1 | 860.21 KB | 08 Mar 2007 - 16:41 |
EARTHCOM.info | 0+1 | 72 Bytes | 08 Mar 2007 - 19:05 |
Fish search | 1 | 267.98 KB | 23 Mar 2007 - 21:11 |
Others | 0 | 1 Bytes | |