85 different robots | Hits | Bandwidth | Last visit |
Googlebot | 79050+92 | 76.55 GB | 31 Jul 2006 - 23:59 |
Yahoo Slurp | 36091+2792 | 23.53 GB | 31 Jul 2006 - 23:59 |
Unknown robot (identified by 'crawl') | 22432+673 | 5.69 GB | 31 Jul 2006 - 23:59 |
Ask | 19415+195 | 441.26 MB | 31 Jul 2006 - 08:23 |
NutchCVS | 16099+29 | 44.16 GB | 28 Jul 2006 - 18:04 |
MSNBot | 12965+763 | 24.53 GB | 31 Jul 2006 - 23:30 |
Ocelli | 2547+2 | 1.33 GB | 31 Jul 2006 - 23:34 |
ZyBorg | 2305+8 | 21.37 MB | 24 Jul 2006 - 08:21 |
WGet tools | 2071+5 | 104.74 MB | 31 Jul 2006 - 11:36 |
BaiDuSpider | 1927+9 | 20.97 MB | 30 Jul 2006 - 23:57 |
Nutch | 1734+26 | 14.96 MB | 31 Jul 2006 - 23:12 |
psbot | 1653+81 | 17.11 MB | 31 Jul 2006 - 23:14 |
Unknown robot (identified by empty user agent string) | 766+41 | 205.36 MB | 31 Jul 2006 - 20:18 |
Alexa (IA Archiver) | 694+21 | 452.54 MB | 21 Jul 2006 - 11:32 |
RoboCrawl Spider | 570+1 | 48.35 MB | 14 Jul 2006 - 00:11 |
BecomeBot | 467+58 | 4.95 MB | 31 Jul 2006 - 17:50 |
ConveraCrawler | 507+8 | 1.17 GB | 26 Jul 2006 - 02:23 |
Unknown robot (identified by 'bot*') | 379+93 | 32.79 MB | 31 Jul 2006 - 22:19 |
Unknown robot (identified by hit on 'robots.txt') | 0+338 | 23.41 KB | 31 Jul 2006 - 23:11 |
IRLbot | 168+13 | 6.18 MB | 29 Jul 2006 - 06:21 |
Harvest | 166 | 45.66 MB | 30 Jul 2006 - 12:02 |
Perl tool | 160+1 | 2.30 MB | 31 Jul 2006 - 11:23 |
aipbot | 105+17 | 1.06 MB | 31 Jul 2006 - 08:05 |
Turn It In | 119+2 | 2.26 MB | 25 Jul 2006 - 23:55 |
SBIder | 44+39 | 3.43 MB | 31 Jul 2006 - 21:20 |
lanshanbot | 43+30 | 50.43 MB | 31 Jul 2006 - 18:48 |
GigaBot | 41+32 | 61.39 MB | 30 Jul 2006 - 10:58 |
Exabot | 61+10 | 1.40 MB | 31 Jul 2006 - 18:00 |
nicebot | 70 | 7.07 MB | 31 Jul 2006 - 17:18 |
IBM Almaden Research Center WebFountain™ | 50+13 | 184.71 MB | 31 Jul 2006 - 01:04 |
Custo | 56 | 42.77 MB | 31 Jul 2006 - 12:44 |
Voyager | 48+5 | 485.69 KB | 13 Jul 2006 - 10:33 |
ASpider (Associative Spider) | 23+23 | 4.74 KB | 30 Jul 2006 - 09:32 |
MJ12bot | 39+5 | 398.10 KB | 11 Jul 2006 - 23:42 |
Java (Often spam bot) | 37+4 | 16.51 MB | 31 Jul 2006 - 19:58 |
Findlinks | 25+12 | 2.40 MB | 30 Jul 2006 - 15:09 |
CFNetwork | 35 | 173.79 MB | 31 Jul 2006 - 13:57 |
Jakarta commons-httpclient | 32+1 | 43.25 MB | 28 Jul 2006 - 22:41 |
larbin | 17+15 | 101.03 KB | 28 Jul 2006 - 16:50 |
Combine System | 15+12 | 5.78 MB | 28 Jul 2006 - 23:23 |
Unknown robot (identified by 'robot') | 16+10 | 82.58 KB | 31 Jul 2006 - 06:06 |
Sogou Spider | 26 | 2.33 MB | 28 Jul 2006 - 21:50 |
Walhello appie | 15+9 | 402.07 KB | 08 Jul 2006 - 18:09 |
Voila | 11+12 | 45.75 KB | 26 Jul 2006 - 07:17 |
MSNBot-media | 13+8 | 2.94 MB | 29 Jul 2006 - 07:38 |
Unknown robot (identified by 'spider') | 13+7 | 2.87 MB | 31 Jul 2006 - 16:05 |
Yahoo-MMCrawler | 12+8 | 576 Bytes | 29 Jul 2006 - 07:07 |
Unknown robot (identified by 'discovery') | 17 | 0 | 29 Jul 2006 - 05:20 |
Unknown robot (identified by 'checker') | 12+5 | 896.91 KB | 31 Jul 2006 - 05:33 |
Gaisbot | 9+7 | 366.81 KB | 26 Jul 2006 - 09:30 |
Digger | 10+3 | 115.53 KB | 29 Jul 2006 - 12:14 |
Girafabot | 8+5 | 1.46 MB | 16 Jul 2006 - 16:52 |
Sina Iask Spider | 12 | 997.86 KB | 30 Jul 2006 - 11:50 |
HTTrack off-line browser | 9+3 | 6.00 MB | 26 Jul 2006 - 13:19 |
BBot | 11+1 | 18.55 KB | 26 Jul 2006 - 15:19 |
Cursor | 10 | 898.30 KB | 15 Jul 2006 - 08:11 |
ASPseek | 7 | 730.82 KB | 21 Jul 2006 - 03:17 |
Geniebot | 3+3 | 33.32 KB | 07 Jul 2006 - 15:47 |
The web archive (IA Archiver) | 0+5 | 360 Bytes | 19 Jul 2006 - 21:41 |
BSpider | 3+2 | 886.12 KB | 14 Jul 2006 - 12:39 |
lwp-trivial | 5 | 9.36 KB | 31 Jul 2006 - 02:06 |
Web Core / Roots | 2+2 | 422 Bytes | 09 Jul 2006 - 16:09 |
Google AdSense | 4 | 35.15 KB | 31 Jul 2006 - 00:18 |
Perman surfer | 3+1 | 24.33 KB | 11 Jul 2006 - 04:24 |
Shim-Crawler | 2+1 | 4.45 KB | 21 Jul 2006 - 19:53 |
yacy | 1+2 | 8.09 KB | 14 Jul 2006 - 19:26 |
topicblogs | 2+1 | 57.80 KB | 02 Jul 2006 - 17:38 |
StackRambler | 0+3 | 216 Bytes | 18 Jul 2006 - 16:32 |
EasyDL | 3 | 50.16 KB | 01 Jul 2006 - 08:34 |
Scooter | 0+3 | 216 Bytes | 26 Jul 2006 - 12:17 |
Krugle | 1+1 | 10.30 KB | 20 Jul 2006 - 16:17 |
Ingrid | 1+1 | 15.72 KB | 21 Jul 2006 - 10:29 |
INFOMINE VLCrawler | 1+1 | 211 Bytes | 16 Jul 2006 - 00:29 |
Python-urllib | 1+1 | 38.56 MB | 11 Jul 2006 - 04:04 |
LinkChecker | 1+1 | 17.09 KB | 24 Jul 2006 - 10:27 |
Openfind data gatherer | 1 | 0 | 21 Jul 2006 - 01:53 |
Powermarks | 1 | 0 | 04 Jul 2006 - 05:43 |
Unknown robot (identified by '*bot') | 1 | 139 Bytes | 28 Jul 2006 - 22:37 |
PyQuery | 1 | 8.62 KB | 11 Jul 2006 - 11:02 |
boitho.com-dc | 0+1 | 72 Bytes | 30 Jul 2006 - 16:47 |
HTMLParser | 1 | 7.25 KB | 26 Jul 2006 - 16:20 |
MSIECrawler | 0+1 | 72 Bytes | 16 Jul 2006 - 13:00 |
Others | 0 | 2 Bytes | |