74 different robots | Hits | Bandwidth | Last visit |
Googlebot | 58371+229 | 26.67 GB | 28 Feb 2005 - 23:57 |
Unknown robot (identified by 'crawl') | 17010+491 | 10.26 GB | 28 Feb 2005 - 23:49 |
Ask | 10488+128 | 128.64 MB | 28 Feb 2005 - 04:43 |
Yahoo Slurp | 8654+1142 | 7.96 GB | 28 Feb 2005 - 22:46 |
MSNBot | 6213+262 | 11.28 GB | 28 Feb 2005 - 23:44 |
Python-urllib | 4821 | 14.70 GB | 23 Feb 2005 - 06:26 |
BaiDuSpider | 3399+5 | 35.46 MB | 28 Feb 2005 - 22:23 |
YahooSeeker Yahoo! Blog crawler | 1777+24 | 113.16 MB | 28 Feb 2005 - 11:29 |
sohu-search | 1499+8 | 7.45 MB | 24 Feb 2005 - 19:38 |
Grub.org | 662 | 5.75 MB | 28 Feb 2005 - 18:30 |
Harvest | 404 | 66.61 MB | 28 Feb 2005 - 18:01 |
Unknown robot (identified by empty user agent string) | 325+58 | 74.21 MB | 28 Feb 2005 - 22:16 |
INFOMINE VLCrawler | 244+10 | 208.95 MB | 28 Feb 2005 - 10:48 |
Heritrix | 199+6 | 3.02 MB | 28 Feb 2005 - 00:39 |
Fish search | 182 | 1.66 MB | 28 Feb 2005 - 13:28 |
Walhello appie | 137+24 | 1.20 MB | 21 Feb 2005 - 20:14 |
Alexa (IA Archiver) | 90+22 | 504.57 KB | 28 Feb 2005 - 15:12 |
Perl tool | 109 | 18.89 MB | 28 Feb 2005 - 21:35 |
Custo | 79 | 38.83 MB | 27 Feb 2005 - 14:41 |
Unknown robot (identified by 'robot') | 68+3 | 3.15 MB | 28 Feb 2005 - 18:21 |
BecomeBot | 36+21 | 1.90 MB | 26 Feb 2005 - 16:45 |
Java (Often spam bot) | 52+4 | 6.31 MB | 28 Feb 2005 - 19:25 |
Unknown robot (identified by 'bot*') | 31+18 | 691.21 KB | 28 Feb 2005 - 19:28 |
GigaBot | 28+18 | 2.08 MB | 22 Feb 2005 - 17:05 |
Fast-Webcrawler | 37+5 | 37.52 KB | 28 Feb 2005 - 17:22 |
Jakarta commons-httpclient | 40 | 27.45 MB | 27 Feb 2005 - 06:21 |
The web archive (IA Archiver) | 0+34 | 2.39 KB | 01 Feb 2005 - 05:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+29 | 1.97 KB | 25 Feb 2005 - 19:33 |
IRLbot | 13+12 | 513.64 KB | 27 Feb 2005 - 01:28 |
Voila | 11+14 | 10.38 MB | 26 Feb 2005 - 00:01 |
NutchCVS | 13+9 | 43.49 KB | 28 Feb 2005 - 20:23 |
Unknown robot (identified by 'spider') | 11+10 | 70.81 KB | 27 Feb 2005 - 23:11 |
WGet tools | 19 | 10.12 MB | 28 Feb 2005 - 21:56 |
psbot | 8+8 | 65.21 KB | 27 Feb 2005 - 11:39 |
updated | 11+4 | 6.61 MB | 25 Feb 2005 - 19:00 |
IBM Almaden Research Center WebFountain™ | 9+5 | 1.23 MB | 27 Feb 2005 - 21:32 |
ichiro | 12+1 | 86.87 KB | 17 Feb 2005 - 07:03 |
lwp-trivial | 13 | 130.18 KB | 19 Feb 2005 - 12:19 |
Unknown robot (identified by 'checker') | 12 | 162.40 KB | 23 Feb 2005 - 11:02 |
Girafabot | 8+4 | 905.02 KB | 08 Feb 2005 - 19:41 |
Openfind data gatherer | 5+5 | 29.88 KB | 27 Feb 2005 - 22:56 |
Fast-Search-Engine (not fastsearch.com) | 10 | 380.97 KB | 24 Feb 2005 - 08:32 |
Google AdSense | 7+3 | 2.09 MB | 16 Feb 2005 - 04:51 |
Yahoo-MMCrawler | 0+9 | 648 Bytes | 05 Feb 2005 - 14:21 |
Yahoo Vertical Crawler | 0+9 | 648 Bytes | 23 Feb 2005 - 07:27 |
UCSD Crawl | 7 | 53.86 KB | 08 Feb 2005 - 21:12 |
MSIECrawler | 4+3 | 863.36 KB | 21 Feb 2005 - 19:47 |
IlTrovatore-Setaccio | 3+2 | 7.58 KB | 06 Feb 2005 - 16:31 |
MJ12bot | 3+2 | 24.84 KB | 28 Feb 2005 - 10:32 |
Findlinks | 4 | 431.98 KB | 26 Feb 2005 - 06:40 |
FastCrawler | 2+2 | 7.84 MB | 21 Feb 2005 - 00:38 |
webcrawl.net | 2+2 | 422 Bytes | 25 Feb 2005 - 22:31 |
Holmes | 2+1 | 72 Bytes | 20 Feb 2005 - 17:16 |
Unknown robot (identified by 'discovery') | 3 | 0 | 14 Feb 2005 - 17:27 |
Powermarks | 3 | 0 | 28 Feb 2005 - 01:08 |
boitho.com-dc | 3 | 7.44 KB | 16 Feb 2005 - 21:45 |
Speedy Spider | 2+1 | 211 Bytes | 16 Feb 2005 - 02:03 |
UdmSearch | 1+1 | 0 | 24 Feb 2005 - 22:17 |
Turn It In | 1+1 | 3.95 MB | 10 Feb 2005 - 11:54 |
CFNetwork | 2 | 447.35 KB | 07 Feb 2005 - 09:10 |
GoForIt.com | 1+1 | 211 Bytes | 24 Feb 2005 - 02:50 |
HTTrack off-line browser | 2 | 139 Bytes | 22 Feb 2005 - 00:25 |
Vagabondo | 1+1 | 211 Bytes | 18 Feb 2005 - 00:30 |
Boris | 1+1 | 7.87 KB | 09 Feb 2005 - 11:19 |
Gaisbot | 1+1 | 211 Bytes | 21 Feb 2005 - 09:34 |
PEERbot | 1+1 | 211 Bytes | 19 Feb 2005 - 01:03 |
Ultraseek | 1+1 | 211 Bytes | 16 Feb 2005 - 16:37 |
larbin | 1+1 | 7.24 KB | 24 Feb 2005 - 09:40 |
Asterias | 1 | 139 Bytes | 03 Feb 2005 - 09:59 |
Spiderman | 1 | 5.42 KB | 21 Feb 2005 - 09:47 |
JoBo Java Web Robot | 0+1 | 72 Bytes | 24 Feb 2005 - 09:20 |
lwp-request | 1 | 0 | 07 Feb 2005 - 16:19 |
EasyDL | 1 | 11.01 KB | 06 Feb 2005 - 22:44 |
Unknown robot (identified by 'sucker') | 1 | 0 | 28 Feb 2005 - 16:11 |
Others | 0 | 7 Bytes | |