77 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 38024+1056 | 18.21 GB | 31 Oct 2007 - 23:23 |
Yahoo Slurp | 31435+242 | 25.46 GB | 31 Oct 2007 - 23:58 |
Googlebot | 23476+91 | 8.43 GB | 31 Oct 2007 - 23:59 |
MSNBot | 22056+1511 | 19.85 GB | 31 Oct 2007 - 23:57 |
Nutch | 10270+55 | 379.68 MB | 31 Oct 2007 - 23:57 |
Ask | 9973+99 | 131.47 MB | 30 Oct 2007 - 20:30 |
Unknown robot (identified by 'bot*') | 6444+86 | 7.74 GB | 31 Oct 2007 - 17:49 |
Heritrix | 5740+8 | 11.78 GB | 11 Oct 2007 - 08:02 |
BaiDuSpider | 2280+5 | 51.22 MB | 31 Oct 2007 - 22:07 |
MSNBot-media | 1977+99 | 50.40 MB | 31 Oct 2007 - 04:16 |
BecomeBot | 842+351 | 12.53 MB | 31 Oct 2007 - 20:15 |
Unknown robot (identified by empty user agent string) | 872+320 | 363.66 MB | 31 Oct 2007 - 22:54 |
MSRBOT | 758+116 | 2.18 GB | 31 Oct 2007 - 21:32 |
Speedy Spider | 763+87 | 3.97 GB | 31 Oct 2007 - 05:27 |
ConveraCrawler | 811+5 | 1.57 GB | 26 Oct 2007 - 02:55 |
noxtrumbot | 719+5 | 69.26 MB | 14 Oct 2007 - 08:55 |
Harvest | 450 | 150.29 MB | 28 Oct 2007 - 12:04 |
Unknown robot (identified by 'robot') | 418+21 | 4.66 MB | 30 Oct 2007 - 22:03 |
Perl tool | 429 | 24.49 MB | 31 Oct 2007 - 18:12 |
Unknown robot (identified by hit on 'robots.txt') | 0+368 | 41.81 KB | 31 Oct 2007 - 16:27 |
Alexa (IA Archiver) | 280+31 | 45.13 MB | 31 Oct 2007 - 22:32 |
Jakarta commons-httpclient | 291 | 12.00 MB | 31 Oct 2007 - 19:33 |
Voila | 100+111 | 26.08 MB | 31 Oct 2007 - 18:43 |
twiceler | 181+23 | 9.56 MB | 26 Oct 2007 - 14:36 |
Turn It In | 171+1 | 1.45 MB | 28 Oct 2007 - 02:45 |
NimbleCrawler | 169+2 | 3.30 MB | 21 Oct 2007 - 02:55 |
Ocelli | 143+6 | 15.39 MB | 31 Oct 2007 - 12:24 |
Java (Often spam bot) | 139+4 | 7.82 MB | 31 Oct 2007 - 23:44 |
Sogou Spider | 130+9 | 19.20 MB | 29 Oct 2007 - 07:18 |
CFNetwork | 113 | 628.76 MB | 29 Oct 2007 - 22:09 |
Exabot | 76+15 | 3.62 MB | 31 Oct 2007 - 06:08 |
Voyager | 77+11 | 2.07 MB | 18 Oct 2007 - 08:14 |
WGet tools | 79+3 | 85.78 MB | 31 Oct 2007 - 15:23 |
MSIECrawler | 37+20 | 15.78 MB | 31 Oct 2007 - 06:26 |
OutfoxBot/YodaoBot | 43+12 | 3.77 MB | 31 Oct 2007 - 12:06 |
NG 2.x (Exalead) | 36+10 | 71.13 MB | 17 Oct 2007 - 08:43 |
yacy | 37+8 | 990.75 KB | 30 Oct 2007 - 03:20 |
lwp-trivial | 44 | 90.37 MB | 23 Oct 2007 - 21:49 |
Custo | 39 | 153.59 MB | 31 Oct 2007 - 01:58 |
The web archive (IA Archiver) | 1+33 | 44.47 KB | 30 Oct 2007 - 16:22 |
Gaisbot | 26+3 | 274.35 KB | 16 Oct 2007 - 20:43 |
GigaBot | 18+9 | 16.55 MB | 31 Oct 2007 - 23:03 |
Holmes | 5+16 | 21.38 KB | 31 Oct 2007 - 19:29 |
ichiro | 17+4 | 1.16 MB | 31 Oct 2007 - 23:57 |
Unknown robot (identified by 'spider') | 14+5 | 8.92 MB | 29 Oct 2007 - 05:52 |
Python-urllib | 7+11 | 183.15 MB | 31 Oct 2007 - 10:47 |
Unknown robot (identified by 'discovery') | 17 | 0 | 28 Oct 2007 - 08:19 |
EasyDL | 17 | 34.32 MB | 26 Oct 2007 - 21:16 |
Web Core / Roots | 14+1 | 22.76 MB | 30 Oct 2007 - 09:45 |
YahooSeeker Yahoo! Blog crawler | 8+5 | 3.04 MB | 27 Oct 2007 - 15:32 |
Combine System | 5+6 | 74.27 KB | 28 Oct 2007 - 13:30 |
UCSD Crawl | 6+5 | 48.27 MB | 28 Oct 2007 - 14:28 |
Yahoo-MMCrawler | 6+4 | 465 Bytes | 28 Oct 2007 - 10:24 |
psbot | 4+4 | 9.47 KB | 09 Oct 2007 - 01:03 |
DoCoMo | 8 | 1.09 MB | 29 Oct 2007 - 06:34 |
boitho.com-dc | 7+1 | 1.02 MB | 13 Oct 2007 - 19:14 |
QihooBot | 7 | 443.40 KB | 31 Oct 2007 - 06:24 |
WordPress | 6 | 35.95 KB | 30 Oct 2007 - 13:54 |
Google AdSense | 6 | 30.37 MB | 26 Oct 2007 - 13:21 |
Checkbot | 5 | 0 | 25 Oct 2007 - 03:14 |
Girafabot | 0+5 | 360 Bytes | 06 Oct 2007 - 12:48 |
nicebot | 4 | 1.01 MB | 19 Oct 2007 - 06:03 |
BBot | 4 | 2.75 MB | 20 Oct 2007 - 12:49 |
MJ12bot | 2+1 | 2.04 MB | 18 Oct 2007 - 07:15 |
FaceBook bot | 2 | 23.91 KB | 13 Oct 2007 - 13:47 |
Geniebot | 1+1 | 9.63 KB | 08 Oct 2007 - 19:18 |
INFOMINE VLCrawler | 1+1 | 270 Bytes | 27 Oct 2007 - 22:52 |
SynooBot | 1+1 | 9.69 KB | 21 Oct 2007 - 09:55 |
Internet Shinchakubin | 1 | 410.31 KB | 17 Oct 2007 - 17:37 |
HTTrack off-line browser | 1 | 139 Bytes | 23 Oct 2007 - 11:30 |
JoBo Java Web Robot | 1 | 139 Bytes | 04 Oct 2007 - 03:41 |
Fish search | 1 | 244.27 KB | 08 Oct 2007 - 06:45 |
Powermarks | 1 | 0 | 03 Oct 2007 - 01:04 |
Unknown robot (identified by '*bot') | 1 | 8.11 KB | 31 Oct 2007 - 01:54 |
Unknown robot (identified by 'hunter') | 1 | 4.83 KB | 14 Oct 2007 - 14:13 |
larbin | 0+1 | 131 Bytes | 19 Oct 2007 - 09:11 |
Others | 0 | 0 | |