86 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 163029+723 | 52.21 GB | 31 Aug 2005 - 23:59 |
Yahoo Slurp | 7510+825 | 5.81 GB | 31 Aug 2005 - 23:58 |
Googlebot | 85759+287 | 47.75 GB | 31 Aug 2005 - 23:57 |
Grub.org | 574 | 4.98 MB | 31 Aug 2005 - 23:52 |
MSNBot | 4633+253 | 10.92 GB | 31 Aug 2005 - 23:47 |
BecomeBot | 2241+61 | 7.11 MB | 31 Aug 2005 - 23:34 |
Java (Often spam bot) | 68+5 | 1.02 MB | 31 Aug 2005 - 23:00 |
nicebot | 194 | 3.27 MB | 31 Aug 2005 - 22:53 |
CFNetwork | 37 | 119.62 MB | 31 Aug 2005 - 22:44 |
Alexa (IA Archiver) | 69+116 | 18.85 MB | 31 Aug 2005 - 21:47 |
Ask | 18143+103 | 201.26 MB | 31 Aug 2005 - 21:14 |
Unknown robot (identified by empty user agent string) | 329+61 | 151.51 MB | 31 Aug 2005 - 17:15 |
Unknown robot (identified by 'bot*') | 158+37 | 2.08 MB | 31 Aug 2005 - 16:14 |
Unknown robot (identified by hit on 'robots.txt') | 0+42 | 2.95 KB | 31 Aug 2005 - 16:08 |
MSIECrawler | 14+4 | 7.06 MB | 31 Aug 2005 - 07:32 |
MJ12bot | 2+2 | 21.45 KB | 31 Aug 2005 - 05:34 |
Voila | 16+22 | 4.09 MB | 31 Aug 2005 - 04:40 |
Combine System | 10+6 | 102.63 KB | 31 Aug 2005 - 04:22 |
Gaisbot | 2216+19 | 22.39 MB | 31 Aug 2005 - 02:27 |
Turn It In | 358+2 | 1.04 GB | 31 Aug 2005 - 02:18 |
psbot | 114+39 | 924.26 KB | 30 Aug 2005 - 23:55 |
BaiDuSpider | 259+4 | 6.29 MB | 30 Aug 2005 - 21:55 |
Heritrix | 92+6 | 20.41 MB | 30 Aug 2005 - 20:19 |
Perl tool | 119 | 87.68 MB | 30 Aug 2005 - 19:16 |
NutchCVS | 121+26 | 5.29 MB | 30 Aug 2005 - 19:06 |
Spiderman | 50 | 1.49 MB | 30 Aug 2005 - 14:01 |
Yahoo-MMCrawler | 7+7 | 110.88 KB | 30 Aug 2005 - 12:11 |
Unknown robot (identified by 'spider') | 6+2 | 16.99 KB | 30 Aug 2005 - 08:37 |
Jakarta commons-httpclient | 24 | 4.51 MB | 30 Aug 2005 - 07:33 |
EasyDL | 4 | 1.03 MB | 30 Aug 2005 - 01:40 |
Argus | 12+6 | 929.09 KB | 29 Aug 2005 - 23:18 |
Harvest | 393 | 117.22 MB | 29 Aug 2005 - 14:16 |
sohu-search | 29+10 | 2.76 MB | 29 Aug 2005 - 12:03 |
Findlinks | 205+7 | 3.03 MB | 29 Aug 2005 - 11:52 |
Custo | 42 | 75.89 MB | 29 Aug 2005 - 02:24 |
Powermarks | 3 | 0 | 29 Aug 2005 - 01:58 |
ActiveBookmark | 3 | 417 Bytes | 28 Aug 2005 - 13:55 |
Google AdSense | 28+4 | 2.25 MB | 28 Aug 2005 - 12:11 |
INFOMINE VLCrawler | 428+2 | 3.71 MB | 28 Aug 2005 - 11:26 |
Dumbot | 158+3 | 1.15 MB | 28 Aug 2005 - 10:30 |
twiceler | 3+1 | 781.10 KB | 28 Aug 2005 - 10:18 |
Unknown robot (identified by 'checker') | 7 | 162.65 KB | 28 Aug 2005 - 09:04 |
archive.org bot | 4+4 | 4.75 MB | 27 Aug 2005 - 05:17 |
Unknown robot (identified by 'robot') | 30+4 | 400.52 KB | 26 Aug 2005 - 16:30 |
GoForIt.com | 3+3 | 633 Bytes | 26 Aug 2005 - 12:26 |
Cfetch | 51+11 | 726.04 KB | 26 Aug 2005 - 01:04 |
Scooter | 0+2 | 144 Bytes | 25 Aug 2005 - 13:24 |
Unknown robot (identified by 'sucker') | 1 | 0 | 25 Aug 2005 - 05:44 |
HTTrack off-line browser | 5+1 | 882.57 KB | 24 Aug 2005 - 22:04 |
Pompos | 1 | 5.42 KB | 24 Aug 2005 - 21:54 |
larbin | 15+5 | 130.34 KB | 24 Aug 2005 - 07:51 |
W3C Link Checker | 8+4 | 288 Bytes | 23 Aug 2005 - 23:08 |
InsurancoBot | 4+4 | 32.82 KB | 23 Aug 2005 - 04:04 |
IBM Almaden Research Center WebFountain™ | 15+10 | 2.45 MB | 23 Aug 2005 - 03:19 |
Unknown robot (identified by 'discovery') | 20 | 0 | 22 Aug 2005 - 15:03 |
aipbot | 69+7 | 320.55 KB | 21 Aug 2005 - 23:28 |
boitho.com-dc | 1 | 10.54 KB | 21 Aug 2005 - 15:08 |
Geniebot | 1+1 | 7.23 KB | 20 Aug 2005 - 20:33 |
Cursor | 3 | 30.85 KB | 20 Aug 2005 - 18:01 |
ZyBorg | 2109+16 | 19.60 MB | 20 Aug 2005 - 11:24 |
Walhello appie | 6+3 | 60.91 KB | 20 Aug 2005 - 02:51 |
LinkChecker | 33+2 | 144 Bytes | 19 Aug 2005 - 16:36 |
WGet tools | 19 | 39.34 MB | 19 Aug 2005 - 10:45 |
Nutch | 2143+7 | 18.45 MB | 18 Aug 2005 - 21:58 |
Calif | 1 | 65.62 KB | 18 Aug 2005 - 17:33 |
NG 2.x (Exalead) | 38+2 | 152.88 KB | 16 Aug 2005 - 19:23 |
Python-urllib | 1 | 2.73 MB | 16 Aug 2005 - 19:11 |
Openfind data gatherer | 1+1 | 211 Bytes | 16 Aug 2005 - 18:26 |
BSpider | 3+1 | 24.98 KB | 15 Aug 2005 - 13:09 |
WebIndexer | 1+1 | 7.23 KB | 13 Aug 2005 - 00:51 |
ConveraCrawler | 320+5 | 257.10 MB | 12 Aug 2005 - 15:03 |
Fish search | 1 | 18.16 KB | 11 Aug 2005 - 18:59 |
PostFavorites | 2 | 139 Bytes | 05 Aug 2005 - 11:45 |
Netcraft | 1 | 0 | 05 Aug 2005 - 10:48 |
GigaBot | 2+2 | 31.83 KB | 04 Aug 2005 - 23:28 |
Asterias | 1 | 139 Bytes | 03 Aug 2005 - 05:48 |
InfoSeek Robot 1.0 | 1+1 | 9.64 KB | 02 Aug 2005 - 21:35 |
IRLbot | 0+1 | 72 Bytes | 01 Aug 2005 - 21:03 |
Internet Shinchakubin | 15 | 13.76 MB | 01 Aug 2005 - 14:28 |
Others | 0 | 1.05 KB | |