84 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 36168+3227 | 34.87 GB | 30 Jun 2006 - 23:59 |
MSNBot | 14345+766 | 19.54 GB | 30 Jun 2006 - 23:59 |
Unknown robot (identified by 'crawl') | 34175+632 | 45.01 GB | 30 Jun 2006 - 23:59 |
Nutch | 1579+22 | 13.62 MB | 30 Jun 2006 - 23:58 |
Voyager | 1179+23 | 12.94 MB | 30 Jun 2006 - 23:57 |
Googlebot | 112175+76 | 59.24 GB | 30 Jun 2006 - 23:55 |
Ask | 29655+245 | 526.29 MB | 30 Jun 2006 - 23:53 |
Unknown robot (identified by empty user agent string) | 1028+60 | 392.38 MB | 30 Jun 2006 - 23:03 |
Perl tool | 62 | 84.53 MB | 30 Jun 2006 - 21:21 |
Unknown robot (identified by hit on 'robots.txt') | 0+262 | 18.07 KB | 30 Jun 2006 - 20:27 |
psbot | 23+19 | 177.74 KB | 30 Jun 2006 - 20:15 |
nicebot | 25 | 232.97 KB | 30 Jun 2006 - 19:49 |
WebReaper | 9084+2 | 18.86 GB | 30 Jun 2006 - 19:44 |
Unknown robot (identified by 'bot*') | 329+197 | 65.36 MB | 30 Jun 2006 - 19:20 |
Sogou Spider | 31 | 2.26 MB | 30 Jun 2006 - 16:58 |
ZyBorg | 423+10 | 5.95 MB | 30 Jun 2006 - 16:39 |
CFNetwork | 34 | 252.94 MB | 30 Jun 2006 - 15:37 |
BecomeBot | 2085+109 | 22.16 MB | 30 Jun 2006 - 12:48 |
SBIder | 11+14 | 127.59 KB | 30 Jun 2006 - 11:38 |
NutchCVS | 75+21 | 40.16 MB | 30 Jun 2006 - 10:39 |
Unknown robot (identified by 'discovery') | 25 | 0 | 30 Jun 2006 - 10:04 |
Unknown robot (identified by 'checker') | 6 | 425.03 KB | 30 Jun 2006 - 10:00 |
MSNBot-media | 42+24 | 5.89 MB | 30 Jun 2006 - 09:49 |
Yahoo-MMCrawler | 7+5 | 360 Bytes | 30 Jun 2006 - 06:17 |
Unknown robot (identified by 'robot') | 24+33 | 5.13 MB | 30 Jun 2006 - 06:08 |
Harvest | 118 | 11.16 MB | 30 Jun 2006 - 05:21 |
Java (Often spam bot) | 239+3 | 28.41 MB | 30 Jun 2006 - 05:08 |
ConveraCrawler | 573+8 | 943.02 MB | 30 Jun 2006 - 03:31 |
Combine System | 77+79 | 491.69 KB | 29 Jun 2006 - 21:48 |
Python-urllib | 3729 | 78.04 MB | 29 Jun 2006 - 17:30 |
Geniebot | 31+16 | 1.58 MB | 29 Jun 2006 - 16:58 |
ASpider (Associative Spider) | 3+3 | 633 Bytes | 29 Jun 2006 - 16:43 |
lanshanbot | 38+32 | 1.16 MB | 29 Jun 2006 - 14:46 |
WGet tools | 235+9 | 203.63 MB | 29 Jun 2006 - 13:18 |
Custo | 67 | 45.41 MB | 29 Jun 2006 - 08:56 |
larbin | 308+68 | 16.54 MB | 29 Jun 2006 - 01:49 |
The web archive (IA Archiver) | 2+30 | 2.99 MB | 29 Jun 2006 - 01:40 |
aipbot | 458+10 | 4.47 MB | 28 Jun 2006 - 23:40 |
MSIECrawler | 15+3 | 6.35 MB | 28 Jun 2006 - 20:43 |
Findlinks | 11+7 | 975.84 KB | 28 Jun 2006 - 19:34 |
Exabot | 39+11 | 453.15 KB | 28 Jun 2006 - 19:32 |
StackRambler | 0+4 | 288 Bytes | 28 Jun 2006 - 18:09 |
Sina Iask Spider | 10 | 923.02 KB | 28 Jun 2006 - 14:34 |
GigaBot | 77+46 | 26.79 MB | 28 Jun 2006 - 12:49 |
BBot | 2 | 435.93 KB | 28 Jun 2006 - 08:18 |
Web Core / Roots | 8+3 | 114.57 KB | 28 Jun 2006 - 07:42 |
Heritrix | 534+1 | 34.23 MB | 28 Jun 2006 - 02:53 |
EasyDL | 3 | 50.16 KB | 28 Jun 2006 - 01:34 |
Alexa (IA Archiver) | 193+25 | 123.39 MB | 27 Jun 2006 - 20:52 |
topicblogs | 2+2 | 57.52 KB | 27 Jun 2006 - 05:14 |
Powermarks | 4 | 0 | 27 Jun 2006 - 03:58 |
BaiDuSpider | 13+6 | 2.22 MB | 26 Jun 2006 - 23:59 |
Unknown robot (identified by 'spider') | 25+5 | 2.87 MB | 26 Jun 2006 - 08:36 |
Jakarta commons-httpclient | 3 | 719.12 KB | 26 Jun 2006 - 03:26 |
SuperBot | 22 | 7.31 MB | 25 Jun 2006 - 16:38 |
LinkChecker | 1+1 | 17.09 KB | 25 Jun 2006 - 10:52 |
Google AdSense | 2 | 14.64 KB | 24 Jun 2006 - 01:54 |
Turn It In | 92+1 | 18.56 MB | 24 Jun 2006 - 01:02 |
Voila | 14+18 | 7.19 MB | 23 Jun 2006 - 21:16 |
W3C Link Checker | 1+1 | 72 Bytes | 23 Jun 2006 - 20:03 |
Openfind data gatherer | 3+1 | 18.91 KB | 23 Jun 2006 - 11:43 |
RoboCrawl Spider | 4+5 | 41.87 KB | 22 Jun 2006 - 12:28 |
IRLbot | 791+12 | 11.30 MB | 22 Jun 2006 - 06:28 |
Walhello appie | 3+3 | 10.22 KB | 20 Jun 2006 - 07:06 |
Yahoo-Blogs | 1+1 | 5.27 MB | 19 Jun 2006 - 07:12 |
Digger | 10+3 | 115.39 KB | 19 Jun 2006 - 05:37 |
Cursor | 11 | 3.01 MB | 18 Jun 2006 - 04:35 |
WordPress | 1 | 0 | 18 Jun 2006 - 04:02 |
Scooter | 0+3 | 216 Bytes | 18 Jun 2006 - 00:04 |
Shim-Crawler | 4+2 | 57.74 KB | 17 Jun 2006 - 00:26 |
lwp-request | 1 | 139 Bytes | 16 Jun 2006 - 03:45 |
GoForIt.com | 1+1 | 211 Bytes | 16 Jun 2006 - 03:09 |
Fish search | 1 | 718.85 KB | 15 Jun 2006 - 00:26 |
noxtrumbot | 11+5 | 1.50 MB | 14 Jun 2006 - 16:27 |
ichiro | 65+8 | 599.12 KB | 14 Jun 2006 - 13:37 |
Ocelli | 2500+2 | 1.32 GB | 12 Jun 2006 - 21:01 |
NG 2.x (Exalead) | 0+1 | 72 Bytes | 11 Jun 2006 - 17:38 |
Bloglines | 2 | 726.22 KB | 11 Jun 2006 - 03:24 |
Girafabot | 8+5 | 1.44 MB | 10 Jun 2006 - 04:47 |
updated | 1+1 | 211 Bytes | 09 Jun 2006 - 02:57 |
UdmSearch | 15+3 | 840.43 KB | 09 Jun 2006 - 01:45 |
KnowItAll | 5+31 | 51.32 KB | 07 Jun 2006 - 13:46 |
arks | 0+1 | 72 Bytes | 06 Jun 2006 - 13:36 |
MJ12bot | 23+2 | 365.62 KB | 03 Jun 2006 - 19:12 |