68 different robots | Hits | Bandwidth | Last visit |
MSNBot | 90006+2035 | 46.77 GB | 31 May 2010 - 23:59 |
Feedfetcher-Google | 1527 | 10.66 MB | 31 May 2010 - 23:59 |
Googlebot | 52538+130 | 56.17 GB | 31 May 2010 - 23:59 |
Unknown robot (identified by 'bot*') | 6504+324 | 142.65 MB | 31 May 2010 - 23:57 |
Yahoo Slurp | 32812+282 | 9.42 GB | 31 May 2010 - 23:57 |
Ask | 2011+675 | 876.19 MB | 31 May 2010 - 23:49 |
Exabot | 1282+64 | 229.21 MB | 31 May 2010 - 23:46 |
Unknown robot (identified by 'robot') | 1195+24 | 15.62 MB | 31 May 2010 - 23:45 |
Unknown robot (identified by hit on 'robots.txt') | 0+728 | 22.04 KB | 31 May 2010 - 23:39 |
BBot | 19+2 | 17.85 MB | 31 May 2010 - 23:19 |
twiceler | 4277+560 | 2.26 GB | 31 May 2010 - 23:18 |
BaiDuSpider | 1389+194 | 289.23 MB | 31 May 2010 - 23:09 |
Unknown robot (identified by empty user agent string) | 3061+318 | 197.54 MB | 31 May 2010 - 22:59 |
Yandex bot | 21654+47 | 66.03 GB | 31 May 2010 - 22:46 |
Unknown robot (identified by 'crawl') | 31401+1057 | 42.66 GB | 31 May 2010 - 20:44 |
Sogou Spider | 7+23 | 73.30 KB | 31 May 2010 - 20:28 |
MSNBot-media | 3406+2001 | 75.24 MB | 31 May 2010 - 20:04 |
Java (Often spam bot) | 5724+33 | 118.16 MB | 31 May 2010 - 19:29 |
CFNetwork | 62 | 973.92 MB | 31 May 2010 - 18:32 |
WGet tools | 16 | 61.34 MB | 31 May 2010 - 17:47 |
Jakarta commons-httpclient | 125 | 200.99 MB | 31 May 2010 - 17:08 |
Alexa (IA Archiver) | 115+55 | 7.17 MB | 31 May 2010 - 15:15 |
SuperBot | 3 | 58.17 KB | 31 May 2010 - 14:17 |
EasyDL | 48 | 1.07 MB | 31 May 2010 - 13:57 |
Unknown robot (identified by 'discovery') | 137+82 | 87.86 MB | 31 May 2010 - 11:05 |
Nutch | 66+29 | 1.26 MB | 31 May 2010 - 08:16 |
Google AdSense | 4 | 705.61 KB | 31 May 2010 - 05:49 |
Unknown robot (identified by 'spider') | 608+54 | 18.80 MB | 31 May 2010 - 01:17 |
NG 2.x (Exalead) | 0+21 | 651 Bytes | 31 May 2010 - 00:20 |
Harvest | 69 | 20.58 MB | 30 May 2010 - 23:36 |
yacy | 483+7 | 206.98 MB | 30 May 2010 - 17:49 |
Perl tool | 18 | 114.60 KB | 30 May 2010 - 17:17 |
MJ12bot | 157+26 | 9.90 MB | 30 May 2010 - 13:13 |
Fish search | 4 | 164.11 KB | 30 May 2010 - 08:20 |
MSIECrawler | 0+2 | 62 Bytes | 29 May 2010 - 22:48 |
W3C Link Checker | 1+1 | 31 Bytes | 29 May 2010 - 22:03 |
OutfoxBot/YodaoBot | 1+1 | 258.88 KB | 29 May 2010 - 05:07 |
psbot | 5+11 | 90.96 KB | 29 May 2010 - 04:15 |
The web archive (IA Archiver) | 0+8 | 248 Bytes | 28 May 2010 - 11:52 |
FaceBook bot | 10 | 10.49 MB | 28 May 2010 - 00:41 |
Unknown robot (identified by 'scanner') | 2+1 | 40.11 MB | 27 May 2010 - 18:00 |
Custo | 13 | 4.00 MB | 27 May 2010 - 16:25 |
Voyager | 1 | 17.48 KB | 27 May 2010 - 15:56 |
Girafabot | 0+3 | 93 Bytes | 27 May 2010 - 01:14 |
Mail.ru bot | 5+3 | 473.27 KB | 26 May 2010 - 20:33 |
WallPaper (alias crawlpaper) | 16 | 443.60 KB | 26 May 2010 - 10:42 |
larbin | 5+2 | 83.17 KB | 25 May 2010 - 03:18 |
Unknown robot (identified by '*bot') | 1+1 | 22.09 KB | 25 May 2010 - 03:06 |
legs | 8+8 | 18.70 MB | 24 May 2010 - 18:56 |
Speedy Spider | 6+6 | 66.55 KB | 24 May 2010 - 16:52 |
Web Core / Roots | 10 | 357.91 KB | 23 May 2010 - 20:55 |
Findlinks | 1+2 | 7.03 KB | 22 May 2010 - 03:58 |
GigaBot | 22+26 | 198.58 KB | 21 May 2010 - 21:54 |
Powermarks | 2 | 29.17 KB | 21 May 2010 - 07:15 |
Python-urllib | 1+3 | 23.54 KB | 21 May 2010 - 01:15 |
MSRBOT | 0+6 | 186 Bytes | 20 May 2010 - 18:18 |
Unknown robot (identified by 'checker') | 1 | 0 | 20 May 2010 - 12:23 |
DoCoMo | 0+3 | 93 Bytes | 20 May 2010 - 12:04 |
Gaisbot | 1+1 | 7.00 KB | 17 May 2010 - 17:46 |
WordPress | 4 | 56.87 KB | 15 May 2010 - 00:10 |
LinkScan | 1 | 6.96 KB | 13 May 2010 - 23:41 |
Netcraft | 4 | 27.86 KB | 11 May 2010 - 14:43 |
HTMLParser | 1 | 6.96 KB | 11 May 2010 - 06:59 |
Digger | 2 | 13.93 KB | 10 May 2010 - 09:07 |
BSpider | 1+1 | 1.08 MB | 05 May 2010 - 18:48 |
W3C Validator | 2 | 39.61 KB | 04 May 2010 - 12:07 |
WebReaper | 126747 | 18.34 GB | 04 May 2010 - 00:57 |
arks | 1 | 6.72 MB | 01 May 2010 - 09:52 |
Others | 0 | 0 | |