61 different robots | Hits | Bandwidth | Last visit |
Googlebot | 69132+110 | 17.67 GB | 31 Oct 2010 - 23:59 |
Yahoo Slurp | 28868+294 | 10.57 GB | 31 Oct 2010 - 23:58 |
Unknown robot (identified by 'crawl') | 24991+1024 | 6.41 GB | 31 Oct 2010 - 23:37 |
Unknown robot (identified by 'bot*') | 10385+1127 | 1.93 GB | 31 Oct 2010 - 23:55 |
MSNBot | 9154+1784 | 1.43 GB | 31 Oct 2010 - 23:21 |
Yandex bot | 6287+55 | 11.85 GB | 31 Oct 2010 - 22:58 |
Ask | 4252+92 | 5.58 GB | 31 Oct 2010 - 23:59 |
MJ12bot | 2526+32 | 40.11 MB | 31 Oct 2010 - 03:25 |
Feedfetcher-Google | 2469 | 16.33 MB | 31 Oct 2010 - 23:34 |
BaiDuSpider | 1429+177 | 1.91 GB | 31 Oct 2010 - 23:59 |
Exabot | 1526+65 | 25.31 MB | 31 Oct 2010 - 23:34 |
Unknown robot (identified by empty user agent string) | 1236+4 | 1.98 GB | 31 Oct 2010 - 23:48 |
MSNBot-media | 635+422 | 14.42 MB | 31 Oct 2010 - 21:46 |
Unknown robot (identified by 'spider') | 875+85 | 48.57 MB | 31 Oct 2010 - 23:59 |
Unknown robot (identified by hit on 'robots.txt') | 0+797 | 24.13 KB | 31 Oct 2010 - 22:08 |
DoCoMo | 622+13 | 18.44 MB | 31 Oct 2010 - 05:59 |
Nutch | 494+70 | 151.66 MB | 31 Oct 2010 - 13:58 |
HTTrack off-line browser | 532+4 | 14.76 MB | 20 Oct 2010 - 21:18 |
Unknown robot (identified by 'discovery') | 324+178 | 34.81 MB | 30 Oct 2010 - 00:20 |
Bloglines | 343 | 2.31 MB | 31 Oct 2010 - 22:34 |
Alexa (IA Archiver) | 220+63 | 52.85 MB | 31 Oct 2010 - 06:33 |
Java (Often spam bot) | 100+17 | 21.13 MB | 31 Oct 2010 - 20:15 |
WordPress | 114 | 26.50 MB | 31 Oct 2010 - 02:05 |
CFNetwork | 94 | 787.49 MB | 31 Oct 2010 - 14:16 |
Harvest | 91 | 21.27 MB | 29 Oct 2010 - 16:10 |
Speedy Spider | 25+58 | 13.18 MB | 31 Oct 2010 - 19:18 |
WGet tools | 81+1 | 194.88 MB | 30 Oct 2010 - 08:56 |
FaceBook bot | 79 | 1.51 MB | 31 Oct 2010 - 11:27 |
Unknown robot (identified by 'robot') | 44+33 | 1.45 MB | 30 Oct 2010 - 20:41 |
Jakarta commons-httpclient | 66 | 48.97 MB | 31 Oct 2010 - 03:26 |
Fish search | 55 | 5.52 MB | 29 Oct 2010 - 11:20 |
yacy | 27+12 | 15.25 MB | 30 Oct 2010 - 12:12 |
EasyDL | 38 | 1.04 MB | 19 Oct 2010 - 14:28 |
Sogou Spider | 8+25 | 137.33 KB | 30 Oct 2010 - 04:29 |
The web archive (IA Archiver) | 0+32 | 992 Bytes | 29 Oct 2010 - 04:30 |
Python-urllib | 30 | 2.32 MB | 28 Oct 2010 - 23:50 |
Motor | 27 | 13.25 MB | 28 Oct 2010 - 04:51 |
Perl tool | 25 | 1.53 MB | 25 Oct 2010 - 20:44 |
NG 2.x (Exalead) | 0+22 | 682 Bytes | 31 Oct 2010 - 06:38 |
larbin | 8+6 | 105.09 KB | 31 Oct 2010 - 16:19 |
Google AdSense | 7+1 | 5.27 MB | 23 Oct 2010 - 21:37 |
GigaBot | 4+4 | 28.40 KB | 19 Oct 2010 - 02:54 |
Powermarks | 5 | 76.36 KB | 19 Oct 2010 - 16:49 |
Findlinks | 0+5 | 155 Bytes | 27 Oct 2010 - 23:04 |
StackRambler | 2+3 | 17.79 KB | 18 Oct 2010 - 15:08 |
MSIECrawler | 3+2 | 44.65 KB | 24 Oct 2010 - 02:03 |
legs | 2+2 | 11.91 KB | 19 Oct 2010 - 17:46 |
Netcraft | 4 | 28.28 KB | 08 Oct 2010 - 01:24 |
WebCollage | 3 | 53.52 KB | 29 Oct 2010 - 15:46 |
Custo | 2 | 3.17 MB | 14 Oct 2010 - 21:50 |
OutfoxBot/YodaoBot | 1+1 | 258.88 KB | 04 Oct 2010 - 04:59 |
Web Core / Roots | 2 | 1.06 MB | 22 Oct 2010 - 14:02 |
W3C Link Checker | 1+1 | 31 Bytes | 14 Oct 2010 - 05:32 |
BBot | 2 | 6.52 MB | 29 Oct 2010 - 01:03 |
QihooBot | 2 | 15.29 KB | 01 Oct 2010 - 18:41 |
UCSD Crawl | 1 | 7.86 MB | 27 Oct 2010 - 15:33 |
Unknown robot (identified by 'scanner') | 1 | 17.00 KB | 04 Oct 2010 - 05:47 |
W3C Validator | 1 | 7.07 KB | 25 Oct 2010 - 09:06 |
Heritrix | 1 | 15.65 KB | 28 Oct 2010 - 20:03 |
FavIconizer | 1 | 7.07 KB | 15 Oct 2010 - 14:53 |
Unknown robot (identified by 'checker') | 1 | 35.73 KB | 07 Oct 2010 - 19:47 |