48 different robots | Hits | Bandwidth | Last visit |
Googlebot | 58007+33 | 62.97 GB | 31 Jan 2010 - 23:59 |
MSNBot | 50809+1343 | 3.32 GB | 31 Jan 2010 - 23:59 |
Python-urllib | 47269 | 20.50 GB | 31 Jan 2010 - 21:21 |
Yahoo Slurp | 46005+69 | 13.93 GB | 31 Jan 2010 - 23:59 |
twiceler | 4423+22 | 4.18 GB | 31 Jan 2010 - 23:48 |
Unknown robot (identified by 'crawl') | 3187+105 | 755.55 MB | 31 Jan 2010 - 21:23 |
Ask | 2331+116 | 1.30 GB | 31 Jan 2010 - 22:51 |
BaiDuSpider | 1713+77 | 119.06 MB | 31 Jan 2010 - 18:34 |
Exabot | 1313+39 | 298.63 MB | 31 Jan 2010 - 23:49 |
Unknown robot (identified by 'spider') | 995+92 | 19.36 MB | 31 Jan 2010 - 16:44 |
Sogou Spider | 603 | 12.78 MB | 21 Jan 2010 - 05:59 |
Unknown robot (identified by empty user agent string) | 551+28 | 352.74 MB | 31 Jan 2010 - 23:38 |
HTMLParser | 480 | 12.25 MB | 15 Jan 2010 - 14:39 |
Unknown robot (identified by 'bot*') | 269+129 | 206.72 MB | 31 Jan 2010 - 23:33 |
Yandex bot | 284+31 | 318.38 MB | 31 Jan 2010 - 14:51 |
WGet tools | 311 | 541.87 MB | 28 Jan 2010 - 01:43 |
Feedfetcher-Google | 220 | 1.58 MB | 31 Jan 2010 - 22:39 |
Unknown robot (identified by hit on 'robots.txt') | 0+197 | 6.24 KB | 31 Jan 2010 - 23:04 |
MSNBot-media | 155+38 | 2.70 MB | 31 Jan 2010 - 17:08 |
Alexa (IA Archiver) | 120+58 | 4.62 MB | 31 Jan 2010 - 17:18 |
Java (Often spam bot) | 173+3 | 8.47 MB | 31 Jan 2010 - 19:00 |
Unknown robot (identified by 'robot') | 101+22 | 1.72 MB | 31 Jan 2010 - 22:24 |
CFNetwork | 33 | 128.88 MB | 29 Jan 2010 - 09:14 |
Voyager | 24+4 | 178.24 KB | 23 Jan 2010 - 10:27 |
WordPress | 24 | 511.92 KB | 23 Jan 2010 - 16:43 |
Nutch | 11+7 | 2.54 MB | 31 Jan 2010 - 03:36 |
FaceBook bot | 12 | 183.97 KB | 15 Jan 2010 - 03:46 |
MJ12bot | 10+2 | 242.22 KB | 27 Jan 2010 - 05:58 |
Custo | 11 | 368.68 KB | 19 Jan 2010 - 22:00 |
yacy | 6+5 | 54.30 KB | 29 Jan 2010 - 23:55 |
Jakarta commons-httpclient | 8 | 2.90 MB | 31 Jan 2010 - 20:13 |
BBot | 6 | 18.74 MB | 25 Jan 2010 - 05:47 |
The web archive (IA Archiver) | 0+5 | 155 Bytes | 29 Jan 2010 - 06:28 |
larbin | 4+1 | 75.78 KB | 01 Jan 2010 - 23:59 |
legs | 2+2 | 2.31 MB | 12 Jan 2010 - 10:26 |
LinkChecker | 2+1 | 6.90 KB | 04 Jan 2010 - 18:20 |
Web Core / Roots | 3 | 0 | 17 Jan 2010 - 11:16 |
WebCollage | 3 | 68.03 KB | 29 Jan 2010 - 19:33 |
Perl tool | 3 | 25.26 KB | 19 Jan 2010 - 01:18 |
Unknown robot (identified by 'discovery') | 2 | 0 | 04 Jan 2010 - 19:51 |
OutfoxBot/YodaoBot | 1+1 | 258.88 KB | 27 Jan 2010 - 19:54 |
W3C Link Checker | 1+1 | 31 Bytes | 04 Jan 2010 - 17:05 |
Findlinks | 1+1 | 6.90 KB | 26 Jan 2010 - 06:35 |
Spiderman | 1+1 | 6.90 KB | 02 Jan 2010 - 13:57 |
Heritrix | 1+1 | 6.90 KB | 15 Jan 2010 - 22:09 |
Fish search | 2 | 34.31 KB | 26 Jan 2010 - 21:06 |
QihooBot | 1 | 31.52 KB | 04 Jan 2010 - 00:54 |
Netcraft | 1 | 6.87 KB | 13 Jan 2010 - 15:32 |