74 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 61810+367 | 49.58 GB | 31 Aug 2007 - 23:59 |
Unknown robot (identified by 'crawl') | 40809+1085 | 51.03 GB | 31 Aug 2007 - 23:55 |
Googlebot | 32247+84 | 11.53 GB | 31 Aug 2007 - 23:59 |
MSNBot | 16461+2442 | 27.28 GB | 31 Aug 2007 - 23:58 |
Heritrix | 10595+23 | 18.62 GB | 31 Aug 2007 - 21:04 |
Ask | 7110+143 | 127.49 MB | 31 Aug 2007 - 23:01 |
MSNBot-media | 6151+117 | 1.66 GB | 30 Aug 2007 - 13:46 |
noxtrumbot | 4815+5 | 50.34 MB | 05 Aug 2007 - 22:39 |
Nutch | 4227+57 | 67.71 MB | 31 Aug 2007 - 17:42 |
Unknown robot (identified by 'bot*') | 2800+86 | 48.16 MB | 31 Aug 2007 - 22:42 |
Ocelli | 2850+6 | 1.45 GB | 22 Aug 2007 - 13:32 |
ConveraCrawler | 2377+6 | 6.27 GB | 29 Aug 2007 - 08:24 |
INFOMINE VLCrawler | 2150+1 | 18.45 MB | 20 Aug 2007 - 01:23 |
twiceler | 1605+51 | 6.13 MB | 31 Aug 2007 - 14:06 |
Unknown robot (identified by empty user agent string) | 1075+317 | 418.30 MB | 31 Aug 2007 - 21:36 |
BecomeBot | 519+197 | 9.15 MB | 31 Aug 2007 - 23:50 |
Speedy Spider | 668+42 | 4.68 GB | 31 Aug 2007 - 10:57 |
GigaBot | 481+112 | 2.41 GB | 30 Aug 2007 - 22:59 |
BaiDuSpider | 538+16 | 12.14 MB | 31 Aug 2007 - 18:28 |
Harvest | 500 | 171.73 MB | 31 Aug 2007 - 16:03 |
Alexa (IA Archiver) | 464+19 | 22.75 MB | 30 Aug 2007 - 22:44 |
Voila | 207+208 | 1.25 MB | 31 Aug 2007 - 21:41 |
Turn It In | 377+2 | 606.87 MB | 12 Aug 2007 - 09:43 |
Python-urllib | 367+9 | 784.63 MB | 31 Aug 2007 - 21:38 |
Unknown robot (identified by 'robot') | 322+38 | 1.67 MB | 31 Aug 2007 - 23:35 |
Unknown robot (identified by hit on 'robots.txt') | 0+283 | 19.90 KB | 31 Aug 2007 - 20:17 |
Perl tool | 189 | 23.70 MB | 30 Aug 2007 - 01:54 |
MJ12bot | 155+5 | 1.46 MB | 23 Aug 2007 - 02:19 |
Sogou Spider | 111+22 | 51.66 MB | 31 Aug 2007 - 21:23 |
OutfoxBot/YodaoBot | 65+32 | 16.98 MB | 31 Aug 2007 - 22:59 |
MSIECrawler | 75+18 | 39.76 MB | 29 Aug 2007 - 01:51 |
Mail.ru bot | 80+2 | 5.13 MB | 10 Aug 2007 - 03:42 |
CFNetwork | 64 | 456.31 MB | 31 Aug 2007 - 11:32 |
Jakarta commons-httpclient | 54+5 | 763.43 KB | 31 Aug 2007 - 12:19 |
Voyager | 52+6 | 1014.33 KB | 31 Aug 2007 - 19:27 |
archive.org bot | 54+4 | 27.94 MB | 24 Aug 2007 - 09:56 |
lanshanbot | 30+26 | 6.55 MB | 17 Aug 2007 - 13:29 |
Exabot | 43+9 | 489.47 KB | 29 Aug 2007 - 08:01 |
WGet tools | 48 | 108.70 MB | 31 Aug 2007 - 22:43 |
Java (Often spam bot) | 41+7 | 21.47 MB | 29 Aug 2007 - 06:04 |
The web archive (IA Archiver) | 1+38 | 44.02 KB | 31 Aug 2007 - 11:10 |
HTMLParser | 28 | 8.80 MB | 19 Aug 2007 - 19:36 |
Yahoo-MMCrawler | 14+12 | 864 Bytes | 31 Aug 2007 - 13:21 |
Unknown robot (identified by 'discovery') | 23 | 0 | 31 Aug 2007 - 12:19 |
NutchCVS | 18+5 | 15.55 MB | 29 Aug 2007 - 05:14 |
Unknown robot (identified by 'spider') | 14+5 | 8.60 MB | 29 Aug 2007 - 12:22 |
Custo | 17 | 4.79 MB | 31 Aug 2007 - 08:18 |
NG 2.x (Exalead) | 8+3 | 197.13 KB | 23 Aug 2007 - 09:11 |
EasyDL | 11 | 1.29 MB | 29 Aug 2007 - 16:04 |
lwp-trivial | 10 | 27.47 KB | 31 Aug 2007 - 00:50 |
Web Core / Roots | 8+1 | 5.11 MB | 15 Aug 2007 - 18:29 |
WordPress | 9 | 3.97 MB | 24 Aug 2007 - 20:32 |
SuperBot | 8 | 43.30 KB | 24 Aug 2007 - 10:11 |
Krugle | 5+3 | 39.48 KB | 28 Aug 2007 - 04:13 |
Combine System | 4+4 | 62.41 KB | 31 Aug 2007 - 09:54 |
larbin | 5+3 | 78.35 KB | 26 Aug 2007 - 00:24 |
Holmes | 2+5 | 1.26 MB | 29 Aug 2007 - 22:14 |
yacy | 5+2 | 39.99 KB | 21 Aug 2007 - 00:04 |
The World Wide Web Worm | 7 | 15.77 KB | 27 Aug 2007 - 17:37 |
Checkbot | 7 | 0 | 30 Aug 2007 - 03:02 |
nicebot | 5 | 40.80 KB | 30 Aug 2007 - 11:23 |
ichiro | 3+2 | 4.65 KB | 04 Aug 2007 - 16:38 |
Girafabot | 0+5 | 360 Bytes | 16 Aug 2007 - 17:10 |
WebCollage | 4 | 1.96 MB | 28 Aug 2007 - 21:22 |
BBot | 4 | 74.70 KB | 11 Aug 2007 - 23:41 |
SlySearch | 3 | 992.93 KB | 11 Aug 2007 - 17:56 |
Internet Shinchakubin | 3 | 704.67 KB | 10 Aug 2007 - 18:47 |
HTTrack off-line browser | 2+1 | 78.98 KB | 24 Aug 2007 - 22:29 |
QihooBot | 3 | 345.52 KB | 28 Aug 2007 - 21:07 |
psbot | 1+1 | 1.13 KB | 28 Aug 2007 - 20:43 |
Robozilla | 1 | 139 Bytes | 08 Aug 2007 - 12:32 |
Unknown robot (identified by '*bot') | 1 | 9.99 KB | 27 Aug 2007 - 18:14 |
Unknown robot (identified by 'hunter') | 1 | 1.13 MB | 21 Aug 2007 - 07:06 |
Google AdSense | 1 | 8.08 KB | 19 Aug 2007 - 10:17 |
Others | 0 | 7 Bytes | |