70 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 447954+1236 | 65.45 GB | 28 Feb 2009 - 23:59 |
Yahoo Slurp | 34666+497 | 47.78 GB | 28 Feb 2009 - 23:59 |
BaiDuSpider | 2244+21 | 93.74 MB | 28 Feb 2009 - 23:58 |
twiceler | 923+27 | 22.02 MB | 28 Feb 2009 - 23:57 |
MSNBot-media | 2047+128 | 44.41 MB | 28 Feb 2009 - 23:55 |
Ask | 5352+144 | 5.25 GB | 28 Feb 2009 - 23:53 |
Googlebot | 36144+84 | 73.90 GB | 28 Feb 2009 - 23:53 |
MSNBot | 15517+831 | 29.93 GB | 28 Feb 2009 - 23:50 |
Sogou Spider | 606 | 40.71 MB | 28 Feb 2009 - 23:47 |
Voila | 562+30 | 229.77 MB | 28 Feb 2009 - 23:40 |
Ocelli | 130+4 | 13.11 MB | 28 Feb 2009 - 23:33 |
Unknown robot (identified by empty user agent string) | 624+309 | 553.35 MB | 28 Feb 2009 - 23:07 |
Unknown robot (identified by hit on 'robots.txt') | 0+1554 | 198.80 KB | 28 Feb 2009 - 21:46 |
BSpider | 1+25 | 5.56 MB | 28 Feb 2009 - 21:16 |
Java (Often spam bot) | 181+13 | 57.21 MB | 28 Feb 2009 - 20:33 |
Unknown robot (identified by 'spider') | 102+47 | 5.62 MB | 28 Feb 2009 - 20:27 |
Nutch | 5578+79 | 851.30 MB | 28 Feb 2009 - 20:07 |
WGet tools | 10417+5 | 159.88 MB | 28 Feb 2009 - 19:50 |
yacy | 56+7 | 1.52 MB | 28 Feb 2009 - 19:20 |
T-H-U-N-D-E-R-S-T-O-N-E | 4 | 29.83 KB | 28 Feb 2009 - 18:52 |
Grub.org | 4+3 | 38.37 KB | 28 Feb 2009 - 18:43 |
Feedfetcher-Google | 4 | 8.94 MB | 28 Feb 2009 - 18:00 |
Alexa (IA Archiver) | 259+50 | 90.43 MB | 28 Feb 2009 - 17:35 |
HTTrack off-line browser | 4056 | 10.18 GB | 28 Feb 2009 - 16:32 |
FaceBook bot | 3 | 36.17 KB | 28 Feb 2009 - 15:59 |
Unknown robot (identified by 'robot') | 247+47 | 238.67 MB | 28 Feb 2009 - 14:20 |
NG 2.x (Exalead) | 0+21 | 2.69 KB | 28 Feb 2009 - 12:30 |
Harvest | 633 | 224.79 MB | 28 Feb 2009 - 11:13 |
Custo | 160+56 | 81.21 MB | 28 Feb 2009 - 09:31 |
CFNetwork | 209 | 2.09 GB | 28 Feb 2009 - 08:21 |
Exabot | 395+31 | 88.33 MB | 28 Feb 2009 - 04:50 |
Walhello appie | 3+3 | 810 Bytes | 28 Feb 2009 - 02:36 |
Turn It In | 772+9 | 753.94 MB | 28 Feb 2009 - 02:24 |
larbin | 4+6 | 17.40 KB | 28 Feb 2009 - 02:21 |
MSIECrawler | 8+1 | 1.09 MB | 27 Feb 2009 - 19:43 |
BBot | 27+2 | 49.91 MB | 27 Feb 2009 - 15:09 |
Heritrix | 9+4 | 384.96 KB | 27 Feb 2009 - 13:38 |
psbot | 15+8 | 117.65 MB | 27 Feb 2009 - 12:56 |
WordPress | 10 | 176.73 KB | 27 Feb 2009 - 12:03 |
Unknown robot (identified by 'bot*') | 165+23 | 60.14 MB | 27 Feb 2009 - 09:01 |
Checkbot | 9 | 0 | 27 Feb 2009 - 08:17 |
Unknown robot (identified by 'discovery') | 127 | 0 | 27 Feb 2009 - 02:58 |
Jakarta commons-httpclient | 54+10 | 30.39 MB | 26 Feb 2009 - 23:54 |
Mail.ru bot | 1+1 | 270 Bytes | 26 Feb 2009 - 23:08 |
The web archive (IA Archiver) | 0+26 | 3.33 KB | 26 Feb 2009 - 12:55 |
Perl tool | 152+1 | 305.08 MB | 26 Feb 2009 - 12:35 |
Web Core / Roots | 3 | 25.38 KB | 26 Feb 2009 - 11:02 |
Voyager | 664+10 | 7.36 MB | 26 Feb 2009 - 09:27 |
Speedy Spider | 33+31 | 15.40 MB | 25 Feb 2009 - 20:20 |
archive.org bot | 1+1 | 705.44 KB | 25 Feb 2009 - 01:57 |
Gaisbot | 15+5 | 1.10 MB | 25 Feb 2009 - 01:24 |
Powermarks | 5 | 595.71 KB | 24 Feb 2009 - 15:38 |
lwp-trivial | 6 | 18.20 MB | 24 Feb 2009 - 13:26 |
Python-urllib | 8+3 | 20.90 KB | 24 Feb 2009 - 11:13 |
Yanga WorldSearch Bot | 27+5 | 3.09 MB | 24 Feb 2009 - 07:24 |
Geniebot | 28+28 | 600.35 KB | 21 Feb 2009 - 15:03 |
GigaBot | 193+29 | 871.93 MB | 21 Feb 2009 - 11:45 |
UCSD Crawl | 5+4 | 5.04 MB | 20 Feb 2009 - 01:11 |
Snappy | 2 | 18.22 KB | 20 Feb 2009 - 01:05 |
Yandex bot | 8+2 | 743.49 KB | 19 Feb 2009 - 20:47 |
YahooSeeker Yahoo! Blog crawler | 0+1 | 131 Bytes | 17 Feb 2009 - 05:19 |
Netcraft | 4 | 816.22 KB | 13 Feb 2009 - 17:29 |
Robozilla | 1 | 139 Bytes | 13 Feb 2009 - 08:00 |
Susie | 1 | 4.24 KB | 12 Feb 2009 - 16:25 |
DoCoMo | 2 | 22.72 KB | 12 Feb 2009 - 11:18 |
Y!J Yahoo Japan | 2 | 25.81 KB | 09 Feb 2009 - 03:12 |
RoadHouse Crawling System | 1 | 9.89 KB | 07 Feb 2009 - 04:44 |
OutfoxBot/YodaoBot | 0+2 | 262 Bytes | 06 Feb 2009 - 20:23 |
WebCollage | 1 | 15.98 KB | 06 Feb 2009 - 16:53 |
EasyDL | 3 | 26.54 KB | 04 Feb 2009 - 18:20 |
Others | 0 | 0 | |