67 different robots | Hits | Bandwidth | Last visit |
Googlebot | 58869+217 | 20.53 GB | 31 Jan 2005 - 23:59 |
Grub.org | 498+5 | 3.37 MB | 31 Jan 2005 - 23:57 |
Ask | 14651+153 | 8.87 GB | 31 Jan 2005 - 23:56 |
Yahoo Slurp | 9407+1454 | 9.18 GB | 31 Jan 2005 - 23:51 |
ZyBorg | 858+16 | 8.87 MB | 31 Jan 2005 - 23:46 |
MSNBot | 4955+308 | 8.77 GB | 31 Jan 2005 - 22:56 |
BaiDuSpider | 4981+8 | 59.52 MB | 31 Jan 2005 - 21:38 |
Unknown robot (identified by 'crawl') | 23674+424 | 44.80 GB | 31 Jan 2005 - 21:27 |
sohu-search | 813+4 | 3.66 MB | 31 Jan 2005 - 19:45 |
Unknown robot (identified by empty user agent string) | 3352+6 | 84.20 MB | 31 Jan 2005 - 19:21 |
Java (Often spam bot) | 25+1 | 11.79 MB | 31 Jan 2005 - 18:58 |
Findlinks | 9 | 53.64 KB | 31 Jan 2005 - 17:04 |
The web archive (IA Archiver) | 0+5 | 360 Bytes | 31 Jan 2005 - 16:03 |
psbot | 14+12 | 109.11 KB | 31 Jan 2005 - 14:25 |
Fish search | 17 | 313.32 KB | 31 Jan 2005 - 13:49 |
Harvest | 218 | 7.49 MB | 31 Jan 2005 - 13:37 |
Perl tool | 80 | 11.78 MB | 31 Jan 2005 - 10:13 |
Unknown robot (identified by hit on 'robots.txt') | 0+36 | 2.53 KB | 31 Jan 2005 - 07:55 |
Unknown robot (identified by 'bot*') | 296+128 | 5.63 MB | 31 Jan 2005 - 05:10 |
IRLbot | 23+23 | 261.36 KB | 31 Jan 2005 - 01:59 |
Powermarks | 4 | 0 | 31 Jan 2005 - 01:21 |
NutchCVS | 13+13 | 2.68 KB | 30 Jan 2005 - 22:03 |
Alexa (IA Archiver) | 2426+50 | 22.09 MB | 30 Jan 2005 - 21:57 |
MSIECrawler | 10+2 | 873.58 KB | 30 Jan 2005 - 21:13 |
GigaBot | 7+6 | 695.21 KB | 30 Jan 2005 - 12:14 |
Yahoo-MMCrawler | 6+28 | 1.97 KB | 30 Jan 2005 - 09:21 |
Unknown robot (identified by 'spider') | 3+3 | 633 Bytes | 29 Jan 2005 - 13:22 |
INFOMINE VLCrawler | 14+8 | 448.57 KB | 29 Jan 2005 - 12:17 |
YahooSeeker Yahoo! Blog crawler | 844+27 | 33.91 MB | 29 Jan 2005 - 07:18 |
updated | 1+1 | 211 Bytes | 29 Jan 2005 - 05:07 |
Voila | 14+17 | 10.81 MB | 28 Jan 2005 - 23:42 |
Custo | 66 | 42.00 MB | 28 Jan 2005 - 17:58 |
Ingrid | 1 | 139 Bytes | 28 Jan 2005 - 11:23 |
Vagabondo | 0+1 | 72 Bytes | 28 Jan 2005 - 11:23 |
lwp-trivial | 2 | 3.13 KB | 27 Jan 2005 - 16:39 |
Unknown robot (identified by 'robot') | 7 | 203.85 KB | 27 Jan 2005 - 16:19 |
Walhello appie | 45+21 | 416.92 KB | 27 Jan 2005 - 16:12 |
WGet tools | 42 | 23.78 MB | 27 Jan 2005 - 15:52 |
Holmes | 0+15 | 1.05 KB | 27 Jan 2005 - 13:23 |
Jakarta commons-httpclient | 3 | 142.08 KB | 27 Jan 2005 - 05:41 |
Unknown robot (identified by 'checker') | 25 | 6.12 MB | 27 Jan 2005 - 05:35 |
NPBot | 31+31 | 12.95 MB | 26 Jan 2005 - 00:40 |
Google AdSense | 10+1 | 16.70 MB | 25 Jan 2005 - 23:24 |
BecomeBot | 17+20 | 661.96 KB | 25 Jan 2005 - 20:12 |
IBM Almaden Research Center WebFountain™ | 24+13 | 5.89 MB | 25 Jan 2005 - 16:54 |
ichiro | 89+6 | 724.68 KB | 25 Jan 2005 - 12:58 |
Yahoo Vertical Crawler | 3+2 | 18.97 KB | 25 Jan 2005 - 09:02 |
HTTrack off-line browser | 3+1 | 438.98 KB | 24 Jan 2005 - 18:00 |
MJ12bot | 10+6 | 908.19 KB | 23 Jan 2005 - 11:13 |
Nutch | 4+2 | 14.74 KB | 23 Jan 2005 - 05:48 |
ConveraCrawler | 870+9 | 8.51 MB | 23 Jan 2005 - 05:41 |
Cursor | 1 | 8.03 KB | 22 Jan 2005 - 23:25 |
Python-urllib | 20 | 88.49 MB | 21 Jan 2005 - 10:08 |
Spiderman | 2 | 10.84 KB | 20 Jan 2005 - 08:02 |
Fast-Webcrawler | 5+9 | 1.69 MB | 18 Jan 2005 - 14:04 |
Mirago | 0+1 | 72 Bytes | 17 Jan 2005 - 20:43 |
Openfind data gatherer | 2+2 | 4.45 KB | 14 Jan 2005 - 22:05 |
Girafabot | 4+1 | 444.48 KB | 13 Jan 2005 - 15:28 |
Unknown robot (identified by 'discovery') | 6 | 0 | 11 Jan 2005 - 13:47 |
IlTrovatore-Setaccio | 1+1 | 211 Bytes | 11 Jan 2005 - 11:17 |
Ultraseek | 3+2 | 1.23 MB | 10 Jan 2005 - 14:54 |
Ocelli | 952+2 | 942.36 MB | 09 Jan 2005 - 05:02 |
Heritrix | 1+1 | 11.66 KB | 09 Jan 2005 - 02:43 |
Fluid Dynamics Search Engine robot | 2 | 232.11 KB | 08 Jan 2005 - 08:14 |
Gaisbot | 2 | 3.07 MB | 05 Jan 2005 - 00:05 |
Others | 0 | 0 | |