77 different robots | Hits | Bandwidth | Last visit |
Googlebot | 65853+243 | 31.56 GB | 30 Apr 2005 - 23:50 |
Unknown robot (identified by 'crawl') | 60805+1671 | 294.80 GB | 30 Apr 2005 - 23:17 |
Yahoo Slurp | 9935+1264 | 7.47 GB | 30 Apr 2005 - 23:49 |
INFOMINE VLCrawler | 9334+18 | 10.41 GB | 26 Apr 2005 - 06:38 |
MSNBot | 5387+377 | 10.60 GB | 30 Apr 2005 - 23:36 |
BaiDuSpider | 5037+4 | 56.13 MB | 30 Apr 2005 - 15:24 |
Ask | 4282+83 | 80.46 MB | 30 Apr 2005 - 21:41 |
ZyBorg | 2852+12 | 24.41 MB | 30 Apr 2005 - 23:47 |
Unknown robot (identified by '*bot') | 1739+1 | 14.95 MB | 07 Apr 2005 - 23:39 |
UdmSearch | 1707 | 15.43 MB | 01 Apr 2005 - 15:53 |
Java (Often spam bot) | 1030+6 | 118.47 MB | 30 Apr 2005 - 20:25 |
aipbot | 941+38 | 6.15 MB | 30 Apr 2005 - 23:56 |
Grub.org | 510+5 | 4.35 MB | 30 Apr 2005 - 19:35 |
Unknown robot (identified by empty user agent string) | 405+51 | 58.67 MB | 30 Apr 2005 - 20:11 |
YahooSeeker Yahoo! Blog crawler | 390+27 | 1.55 MB | 30 Apr 2005 - 16:36 |
Nutch | 392+2 | 3.41 MB | 22 Apr 2005 - 16:42 |
Turn It In | 381+2 | 1.92 GB | 14 Apr 2005 - 16:28 |
IRLbot | 239+71 | 328.93 KB | 30 Apr 2005 - 02:27 |
Harvest | 298 | 22.55 MB | 30 Apr 2005 - 20:25 |
Unknown robot (identified by 'bot*') | 196+5 | 1.63 MB | 29 Apr 2005 - 03:51 |
NG 2.x (Exalead) | 174+5 | 1.90 MB | 25 Apr 2005 - 07:48 |
Perl tool | 169 | 7.37 MB | 29 Apr 2005 - 15:17 |
Alexa (IA Archiver) | 111+46 | 84.80 MB | 30 Apr 2005 - 16:11 |
GigaBot | 41+41 | 15.44 MB | 28 Apr 2005 - 15:27 |
Custo | 52 | 29.12 MB | 27 Apr 2005 - 21:38 |
lwp-trivial | 51 | 530.51 KB | 27 Apr 2005 - 11:01 |
IBM Almaden Research Center WebFountain™ | 31+9 | 4.30 MB | 29 Apr 2005 - 23:54 |
Exabot | 36 | 110.84 MB | 21 Apr 2005 - 05:02 |
Unknown robot (identified by hit on 'robots.txt') | 0+35 | 2.46 KB | 29 Apr 2005 - 06:17 |
Cursor | 34 | 3.25 MB | 26 Apr 2005 - 13:19 |
Google AdSense | 25+9 | 46.77 MB | 25 Apr 2005 - 02:31 |
Speedy Spider | 22+11 | 9.30 KB | 29 Apr 2005 - 17:02 |
NutchCVS | 18+14 | 76.64 KB | 29 Apr 2005 - 06:43 |
Voila | 14+17 | 2.39 MB | 29 Apr 2005 - 23:20 |
BecomeBot | 21+9 | 1010.31 KB | 29 Apr 2005 - 03:27 |
Unknown robot (identified by 'robot') | 24+3 | 927.79 KB | 26 Apr 2005 - 21:22 |
psbot | 15+8 | 129.53 KB | 26 Apr 2005 - 13:16 |
WGet tools | 16+4 | 64.79 MB | 28 Apr 2005 - 20:30 |
Jakarta commons-httpclient | 20 | 6.17 MB | 29 Apr 2005 - 19:46 |
Unknown robot (identified by 'spider') | 8+10 | 16.68 KB | 29 Apr 2005 - 19:07 |
Scooter | 0+17 | 1.20 KB | 30 Apr 2005 - 07:36 |
Cfetch | 16 | 132.71 KB | 04 Apr 2005 - 01:13 |
Girafabot | 8+4 | 958.60 KB | 10 Apr 2005 - 21:12 |
KnowItAll | 7+5 | 70.48 KB | 30 Apr 2005 - 23:21 |
larbin | 7+5 | 43.31 KB | 16 Apr 2005 - 17:04 |
Unknown robot (identified by 'discovery') | 10 | 0 | 18 Apr 2005 - 04:58 |
Fish search | 10 | 105.15 KB | 27 Apr 2005 - 08:53 |
Combine System | 6+4 | 64.10 KB | 28 Apr 2005 - 19:30 |
Unknown robot (identified by 'checker') | 9 | 150.59 KB | 28 Apr 2005 - 07:00 |
Walhello appie | 4+4 | 1.91 MB | 23 Apr 2005 - 14:40 |
MSIECrawler | 6+1 | 34.51 KB | 30 Apr 2005 - 02:01 |
Pioneer | 6 | 26.16 KB | 20 Apr 2005 - 08:18 |
HTTrack off-line browser | 5+1 | 1.75 MB | 29 Apr 2005 - 10:51 |
HTMLParser | 5 | 53.14 KB | 06 Apr 2005 - 19:05 |
VSE | 2+2 | 462.49 KB | 26 Apr 2005 - 04:57 |
Findlinks | 0+4 | 288 Bytes | 29 Apr 2005 - 12:50 |
Spiderman | 4 | 16.40 KB | 30 Apr 2005 - 18:34 |
Openfind data gatherer | 2+2 | 31.68 KB | 24 Apr 2005 - 04:38 |
Powermarks | 4 | 0 | 26 Apr 2005 - 02:30 |
EasyDL | 4 | 27.21 KB | 16 Apr 2005 - 01:59 |
Steeler | 1+3 | 355 Bytes | 20 Apr 2005 - 17:44 |
Holmes | 0+3 | 216 Bytes | 03 Apr 2005 - 19:34 |
Unknown robot (identified by 'hunter') | 3 | 34.49 KB | 14 Apr 2005 - 07:56 |
MojeekBot | 2+1 | 7.37 KB | 29 Apr 2005 - 07:50 |
IlTrovatore-Setaccio | 1+1 | 211 Bytes | 29 Apr 2005 - 17:06 |
CFNetwork | 2 | 20.37 MB | 30 Apr 2005 - 22:35 |
sohu-search | 2 | 176.11 KB | 20 Apr 2005 - 18:59 |
webcrawl.net | 1+1 | 10.62 KB | 28 Apr 2005 - 04:47 |
Gaisbot | 1+1 | 211 Bytes | 11 Apr 2005 - 03:23 |
mnoGoSearch search engine software | 1+1 | 211 Bytes | 03 Apr 2005 - 09:26 |
Argus | 1+1 | 211 Bytes | 16 Apr 2005 - 22:27 |
PostFavorites | 2 | 6.07 KB | 28 Apr 2005 - 20:52 |
RoadHouse Crawling System | 1 | 139 Bytes | 08 Apr 2005 - 22:41 |
Python-urllib | 1 | 1.45 MB | 21 Apr 2005 - 21:47 |
Netcraft | 1 | 0 | 08 Apr 2005 - 03:48 |
UCSD Crawl | 1 | 3.76 MB | 14 Apr 2005 - 14:44 |
RuLeS | 1 | 159.10 KB | 18 Apr 2005 - 10:42 |
Others | 0 | 1 Bytes | |