83 different robots | Hits | Bandwidth | Last visit |
Googlebot | 142384+286 | 59.88 GB | 28 Feb 2006 - 23:59 |
Unknown robot (identified by 'crawl') | 12582+533 | 7.23 GB | 28 Feb 2006 - 23:58 |
Yahoo Slurp | 15681+1626 | 15.52 GB | 28 Feb 2006 - 23:58 |
ZyBorg | 5+7 | 223.41 KB | 28 Feb 2006 - 23:45 |
MSNBot | 12589+607 | 22.24 GB | 28 Feb 2006 - 23:39 |
Java (Often spam bot) | 138+8 | 18.96 MB | 28 Feb 2006 - 23:23 |
NutchCVS | 28+51 | 2.22 MB | 28 Feb 2006 - 21:59 |
Findlinks | 39+15 | 185.74 KB | 28 Feb 2006 - 21:49 |
Exabot | 152+24 | 1004.51 KB | 28 Feb 2006 - 21:22 |
Unknown robot (identified by empty user agent string) | 356+27 | 114.58 MB | 28 Feb 2006 - 20:48 |
CFNetwork | 19 | 251.33 MB | 28 Feb 2006 - 20:26 |
BecomeBot | 1809+120 | 17.49 MB | 28 Feb 2006 - 20:21 |
Python-urllib | 19 | 11.56 MB | 28 Feb 2006 - 19:09 |
Fast-Webcrawler | 48 | 12.48 MB | 28 Feb 2006 - 19:05 |
Ask | 5912+58 | 79.22 MB | 28 Feb 2006 - 16:31 |
IRLbot | 14+11 | 434.09 KB | 28 Feb 2006 - 14:03 |
Unknown robot (identified by hit on 'robots.txt') | 0+165 | 11.60 KB | 28 Feb 2006 - 13:28 |
Yahoo-MMCrawler | 8+19 | 17.70 KB | 28 Feb 2006 - 11:53 |
yoogliFetchAgent | 1 | 10.24 KB | 28 Feb 2006 - 11:11 |
Combine System | 67+63 | 429.38 KB | 28 Feb 2006 - 10:42 |
BaiDuSpider | 56+9 | 9.84 MB | 28 Feb 2006 - 07:21 |
Unknown robot (identified by 'checker') | 7 | 286.27 KB | 28 Feb 2006 - 07:06 |
ConveraCrawler | 1671+10 | 4.49 GB | 28 Feb 2006 - 06:54 |
psbot | 205+69 | 5.09 MB | 28 Feb 2006 - 05:46 |
Shim-Crawler | 3+3 | 633 Bytes | 28 Feb 2006 - 05:33 |
Unknown robot (identified by 'bot*') | 264+68 | 15.66 MB | 28 Feb 2006 - 04:21 |
Harvest | 145+1 | 38.89 MB | 28 Feb 2006 - 03:19 |
HTMLParser | 15 | 67.74 MB | 28 Feb 2006 - 01:32 |
Ingrid | 1+1 | 15.72 KB | 28 Feb 2006 - 00:20 |
Nutch | 4761+21 | 41.10 MB | 27 Feb 2006 - 21:21 |
IBM Almaden Research Center WebFountain™ | 30+19 | 2.51 MB | 27 Feb 2006 - 16:05 |
Sina Iask Spider | 13 | 1.33 MB | 27 Feb 2006 - 12:53 |
larbin | 17+14 | 197.03 KB | 27 Feb 2006 - 11:49 |
GigaBot | 57+44 | 15.49 MB | 27 Feb 2006 - 07:18 |
Argus | 12+6 | 889.09 KB | 27 Feb 2006 - 04:27 |
Girafabot | 12+8 | 1.95 MB | 27 Feb 2006 - 03:40 |
Voila | 12+15 | 149.06 KB | 27 Feb 2006 - 03:12 |
Powermarks | 5 | 0 | 27 Feb 2006 - 03:09 |
nicebot | 39 | 384.93 KB | 27 Feb 2006 - 02:32 |
Google AdSense | 5+1 | 42.41 KB | 27 Feb 2006 - 02:00 |
Scooter | 0+6 | 432 Bytes | 26 Feb 2006 - 23:02 |
Voyager | 361+6 | 3.62 MB | 26 Feb 2006 - 19:44 |
Unknown robot (identified by 'robot') | 506+1 | 321.76 MB | 26 Feb 2006 - 19:10 |
Alexa (IA Archiver) | 344+30 | 77.41 MB | 26 Feb 2006 - 18:06 |
Unknown robot (identified by 'spider') | 10+10 | 197.90 KB | 26 Feb 2006 - 12:03 |
Scumbot | 1+1 | 211 Bytes | 26 Feb 2006 - 08:04 |
Turn It In | 201+2 | 1.12 GB | 26 Feb 2006 - 03:33 |
Walhello appie | 28+8 | 243.67 KB | 25 Feb 2006 - 19:43 |
ichiro | 97+13 | 759.01 KB | 25 Feb 2006 - 18:47 |
Unknown robot (identified by 'discovery') | 65 | 0 | 25 Feb 2006 - 12:51 |
BlogSearch | 11 | 681.14 KB | 25 Feb 2006 - 10:39 |
Perl tool | 89+1 | 18.68 MB | 24 Feb 2006 - 22:02 |
Gaisbot | 16+13 | 1.96 MB | 24 Feb 2006 - 08:11 |
WGet tools | 9+2 | 30.67 MB | 24 Feb 2006 - 03:07 |
Custo | 16 | 8.14 MB | 22 Feb 2006 - 23:26 |
Openfind data gatherer | 2+2 | 6.28 KB | 22 Feb 2006 - 23:19 |
MSIECrawler | 9+3 | 5.11 MB | 22 Feb 2006 - 22:02 |
HTTrack off-line browser | 4 | 139 Bytes | 22 Feb 2006 - 02:33 |
aipbot | 57+3 | 509.42 KB | 21 Feb 2006 - 06:39 |
ConveraMultiMediaCrawler | 1+1 | 72 Bytes | 20 Feb 2006 - 23:10 |
InfoSeek Robot 1.0 | 1+1 | 9.64 KB | 19 Feb 2006 - 13:27 |
Cursor | 1 | 1.17 MB | 19 Feb 2006 - 09:59 |
ObjectsSearch | 3+3 | 97.56 KB | 16 Feb 2006 - 19:29 |
Sogou Spider | 11 | 2.54 MB | 16 Feb 2006 - 11:18 |
Spiderman | 4 | 13.16 KB | 15 Feb 2006 - 17:35 |
Jakarta commons-httpclient | 93 | 102.09 MB | 14 Feb 2006 - 23:46 |
Vagabondo | 1+1 | 211 Bytes | 14 Feb 2006 - 16:54 |
UCSD Crawl | 5 | 3.01 MB | 14 Feb 2006 - 08:46 |
lwp-trivial | 2 | 278 Bytes | 14 Feb 2006 - 04:47 |
MJ12bot | 19+3 | 1003.24 KB | 12 Feb 2006 - 10:27 |
BBot | 5 | 73.01 KB | 11 Feb 2006 - 20:23 |
MSRBOT | 1+1 | 7.65 KB | 10 Feb 2006 - 13:12 |
HooWWWer | 1+1 | 211 Bytes | 09 Feb 2006 - 10:03 |
Hylanda | 3+1 | 663.06 KB | 08 Feb 2006 - 03:26 |
UdmSearch | 273 | 114.11 KB | 07 Feb 2006 - 15:53 |
Geniebot | 1+1 | 8.48 KB | 07 Feb 2006 - 08:09 |
Web Core / Roots | 1+1 | 211 Bytes | 05 Feb 2006 - 18:08 |
RufusBot Rufus Web Miner | 5+1 | 43.83 KB | 03 Feb 2006 - 10:18 |
Netcraft | 2 | 0 | 03 Feb 2006 - 03:54 |
archive.org bot | 3+1 | 46.20 KB | 02 Feb 2006 - 19:44 |
Cfetch | 1 | 0 | 02 Feb 2006 - 08:06 |
Others | 0 | 767 Bytes | |