75 different robots | Hits | Bandwidth | Last visit |
Googlebot | 53045+83 | 59.85 GB | 28 Feb 2007 - 23:58 |
Yahoo Slurp | 35687+3498 | 19.12 GB | 28 Feb 2007 - 23:59 |
Unknown robot (identified by 'crawl') | 29569+721 | 20.92 GB | 28 Feb 2007 - 23:55 |
MSNBot | 21722+1675 | 39.08 GB | 28 Feb 2007 - 23:53 |
Ask | 16978+157 | 18.28 GB | 28 Feb 2007 - 22:05 |
Unknown robot (identified by empty user agent string) | 1207+7418 | 285.38 MB | 28 Feb 2007 - 22:47 |
MSNBot-media | 5234+147 | 497.53 MB | 28 Feb 2007 - 23:18 |
WGet tools | 4319+1 | 6.46 GB | 28 Feb 2007 - 07:21 |
Alexa (IA Archiver) | 4049+25 | 8.00 GB | 28 Feb 2007 - 02:52 |
BecomeBot | 2589+183 | 31.41 MB | 28 Feb 2007 - 23:59 |
Nutch | 2404+69 | 45.78 MB | 28 Feb 2007 - 23:54 |
noxtrumbot | 1877+2 | 19.25 MB | 28 Feb 2007 - 23:59 |
Accoona-AI-Agent | 1827+4 | 62.74 MB | 12 Feb 2007 - 10:57 |
INFOMINE VLCrawler | 1822+2 | 15.69 MB | 28 Feb 2007 - 00:53 |
RoboCrawl Spider | 1813+2 | 7.42 MB | 24 Feb 2007 - 10:59 |
Unknown robot (identified by 'bot*') | 914+151 | 104.13 MB | 28 Feb 2007 - 23:20 |
ConveraCrawler | 695+5 | 1.06 GB | 24 Feb 2007 - 16:33 |
ichiro | 477+4 | 6.11 MB | 28 Feb 2007 - 09:03 |
Voyager | 305+13 | 3.61 MB | 14 Feb 2007 - 16:47 |
Harvest | 303 | 98.14 MB | 27 Feb 2007 - 22:45 |
Unknown robot (identified by hit on 'robots.txt') | 0+271 | 18.98 KB | 28 Feb 2007 - 21:07 |
Geniebot | 248+9 | 2.00 MB | 19 Feb 2007 - 21:14 |
Exabot | 199+31 | 2.48 MB | 28 Feb 2007 - 22:43 |
Sogou Spider | 181+46 | 49.50 MB | 28 Feb 2007 - 15:44 |
Voila | 90+104 | 27.63 MB | 28 Feb 2007 - 21:02 |
Perl tool | 187+1 | 27.34 MB | 28 Feb 2007 - 19:33 |
Jakarta commons-httpclient | 135 | 1.37 MB | 28 Feb 2007 - 14:56 |
Sina Iask Spider | 97 | 5.64 MB | 28 Feb 2007 - 18:16 |
Shim-Crawler | 51+2 | 463.09 KB | 17 Feb 2007 - 11:30 |
arianna.libero.it | 49 | 6.65 KB | 09 Feb 2007 - 23:10 |
CFNetwork | 43 | 544.29 MB | 27 Feb 2007 - 21:43 |
BaiDuSpider | 42+1 | 7.99 KB | 27 Feb 2007 - 09:11 |
Java (Often spam bot) | 35+5 | 15.43 MB | 28 Feb 2007 - 14:24 |
Krugle | 20+12 | 12.66 MB | 18 Feb 2007 - 20:45 |
OutfoxBot/YodaoBot | 21+10 | 9.15 MB | 28 Feb 2007 - 17:00 |
Heritrix | 23+8 | 26.72 MB | 22 Feb 2007 - 10:16 |
Unknown robot (identified by 'spider') | 22+8 | 6.89 MB | 27 Feb 2007 - 17:55 |
WebCollage | 28 | 268.79 KB | 21 Feb 2007 - 01:39 |
The web archive (IA Archiver) | 1+23 | 42.96 KB | 25 Feb 2007 - 02:19 |
YahooSeeker Yahoo! Blog crawler | 13+7 | 7.50 MB | 28 Feb 2007 - 05:20 |
Yahoo-MMCrawler | 12+8 | 576 Bytes | 24 Feb 2007 - 13:21 |
MSIECrawler | 11+9 | 37.61 KB | 27 Feb 2007 - 00:25 |
Findlinks | 4+11 | 44.12 KB | 28 Feb 2007 - 02:28 |
MJ12bot | 8+7 | 5.69 MB | 18 Feb 2007 - 00:54 |
Custo | 11 | 8.66 MB | 22 Feb 2007 - 02:57 |
Unknown robot (identified by 'discovery') | 11 | 0 | 27 Feb 2007 - 08:12 |
BBot | 10 | 43.44 MB | 27 Feb 2007 - 11:48 |
Holmes | 1+8 | 7.77 KB | 28 Feb 2007 - 22:10 |
lwp-trivial | 8 | 37.52 KB | 26 Feb 2007 - 15:31 |
Unknown robot (identified by 'robot') | 6+2 | 38.09 KB | 22 Feb 2007 - 19:02 |
Combine System | 3+4 | 51.26 KB | 28 Feb 2007 - 02:50 |
Girafabot | 0+7 | 504 Bytes | 12 Feb 2007 - 19:18 |
psbot | 3+3 | 9.67 KB | 28 Feb 2007 - 23:34 |
EasyDL | 6 | 132.74 KB | 15 Feb 2007 - 11:09 |
Google AdSense | 6 | 69.13 KB | 22 Feb 2007 - 04:16 |
GigaBot | 3+2 | 235.71 KB | 10 Feb 2007 - 09:10 |
The World Wide Web Worm | 5 | 15.77 KB | 23 Feb 2007 - 13:18 |
UCSD Crawl | 4 | 27.68 KB | 20 Feb 2007 - 13:16 |
WebFilter | 0+3 | 216 Bytes | 24 Feb 2007 - 19:54 |
Unknown robot (identified by 'checker') | 3 | 0 | 22 Feb 2007 - 18:50 |
NutchCVS | 2+1 | 18.67 KB | 24 Feb 2007 - 05:58 |
TailRank | 2 | 0 | 28 Feb 2007 - 07:22 |
Web Core / Roots | 1+1 | 211 Bytes | 18 Feb 2007 - 13:08 |
nicebot | 2 | 18.16 KB | 26 Feb 2007 - 20:01 |
Python-urllib | 2 | 635.92 KB | 26 Feb 2007 - 03:56 |
QihooBot | 2 | 9.98 KB | 18 Feb 2007 - 18:01 |
Fish search | 2 | 480.11 KB | 24 Feb 2007 - 18:12 |
Checkbot | 0+2 | 144 Bytes | 23 Feb 2007 - 10:58 |
Gaisbot | 1+1 | 846.93 KB | 12 Feb 2007 - 19:45 |
larbin | 1+1 | 211 Bytes | 15 Feb 2007 - 11:24 |
SuperBot | 1 | 139 Bytes | 17 Feb 2007 - 07:54 |
yacy | 1 | 12.01 KB | 17 Feb 2007 - 22:32 |
Powermarks | 1 | 0 | 26 Feb 2007 - 06:52 |
HTMLParser | 1 | 9.39 KB | 24 Feb 2007 - 16:29 |
Scooter | 0+1 | 72 Bytes | 07 Feb 2007 - 04:35 |