It has long been known that high-frequency sensorineural hearing loss (HFHL) can contribute to difficulty in speech understanding by elderly listeners. This study evaluated the relative contribution of HFHL and age to speech understanding. Subjects included adult middle-aged and old groups with normal hearing or with limited HFHL. The Hearing-in-Noise-Test (HINT) was used to measure speech perception performance in quiet and in noise. The middle-aged groups showed significant effects of HFHL for speech intelligibility in quiet and in noise, but the old groups showed the difference in quiet only due to high frequency hearing. The results suggest that HFHL may affect speech intelligibility differently with age and therefore hearing aid selection needs to take into account the influence of age.