A method for simulation the effect of the reduced frequency resolution of the ear in patients with sensorineural hearing loss
https://doi.org/10.37661/1816-0301-2021-18-3-68-82
Abstract
A method for the simulation of reduced frequency resolution of the ear in patients with sensorineural hearing loss is proposed. The method is based upon the ability to adjust it according to the audiogram of a concrete person by frame-by-frame signal processing in the frequency domain. Simulation of the effect of the reduced frequency resolution of the ear is achieved by processing the components of amplitude spectrum of the original sound signal by the "smearing" function. The "smearing" function is formed from the amplitude-frequency characteristics of the auditory filters, which bandwidth is determined by the audiogram of the deaf person. The proposed method is implemented in the MATLAB. An experimental study of the effect of the reduced frequency resolution of the ear using the speech intelligibility test was conducted. The experiment involved 15 people who listened the records processed by the proposed method with various settings and noise conditions. Experimental data have shown that reduced frequency resolution of the ear leads to the deterioration in speech intelligibility, especially in the presence of background noise. Based on the answers of the participants of the experiment, the confusion tables of sounds were compiled, reflecting the fact of indistinguishability of sounds similar in frequency, that confirms the correctness of the proposed method.
About the Authors
M. I. Porhun
Belarusian State University of Informatics and Radioelectronics
Belarus
Belarus
Maksim I. Porhun - М. Sci. (Eng.), Assistant Lecturer of Computer Engineering Department.
St. Р. Brovki, 6, Minsk, 220013
M. I. Vashkevich
Belarusian State University of Informatics and Radioelectronics
Belarus
Belarus
Maksim I. Vashkevich - Cand. Sci. (Eng.), Associate Professor of Computer Engineering Department.
St. Р. Brovki, 6, Minsk, 220013
References
1. Koroleva I. V. Vvedenie v audiologiyu i slukhoprotezirovanie. Introduction to Audiology and Hearing Care. Saint Petersburg, KARO, 2012, 400 p. (In Russ.).
2. Erber N. Applications of hearing-loss simulation in education of student clinicians. Journal of the Academy of Rehabilitative Audiology, 1995, vol. 28, pp. 37-50.
3. Hu. H., Sang J., Lutman M. E., Bleeck S. Simulation of hearing loss using compressive gammachirp auditory filters. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Prague, Czech Republic, 2011, pp. 5428-5431. https://doi.org/10.1109/ICASSP.2011.5947586
4. Graf I. Simulation of the Effects of Sensorineural Hearing Loss. Cambridge, Massachusetts Institute of Technology, 1997, 112 p.
5. Mourgela A., Agus T., Reiss J. D. Perceptually motivated hearing loss simulation for audio mixing reference. 147th Audio Engineering Society International Convention. New York, 2019.
6. Moore B. Cochlear Hearing Loss: Physiological, Psychological and Technical Issues. 2nd ed., John Wiley & Sons, 2008, 332 p. https://doi.org/10.1002/9780470987889
7. Baer T., Moore B. Effects of spectral smearing on the intelligibility of sentences in noise. The Journal of the Acoustical Society of America, 1993, vol. 94, no. 3, pp. 1229-1241. https://doi.org/10.1121/L408176
8. Goodwin M. The STFT, sinusoidal models, and speech modification. Handbook of Speech Processing, Springer, 2008, pp. 229-258. https://doi.org/10.1007/978-3-540-49127-9_12
9. Jinbo N., Takamichi S., Toda T., Neubig G., Sakti S., Nakamura S. A hearing impairment simulation method using audiogram-based approximation of auditory characteristics. 15th Annual Conference of the International Speech Communication Association (INTERSPEECH). Singapore, 2014, pp. 490-494.
10. Patterson R. D., Nimmo-Smith I., Weber D. L., Milroy R. The deterioration of hearing with age: Frequency selectivity, the critical ratio, the audiogram, and speech threshold. The Journal of the Acoustical Society of America, 1982, vol. 72, no. 6, pp. 1788-1803. https://doi.org/10.1121/L388652
11. Hwang J. H., Nam K. W., Jang D. P., Kim I. Y. Effects of spectral smearing of stimuli on the performance of auditory steady-state response-based brain-computer interface. Cogn Neurodyn, 2017, vol. 11, no. 6, pp. 515-527. https://doi.org/10.1007/s11571-017-9448-y
12. Vonlanthen A., Arndt H. Hearing Instrument Technology for the Hearing Healthcare Professional. Thomson Delmar Learning, 2007, 318 p.
13. Glasberg B., Moore B. Auditory filter shapes in subjects with unilateral and bilateral cochlear impairments. The Journal of the Acoustical Society of America, 1986, vol. 79, no. 4, pp. 1020-1033. https://doi.org/10.1121/1.393374
14. Baer T., Moore B. Effects of spectral smearing on the intelligibility of sentences in the presence of interfering speech. The Journal of the Acoustical Society of America, 1994, vol. 95, pp. 2277-2280. https://doi.org/10.1121/L408640
15. Moore B., Glasberg B. Simulation of the effects of loudness recruitment and threshold elevation on the intelligibility of speech in quiet and in a background of speech. The Journal of the Acoustical Society of America, 1993, vol. 94, no. 4, pp. 2050-2062. https://doi.org/10.1121/1.407478
16. Nejime Y., Moore B. Simulation of the effect of threshold elevation and loudness recruitment combined with reduced frequency selectivity on the intelligibility of speech in noise. The Journal of the Acoustical Society of America, 1997, vol. 102, no. 1, pp. 603-615. https://doi.org/10.1121/L419733
17. Hwang J. H., Nam W. N., Jang P. D., Kim I. Y. Effects of spectral smearing of stimuli on the performance of auditory steady-state response-based brain-computer interface. Cognitive Neurodynamics, 2017, vol. 11, no. 6, pp. 515-527. https://doi.org/10.1007/s11571-017-9448-y
Review
For citations:
Porhun M.I., Vashkevich M.I. A method for simulation the effect of the reduced frequency resolution of the ear in patients with sensorineural hearing loss. Informatics. 2021;18(3):68-82. (In Russ.) https://doi.org/10.37661/1816-0301-2021-18-3-68-82
Views: 400
Email this article 