informИнформатикаInformatics1816-03012617-6963UIIP NASB10.37661/1816-0301-2021-18-3-68-82inform-1145Research ArticleОБРАБОТКА СИГНАЛОВ, ИЗОБРАЖЕНИЙ, РЕЧИ, ТЕКСТА И РАСПОЗНАВАНИЕ ОБРАЗОВSIGNAL, IMAGE, SPEECH, TEXT PROCESSING AND PATTERN RECOGNITIONМетод моделирования эффекта ухудшения частотного разрешения слуха у больных нейросенсорной тугоухостьюA method for simulation the effect of the reduced frequency resolution of the ear in patients with sensorineural hearing lossПорхунМ. И.PorhunM. I.

Порхун Максим Игоревич - магистр технических наук, ассистент кафедры электронных вычислительных средств.

Ул. П. Бровки, 6, Минск, 220013

Maksim I. Porhun - М. Sci. (Eng.), Assistant Lecturer of Computer Engineering Department.

St. Р. Brovki, 6, Minsk, 220013

porhun@bsuir.byhttps://orcid.org/0000-0002-1267-0795ВашкевичМ. И.VashkevichM. I.

Вашкевич Максим Иосифович - кандидат технических наук, доцент кафедры электронных вычислительных средств.

Ул. П. Бровки, 6, Минск, 220013

Maksim I. Vashkevich - Cand. Sci. (Eng.), Associate Professor of Computer Engineering Department.

St. Р. Brovki, 6, Minsk, 220013

vashkevich@bsuir.byБелорусский государственный университет информатики и радиоэлектроникиBelarusian State University of Informatics and Radioelectronics2021300920211836882Copyright © Порхун М.И., Вашкевич М.И., 20212021Порхун М.И., Вашкевич М.И.Porhun M.I., Vashkevich M.I.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://inf.grid.by/jour/article/view/1145

Предложен метод моделирования эффекта ухудшения частотного разрешения уха у больных нейросенсорной тугоухостью, особенностью которого является возможность его настройки по аудиограмме конкретного человека. Метод основан на пофреймовой обработке сигнала в частотной области. Моделирование эффекта ухудшения частотного разрешения уха достигается за счет обработки составляющих амплитудного спектра исходного звукового сигнала «размывающей» функцией. «Размывающая» функция формируется из амплитудно-частотных характеристик слуховых фильтров, ширина полос которых определяется исходя из аудиограммы тугоухого человека. Предложенный метод реализован в среде MATLAB. Проведено экспериментальное исследование влияния эффекта ухудшения частотного разрешения уха с использованием теста на разборчивость речи. В эксперименте участвовало 15 человек, которым давали прослушивать записи, обработанные предложенным методом с различными настроечными параметрами, в том числе с добавлением белого шума и без добавления. Экспериментальные данные показали, что ухудшение частотного разрешения уха приводит к ухудшению разборчивости речи, особенно сильному при наличии фонового шума. На основании ответов участников эксперимента составлены таблицы спутывания звуков, отражающие факт неразличимости схожих по частоте звуков, что подтверждает корректность работы предложенного метода.

A method for the simulation of reduced frequency resolution of the ear in patients with sensorineural hearing loss is proposed. The method is based upon the ability to adjust it according to the audiogram of a concrete person by frame-by-frame signal processing in the frequency domain. Simulation of the effect of the reduced frequency resolution of the ear is achieved by processing the components of amplitude spectrum of the original sound signal by the "smearing" function. The "smearing" function is formed from the amplitude-frequency characteristics of the auditory filters, which bandwidth is determined by the audiogram of the deaf person. The proposed method is implemented in the MATLAB. An experimental study of the effect of the reduced frequency resolution of the ear using the speech intelligibility test was conducted. The experiment involved 15 people who listened the records processed by the proposed method with various settings and noise conditions. Experimental data have shown that reduced frequency resolution of the ear leads to the deterioration in speech intelligibility, especially in the presence of background noise. Based on the answers of the participants of the experiment, the confusion tables of sounds were compiled, reflecting the fact of indistinguishability of sounds similar in frequency, that confirms the correctness of the proposed method.

слуховые патологиичастотное разрешение ухамоделирование потери слухаroex-фильтрразборчивость речиhearing pathologiesear frequency resolutionhearing loss simulationroex-filterspeech intelligibilityReferencesКоролева, И. В. Введение в аудиологию и слухопротезирование / И. В. Королева. - СПб. : КАРО, 2012. - 400 с.Koroleva I. V. Vvedenie v audiologiyu i slukhoprotezirovanie. Introduction to Audiology and Hearing Care. Saint Petersburg, KARO, 2012, 400 p. (In Russ.).Erber, N. Applications of hearing-loss simulation in education of student clinicians / N. Erber // J. of the Academy of Rehabilitative Audiology. - 1995. - Vol. 28. - P. 37-50.Erber N. Applications of hearing-loss simulation in education of student clinicians. Journal of the Academy of Rehabilitative Audiology, 1995, vol. 28, pp. 37-50.Simulation of hearing loss using compressive gammachirp auditory filters / H. Hu. [et al.] // IEEE Intern. Conf. on Acoustics, Speech and Signal Processing (ICASSP). - Prague, Czech Republic, 2011. - Р. 5428-5431. https://doi.org/10.1109/ICASSP.2011.5947586Hu. H., Sang J., Lutman M. E., Bleeck S. Simulation of hearing loss using compressive gammachirp auditory filters. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Prague, Czech Republic, 2011, pp. 5428-5431. https://doi.org/10.1109/ICASSP.2011.5947586Graf, I. Simulation of the Effects of Sensorineural Hearing Loss / I. Graf. - Cambridge : Massachusetts Institute of Technology, 1997. - 112 p.Graf I. Simulation of the Effects of Sensorineural Hearing Loss. Cambridge, Massachusetts Institute of Technology, 1997, 112 p.Mourgela, A. Perceptually motivated hearing loss simulation for audio mixing reference / A. Mourgela, T. Agus, J. D. Reiss // 147th Audio Engineering Society Intern. Convention. - N. Y., 2019.Mourgela A., Agus T., Reiss J. D. Perceptually motivated hearing loss simulation for audio mixing reference. 147th Audio Engineering Society International Convention. New York, 2019.Moore, B. Cochlear Hearing Loss: Physiological, Psychological and Technical Issues / B. Moore. -2nd ed. - John Wiley & Sons, 2008. - 332 p. https://doi.org/10.1002/9780470987889Moore B. Cochlear Hearing Loss: Physiological, Psychological and Technical Issues. 2nd ed., John Wiley & Sons, 2008, 332 p. https://doi.org/10.1002/9780470987889Baer, T. Effects of spectral smearing on the intelligibility of sentences in noise / T. Baer, B. Moore // The J. of the Acoustical Society of America. - 1993. - Vol. 94, no. 3. - P. 1229-1241. https://doi.org/10.1121/1.408176Baer T., Moore B. Effects of spectral smearing on the intelligibility of sentences in noise. The Journal of the Acoustical Society of America, 1993, vol. 94, no. 3, pp. 1229-1241. https://doi.org/10.1121/L408176Goodwin, M. The STFT, sinusoidal models, and speech modification / M. Goodwin // Handbook of Speech Processing. - Springer, 2008. - P. 229-258. https://doi.org/10.1007/978-3-540-49127-9_12Goodwin M. The STFT, sinusoidal models, and speech modification. Handbook of Speech Processing, Springer, 2008, pp. 229-258. https://doi.org/10.1007/978-3-540-49127-9_12A hearing impairment simulation method using audiogram-based approximation of auditory characteristics / N. Jinbo [et al.] // 15th Annual Conf. of the Intern. Speech Communication Association (INTERSPEECH). -Singapore, 2014. - P. 490-494.Jinbo N., Takamichi S., Toda T., Neubig G., Sakti S., Nakamura S. A hearing impairment simulation method using audiogram-based approximation of auditory characteristics. 15th Annual Conference of the International Speech Communication Association (INTERSPEECH). Singapore, 2014, pp. 490-494.The deterioration of hearing with age: Frequency selectivity, the critical ratio, the audiogram, and speech threshold / R. D. Patterson [et al.] // The J. of the Acoustical Society of America. - 1982. - Vol. 72, no. 6. -P. 1788-1803. https://doi.org/10.1121/1.388652Patterson R. D., Nimmo-Smith I., Weber D. L., Milroy R. The deterioration of hearing with age: Frequency selectivity, the critical ratio, the audiogram, and speech threshold. The Journal of the Acoustical Society of America, 1982, vol. 72, no. 6, pp. 1788-1803. https://doi.org/10.1121/L388652Effects of spectral smearing of stimuli on the performance of auditory steady-state response-based brain-computer interface / H. J. Hwang [et al.] // Cogn Neurodyn. - 2017. - Vol. 11, no. 6. - P. 515-527. https://doi.org/10.1007/s11571-017-9448-yHwang J. H., Nam K. W., Jang D. P., Kim I. Y. Effects of spectral smearing of stimuli on the performance of auditory steady-state response-based brain-computer interface. Cogn Neurodyn, 2017, vol. 11, no. 6, pp. 515-527. https://doi.org/10.1007/s11571-017-9448-yФонлантен, А. Слуховые аппараты / А. Фонлантен, Х. Арндт. - Ростов н/Д. : Феникс, 2009. - 302 с.Vonlanthen A., Arndt H. Hearing Instrument Technology for the Hearing Healthcare Professional. Thomson Delmar Learning, 2007, 318 p.Glasberg, B. Auditory filter shapes in subjects with unilateral and bilateral cochlear impairments / B. Glasberg, B. Moore // The J. of the Acoustical Society of America. - 1986. - Vol. 79, no. 4. - P. 1020-1033. https://doi.org/10.1121/L393374Glasberg B., Moore B. Auditory filter shapes in subjects with unilateral and bilateral cochlear impairments. The Journal of the Acoustical Society of America, 1986, vol. 79, no. 4, pp. 1020-1033. https://doi.org/10.1121/1.393374Baer, T. Effects of spectral smearing on the intelligibility of sentences in the presence of interfering speech / T. Baer, B. Moore // The J. of the Acoustical Society of America. - 1994. - Vol. 95. - P. 2277-2280. https://doi.org/10.1121/L408640Baer T., Moore B. Effects of spectral smearing on the intelligibility of sentences in the presence of interfering speech. The Journal of the Acoustical Society of America, 1994, vol. 95, pp. 2277-2280. https://doi.org/10.1121/L408640Moore, B. Simulation of the effects of loudness recruitment and threshold elevation on the intelligibility of speech in quiet and in a background of speech / B. Moore, B. Glasberg // The J. of the Acoustical Society of America. - 1993. - Vol. 94, no. 4. - P. 2050-2062. https://doi.org/10.1121/1.407478Moore B., Glasberg B. Simulation of the effects of loudness recruitment and threshold elevation on the intelligibility of speech in quiet and in a background of speech. The Journal of the Acoustical Society of America, 1993, vol. 94, no. 4, pp. 2050-2062. https://doi.org/10.1121/1.407478Nejime, Y. Simulation of the effect of threshold elevation and loudness recruitment combined with reduced frequency selectivity on the intelligibility of speech in noise / Y. Nejime, B. Moore // The J. of the Acoustical Society of America. - 1997. - Vol. 102, no. 1. - P. 603-615. https://doi.org/10.1121/1.419733Nejime Y., Moore B. Simulation of the effect of threshold elevation and loudness recruitment combined with reduced frequency selectivity on the intelligibility of speech in noise. The Journal of the Acoustical Society of America, 1997, vol. 102, no. 1, pp. 603-615. https://doi.org/10.1121/L419733Effects of spectral smearing of stimuli on the performance of auditory steady-state response-based brain-computer interface / J. H. Hwang [et al.] // Cognitive Neurodynamics. - 2017. - Vol. 11, no. 6. - P. 515-527. https://doi.org/10.1007/s11571-017-9448-yHwang J. H., Nam W. N., Jang P. D., Kim I. Y. Effects of spectral smearing of stimuli on the performance of auditory steady-state response-based brain-computer interface. Cognitive Neurodynamics, 2017, vol. 11, no. 6, pp. 515-527. https://doi.org/10.1007/s11571-017-9448-y

The authors declare that there are no conflicts of interest present.