Simulating speech processing with cochlear implants: How does channel interaction affect learning in neural networks?

PloS One
Robert GrimmWalter Daelemans

Abstract

We introduce a novel machine learning approach for investigating speech processing with cochlear implants (CIs)-prostheses used to replace a damaged inner ear. Concretely, we use a simple perceptron and a deep convolutional network to classify speech spectrograms that are modified to approximate CI-delivered speech. Implant-delivered signals suffer from reduced spectral resolution, chiefly due to a small number of frequency channels and a phenomenon called channel interaction. The latter involves the spread of information from neighboring channels to similar populations of neurons and can be modeled by linearly combining adjacent channels. We find that early during training, this input modification degrades performance if the networks are first pre-trained on high-resolution speech-with a larger number of channels, and without added channel interaction. This suggests that the spectral degradation caused by channel interaction alters the signal to conflict with perceptual expectations acquired from high-resolution speech. We thus predict that a reduction of channel interaction will accelerate learning in CI users who are implanted after having adapted to high-resolution speech during normal hearing. (The code for replicating our...Continue Reading

References

Jun 1, 1993·Australian Veterinary Journal·O P SadhanaJ S Rana
Feb 28, 2002·Proceedings of the National Academy of Sciences of the United States of America·Christopher A SheraAndrew J Oxenham
Apr 19, 2003·Acta Oto-laryngologica·Seung-Ha OhJa Won Koo
Sep 21, 2004·The Journal of the Acoustical Society of America·Ginger S StickneyPeter Assmann
Dec 13, 2005·Hearing Research·Ginger S StickneyJane M Opie
Feb 13, 2007·Bio Systems·Martin Coath, Susan L Denham
Apr 4, 2007·Proceedings of the National Academy of Sciences of the United States of America·J RougerP Barone
Jan 8, 2008·The Journal of the Acoustical Society of America·Helen E Cullington, Fan-Gang Zeng
Apr 23, 2009·Hearing Research·David M Landsberger, Arthi G Srinivasan
Jan 9, 2010·Osteoporosis International : a Journal Established As Result of Cooperation Between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA·A C VanniV P S Zanardo
Jul 14, 2011·Journal of Neural Engineering·Qing TangFan-Gang Zeng
Jan 10, 2013·The Journal of the Acoustical Society of America·Gary L JonesJay T Rubinstein
Sep 21, 2013·Nature Reviews. Neuroscience·Jennifer K Bizley, Yale E Cohen
Apr 2, 2014·Journal of Speech, Language, and Hearing Research : JSLHR·Aaron C MoberlySusan Nittrouer
Dec 3, 2014·Hearing Research·Monita ChatterjeeJulie A Christensen
Mar 20, 2015·The Journal of the Acoustical Society of America·Etienne Gaudrain, Deniz Başkent
Feb 26, 2016·Nature Neuroscience·Daniel L K Yamins, James J DiCarlo
Aug 12, 2017·Ear and Hearing·Etienne Gaudrain, Deniz Başkent

❮ Previous
Next ❯

Citations

Aug 9, 2020·European Archives of Oto-rhino-laryngology : Official Journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : Affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery·Juliana Coutinho da SilvaRicardo Ferreira Bento

❮ Previous
Next ❯

Software Mentioned

TIMIT

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.