Decoding Auditory Saliency from Brain Activity Patterns during Free Listening to Naturalistic Audio Excerpts

Neuroinformatics
Shijie ZhaoTianming Liu

Abstract

In recent years, natural stimuli such as audio excerpts or video streams have received increasing attention in neuroimaging studies. Compared with conventional simple, idealized and repeated artificial stimuli, natural stimuli contain more unrepeated, dynamic and complex information that are more close to real-life. However, there is no direct correspondence between the stimuli and any sensory or cognitive functions of the brain, which makes it difficult to apply traditional hypothesis-driven analysis methods (e.g., the general linear model (GLM)). Moreover, traditional data-driven methods (e.g., independent component analysis (ICA)) lack quantitative modeling of stimuli, which may limit the power of analysis models. In this paper, we propose a sparse representation based decoding framework to explore the neural correlates between the computational audio features and functional brain activities under free listening conditions. First, we adopt a biologically-plausible auditory saliency feature to quantitatively model the audio excerpts and meanwhile develop sparse representation/dictionary learning method to learn an over-complete dictionary basis of brain activity patterns. Then, we reconstruct the auditory saliency features fr...Continue Reading

References

Mar 14, 1998·Proceedings of the National Academy of Sciences of the United States of America·M J McKeownT J Sejnowski
Mar 17, 1998·NeuroImage·K J FristonR Turner
Mar 30, 1999·Journal of Computer Assisted Tomography·B B Biswal, J L Ulmer
Mar 21, 2001·Nature Reviews. Neuroscience·L Itti, C Koch
Apr 13, 2001·Current Opinion in Neurobiology·J C Culham, N G Kanwisher
Aug 23, 2001·Medical Image Analysis·M Jenkinson, S Smith
Jan 24, 2002·Vision Research·Derrick ParkhurstErnst Niebur
Dec 31, 2002·Proceedings of the National Academy of Sciences of the United States of America·Michael D GreiciusVinod Menon
Feb 18, 2004·IEEE Transactions on Medical Imaging·Christian F Beckmann, Stephen M Smith
Apr 14, 2005·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Junwei HanHong-Jiang Zhang
Nov 8, 2005·Current Biology : CB·Christoph KayserNikos K Logothetis
May 1, 2007·Nature Neuroscience·Haishan YaoYang Dan
Feb 12, 2008·Trends in Cognitive Sciences·R Quian QuirogaI Fried
Apr 2, 2008·NeuroImage·Christian F AltmannJochen Kaiser
Jun 27, 2009·Proceedings of the National Academy of Sciences of the United States of America·I DaubechiesJ Haxby
Jul 22, 2009·Proceedings of the National Academy of Sciences of the United States of America·Stephen M SmithChristian F Beckmann
Dec 17, 2009·Trends in Cognitive Sciences·Uri HassonDavid J Heeger
Dec 9, 2010·IEEE Transactions on Medical Imaging·Kangjoo LeeJong Chul Ye
Sep 29, 2011·Current Biology : CB·Shinji NishimotoJack L Gallant
Nov 24, 2011·Journal of Neuroscience Methods·Jing SuiVince D Calhoun
May 24, 2012·The Behavioral and Brain Sciences·Luiz Pessoa
Oct 13, 2012·Topics in Cognitive Science·Marcus Pearce, Martin Rohrmeier
Aug 8, 2014·Proceedings. Biological Sciences·Sukhbinder KumarTimothy D Griffiths
Oct 15, 2014·IEEE Transactions on Cybernetics·Junwei HanTianming Liu
Nov 25, 2014·IEEE Transactions on Bio-medical Engineering·Jinglei LvTianming Liu
Apr 20, 2017·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Xiwen YaoFeiping Nie

❮ Previous
Next ❯

Methods Mentioned

BETA
feature extraction

Software Mentioned

ACMMM
SCCA
SPM
FSL MELODIC toolbox
MEAN

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.