Interactive Sonification Exploring Emergent Behavior Applying Models for Biological Information and Listening

Frontiers in Neuroscience
Insook Choi

Abstract

Sonification is an open-ended design task to construct sound informing a listener of data. Understanding application context is critical for shaping design requirements for data translation into sound. Sonification requires methodology to maintain reproducibility when data sources exhibit non-linear properties of self-organization and emergent behavior. This research formalizes interactive sonification in an extensible model to support reproducibility when data exhibits emergent behavior. In the absence of sonification theory, extensibility demonstrates relevant methods across case studies. The interactive sonification framework foregrounds three factors: reproducible system implementation for generating sonification; interactive mechanisms enhancing a listener's multisensory observations; and reproducible data from models that characterize emergent behavior. Supramodal attention research suggests interactive exploration with auditory feedback can generate context for recognizing irregular patterns and transient dynamics. The sonification framework provides circular causality as a signal pathway for modeling a listener interacting with emergent behavior. The extensible sonification model adopts a data acquisition pathway to for...Continue Reading

References

Aug 1, 1978·Journal of Experimental Psychology. Human Perception and Performance·A S Bregman
Sep 1, 1991·Electroencephalography and Clinical Neurophysiology·M G Woldorff, S A Hillyard
Oct 12, 1973·Science·S A HillyardT W Picton
Jul 1, 1981·Biophysical Journal·C Morris, H Lecar
Aug 25, 1994·Nature·S J SchiffW L Ditto
Jun 1, 1994·Canadian Journal of Experimental Psychology = Revue Canadienne De Psychologie Expérimentale·L M Ward
Feb 1, 1994·Journal of Applied Physiology·C L Webber, J P Zbilut
Sep 18, 2001·Comptes rendus de l'Académie des sciences. Série III, Sciences de la vie·P Faure, H Korn
Dec 13, 2002·Experimental Brain Research·Kirsten HöttingBrigitte Röder
Jan 1, 1954·Acta Oto-laryngologica. Supplementum·S ELIASSON, L GISSELSSON
Dec 26, 2003·Comptes rendus biologies·Henri Korn, Philippe Faure
Apr 15, 2004·Current Opinion in Neurobiology·Richard B Ivry, Rebecca M C Spencer
Jul 9, 2004·Cerebral Cortex·Mika H MartikainenRiitta Hari
Aug 11, 2004·Journal of Experimental Psychology. Human Perception and Performance·Rhodri CusackRobert P Carlyon
Aug 21, 2004·Cerebral Cortex·André Brechmann, Henning Scheich
Nov 19, 2004·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Nachum UlanovskyIsrael Nelken
Dec 8, 2004·Current Opinion in Neurobiology·Richard A AndersenBijan Pesaran
Mar 4, 2005·Physiological Measurement·Christopher J James, Christian W Hesse
Aug 19, 2005·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Jonathan B FritzShihab A Shamma
Sep 8, 2005·IEEE Transactions on Visualization and Computer Graphics·Marcus MagnorNeb Duric
Nov 18, 2005·NeuroImage·M A PastorR S J Frackowiak
Jan 10, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Julien VoisinPierre Fonlupt
Jun 7, 2006·Cerebral Cortex·Claude AlainKaren S Reinke
Jun 14, 2006·Journal of Cognitive Neuroscience·Kathrin Lange, Brigitte Röder
Feb 23, 2007·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Christoph KayserNikos K Logothetis
Apr 25, 2007·Journal of the Association for Research in Otolaryngology : JARO·Virginia BestBarbara G Shinn-Cunningham
May 23, 2007·Perception & Psychophysics·Elyse S SussmanMark Orr
Aug 24, 2007·Current Opinion in Neurobiology·Jonathan B FritzShihab A Shamma
Feb 5, 2008·IEEE Transactions on Neural Networks·E M Izhikevich
Apr 24, 2009·Trends in Cognitive Sciences·Alex O Holcombe
May 5, 2011·PloS One·Tamas MadlStan Franklin
Feb 26, 2013·Nature Neuroscience·Josh H McDermottEero P Simoncelli
Jun 14, 2013·Psychological Science·Elise A PiazzaDavid Whitney
Feb 21, 2014·The New England Journal of Medicine·Abraham BohadanaSteve S Kraman
Mar 7, 2014·Frontiers in Computational Neuroscience·Tobias A Mattei
Jun 13, 2014·International Journal of Health Services : Planning, Administration, Evaluation·Mary Anne MercerRui Maria de Araujo
Oct 8, 2016·Scientific Reports·Xiangbin TengDavid Poeppel
Mar 30, 2017·Frontiers in Systems Neuroscience·Robert Kozma, Walter J Freeman

❮ Previous
Next ❯

Software Mentioned

Swarm Chemistry
Sonification
LIDA

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.