Information-Driven Active Audio-Visual Source Localization

PloS One
Niclas SchultChristoph Zetzsche

Abstract

We present a system for sensorimotor audio-visual source localization on a mobile robot. We utilize a particle filter for the combination of audio-visual information and for the temporal integration of consecutive measurements. Although the system only measures the current direction of the source, the position of the source can be estimated because the robot is able to move and can therefore obtain measurements from different directions. These actions by the robot successively reduce uncertainty about the source's position. An information gain mechanism is used for selecting the most informative actions in order to minimize the number of actions required to achieve accurate and precise position estimates in azimuth and distance. We show that this mechanism is an efficient solution to the action selection problem for source localization, and that it is able to produce precise position estimates despite simplified unisensory preprocessing. Because of the robot's mobility, this approach is suitable for use in complex and cluttered environments. We present qualitative and quantitative results of the system's performance and discuss possible areas of application.

References

Mar 1, 1992·The Journal of the Acoustical Society of America·F L Wightman, D J Kistler
Aug 1, 1990·Hearing Research·B R Glasberg, B C Moore
Feb 1, 1989·The Journal of the Acoustical Society of America·F L Wightman, D J Kistler
Sep 18, 1999·The Journal of the Acoustical Society of America·D S Brungart, W M Rabinowitz
Aug 10, 2001·Neuroreport·G F Meyer, S M Wuerger
Jan 9, 2004·Perception & Psychophysics·S M WuergerG F Meyer
Feb 6, 2004·Current Biology : CB·David Alais, David Burr
Feb 3, 2009·Neuroinformatics·Michael HankeStefan Pollmann
May 17, 2011·Neuroscience and Biobehavioral Reviews·Jane Klemen, Christopher D Chambers
Apr 9, 2014·Current Opinion in Neurobiology·Robert L SeilheimerDora E Angelaki
Apr 1, 2010·Topics in Cognitive Science·Aapo Hyvärinen

❮ Previous
Next ❯

Citations


❮ Previous
Next ❯

Methods Mentioned

BETA
feature extraction

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.

Related Papers

IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
G OrioloM Vendittelli
IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
Qiang LuJian Wang
© 2021 Meta ULC. All rights reserved