Acceleration and deceleration at constant speed: systematic modulation of motion perception by kinematic sonification
Abstract
Many domains of human behavior are based on multisensory representations. Knowledge about the principles of multisensory integration is useful to configure real-time movement information for the online support of perceptuomotor processes (motor perception, control, and learning). A powerful method for generating real-time information is movement sonification. Remarkable evidence exists on movement-acoustic real-time information being effective in behavioral domains (music training, motor rehabilitation, sports). Here, we investigate whether and how biological motion perception can be enhanced, substituted, or modulated by kinematic sonification, with a focus on pitch coding. We work with gross motor cyclic movements and investigate the effectiveness of pitch scaling and consistent transposition on audiovisual motor perception accuracy (Experiment A). Beyond that, a new kind of audiovisual stimulus with inconsistent pitch transposition is used to produce a directed modulation of the integrated audiovisual percept (Experiment B). Results from Experiment A indicate pitch being powerful for mediating kinematic information to enhance motor perception and substituting information between perceptual modalities, even exceeding visual p...Continue Reading
References
Multimodal motion processing in area V5/MT: evidence from an artificial class of audio-visual events
Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning
Citations
Related Concepts
Related Feeds
Auditory Perception
Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.