Category Archives: article

ACM Multimedia 2013

3 contributions accepted at the 21st ACM international conference on Multimedia in Barcelona, Spain. These works describe our current approach and technology we are developing to build motion-sound interactive systems. These systems should favor the building of an action-perception loop (motion-sound) and should facilitate the sensori-motor learning, which will be evaluated next.

Jules Françoise won the Best Doctoral Symposium Paper (see below)

Short paper

Demo

Doctoral Consortium

Front. Comput. Neurosci.

From ear to hand: the role of the auditory-motor loop in pointing to an auditory source

Eric O. Boyer1, 2*Bénédicte M. Babayan3Frédéric Bevilacqua1Markus Noisternig1Olivier Warusfel1Agnès Roby-Brami4Sylvain Hanneton2 and Isabelle Viaud-Delmon1
  • 1 CNRS UMR 9912 IRCAM, France
  • 2Laboratoire de Neurophysique et Physiologie, CNRS UMR 8119, Université Paris Descartes UFR Biomédicale des Saints Pères, France
  • 3Neurobiologie des Processus Adaptatifs, CNRS UMR 7102, UPMC, France
  • 4Institut des systèmes intelligents et de robotique (ISIR) CNRS UMR 7222, UPMC, France

Studies of the nature of the neural mechanisms involved in goal-directed movements tend to concentrate on the role of vision. We present here an attempt to address the mechanisms whereby an auditory input is transformed into a motor command. The spatial and temporal organization of hand movements were studied in normal human subjects as they pointed towards unseen auditory targets located in a horizontal plane in front of them. Positions and movements of the hand were measured by a six infrared camera tracking system. In one condition, we assessed the role of auditory information about target position in correcting the trajectory of the hand. To accomplish this, the duration of the target presentation was varied. In another condition, subjects received continuous auditory feedback of their hand movement while pointing to the auditory targets. Online auditory control of the direction of pointing movements was assessed by evaluating how subjects reacted to shifts in heard hand position. Localization errors were exacerbated by short duration of target presentation but not modified by auditory feedback of hand position. Long duration of target presentation gave rise to a higher level of accuracy and was accompanied by early automatic head orienting movements consistently related to target direction. These results highlight the efficiency of auditory feedback processing in online motor control and suggest that the auditory system takes advantages of dynamic changes of the acoustic cues due to changes in head orientation in order to process online motor control. How to design an informative acoustic feedback needs to be carefully studied to demonstrate that auditory feedback of the hand could assist the monitoring of movements directed at objects in auditory space.