Conference, demos and discussion days on auditory feedback for motor learning, music, interacion and rehabilitation.
Thirty researchers, teachers and students attended the Legos Days on March 18th and 19th 2014 at IRCAM. We organized two days of conference, demos and discussion around diverse topics:
- auditory feedbakc for motor learning, continuous and rhythmic aspects
- sonification and perception of drawing movements
- motor rehabiltation, with special cases of stroke patients, musicians and dystonic children
- relationships between auditory and body perception in sonic surface interactions
- interactive sound design and auditory object affordances
The goal of this event was to gather people working on interactive auditory feebback with different approaches and applications, which is an emerging community among people coming from computer science, audio processing, neuroscience, rehabilitation and sports.
Hands-on demos and intense discussions gace rise to news collaboration opportunities and exchange words on latest findings, experimental protocols and formalization of concepts.
- Floris van Vugt, IMMM Hannover and CAP lab in Lyon
Auditory feedback in learning, re-learning and over-learning of motor regularity.
Ana Tajadura-Jiménez, Laboratory of Action and Body, UCLIC, University College London Sonification of surface interactions: Influences on body sense, surface perception, behavior and emotion
- Etienne Thoret, Laboratoire de Mécanique et d’Acoustique (LMA Marseille)
Auditory perception of drawing movements: when motor cues shape auditory cognitive processes.
Eric O. Boyer, Frédéric Bevilacqua, Houix Olivier (IRCAM)
Latest updates on the Legos project.
Demos made by:
Eric O. Boyer, Jules Françoise, Olivier Houix, Frédéric Bevilacqua (IRCAM)
Etienne Thoret (LMA Marseille)
Eric O. Boyer & Frédéric Bevilacqua (IRCAM)
3 contributions accepted at the 21st ACM international conference on Multimedia in Barcelona, Spain. These works describe our current approach and technology we are developing to build motion-sound interactive systems. These systems should favor the building of an action-perception loop (motion-sound) and should facilitate the sensori-motor learning, which will be evaluated next.
Jules Françoise won the Best Doctoral Symposium Paper (see below)
- J. Françoise, N. Schnell and F. Bevilacqua, “A Multimodal Probabilistic Model for Gesture–based Control of Sound Synthesis“, in Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, (New York, NY, USA), pp. 705–708, ACM, 2013.
- J. Françoise, N. Schnell, and F. Bevilacqua, “Gesture-based control of physical modeling sound synthesis: A mapping-by-demonstration approach“, in Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, (New York, NY, USA), pp. 447–448, ACM, 2013.
2 Papers accepted for the conference Computer Muisc Multidisciplinary Research 2013 : Sound, Music & Motion.
We presented two papers at the Multimodal Motor Behaviour : Impact of Sound conference, organized by Leibniz Unversität in Hannover and the ETH Institute of Thechnology of Zurich; which took place 09.31 and 10.01 in Hannover.
- E. O. Boyer, L. Colin Malagon, F. Bevilacqua, P. Susini and S. Hanneton, “Continuous sound feedback in tracking tasks“,
presenting an ongoing work comparing different sonification mappings and their contribution to a 2D visual tracking task.
- F. Bevilacqua, A. Vanzandt-Escobar, N. Schnell, E. O. Boyer, N. Rasamimanana, S. Hanneton and A. Roby-Brami, “Sonification of the coordination of arm movements“,
introducing the primary work on hemiparesis rehabilitation with real-time sound feedback.
- Screenshot of a demo video showing a prototype to simulate hemiparetic patients.
Summer School 2013 Human Computer Confluence, http://hcsquared.eu
Workshop From everyday objects to sonic interaction design
July 17-19 2013, Ircam, PDS and IMTR research teams (collaboration with Goldsmiths-London)
Lauren Hayes – PhD student in creative music practice
Emmanouil Giannisakis – Master student in digital media engineering
Jaime Arias Almeida – PhD student in informatics
Alberto Betella – PhD student in communication, information and audiovisual media
David Hofmann Phd student in theoretical neuroscience
Two posters are accepted for the conference Progress in Motor Control IX meeting to be held at McGill University in Montreal, July 14-16 2013.
- E. Boyer, Q. Pyanet, S. Hanneton, and F. Bevilacqua, “Sensorimotor adaptation to a gesture-sound mapping perturbation”
- S. Hanneton, E. Boyer, and V. Forma, “Influence of an error-related auditory feedback on the adaptation to a visuo-manual perturbation”
November 08-2012 at IRCAM (1:30 pm – 4 pm)¶
Ircam: Frederic Bevilacqua (coordinator), Hugues Vinet (scientific director), Patrick Susini (Head of PDS tem) , Nicolas Misdariis, Olivier Houix, Norbert Schnell, Emmanuel Fléty, Joël Bensoam, Isabelle Viaud-Delmon, Jules Françoise
Neuromouv : Sylvain Hanneton, Agnès Roby-Brami, Nicolas Rasamimanana (Phonotonic)
ANR: Olivier Couchariere
General presentation of the project (slides), F. Bevilacqua
Présentation of Olivier Coucharière of ANR
Presentation of the scientific aims for the three different types of applications:
- Musical interfaces (slides) (F. Bevilacqua)
- Sonic interaction design (slides) (P. Susini)
- Motor control and learning (slides) (S. Hanneton)