Category Archives: music

ACM Multimedia 2013

3 contributions accepted at the 21st ACM international conference on Multimedia in Barcelona, Spain. These works describe our current approach and technology we are developing to build motion-sound interactive systems. These systems should favor the building of an action-perception loop (motion-sound) and should facilitate the sensori-motor learning, which will be evaluated next.

Jules Françoise won the Best Doctoral Symposium Paper (see below)

Short paper

J. Françoise, N. Schnell and F. Bevilacqua, “A Multimodal Probabilistic Model for Gesture–based Control of Sound Synthesis“, in Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, (New York, NY, USA), pp. 705–708, ACM, 2013.

Demo

J. Françoise, N. Schnell, and F. Bevilacqua, “Gesture-based control of physical modeling sound synthesis: A mapping-by-demonstration approach“, in Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, (New York, NY, USA), pp. 447–448, ACM, 2013.

Doctoral Consortium

J. Françoise, “Gesture–sound mapping by demonstration in interactive music systems” inProceedings of the 21st ACM International Conference on Multimedia, MM ’13, (New York, NY, USA), pp. 1051–1054, ACM, 201

CMMR 2013 : Sound Music & Motion

2 Papers accepted for the conference Computer Muisc Multidisciplinary Research 2013 : Sound, Music & Motion.

O. Houix, F. Gutierrez, P. Susini, N. Misdariis, “Participatory Workshops: Everyday Objects and Sound Metaphors“,
E. O. Boyer, Q. Pyanet, S. Hanneton and F. Bevilacqua, “Guiding Motion using a Sound Target“. The first results of a preliminary study introducing the notion of sound-oriented task to study sensorimotor learning will be presented.

The general idea of the LEGOS project is to fertilize interdisciplinary expertise in gesture-controlled sound systems with neurosciences, especially regarding sensori-motor learning. We believe that sensori-motor learning are not sufficiently considered for the development of interactive sound systems. A better understanding of the sensori-motor learning mechanisms involved in gesture-sound coupling should provide us with efficient methodologies for the evaluation and optimization of these interactive systems.

Such advances would significantly expand the usability of today’s gesture-based interactive sound systems, often developed empirically.

Gesture learning or rehabilitation: the task is to perform a gesture guided by an audio feedback. The sensori-motor learning in this case is assessed in terms of the gesture precision and repeatability
Movement-based sound control: The task is to produce a given sound through the manipulation of a gestural interface, as in digital musical instruments. The sensori-motor learning is assessed in terms of sound production quality.
Interactive Sound Design: The task is to manipulate an object or a tangible interface, that is sonified. The sensori-motor learning in this case is assessed through the quality and understanding of the objet manipulation.