in collaboration with the Interaction Sound Music Movement team, IRCAM-STMS

The project is a collaboration between the ISMM-Interaction Son Musique Mouvement team of IRCAM-STMS and the Motion Lab team of CRI Paris. Resulting from the Element research project, is an extension of the CoMo application (for Collaborative Motion). The Element project allows to "stimulate the learning of movements in human-computer interactions". The aim is to create both motion vocabularies and to design computational models capable of analyzing users' movements in real time to provide multimodal feedback. Thus, allows to translate gestures into sound in order to animate a story in an interactive way. is designed for children and teachers to enable the creation of sound and moving stories. 

Le projet est issu de la collaboration entre l’équipe ISMM-Interaction Son Musique Mouvement de l’IRCAM-STMS et l’équipe du Motion Lab du CRI Paris. Issu du projet de recherche Element, est une extension de l’application CoMo (pour Collaborative Motion). Le projet Element permet de «stimuler l’apprentissage de mouvements dans les interactions humain-machine». Il s’agit de créer à la fois des vocabulaires de mouvements et de concevoir des modèles computationnels capables d’analyser les mouvements des utilisateurs en temps réel pour fournir des retours multimodaux. Ainsi permet de traduire des gestes en son afin d’animer une histoire de manière interactive. est destiné aux enfants et enseignants pour permettre la création d’histoires sonores en mouvement. 

CoMo : Copyright and Credits 


CoMo-Education © IRCAM-STMS and CRI-Paris, 2019-2020

Credits: Research and Development: Marion Voillot, Joseph Larralde, Benjamin Matuszweski, Frédéric Bevilacqua and Joël Chevrier

CoMo-Education is based on CoMo by IRCAM-STMS, licensed under BSD-3-Clause


CoMo © IRCAM-STMS licensed under BSD-3-Clause, 


Research and Development: Benjamin Matuszweski, Joseph Larralde, Jean-Philippe Lambert, Frederic Bevilacqua (coordination)

Acknowledgments: The CoMo ecosystem was initiated within the framework of the RAPID-MIX project, an Innovation Action funded by the European Commision (H2020-ICT-2014-1 Project ID 644862). Current supports include the ELEMENT project (ANR-18-CE33-0002). It uses the Soundworks framework developed in the CoSiMa project (ANR-13-CORD-0010), developed by Benjamin Matuszweski, Norbert Schnell and Sébastien Robaszkiewicz, Waves libraries developed in the Wave project (ANR-12-CORD-0027) and the XMM library developed by Jules Françoise

Special thanks to: Roland Cahen, Marion Voillot, Olivier Houix, Anne Dubos, Jan Schacher, Joël Chevrier, Jean-François Jégo, Xavier Boissarie, Michelle Agnes Magalhaes