Abstract:

"Disembodied voices" is an interactive environment designed for an expressive, gesture-based musical performance. The motion sensor Kinect, placed in front of the performer, provides the computer with the 3D space coordinates of the two hands. The application is designed according to the metaphor of the choir director: the performer, through gestures, is able to run a score and to produce a real-time expressive interpretation. The software, developed by the authors, interprets the gestural data by activating a series of compositional algorithms that produce vocal sounds. These are pre-recorded samples processed in real time through the expressive interaction dependent on the conductor's gestures. Hence the name of the application: you follow the conductor's gestures, hear the voices but don't see any singer. The system also provides a display of motion data, a visualization of the part of the score performed at that time, and a representation of the musical result of the compositional algorithms activated.