Gesture-controlled mixing of multichannel audio

Martin Morrell, Roderick Selfridge and Joshua D. Reiss

This project investigates the design of gesture control interfaces for mixing multichannel audio. We describe the design, construction and analysis of interactive gesture-controlled audio mixing systems which utilise a wireless video game controller. The concept is based on the idea that the mixing engineer can step away from the mixing desk and become part of the performance of the piece of audio. Subjective evaluation and listening tests were performed to assess usability and performance of the system.

Demonstration videos

Publications

M. J. Morrell and J. D. Reiss, "Auditory Cues for Gestural Control of Multitrack Audio," 17th International Conference on Auditory Display (ICAD), Budapest, Hungary, June 20-24, 2011.

R. Selfridge and J. D. Reiss, " Interactive Mixing Using the Wii Controller," AES 130th Convention, May 2011.