Audio Engineering Research in the Centre for Digital Music
- News and reporting on our research
- Demonstration videos on YouTube Channel: Intelligent Sound Engineering
- Check out our blog, Intelligent Sound Engineering
- Academic publications
Some of our current and recent research projects include;
- Web Audio Evaluation Tool- a browser-based listening test environment. See the Web Audio Conference and Sound and Music Computing publications and this demo video
- The Open Multitrack Testbed
- Automatic mixing - Methods for automatic multitrack audio production in real-time
- Sound synthesis
- Spatial audio production and reproduction
- Reverse engineering the mix - a targeted mixing and mastering tool
- Reducing Artifacts Between Source and Microphone in Live Sound
- Transient modification
- Source separation for live sound - Crosstalk, bleed and interference reduction techniques
- Gesture-controlled mixing of multichannel audio
- Multitrack segmentation
- Intelligent dynamic range compression
- Microphone shoot-out (pairwise and multi-stimuli evaluation)
PhD Study - interested in joining the team? We are currently accepting PhD applications.
Aims
We develop intelligent recording techniques, for use by audio editors, mixers and sound engineers, which speed up the recording process, minimise preparation for live performance, and enable easy preparation and transmission of high resolution audio.
Advances in signal processing, machine learning and adaptive systems, have rarely been applied to the professional audio market. This is partly because most digital signal processing applications in these areas have remained focused on replicating or improving those techniques which could be applied in the analogue domain. And until recently, mixing consoles and audio workstations did not have the computing power to allow the introduction of multi-input, multi-output processing tools. Thus audio effects have traditionally been limited to those which operate only on single or stereo channels. There is now an opportunity to develop advanced audio effects which analyse all input channels in order to produce the ideal mix.
Audio engineering for live sound production represents a field with strong potential for improvement and automation. Much of the effort of a sound engineer in preparation for a live performance is consumed by tedious, repetitive tasks. Levels must be set to avoid feedback, input channels must be panned to stereo or surround sound, equalisation, normalisation and compression must be applied to each channel, and all equipment must be tested along with establishing an optimal choice of microphone placement. Only after these tasks have been performed, if time and resources permit, may the sound engineer refine these choices to produce an aesthetically pleasing mix which best captures the intended sound. There is a need for tools which minimise sound-checks by automating complex but non-artistic tasks, establish recommended settings based on the input signals and acoustics, and identifying and avoid issues such as acoustic feedback and microphone crossover.
We develop and test techniques to convert audio mixes between formats. We are working to devise methods to automatically create a surround sound mix, which minimise the masking of sources and places sources in positions that are most subjectively pleasing to the listener.
We investigate methodologies of audio editing used by professional sound engineers, in order to better establish best practices and specify the metadata which will be used to enable automation of audio editing.
The benefits of these techniques are demonstrated by developing, evaluating and deploying prototype systems for intelligent recording and sound reproduction. Personnel
Members
| Name | Project/interests/keywords |
|---|---|
| Gary Bromham | The role of nostalga in music production |
| Marco Comunità | Machine learning applied to sound synthesis models |
| Ilias Ibnyahya | Audio Effects design optimization |
| Brendan O'Connor | Singing Voice Attribute Transformation |
| Prof. Joshua D Reiss Professor of Audio Engineering | sound engineering, intelligent audio production, sound synthesis, audio effects, automatic mixing |
| Xavier Riley | Pitch tracking for music applications - beyond 99% accuracy |
| Christian Steinmetz | End-to-end generative modeling of multitrack mixing with non-parallel data and adversarial networks |
| Jingjing Tang | End-to-End System Design for Music Style Transfer with Neural Networks |
| Soumya Sai Vanka | Music Production Style Transfer and Mix Similarity |
- Dr. Pedro Pestana (collaborator) - artistic and scientific basis for audio production techniques
