Audio Engineering Research in the Centre for Digital Music
- News and reporting on our research
- Demonstration videos on YouTube Channel: Intelligent Sound Engineering
- Check out our blog, Intelligent Sound Engineering
- Academic publications
Some of our current and recent research projects include;
- Automatic mixing - Methods for automatic multitrack audio production in real-time
- Sound synthesis
- Spatial audio production and reproduction
- Reverse engineering the mix - a targeted mixing and mastering tool
- Reducing Artifacts Between Source and Microphone in Live Sound
- Transient modification
- Source separation for live sound - Crosstalk, bleed and interference reduction techniques
- Gesture-controlled mixing of multichannel audio
- Multitrack segmentation
- Intelligent dynamic range compression
- Microphone shoot-out (pairwise and multi-stimuli evaluation)
PhD Study - interested in joining the team? We are currently accepting PhD applications.
We develop intelligent recording techniques, for use by audio editors, mixers and sound engineers, which speed up the recording process, minimise preparation for live performance, and enable easy preparation and transmission of high resolution audio.
Advances in signal processing, machine learning and adaptive systems, have rarely been applied to the professional audio market. This is partly because most digital signal processing applications in these areas have remained focused on replicating or improving those techniques which could be applied in the analogue domain. And until recently, mixing consoles and audio workstations did not have the computing power to allow the introduction of multi-input, multi-output processing tools. Thus audio effects have traditionally been limited to those which operate only on single or stereo channels. There is now an opportunity to develop advanced audio effects which analyse all input channels in order to produce the ideal mix.
Audio engineering for live sound production represents a field with strong potential for improvement and automation. Much of the effort of a sound engineer in preparation for a live performance is consumed by tedious, repetitive tasks. Levels must be set to avoid feedback, input channels must be panned to stereo or surround sound, equalisation, normalisation and compression must be applied to each channel, and all equipment must be tested along with establishing an optimal choice of microphone placement. Only after these tasks have been performed, if time and resources permit, may the sound engineer refine these choices to produce an aesthetically pleasing mix which best captures the intended sound. There is a need for tools which minimise sound-checks by automating complex but non-artistic tasks, establish recommended settings based on the input signals and acoustics, and identifying and avoid issues such as acoustic feedback and microphone crossover.
We develop and test techniques to convert audio mixes between formats. We are working to devise methods to automatically create a surround sound mix, which minimise the masking of sources and places sources in positions that are most subjectively pleasing to the listener.
We investigate methodologies of audio editing used by professional sound engineers, in order to better establish best practices and specify the metadata which will be used to enable automation of audio editing.
The benefits of these techniques are demonstrated by developing, evaluating and deploying prototype systems for intelligent recording and sound reproduction. Personnel
|Emmanouil (Emmanuel) Theofanis Chourdakis||Machine Learning for Music Audio Analysis and DAFx control, Computer Assisted Multimedia Production, Large Scale Audio and Video Analysis.|
|Brecht De Man||Semantic Mixing of Multitrack Audio|
|Qiuqiang Kong||Music / Audio Signal Processing, Machine Learning, Pattern Recognition, Mathematics, Statistics, Probability Models, Audio Event Detection.|
|Dave Moffat||Perceptual Evaluation of Sound Synthesis|
|Zulfadhli Mohamad||Electric guitar synthesis|
|Dr Joshua D Reiss|
Reader in Audio Engineering
|sound engineering, intelligent audio production, sound synthesis, audio effects, automatic mixing|
|David Ronan||Automatic subgrouping of multitrack audio|
|Rod Selfridge||Developing real-time physical sound synthesis models. Currently focussed on aeroacoustic sounds|
|Yonghao Wang||Intelligent Audio Consoles|
|Will Wilkinson||Sound Effect Synthesis|
|Dr. Thomas Wilmering|
- Dr. Pedro Pestana (collaborator) - artistic and scientific basis for audio production techniques