Audio and acoustics
Video
Geometry-constrained Beamforming Network for end-to-end Farfield Sound Source Separation
Environmental noise, reverberation and interfering speakers negatively affect the quality of the speech signal and therefore degrade the performance of many speech communication systems including automatic speech recognition systems, hearing assistive devices and mobile devices.…
Tool
Multi-species Bioacoustic Classification
Multi-species bioacoustic classification using deep learning algorithms. With audio recordings collected from rainforests in Puerto Rico, we build a deep learning model that combines transfer learning and pseudo-labeling as a data augmentation technique to: 1)…
Video
Decoding Music Attention from “EEG headphones”: a User-friendly Auditory Brain-computer Interface
Listening to music is a joyful way to relax. Many people enjoy playing music in the background in their daily life, even while working. This makes music an excellent choice as a stimulus for building…
Publication
Online Speaker Diarization with Relation Network
Video
Directional Sources and Listeners in Interactive Sound Propagation using Reciprocal Wave Field Coding
We present the first wave-based interactive system for practical rendering of global sound propagation effects including diffraction, in complex game and VR scenes with moving directional sources and listeners. Learn about Project Triton > Note:…
Video
Planeverb: Interactive sound propagation for dynamic scenes using 2D wave simulation
We present a technique to model wave-based sound propagation to complement visual animation in fully dynamic scenes. We employ 2D wave simulation that captures geometry-based diffraction effects such as obstruction, reverberation, and directivity of perceptually-salient…
