Publication

Multi-Channel Speech Enhancement Using Graph Neural Networks

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)


Abstract

Multi-channel speech enhancement aims to extract clean speech from a noisy mixture using signals captured from multiple microphones. Recently proposed methods tackle this problem by incorporating deep neural network models with spatial filtering techniques such as the minimum variance distortionless response (MVDR) beamformer. In this paper, we introduce a different research direction by viewing each audio channel as a node lying in a non-Euclidean space and, specifically, a graph. This formulation allows us to apply graph neural networks (GNN) to find spatial correlations among the different channels (nodes). We utilize graph convolution networks (GCN) by incorporating them in the embedding space of a U-Net architecture. We use LibriSpeech dataset and simulate room acoustics data to extensively experiment with our approach using different array types, and number of microphones. Results indicate the superiority of our approach when compared to prior state-of-the-art method.

Related Publications

All Publications

Presentation on Late-Breaking Work at CHI - May 9, 2021

A Multichannel Pneumatic Analog Control System for Haptic Displays

Benjamin Stephens-Fripp, Ali Israr, Carine Rognon

ACM CHI Virtual Conference on Human Factors in Computing Systems (CHI) - May 8, 2021

Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality

Zhen Li, Joannes Chan, Joshua Walton, Hrvoje Benko, Daniel Wigdor, Michael Glueck

CHI - May 8, 2021

Understanding, Detecting and Mitigating the Effects of Coactivations in Ten-Finger Mid-Air Typing in Virtual Reality

Conor R. Foy, John J. Dudley, Aakar Gupta, Hrvoje Benko, Per Ola Kristensson

CHI - May 8, 2021

StickyPie: A Gaze-Based, Scale-Invariant Marking Menu Optimized for AR/VR

Sunggeun Ahn, Stephanie Santosa, Mark Parent, Daniel Wigdor, Tovi Grossman, Marcello Giordano

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy