June 14, 2019
2.5D Visual Sound
Conference Computer Vision and Pattern Recognition (CVPR)
Binaural audio provides a listener with 3D sound sensation, allowing a rich perceptual experience of the scene. However, binaural recordings are scarcely available and require nontrivial expertise and equipment to obtain. We propose to convert common monaural audio into binaural audio by leveraging video.
By: Ruohan Gao, Kristen Grauman
Facebook AI Research