Publication

Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing

ACM User Interface Software and Technology Symposium (UIST)


Abstract

In this paper, we present Acustico, a passive acoustic sensing approach that enables tap detection and 2D tap localization on uninstrumented surfaces using a wrist-worn device. Our technique uses a novel application of acoustic time differences of arrival (TDOA) analysis. We adopt a sensor fusion approach by taking both “surface waves” (i.e., vibrations through surface) and “sound waves” (i.e., vibrations through air) into analysis to improve sensing resolution. We carefully design a sensor configuration to meet the constraints of a wristband form factor. We built a wristband prototype with four acoustic sensors, two accelerometers and two microphones. Through a 20- participant study, we evaluated the performance of our proposed sensing technique for tap detection and localization. Results show that our system reliably detects taps with an F1-score of 0.9987 across different environmental noises and yields high localization accuracies with root-mean-square-errors of 7.6mm (X-axis) and 4.6mm (Y-axis) across different surfaces and tapping techniques.

Related Publications

All Publications

SPCE - December 21, 2020

Contact Burn Injuries Part II: The influence of object shape, size, contact resistance, and applied heat flux

May Yen, Francesco Colella, Harri Kytomaa, Boyd Allin, Alex Ockfen

SPCE - December 21, 2020

Contact Burn Injuries Part I: The influence of object thermal mass

May Yen, Francesco Colella, Harri Kytomaa, Boyd Allin, Alex Ockfen

ICSE - November 23, 2020

Predictive Test Selection

Mateusz Machalica, Alex Samylkin, Meredith Porth, Satish Chandra

3DV - November 25, 2020

MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Video

Donglai Xiang, Fabian Prada, Chenglei Wu, Jessica Hodgins

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy