Publication

Perceptual Limits of Visual-Haptic Simultaneity in Virtual Reality Interactions

IEEE World Haptics Conference


Abstract

The goal of this work is to establish the range of visual-haptic asynchronies that go unnoticed when touching an object. To perform a psychophysical study, however, we would need asynchronous visual-haptic stimuli, but because the contact of the finger with a real object inevitably creates synchronized haptic feedback, here we employ instead a virtual reproduction of the interaction. Participants immersed in a realistic Virtual Reality environment tapped on a virtual object with their index while viewing a fully articulated representation of their hand. Upon tapping, they received haptic feedback in the form of vibration at their fingertip. After each tap, participants judged whether they perceived the view of the contact and the haptic signal to be synchronous or asynchronous and they also reported which of the two seemed to happen first. Despite the difference between the two judgments, results indicate that none of the 19 participants could reliably detect the asynchrony if haptic feedback was presented less than 50ms after the view of the contact with an object. The asynchrony tolerated for haptic before visual feedback was instead only 15ms. These findings can be used as guidelines for haptic feedback in hand-based interactions in Virtual Reality.

Related Publications

All Publications

Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing

Jun Gong, Aakar Gupta, Hrvoje Benko

ACM UIST - October 19, 2020

Constraining Dense Hand Surface Tracking with Elasticity

Breannan Smith, Chenglei Wu, He Wen, Patrick Peluse, Yaser Sheikh, Jessica Hodgins, Takaaki Shiratori

SIGGRAPH Asia - December 1, 2020

Enhancement of Ambisonics signals using time-frequency masking

Moti Lugasi, Boaz Rafaely

AVAR - August 17, 2020

Beamforming-based Binaural Reproduction by Matching of Binaural Signals

Lior Madmoni, Jacob Donley, Vladimir Tourbabin, Boaz Rafaely

AVAR - August 17, 2020

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy