Perceptual Limits of Visual-Haptic Simultaneity in Virtual Reality Interactions

IEEE World Haptics Conference


The goal of this work is to establish the range of visual-haptic asynchronies that go unnoticed when touching an object. To perform a psychophysical study, however, we would need asynchronous visual-haptic stimuli, but because the contact of the finger with a real object inevitably creates synchronized haptic feedback, here we employ instead a virtual reproduction of the interaction. Participants immersed in a realistic Virtual Reality environment tapped on a virtual object with their index while viewing a fully articulated representation of their hand. Upon tapping, they received haptic feedback in the form of vibration at their fingertip. After each tap, participants judged whether they perceived the view of the contact and the haptic signal to be synchronous or asynchronous and they also reported which of the two seemed to happen first. Despite the difference between the two judgments, results indicate that none of the 19 participants could reliably detect the asynchrony if haptic feedback was presented less than 50ms after the view of the contact with an object. The asynchrony tolerated for haptic before visual feedback was instead only 15ms. These findings can be used as guidelines for haptic feedback in hand-based interactions in Virtual Reality.

Related Publications

All Publications

SIGGRAPH - August 9, 2021

Deep Relightable Appearance Models for Animatable Faces

Sai Bi, Stephen Lombardi, Shunsuke Saito, Tomas Simon, Shih-En Wei, Kevyn Mcphail, Ravi Ramamoorthi, Yaser Sheikh, Jason Saragih

NeurIPS - December 10, 2020

Neural Sparse Voxel Fields

Lingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua, Christian Theobalt

IEEE AIVR - December 16, 2020

Algorithm-Aware Neural Network Based Image Compression for High-Speed Imaging

Reid Pinkham, Tanner Schmidt, Andrew Berkovich

AAAI - February 9, 2021

NASGEM: Neural Architecture Search via Graph Embedding Method

Hsin-Pai Cheng, Tunhou Zhang, Yixing Zhang, Shiyu Liang, Feng Liang, Feng Yan, Meng Li, Vikas Chandra, Hai Li, Yiran Chen

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy