Head-Coupled Kinematic Template Matching: A Prediction Model for Ray Pointing in VR

Conference on Human Factors in Computing Systems (CHI)


This paper presents a new technique to predict the ray pointer landing position for selection movements in virtual reality (VR) environments. The technique adapts and extends a prior 2D kinematic template matching method to VR environments where ray pointers are used for selection. It builds on the insight that the kinematics of a controller and HeadMounted Display (HMD) can be used to predict the ray’s final landing position and angle. An initial study provides evidence that the motion of the head is a key input channel for improving prediction models. A second study validates this technique across a continuous range of distances, angles, and target sizes. On average, the technique’s predictions were within 7.3° of the true landing position when 50% of the way through the movement and within 3.4° when 90%. Furthermore, compared to a direct extension of Kinematic Template Matching, which only uses controller movement, this head-coupled approach increases prediction accuracy by a factor of 1.8x when 40% of the way through the movement.

Related Publications

All Publications

ARCH: Animatable Reconstruction of Clothed Humans

Zeng Huang, Yuanlu Xu, Christoph Lassner, Hao Li, Tony Tung

CVPR - June 15, 2020

Crossing the Chasm: Linking with the Virtual World through a Compact Haptic Actuator

Pornthep Preechayasomboon, Ali Israr

ACM CHI - April 25, 2020

Explorations of Wrist Haptic Feedback for AR/VR Interactions with Tasbi

Evan Pezent, Marcia K. O’Malley, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, Nicholas Colonnese

CHI - April 25, 2020

1st-order Microphone Array System for Large Area Sound Field Recording and Reconstruction: Discussion and Preliminary Results

Federico Borra, Steven Krenn, Israel Dejene Gebru, Dejan Markovic

IEEE WASPAA - October 23, 2019

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy