Publication

Lost in Style: Gaze-driven Adaptive Aid for VR Navigation

ACM CHI Conference on Human Factors in Computing Systems


Abstract

A key challenge for virtual reality level designers is striking a balance between maintaining the immersiveness of VR and providing users with on-screen aids after designing a virtual experience. These aids are often necessary for wayfinding in virtual environments with complex paths.

We introduce a novel adaptive aid that maintains the effectiveness of traditional aids, while equipping designers and users with the controls of how often help is displayed. Our adaptive aid uses gaze patterns in predicting user’s need for navigation aid in VR and displays mini-maps or arrows accordingly. Using a dataset of gaze angle sequences of users navigating a VR environment and markers of when users requested aid, we trained an LSTM to classify user’s gaze sequences as needing navigation help and display an aid. We validated the efficacy of the adaptive aid for wayfinding compared to other commonly-used wayfinding aids.

Related Publications

All Publications

AES - August 13, 2020

Listener-Preferred Headphone Frequency Response for Stereo and Spatial Audio Content

Isaac Engel, David Lou Alon, Kevin Scheumann, Ravish Mehra

ICMI - December 4, 2019

To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations

Chaitanya Ahuja, Shugao Ma, Louis-Philippe Morency, Yaser Sheikh

The Journal of the Audio Engineering Society (AES) - May 3, 2021

Full Range Omnidirectional Sound Source for Near-Field Head-Related Transfer-Functions Measurement

Bartlomiej Chojnacki, Sang-Ik Terry Cho, Ravish Mehra

ICLR - May 4, 2021

Neural Synthesis of Binaural Speech from Mono Audio

Alexander Richard, Dejan Markovic, Israel D. Gebru, Steven Krenn, Gladstone Butler, Fernando De la Torre, Yaser Sheikh

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy