Research Area
Year Published

87 Results

June 16, 2019

Self-Supervised Adaptation of High-Fidelity Face Models for Monocular Performance Tracking

Conference on Computer Vision and Pattern Recognition (CVPR)

Improvements in data-capture and face modeling techniques have enabled us to create high-fidelity realistic face models. However, driving these realistic face models requires special input data, e.g. 3D meshes and unwrapped textures. Also, these face models expect clean input data taken under controlled lab environments, which is very different from data collected in the wild. All these constraints make it challenging to use the high-fidelity models in tracking for commodity cameras. In this paper, we propose a self-supervised domain adaptation approach to enable the animation of high-fidelity face models from a commodity camera.

By: Jae Shin Yoon, Takaaki Shiratori, Shoou-I Yu, Hyun Soo Park

June 14, 2019

2.5D Visual Sound

Conference Computer Vision and Pattern Recognition (CVPR)

Binaural audio provides a listener with 3D sound sensation, allowing a rich perceptual experience of the scene. However, binaural recordings are scarcely available and require nontrivial expertise and equipment to obtain. We propose to convert common monaural audio into binaural audio by leveraging video.

By: Ruohan Gao, Kristen Grauman

May 31, 2019

Soundfield Reconstruction in Reverberant Environments Using Higher-Order Microphones and Impulse Response Measurements

IEEE International Conference on Acoustics, Speech and Signal Processing

This paper addresses the problem of soundfield reconstruction over a large area using a distributed array of higher-order microphones. Given an area enclosed by the array, one can distinguish between two components of the soundfield: the interior soundfield generated by sources outside of the enclosed area and the exterior soundfield generated by sources inside the enclosed area.

By: Federico Borra, Israel Dejene Gebru, Dejan Markovic
Areas: AR/VR

May 17, 2019

Psychophysical Evaluation of Persistence- and Frequency-Limited Displays for Virtual and Augmented Reality

SID Display Week

Little is known about user sensitivity to flicker and eye movement-induced ghosting at refresh rates and persistence levels relevant for head-mounted displays (HMDs). In this report, we describe a pair of psychophysical experiments that we performed to comprehensively quantify these artifacts and make general recommendations for HMD design.

By: T. Scott Murdison, Christopher McIntosh, James Hillis, Kevin J. MacKenzie

May 10, 2019

Touch with Foreign Hands: The Effect of Virtual Hand Appearance on Visual-Haptic Integration

ACM Symposium on Applied Perception (SAP)

Hand tracking and haptics are gaining more importance as key technologies of virtual reality (VR) systems. For designing such systems, it is fundamental to understand how the appearance of the virtual hands influences user experience and how the human brain integrates vision and haptics.

By: Valentin Schwind, Lorraine Lin, Massimiliano Di Luca, Sophie Jörg, James Hillis
Areas: AR/VR

May 9, 2019

Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio

ACM CHI Conference on Human Factors in Computing Systems

In virtual reality, the lack of kinesthetic feedback often prevents users from experiencing the weight of virtual objects. Control-to-display (C/D) ratio manipulation has been proposed as a method to induce weight perception without kinesthetic feedback. Based on the fact that lighter (heavier) objects are easier (harder) to move, this method induces an illusory perception of weight by manipulating the rendered position of users’ hands—increasing or decreasing their displayed movements.

By: Majed Samad, Elia Gatti, Anne Hermes, Hrvoje Benko, Cesare Parise

May 4, 2019

An Explanation of Fitts’ Law-like Performance in Gaze-Based Selection Tasks Using a Psychophysics Approach

ACM CHI Conference on Human Factors in Computing Systems

Using a vision science-inspired model, we here show that a Fitts’-like distribution of movement times can arise due to the execution of secondary saccades, especially when targets are small.

By: Immo Schuetz, T. Scott Murdison, Kevin J. MacKenzie, Marina Zannoli

May 4, 2019

Lost in Style: Gaze-driven Adaptive Aid for VR Navigation

ACM CHI Conference on Human Factors in Computing Systems

We introduce a novel adaptive aid that maintains the effectiveness of traditional aids, while equipping designers and users with the controls of how often help is displayed.

By: Rawan Alghofaili, Yasuhito Sawahata, Haikun Huang, Hsueh-Cheng Wang, Takaaki Shiratori, Lap-Fai Yu

April 29, 2019

Precise Network Polymerized Ionic Liquids for Low-Voltage, Dopant-Free Soft Actuators

Advanced Materials

Here, a class of network polymerized ionic liquid (n-PIL) actuators is reported, synthesized via a facile step growth polymerization, which not only have comparable actuation strains (≈0.9%) to other state-of-the-art ionic polymer systems at ±3 V, but also exhibit 85% performance preservation after 1000 testing cycles and operate with no additives such as solvent or free ionic liquid.

By: Chengtian Shen, Qiujie Zhao, Christopher M. Evans
Areas: AR/VR

April 28, 2019

Inverse Path Tracing for Joint Material and Lighting Estimation

Computer Vision and Pattern Recognition (CVPR)

Modern computer vision algorithms have brought significant advancement to 3D geometry reconstruction. However, illumination and material reconstruction remain less studied, with current approaches assuming very simplified models for materials and illumination. We introduce Inverse Path Tracing, a novel approach to jointly estimate the material properties of objects and light sources in indoor scenes by using an invertible light transport simulation.

By: Dejan Azinović, Tzu-Mao Li, Anton S. Kaplanyan, Matthias Nießner