Research Area
Year Published

45 Results

January 1, 2020

Designing Safe Spaces for Virtual Reality

Ethics in Design and Communication 2020

Virtual Reality (VR) designers accept the ethical responsibilities of removing a user’s entire world and superseding it with a fabricated reality. These unique immersive design challenges are intensified when virtual experiences become public and socially-driven. As female VR designers in 2018, we see an opportunity to fold the language of consent into the design practice of virtual reality—as a means to design safe, accessible, virtual spaces.

Publication will be made available in 2020.

By: Michelle Cortese, Andrea Zeller

February 16, 2019

Machine Learning at Facebook: Understanding Inference at the Edge

IEEE International Symposium on High-Performance Computer Architecture (HPCA)

This paper takes a data-driven approach to present the opportunities and design challenges faced by Facebook in order to enable machine learning inference locally on smartphones and other edge platforms.

By: Carole-Jean Wu, David Brooks, Kevin Chen, Douglas Chen, Sy Choudhury, Marat Dukhan, Kim Hazelwood, Eldad Isaac, Yangqing Jia, Bill Jia, Tommer Leyvand, Hao Lu, Yang Lu, Lin Qiao, Brandon Reagen, Joe Spisak, Fei Sun, Andrew Tulloch, Peter Vajda, Xiaodong Wang, Yanghan Wang, Bram Wasti, Yiming Wu, Ran Xian, Sungjoo Yoo, Peizhao Zhang

December 17, 2018

Compact Dielectric Elastomer Linear Actuators

Advanced Functional Materials 2018

The design and fabrication of a rolled dielectric elastomer actuator is described and the parametric dependence of the displacement and blocked force on the actuator geometry, elastomer layer thickness, voltage, and number of turns is analyzed.

By: Huichan Zhao, Aftab M. Hussain, Mihai Duduta, Daniel M. Vogt, Robert J. Wood, David R. Clarke
Areas: AR/VR

December 4, 2018

DeepFocus: Learned Image Synthesis for Computational Displays


In this paper, we introduce DeepFocus, a generic, end-to-end convolutional neural network designed to efficiently solve the full range of computational tasks for accommodation-supporting HMDs. This network is demonstrated to accurately synthesize defocus blur, focal stacks, multilayer decompositions, and multiview imagery using only commonly available RGB-D images, enabling real-time, near-correct depictions of retinal blur with a broad set of accommodation-supporting HMDs.

By: Lei Xiao, Anton Kaplanyan, Alexander Fix, Matthew Chapman, Douglas Lanman

October 25, 2018

Peri-personal space as a prior in coupling visual and proprioceptive signals

Scientific Reports 2018

It has been suggested that the integration of multiple body-related sources of information within the peri-personal space (PPS) scaffolds body ownership. However, a normative computational framework detailing the functional role of PPS is still missing. Here we cast PPS as a visuo-proprioceptive Bayesian inference problem whereby objects we see in our environment are more likely to engender sensations as they come near to the body. We propose that PPS is the refection of such an increased a priori probability of visuo-proprioceptive coupling that surrounds the body.

By: Jean-Paul Noel, Majed Samad, Andrew Doxon, Justin Clark, Sean Keller, Massimiliano Di Luca
Areas: AR/VR

October 12, 2018

Conveying Language through Haptics: A Multi-sensory Approach

International Symposium on Wearable Computers 2018

We propose using a multi-sensory haptic device called MISSIVE, which can be worn on the upper arm and is capable of producing brief cues, sufficient in quantity to encode the full English phoneme set.

By: Nathan Dunkelberger, Jenny Sullivan, Joshua Bradley, Nickolas P Walling, Indu Manickam, Gautam Dasarathy, Ali Israr, Frances Lau, Keith Klumb, Brian Knott, Freddy Abnousi, Richard Baraniuk, Marcia K. O’Malley

October 1, 2018

The effects of natural scene statistics on text readability in additive displays

Human Factors and Ergonomics Society

The minimum contrast needed for optimal text readability with additive displays (e.g. AR devices) will depend on the spatial structure of the background and text. Natural scenes and text follow similar spectral patterns. Therefore, natural scenes can mask low contrast text – making it difficult to read. In a set of experiments, we determine the minimum viable contrast for readability on an additive display.

By: Daryn R. Blanc-Goldhammer, Kevin J. MacKenzie
Areas: AR/VR

September 8, 2018

DeepWrinkles: Accurate and Realistic Clothing Modeling

European Conference on Computer Vision (ECCV)

We present a novel method to generate accurate and realistic clothing deformation from real data capture. Previous methods for realistic cloth modeling mainly rely on intensive computation of physics-based simulation (with numerous heuristic parameters), while models reconstructed from visual observations typically suffer from lack of geometric details.

By: Zorah Lähner, Daniel Cremers, Tony Tung

September 7, 2018

Recycle-GAN: Unsupervised Video Retargeting

European Conference on Computer Vision (ECCV)

We introduce a data-driven approach for unsupervised video retargeting that translates content from one domain to another while preserving the style native to a domain, i.e., if contents of John Oliver’s speech were to be transferred to Stephen Colbert, then the generated content/speech should be in Stephen Colbert’s style.

By: Aayush Bansal, Shugao Ma, Deva Ramanan, Yaser Sheikh

September 3, 2018

QuaterNet: A Quaternion-based Recurrent Model for Human Motion

British Machine Vision Convention (BMVC)

Deep learning for predicting or generating 3D human pose sequences is an active research area. Previous work regresses either joint rotations or joint positions. The former strategy is prone to error accumulation along the kinematic chain, as well as discontinuities when using Euler angle or exponential map parameterizations. The latter requires re-projection onto skeleton constraints to avoid bone stretching and invalid configurations. This work addresses both limitations.

By: Dario Pavllo, David Grangier, Michael Auli