All Research Areas
Research Areas
Year Published

78 Results

September 8, 2018

DeepWrinkles: Accurate and Realistic Clothing Modeling

European Conference on Computer Vision (ECCV)

We present a novel method to generate accurate and realistic clothing deformation from real data capture. Previous methods for realistic cloth modeling mainly rely on intensive computation of physics-based simulation (with numerous heuristic parameters), while models reconstructed from visual observations typically suffer from lack of geometric details.

By: Zorah Lähner, Daniel Cremers, Tony Tung
August 14, 2018

Deep Appearance Models for Face Rendering

ACM SIGGRAPH

We introduce a deep appearance model for rendering the human face. Inspired by Active Appearance Models, we develop a data-driven rendering pipeline that learns a joint representation of facial geometry and appearance from a multiview capture setup.

By: Stephen Lombardi, Jason Saragih, Tomas Simon, Yaser Sheikh
August 13, 2018

Unsupervised Generation of Free-Form and Parameterized Avatars

TPAMI: SI: ICCV

We study two problems involving the task of mapping images between different domains. The first problem, transfers an image in one domain to an analog image in another domain. The second problem, extends the previous one by mapping an input image to a tied pair, consisting of a vector of parameters and an image that is created using a graphical engine from this vector of parameters.

By: Adam Polyak, Yaniv Taigman, Lior Wolf
July 29, 2018

Online Optical Marker-based Hand Tracking with Deep Labels

Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH)

We propose a technique that frames the labeling problem as a keypoint regression problem conducive to a solution using convolutional neural networks.

By: Shangchen Han, Beibei Liu, Robert Wang, Yuting Ye, Christopher D. Twigg, Kenrick Kin
July 10, 2018

Optimizing the Latent Space of Generative Networks

International Conference on Machine Learning (ICML)

The goal of this paper is to disentangle the contribution of these two factors to the success of GANs. In particular, we introduce Generative Latent Optimization (GLO), a framework to train deep convolutional generators using simple reconstruction losses.

By: Piotr Bojanowski, Armand Joulin, David Lopez-Paz, Arthur Szlam
July 7, 2018

Reconstructing Scenes with Mirror and Glass Surfaces

ACM SIGGRAPH

We introduce a fully automatic pipeline that allows us to reconstruct the geometry and extent of planar glass and mirror surfaces while being able to distinguish between the two.

By: Thomas Whelan, Michael Goesele, Steven J. Lovegrove, Julian Straub, Simon Green, Richard Szeliski, Steven Butterfield, Shobhit Verma, Richard Newcombe
June 19, 2018

A Generative Adversarial Approach for Zero-Shot Learning from Noisy Texts

Computer Vision and Pattern Recognition (CVPR)

Most existing zero-shot learning methods consider the problem as a visual semantic embedding one. Given the demonstrated capability of Generative Adversarial Networks (GANs) to generate images, we instead leverage GANs to imagine unseen categories from text descriptions and hence recognize novel classes with no examples being seen.

By: Yizhe Zhu, Mohamed Elhoseiny, Bingchen Liu, Xi Peng, Ahmed Elgammal
June 18, 2018

Learning to Segment Every Thing

Computer Vision and Pattern Recognition (CVPR)

The goal of this paper is to propose a new partially supervised training paradigm, together with a novel weight transfer function, that enables training instance segmentation models on a large set of categories all of which have box annotations, but only a small fraction of which have mask annotations.

By: Ronghang Hu, Piotr Dollar, Kaiming He, Trevor Darrell, Ross Girshick
June 18, 2018

Modeling Facial Geometry using Compositional VAEs

Computer Vision and Pattern Recognition (CVPR)

We propose a method for learning non-linear face geometry representations using deep generative models. Our model is a variational autoencoder with multiple levels of hidden variables where lower layers capture global geometry and higher ones encode more local deformations.

By: Timur Bagautdinov, Chenglei Wu, Jason Saragih, Pascal Fua, Yaser Sheikh
June 18, 2018

Detecting and Recognizing Human-Object Interactions

Computer Vision and Pattern Recognition (CVPR)

In this paper, we address the task of detecting triplets in challenging everyday photos. We propose a novel model that is driven by a human-centric approach. Our hypothesis is that the appearance of a person – their pose, clothing, action – is a powerful cue for localizing the objects they are interacting with.

By: Georgia Gkioxari, Ross Girshick, Piotr Dollar, Kaiming He