People

Rob Fergus

Research Lead

I am a Research Scientist in the Facebook AI Research Group. I am currently on leave from the Courant Institute of Mathematical Sciences, New York University where I am an Associate Professor of Computer Science. I received a Masters in Electrical Engineering with Prof. Pietro Perona at Caltech, before completing a PhD with Prof. Andrew Zisserman at the University of Oxford in 2005. Before coming to NYU, I spent two years as a post-doc in the Computer Science and Artificial Intelligence Lab (CSAIL) at MIT, working with Prof. William Freeman. I have received several awards including a CVPR best paper prize, a Sloan Fellowship & NSF Career award and the IEEE Longuet-Higgins prize.

Interests

Computer vision, machine learning

Latest Publications

Energy-based models for atomic-resolution protein conformations

Yilun Du, Joshua Meier, Jerry Ma, Rob Fergus, Alexander Rives

ICLR - April 25, 2020

Finding Generalizable Evidence by Learning to Convince Q&A Models

Ethan Perez, Siddharth Karamcheti, Rob Fergus, Jason Weston, Douwe Kiela, Kyunghyun Cho

EMNLP - November 4, 2019

Hierarchical RL Using an Ensemble of Proprioceptive Periodic Policies

Kenneth Marino, Abhinav Gupta, Rob Fergus, Arthur Szlam

ICLR - May 6, 2019

Modeling Others using Oneself in Multi-Agent Reinforcement Learning

Roberta Raileanu, Emily Denton, Arthur Szlam, Rob Fergus

ICML 2018 - July 10, 2018

Composable Planning with Attributes

Amy Zhang, Adam Lerer, Sainbayar Sukhbaatar, Rob Fergus, Arthur Szlam

ICML 2018 - July 9, 2018

Learning by Asking Questions

Ishan Misra, Ross Girshick, Rob Fergus, Martial Hebert, Abhinav Gupta, Laurens van der Maaten

CVPR 2018 - June 18, 2018

Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play

Sainbayar Sukhbaatar, Zeming Lin, Ilya Kostrikov, Gabriel Synnaeve, Arthur Szlam, Rob Fergus

ICLR 2018 - April 30, 2018

End-to-End Voxel-to-Voxel Prediction

Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, Manohar Paluri

CVPR 2016 - June 26, 2016

Learning Physical Intuition of Block Towers by Example

Adam Lerer, Sam Gross, Rob Fergus

ICML 2016 - June 18, 2016

Simple Bag-of-Words Baseline for Visual Question Answering

Bolei Zhou, Yuandong Tian, Sainbayar Sukhbaatar, Arthur Szlam, Rob Fergus

ArXiv - December 7, 2015

Learning Simple Algorithms from Examples

Wojciech Zaremba, Tomas Mikolov, Armand Joulin, Rob Fergus

ArXiv - November 23, 2015

MazeBase: A Sandbox for Learning from Games

Sainbayar Sukhbaatar, Arthur Szlam, Gabriel Synnaeve, Soumith Chintala, Rob Fergus

ArXiv - November 23, 2015

End-To-End Memory Networks

Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, Rob Fergus

NIPS - June 22, 2015

Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks

Emily Denton, Soumith Chintala, Arthur Szlam, Rob Fergus

ArXiv - June 22, 2015

Learning Spatiotemporal Features with 3D Convolutional Networks

Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, Manohar Paluri

ArXiv - June 22, 2015

Beyond Frontal Faces: Improving Person Recognition Using Multiple Cues

Ning Zhang, Manohar Paluri, Yaniv Taigman, Rob Fergus, Lubomir Bourdev

CVPR - June 1, 2015