Joelle Pineau

Managing Director, FAIR

I am the head of the Facebook AI Research lab in Montreal, Canada. I am also an associate professor and William Dawson Scholar at McGill University where I co-direct the Reasoning and Learning Lab. My research focuses on developing new models and algorithms for planning and learning in complex partially-observable domains. I also work on applying these algorithms to complex problems in robotics, healthcare, games and conversational agents.

I serve on the editorial board of the Journal of Artificial Intelligence Research and the Journal of Machine Learning Research and am currently President-Elect of the International Machine Learning Society. I am a senior fellow of the Canadian Institute for Advanced Research and in 2016 was named a member of the College of New Scholars, Artists and Scientists by the Royal Society of Canada.

Latest Publications

EMNLP - October 1, 2021

Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little

Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, Douwe Kiela

ACL - July 31, 2021

UnNatural Language Inference

Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams

ICML - July 18, 2021

Multi-Task Reinforcement Learning with Context-based Representations

Shagun Sodhani, Amy Zhang, Joelle Pineau

ICLR - May 4, 2021

Learning Robust State Abstractions for Hidden-Parameter Block MDPs

Amy Zhang, Shagun Sodhani, Khimya Khetarpal, Joelle Pineau

arXiv - November 30, 2020

Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning

Peter Henderson, Jieru Hu, Joshua Romoff, Emma Brunskill, Dan Jurafsky, Joelle Pineau

NeurIPS - November 10, 2020

Adversarial Soft Advantage Fitting: Imitation Learning without Policy Optimization

Paul Barde, Julien Roy, Wonseok Jeon, Joelle Pineau, Derek Nowrouzezahrai, Christopher Pal

UAI - August 4, 2020

Stable Policy Optimization via Off-Policy Divergence Regularization

Ahmed Touati, Amy Zhang, Joelle Pineau, Pascal Vincent

ICML - July 14, 2020

Invariant Causal Prediction for Block MDPs

Amy Zhang, Clare Lyle, Shagun Sodhani, Angelos Filos, Marta Kwiatkowska, Joelle Pineau, Yarin Gal, Doina Precup

ACL - July 5, 2020

Learning an Unreferenced Metric for Online Dialogue Evaluation

Koustuv Sinha, Prasanna Parthasarathi, Jasmine Wang, Ryan Lowe, William L. Hamilton, Joelle Pineau

Learning for Dynamics & Control (L4DC) - June 10, 2020

Plan2vec: Unsupervised Representation Learning by Latent Plans

Ge Yang, Amy Zhang, Ari Morcos, Joelle Pineau, Pieter Abbeel, Roberto Calandra

ICLR - April 26, 2020

On the interaction between supervision and self-play in emergent communication

Ryan Lowe, Abhinav Gupta, Jakob Foerster, Douwe Kiela, Joelle Pineau

The Springer Series on Challenges in Machine Learning - December 12, 2019

The Second Conversational Intelligence Challenge (ConvAI2)

Emily Dinan, Varvara Logacheva, Valentin Malykh, Alexander Miller, Kurt Shuster, Jack Urbanek, Douwe Kiela, Arthur Szlam, Iulian Serban, Ryan Lowe, Shrimai Prabhumoye, Alan W. Black, Alexander Rudnicky, Jason Williams, Joelle Pineau, Jason Weston

NeurIPS - December 9, 2019

Gossip-based Actor-Learner Architectures for Deep Reinforcement Learning

Mahmoud Assran, Joshua Romoff, Nicolas Ballas, Joelle Pineau, Michael G. Rabbat

Workshop on ML for Systems at NeurIPS - November 30, 2019

MVFST-RL: An Asynchronous RL Framework for Congestion Control with Delayed Actions

Viswanath Sivakumar, Tim Rocktäschel, Alexander H. Miller, Heinrich Küttler, Nantas Nardelli, Michael G. Rabbat, Joelle Pineau, Sebastian Riedel

EMNLP - November 5, 2019

CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Text

Koustuv Sinha, Shagun Sodhani, Jin Dong, Joelle Pineau, William L. Hamilton

UAI - June 21, 2019

Randomized Value Functions via Multiplicative Normalizing Flows

Ahmed Touati, Harsh Satija, Joshua Romoff, Joelle Pineau, Pascal Vincent

ICML - June 10, 2019

Separating value functions across time-scales

Joshua Romoff, Peter Henderson, Ahmed Touati, Emma Brunskill, Joelle Pineau, Yann Ollivier

ArXiv - March 14, 2019

On the Pitfalls of Measuring Emergent Communication

Ryan Lowe, Jakob Foerster, Y-Lan Boureau, Joelle Pineau, Yann Dauphin

AAAI 2019 - January 28, 2019

Combined Reinforcement Learning via Abstract Representations

Vincent Francois-Lavet, Yoshua Bengio, Doina Precup, Joelle Pineau

AAAI 2019 - January 18, 2019

On-line Adaptative Curriculum Learning for GANs

Thang Doan, João Monteiro, Isabela Albuquerque, Bodgan Mazoure, Audrey Durand, Joelle Pineau, R. Devon Hjelm

AAAI 2019 - January 18, 2019

Spatially Invariant Unsupervised Object Detection with Convolutional Neural Networks

Eric Crawford, Joelle Pineau

NeurIPS 2018 - December 3, 2018

Temporal Regularization in Markov Decision Process

Pierre Thodoroff, Audrey Durand, Joelle Pineau, Doina Precup

EMNLP - October 31, 2018

Extending Neural Generative Conversational Model using External Knowledge Sources

Prasanna Parthasarathi, Joelle Pineau

CoRL - October 29, 2018

Reward Estimation for Variance Reduction in Deep Reinforcement Learning

Joshua Romoff, Peter Henderson, Alexander Piché, Vincent Francois-Lavet, Joelle Pineau

European Workshop on Reinforcement Learning - October 1, 2018

Where Did My Optimum Go?: An Empirical Analysis of Gradient Descent Optimization in Policy Gradient Methods

Peter Henderson, Joshua Romoff, Joelle Pineau

Journal of Machine Learning Research - August 30, 2018

Streaming kernel regression with provably adaptive mean, variance, and regularization

Audrey Durand, Odalric-Ambrym Maillard, Joelle Pineau