Leon Bottou

Research Lead

I received the Diplôme d’Ingénieur de l’École Polytechnique (X84) in 1987, the Magistère de Mathématiques Fondamentales et Appliquées et d’Informatique from École Normale Superieure in 1988, and a PhD in computer science from Université de Paris-Sud in 1991. I went to AT&T Bell Laboratories, AT&T Labs, NEC Labs America and Microsoft Research. I joined the Facebook AI Research in March 2015.

The long term goal of my research is to understand how to build human-level intelligence. Although reaching this goal requires conceptual advances that cannot be anticipated at this point, it certainly entails clarifying how to learn and how to reason. My best known contributions are my work on “deep” neural networks in the 1990s, large scale learning in the 2000s, and possibly my more recent work on causal inference in learning systems. I am also known for the DjVu document compression technology.


AI, machine learning, optimization, computer vision, signal processing, natural language processing and data compression

Latest Publications

ICLR - February 1, 2021

Symplectic Recurrent Neural Networks

Zhengdao Chen, Jianyu Zhang, Martin Arjovsky, Léon Bottou

NeurIPS - December 9, 2019

Cold Case: the Lost MNIST Digits

Chhavi Yadav, Léon Bottou

NeurIPS - December 8, 2019

On the Ineffectiveness of Variance Reduced Optimization for Deep Learning

Aaron Defazio, Léon Bottou

ICML - June 9, 2019

First-order Adversarial Vulnerability of Neural Networks and Input Dimension

Carl-Johann Simon-Gabriel, Yann Ollivier, Bernhard Scholkopf, Léon Bottou, David Lopez-Paz

NIPS 2018 - October 26, 2018

SING: Symbol-to-Instrument Neural Generator

Alexandre Défossez, Neil Zeghidour, Nicolas Usunier, Léon Bottou, Francis Bach

SIAM Review - May 8, 2018

Optimization Methods for Large-Scale Machine Learning

Léon Bottou, Frank E. Curtis, Jorge Nocedal

ICLR 2018 - April 30, 2018

Empirical Analysis of the Hessian of Over-Parametrized Neural Networks

Levent Sagun, Utku Evci, V. Ugur Güney, Yann Dauphin, Léon Bottou

arXiv - March 12, 2018

Geometrical Insights for Implicit Generative Modeling

Léon Bottou, Martin Arjovsky, David Lopez-Paz, Maxime Oquab

ICML 2017 - August 6, 2017

Wasserstein Generative Adversarial Networks

Martin Arjovsky, Soumith Chintala, Léon Bottou

CVPR 2017 - July 21, 2017

Discovering Causal Signals in Images

David Lopez-Paz, Robert Nishihara, Soumith Chintala, Bernhard Scholkopf, Léon Bottou

ICLR 2017 - April 24, 2017

Towards Principled Methods for Training Generative Adversarial Networks

Martin Arjovsky, Léon Bottou

ArXiv - August 12, 2015

No Regret Bound for Extreme Bandits

Robert Nishihara, David Lopez-Paz, Léon Bottou

JMLR - December 16, 2013

Counterfactual Reasoning and Learning Systems: The Example of Computational Advertising

Léon Bottou, Jonas Peters, Joaquin Quiñonero Candela, Denis Charles, Max Chickering, Elon Portugaly, Dipankar Ray, Patrice Simard, Ed Snelson