People

Michael Auli

Research Scientist

I am a Research Scientist at Facebook AI Research since 2015. Previously, I was a postdoc at Microsoft Research in Redmond working on improving translation quality using recurrent neural networks. I earned my Ph.D. at the University of Edinburgh for my work on syntactic parsing with approximate inference where I was advised by Adam Lopez and Philipp Koehn. I received a distinguished paper award at EMNLP in 2011 for my work on combinatory categorial grammar parsing.

Interests

Natural language processing, parsing, statistical machine translation, language modeling, structured prediction, large-scale discriminative training, deep learning, recurrent neural networks

Related Links

Website

Latest Publications

vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations

Alexei Baevski, Steffen Schneider, Michael Auli

ICLR - April 27, 2020

Depth-Adaptive Transformer

Maha Elbayad, Jiatao Gu, Edouard Grave, Michael Auli

ICLR - April 26, 2020

Cloze-driven Pretraining of Self-attention Networks

Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli

EMNLP - November 7, 2019

Simple and Effective Noisy Channel Modeling for Neural Machine Translation

Kyra Yee, Yann Dauphin, Michael Auli

EMNLP - November 1, 2019

wav2vec: Unsupervised Pre-training for Speech Recognition

Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli

Interspeech - September 15, 2019

ELI5: Long Form Question Answering

Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, Michael Auli

ACL - July 28, 2019

3D human pose estimation in video with temporal convolutions and semi-supervised training

Dario Pavllo, Christoph Feichtenhofer, David Grangier, Michael Auli

CVPR - June 16, 2019

Mixture Models for Diverse Machine Translation: Tricks of the Trade

Tianxiao Shen, Myle Ott, Michael Auli, Marc'Aurelio Ranzato

ICML - June 10, 2019

Pay less attention with Lightweight and Dynamic Convolutions

Felix Wu, Angela Fan, Alexei Baevski, Yann Dauphin, Michael Auli

ICLR - June 3, 2019

FAIRSEQ: A Fast, Extensible Toolkit for Sequence Modeling

Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli

NAACL - June 3, 2019

Adaptive Input Representations for Neural Language Modeling

Alexei Baevski, Michael Auli

ICLR - May 6, 2019

Understanding Back-Translation at Scale

Sergey Edunov, Myle Ott, Michael Auli, David Grangier

EMNLP 2018 - October 31, 2018

Scaling Neural Machine Translation

Myle Ott, Sergey Edunov, David Grangier, Michael Auli

WMT 2018 - October 30, 2018

QuaterNet: A Quaternion-based Recurrent Model for Human Motion

Dario Pavllo, David Grangier, Michael Auli

BMVC 2018 - September 3, 2018

Controllable Abstractive Summarization

Angela Fan, David Grangier, Michael Auli

ACL NMT Workshop 2018 - July 20, 2018

Analyzing Uncertainty in Neural Machine Translation

Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato

ICML 2018 - July 13, 2018

Classical Structured Prediction Losses for Sequence to Sequence Learning

Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato

NAACL 2018 - June 1, 2018

QuickEdit: Editing Text & Translations by Crossing Words Out

David Grangier, Michael Auli

NAACL 2018 - June 1, 2018

Language Modeling with Gated Convolutional Networks

Yann Dauphin, Angela Fan, Michael Auli, David Grangier

ICML - August 6, 2017

Convolutional Sequence to Sequence Learning

Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann N. Dauphin

ICML 2017 - August 6, 2017

A Convolutional Encoder Model for Neural Machine Translation

Jonas Gehring, Michael Auli, David Grangier, Yann Dauphin

ACL 2017 - July 30, 2017

Neural Text Generation from Structured Data with Application to the Biography Domain

Remi Lebret, David Grangier, Michael Auli

EMNLP - November 1, 2016

Neural Network-Based Word Alignment through Score Aggregation

Joel Legrand, Michael Auli, Ronan Collobert

WMT16 - August 10, 2016

Strategies for Training Large Vocabulary Neural Language Models

Wenlin Chen, David Grangier, Michael Auli

ACL 2016 - August 7, 2016

Abstractive Summarization with Attentive RNN

Sumit Chopra, Michael Auli, Alexander M. Rush

NAACL - April 13, 2016

Sequence Level Training with Recurrent Neural Networks

Marc'Aurelio Ranzato, Sumit Chopra, Michael Auli, Wojciech Zaremba

ICLR - November 20, 2015