Stephen Roller

Research Engineer

I am a Research Engineer at Facebook AI Research. Previously, I completed my PhD at the University of Texas at Austin, where I studied applications of word embeddings in areas including textual entailment, lexical entailment, lexical relations, paraphrasing, and non-textual modalities. I was also briefly a visiting student at The University of Stuttgart, and completed my undergraduate studies at North Carolina State University.


Natural language processing, semantics, word embeddings, deep learning, and lexical entailment.

Related Links

Google Scholar

Latest Publications

ICML - July 17, 2021

Not All Memories are Created Equal: Learning to Forget by Expiring

Sainbayar Sukhbaatar, Spencer Poff, Stephen Roller, Arthur Szlam, Jason Weston, Angela Fan

ACL - June 22, 2020

Don’t Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training

Margaret Li, Stephen Roller, Ilia Kulikov, Sean Welleck, Y-Lan Boureau, Kyunghyun Cho, Jason Weston

ACL - June 19, 2020

The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents

Kurt Shuster, Da Ju, Stephen Roller, Emily Dinan, Y-Lan Boureau, Jason Weston

NAACL - July 28, 2019

What makes a good conversation? How controllable attributes affect human judgments

Abigail See, Stephen Roller, Douwe Kiela, Jason Weston

ACL - July 28, 2019

Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings

Matt Le, Stephen Roller, Laetitia Papaxanthos, Douwe Kiela, Maximilian Nickel

ACL 2018 - July 16, 2018

Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corpora

Stephen Roller, Douwe Kiela, Maximilian Nickel