All Research Areas
Research Areas
Year Published

129 Results

May 7, 2018

Advances in Pre-Training Distributed Word Representations

Language Resources and Evaluation Conference (LREC)

In this paper, we show how to train high-quality word vector representations by using a combination of known tricks that are however rarely used together.

By: Tomas Mikolov, Edouard Grave, Piotr Bojanowski, Christian Puhrsch, Armand Joulin
April 15, 2018

Learning Filterbanks from Raw Speech for Phone Recognition

International Conference on Acoustics, Speech and Signal Processing (ICASSP)

We train a bank of complex filters that operates on the raw waveform and is fed into a convolutional neural network for end-to-end phone recognition.

By: Neil Zeghidour, Nicolas Usunier, Iasonas Kokkinos, Thomas Schatz, Gabriel Synnaeve, Emmanuel Dupoux
February 2, 2018

StarSpace: Embed All The Things!

Conference on Artificial Intelligence (AAAI)

We present StarSpace, a general-purpose neural embedding model that can solve a wide variety of problems: labeling tasks such as text classification, ranking tasks such as information retrieval/web search, collaborative filtering-based or content-based recommendation, embedding of multi-relational graphs, and learning word, sentence or document level embeddings.

By: Ledell Wu, Adam Fisch, Sumit Chopra, Keith Adams, Antoine Bordes, Jason Weston
February 2, 2018

Efficient Large-Scale Multi-Modal Classification

Conference on Artificial Intelligence (AAAI)

We investigate various methods for performing multi-modal fusion and analyze their trade-offs in terms of classification accuracy and computational efficiency.

By: Douwe Kiela, Edouard Grave, Armand Joulin, Tomas Mikolov
December 4, 2017

ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy Games

Neural Information Processing Systems (NIPS)

In this paper, we propose ELF, an Extensive, Lightweight and Flexible platform for fundamental reinforcement learning research.

By: Yuandong Tian, Qucheng Gong, Wenling Shang, Yuxin Wu, Larry Zitnick
December 4, 2017

Unbounded Cache Model for Online Language Modeling with Open Vocabulary

Neural Information Processing Systems (NIPS)

In this paper, we propose an extension of continuous cache models, which can scale to larger contexts. In particular, we use a large scale non-parametric memory component that stores all the hidden activations seen in the past.

By: Edouard Grave, Moustapha Cisse, Armand Joulin
December 4, 2017

VAIN: Attentional Multi-agent Predictive Modeling

Neural Information Processing Systems (NIPS)

In this paper we introduce VAIN, a novel attentional architecture for multi-agent predictive modeling that scales linearly with the number of agents. Multi-agent predictive modeling is an essential step for understanding physical, social and team-play systems.

By: Yedid Hoshen
December 4, 2017

Gradient Episodic Memory for Continual Learning

Neural Information Processing Systems (NIPS)

One major obstacle towards AI is the poor ability of models to solve new problems quicker, and without forgetting previously acquired knowledge. To better understand this issue, we study the problem of continual learning, where the model observes, once and one by one, examples concerning a sequence of tasks.

By: David Lopez-Paz, Marc'Aurelio Ranzato
December 4, 2017

Poincaré Embeddings for Learning Hierarchical Representations

Neural Information Processing Systems (NIPS)

In this work, we introduce a new approach for learning hierarchical representations of symbolic data by embedding them into hyperbolic space – or more precisely into an n-dimensional Poincaré ball.

By: Maximilian Nickel, Douwe Kiela
December 4, 2017

Houdini: Fooling Deep Structured Visual and Speech Recognition Models with Adversarial Examples

Neural Information Processing Systems (NIPS)

We introduce a novel flexible approach named Houdini for generating adversarial examples specifically tailored for the final performance measure of the task considered, be it combinatorial and non-decomposable.

By: Moustapha Cisse, Yossi Adi, Natalia Neverova, Joseph Keshet