January 30, 2019
Memorize or generalize? Searching for a compositional RNN in a haystack
IJCAI-ECAI Workshop: Architectures and Evaluation for Generality, Autonomy & Progress in AI
Neural networks are very powerful learning systems, but they do not readily generalize from one task to the other. This is partly due to the fact that they do not learn in a compositional way, that is, by discovering skills that are shared by different tasks, and recombining them to solve new problems. In this paper, we explore the compositional generalization capabilities of recurrent neural networks (RNNs).
By: Adam Liška, Germán Kruszewski, Marco Baroni
Facebook AI Research