SCRNNs

Structurally Constrained Recurrent Neural Network

This is a self contained software accompanying the paper titled: Learning Longer Memory in Recurrent Neural Networks. The code allows you to reproduce our results on two language modeling datasets:

  • PenntreeBank
  • Text8

The code implements three recurrent models:

  • Standard Recurrent Neural Networks
  • Long Short Term Memory Recurrent Neural Networks
  • Structurally Constrained Recurrent Neural Networks

It also allows you to play around with various hyper-parameters.