Regularizing and Optimizing LSTM Language Models

While the original paper (AWD-LSTM) was a major milestone in RNN research, this specific repository lacks community traction (0 stars). Furthermore, LSTMs have been almost entirely replaced by Transformers and more recently State Space Models (SSMs) in frontier-lab research. The techniques (Weight-dropping, NT-AvSGD) are now standard knowledge and easily reproducible, offering no modern competitive moat.