Word embeddings

Memory Networks

Compressing Word Embeddings

Softmax Bottlneck

Research Guild Meeting: "Breaking the Softmax Bottleneck: A High-Rank RNN Language Model" by Zhilin Yang, Zihang Dai, Ruslan Salakhutdinov, and William W. Cohen.

Recent Advanced in Language Modelling