"NLP's ImageNet moment has arrived" - S. Ruder

GIST: germank/a542f22be0dad004b18775a7976d1a0b

 

Hilgers et al. 2007

Peters et al. 2018

https://gluebenchmark.com/leaderboard

Sanh 2019

Huggingface 

RuBERT

pretrained embeddings for Russian

 

Slavic BERT

 Bulgarian, Czech, Polish, Russian

Papers with Code

Next steps

https://course.spacy.io/

https://www.futurelearn.com/courses/corpus-linguistics