New trends in NLP

(Natural Language Processing)

Plan

• A bit of history
• Best exciting trends
• Some examples

History

Dependency Parsing

Named entity recognition

Tokenization

Context comprehesion in vectors

Vectorization

Embeddings

T5

Parameters

Massive Multi task learning

Beyond the  transformer

Universal Models

Conditional image generation

Program synthesis

Bias

Token-free models

NLP Libraries

• SpaCy
• NLTk
• GenSim
• CoreNLP
• TextBlob
• Pattern
• AllenNLP
• Contractions
• NLPAug
• Transformers (hugging face)