NLP News Cypher | 01.05.20

Where Eagles Dare…

Quantum Stat
Jan 5 · 4 min read

“Before the first frost, a brilliant flash of blue-green light lit the snow and reminded us that winter was almost here.” — GPT-2 (1st iteration)

It’s 2020, can you believe it? It’s been 19 years since the monolith created a baby in space!

sup homie

But seriously, it is 2020, and in my opinion, one of the best outcomes from the recent advancements in NLP/deep learning is the ease of fine-tuning and inference with only a couple lines of code:

@jmcimula twitter

Happy New Year!

This Week:

AI Recap For the New Year

The Common Voice

GPT-2 for the Twitter

The Italian BERT

RASA and the Community

Where is AI Going?

Keras for OCR

Yann Goes Deep

AI Recap For the New Year

Top models and libraries in use today:

The Common Voice

GPT-2 for the Twitter

GPT-2-simple GitHub:

The Italian BERT

Well, we have one now! Turns out it’s called GilBERTo (Sorry BERTini)! And it’s architecture is based on RoBERTa:

GitHub:

RASA and the Community

Where is AI Going?

For what it’s worth, In 2020, I expect to see more multi-modal learning (Merging pictures/video and text) research and newer datasets. I find there is not enough entropy in raw text to model the world. In addition, expect to see more deployments into other languages other than English and more Symbolic/Connectionist integration (aka deep knowledge graphs).

Let’s see what they say:

Keras for OCR

In addition, its performance is robust 👇!

in GitHub

Every Sunday we do a weekly round-up of NLP news and code drops from researchers around the world.

If you enjoyed this article, help us out and share with friends or social media!

For complete coverage, follow our twitter: @Quantum_Stat

www.quantumstat.com

Quantum Stat

Written by

We Build Natural Language Processing Solutions | www.quantumstat.com

More From Medium

Also tagged Naturallanguageprocessing

Also tagged Naturallanguageprocessing

Natural Language Processing

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade