🌊 Beating the state-of-the-art in NLP with HMTL

Victor Sanh
Nov 20, 2018 · 11 min read
Example of results given by the online demo of HMTL

A brief introduction to cool 😎 stuff in Multi-Task Learning and why it matters.

Ok, this image has little to do with this post, but who doesn’t like dogs ? — Source: Cheezburger.com

Multi-Task Learning in Python 🐍




Improving the state-of-the-art 📈 in semantic tasks: A Hierarchical Multi-Task Learning model (HMTL)

The HMTL (Hierarchical Multi-Task Learning) architecture. The base word representations (embeddings) are shared over the whole architecture through short-connections.

References

HuggingFace

Stories @ Hugging Face

Thanks to Julien Chaumond, Clément Delangue, and Thomas Wolf.

Victor Sanh

Written by

Scientist at @HuggingFace | Into Natural Language Processing, started with Computer Vision

HuggingFace

Stories @ Hugging Face