Music Translation; LDA on Mental Health; Transfer Learning for NLP

Weekly Reading List #6

Issue #6: 2018/05/21 to 2018/05/27

Photo on Visualhunt

First of all, a big thank you to those who have been supporting this series. It has surpassed my expectation, but unfortunately this series is losing momentum, mostly because of my lack of energy. Therefore I’ve decided to suspend this series after this issue, and instead focus on creating more original and in-depth contents on this platform.

Data Science Tweets of the Day (Shameless Plug)

I’ve created this website to keep track of the best data science-related tweets of the day. A lot of it is still WIP, but I’d love to hear your feedback!

Universal Music Translation Network

This is arguably the most impressive work of the week. Just listen to the samples:

Their model uses a shared WaveNet encoder for all domains, and multiple domain-specific WaveNet decoders. They employs a domain confusion loss to ensure the encoder is not domain-specific.

Taken from the paper

Investigate the Discourse on Metal Health over Time

This is a very well-executed and well-explained end-to-end NLP analysis project.

Transfer Learning for NLP

Sebastian Ruder just gave a keynote on Successes and Frontiers of Deep Learning:

One of the new frontiers is NLP transfer learning he and Jeremy Howard pioneered:

What Your Writing Says About You

Visualize some of the common NLP tasks: part of speech tagging, sentiment analysis, complexity of writing.

An Overview of the FastAI Library

This is a mind map that help you navigate the FastAI library. Should be quite helpful when you want to customize things or extract some parts to your own framework.