AI Research at Deep Learning lab @ MIPT
The first part is devoted to the main fresh idea in our field — Transformer. If you are interested in Feed-Forward networks disrupting RNNs’ monopoly, welcome to the first part.
Disclaimer: First of all I need to say that all these trends and advances are only my point of view, other people could have other perspectives.
In 2017 A.D. I could spot two main trends:
It seems that dialog systems have been around from the dawn of our age. A good example of them is Eliza — a chatbot system born in the 1960s. This is a psychotherapist bot, whose interface resembles the interface of Apollo mission, and…