Tagged in

Deep Learning

Explorations in Language and Learning

This is a collection of articles on machine learning and deep learning techniques applied to natural language processing. The content includes overviews of popular methods, new approaches for specific NLP tasks, and blogs about the authors’ personal research in the subject.

More information

Followers

516

More, on Medium

Deep Learning

Desh Raj in Explorations in Language and Learning

Jun 15, 2018

Transfer Learning in NLP

Transfer learning is undoubtedly the new (well, relatively anyway) hot thing in deep learning right now. In vision…

1 response

Desh Raj in Explorations in Language and Learning

Jun 6, 2018

Evaluation Methods for Dialog Systems

Spoken Dialog Systems (SDS) have become very popular recently, especially for goal completion tasks on mobile devices. Also, with the increasing use of IoT devices and their associated assistants like Alexa, Google Home, etc., systems that can converse with users…

Desh Raj in Explorations in Language and Learning

Apr 12, 2018

How to obtain Sentence Vectors?

In several of my previous posts, I have discussed methods for obtaining word embeddings, such as SVD, word2vec, or GloVe. In this post, I will abstract a level higher and talk about 4 different methods that have been proposed to get embeddings for sentences.

1 response

Desh Raj in Explorations in Language and Learning

Mar 14, 2018

Online Learning of Word Embeddings

Word vectors have become the building blocks for all natural language processing systems. I have earlier written an overview of popular algorithms for learning word embeddings here. One limitation with all these methods (namely SVD, skip-gram, and GloVe) is that they…

Desh Raj in Explorations in Language and Learning

Feb 7, 2018

Irony detection in tweets

There was a SemEval 2018 Shared Task on “irony detection in tweets” that ended recently. As a fun personal project, I thought of giving it a shot, just to implement some new ideas. In this post, I will describe my approach for the problem along with some code.

Desh Raj in Explorations in Language and Learning

Dec 14, 2017

Unsupervised approaches for NMT

Translation is one of those tasks in language where the arrival of deep learning systems, and in particular sequence-to-sequence, has been something like a boon. In less than 4 years since the first paper on Neural Machine Translation, software giants such as Google and…

Desh Raj in Explorations in Language and Learning

Dec 6, 2017

Beyond Euclidean embeddings

Representation learning, as the name suggests, seeks to learn representations for structures such as images, videos, words, sentencences, graphs, etc., which may then be used for several objectives. Arguably the most important representations used nowadays are word embeddings…

Desh Raj in Explorations in Language and Learning

Nov 9, 2017

Deep Learning for Multimodal Systems

When I was browsing through research groups for my grad school applications, I came across some…

Desh Raj in Explorations in Language and Learning

Nov 7, 2017

Trends in Semantic Parsing — Part 2

In Part 1 of this two-part series, I discussed some supervised approaches for the objective. In this part, we will look at some unsupervised or semi-supervised approaches, namely a Bayesian model, and transfer learning.

An unsupervised…

Desh Raj in Explorations in Language and Learning

Oct 14, 2017

The best papers at ICLR ‘17

The International Conference on Learning Representations (ICLR) has evolved into the deep learning conference over the last few years, and with its open review system, it is not difficult to understand why. I was recently going through some of the papers accepted at this year’s…