Explorations in Language and Learning

Hi! It has been fun maintaining this blog. I have learned a lot about ML, deep learning, NLP, and lots more since I started writing here…

Transfer learning is undoubtedly the new (well, relatively anyway) hot thing in deep learning right now. In vision, it has been in practice…

Spoken Dialog Systems (SDS) have become very popular recently, especially for goal completion tasks on mobile devices. Also, with the…

This article is in a different flavor from the other posts in this publication. This is because I have been reading Roman Vershynin’s “High…

Until now, all of my blog posts have been about deep learning methods or their application to NLP. Since the last couple of weeks, however…

In several of my previous posts, I have discussed methods for obtaining word embeddings, such as SVD, word2vec, or GloVe. In this post, I…

Word vectors have become the building blocks for all natural language processing systems. I have earlier written an overview of popular…

Sparse vectors have become popular recently for 2 reasons:

I just finished reading Sebastian Ruder’s amazing article providing an overview of the most popular algorithms used for optimizing gradient…

There was a SemEval 2018 Shared Task on “irony detection in tweets” that ended recently. As a fun personal project, I thought of giving it…

In the first part of this series on learning theory, we looked only at the case of finite hypothesis sets, and derived some generalization…

One of the most significant take-aways from NIPS 2017 was the “alchemy” debate spearheaded by Ali Rahimi. In the wake of the event, I have…

Translation is one of those tasks in language where the arrival of deep learning systems, and in particular sequence-to-sequence, has been…

Representation learning, as the name suggests, seeks to learn representations for structures such as images, videos, words, sentencences…

When I was browsing through research groups for my grad school applications, I came across some interesting applications of new deep…

In Part 1 of this two-part series, I discussed some supervised approaches for the objective. In this part, we will look at some…

The International Conference on Learning Representations (ICLR) has evolved into the deep learning conference over the last few years, and…

While working on my undergrad thesis on relation classification of biomedical text using deep learning methods, I quickly hacked together…

This article is a formal representation of my understanding of vector semantics, from course notes and reading reference papers and…

In this article, I will try to round up some (mostly neural) approaches for semantic parsing and semantic role labeling (SRL). This is not…