Explorations in Language and Learning

Transfer Learning in NLP

Transfer learning is undoubtedly the new (well, relatively anyway) hot thing in deep learning right now. In vision…

Evaluation Methods for Dialog Systems

Spoken Dialog Systems (SDS) have become very popular recently, especially for goal completion tasks on mobile devices. Also, with the increasing use of IoT devices and their associated assistants like Alexa, Google Home, etc., systems that can converse with users…

The 8 commandments for coding your research

This article is in a different flavor from the other posts in this publication. This…

An Introduction to Speech Recognition using WFSTs

Until now, all of my blog posts have been about deep learning methods or their application to NLP. Since the last couple of weeks, however, I have started learning about Automatic Speech Recognition (ASR). Therefore, I will also include…

How to obtain Sentence Vectors?

In several of my previous posts, I have discussed methods for obtaining word embeddings, such as SVD, word2vec, or GloVe. In this post, I will abstract a level higher and talk about 4 different methods that have been proposed to get embeddings for sentences.

Sparsity in Online Learning with Lasso Regularization

Sparse vectors have become popular recently for 2 reasons:

1. Sparse matrices require much less storage since they can be stored using various space-saving methods.
2. Sparse vectors are much…

A short note on Gradient Descent optimization algorithms