Top stories published by Explorations in Language and Learning in 2017

Homepage

Open in app

Top Stories published by Explorations in Language and Learning in 2017

All

2017

Desh Raj in Explorations in Language and Learning

Sep 16, 2017

Metrics for NLG evaluation

Simple natural language processing tasks such as sentiment analysis, or even more complex ones like semantic parsing are easy to evaluate since the evaluation simply requires label matching. As such, metrics like F-score (which is the harmonic mean of precision and recall), or even…

Desh Raj in Explorations in Language and Learning

Sep 28, 2017

Understanding word vectors

This article is a formal representation of my understanding of vector semantics, from course notes and reading reference papers and chapters from Jurafsky’s SLP book. I will be talking about sparse and dense vector semantics, including SVD, skip-gram, and GloVe. In many places, I…

2 responses

Desh Raj in Explorations in Language and Learning

Sep 19, 2017

Trends in Semantic Parsing — Part 1

In this article, I will try to round up some (mostly neural) approaches for semantic parsing and semantic role labeling (SRL). This is not an extensive review of these methods, but just a collection of my notes on reading some recent research on the subject. However…

1 response

Desh Raj in Explorations in Language and Learning

Dec 6, 2017

Beyond Euclidean embeddings

Representation learning, as the name suggests, seeks to learn representations for structures such as images, videos, words, sentencences, graphs, etc., which may then be used for several objectives. Arguably the most important representations used nowadays are word embeddings…

Desh Raj in Explorations in Language and Learning

Dec 14, 2017

Unsupervised approaches for NMT

Translation is one of those tasks in language where the arrival of deep learning systems, and in particular sequence-to-sequence, has been something like a boon. In less than 4 years since the first paper on Neural Machine Translation, software giants such as Google and…

Desh Raj in Explorations in Language and Learning

Oct 1, 2017

The last 3 years in Text Classification

While working on my undergrad thesis on relation classification of biomedical text using deep learning methods, I quickly hacked together models in Tensorflow that combined convolutional and recurrent layers in various combinations. While some of these…

1 response

Desh Raj in Explorations in Language and Learning

Oct 14, 2017

The best papers at ICLR ‘17

The International Conference on Learning Representations (ICLR) has evolved into the deep learning conference over the last few years, and with its open review system, it is not difficult to understand why. I was recently going through some of the papers accepted at this year’s…

Desh Raj in Explorations in Language and Learning

Nov 7, 2017

Trends in Semantic Parsing — Part 2

In Part 1 of this two-part series, I discussed some supervised approaches for the objective. In this part, we will look at some unsupervised or semi-supervised approaches, namely a Bayesian model, and transfer learning.

An unsupervised…

Desh Raj in Explorations in Language and Learning

Nov 9, 2017

Deep Learning for Multimodal Systems

When I was browsing through research groups for my grad school applications, I came across some…

2018

About

Explorations in Language and Learning

This is a collection of articles on machine learning and deep learning techniques applied to natural language processing. The content includes overviews of popular methods, new approaches for specific NLP tasks, and blogs about the authors’ personal research in the subject.

More information