MongoDB and PySpark 2.1.0

The common problem with using the latest release of any framework is that there are no or very few adopters, docs are not updated or point to older versions. We encountered a similar problem while integrating MongoDB driver with Apache Spark 2.X. Majority of the library docs…

Building Data Pipelines with Luigi

All data science solutions start off as a prototype. As we start proving our hypothesis, we build on top of existing prototypes, which soon bloats. The real challenge begins when we need to run this prototype in production which obviously has to be a scalable system…

Spark 2.x External Packages

The bane of using bleeding edge technology is very less or hidden information of new features in the latest version. We at Unnati use bleeding edge releases of many data science tools for various research and production systems. In this post we explain how to add external jars to…

Introduction to Neural Networks

Artificial Neural Networks (ANNs) have totally changed what computers are capable of learning. Though…

What?

Word embedding is a technique of converting words to vectors of a high dimension space. In simple terms, in each dimension, we group words based on…

Music and Building Software Systems

Recently, I was at a data science conference, day 1 was concluded with wonderful djembe (an African percussion instrument) workshop.

Art is Science made clear — Wilson Mizner

Data Science & Visualization

Dev sprint as we know, is a day that is dedicated to solving bugs for a project or building a new project in itself. Having never done a dev sprint before, we chose to visualize data in Pandas using Vega.

Neural Networks — The first cut

As I get ready to do my first solo workshop on Deep learning in the field of Natural Language Processing, my anxiety levels are extremely high and I am definitely excited. 
The anxiety levels have made me read numerous papers , blog posts and definitely some code. I feel I…

A Prettier Word Cloud

How to fix word spacing?

Word cloud is one of the most common visualizations we see today, especially with social media analytics. Open source libraries like D3JS have eased developers life. With these libraries we can quickly wire data and get beautiful…

Data Science and Beyond

Experts often possess more data than judgment

- Colin Powell

Big Data, Data Science, Machine Learning and Statistics are buzz words that you will keep hearing more and more in the time to come…