Data Science with Ming

How to spot the outlier dataset when you only have the statistics

4 Ways to improve the performance of a SQL MERGE statement

Building A Text UnWrapper: An Example Of Feature Engineering

My Infrastructure For Document-Parsing Projects

Here’s how my document-parsing (i.e. info-extraction) projects are usually set up:

1. Save all documents-to-parse into a folder called raw_files.
2. Pre-process raw documents and save processed content…

MongoDB Left Anti-Join

Suppose you have two Collections (A and B) in a MongoDB Database, and you want to find all Documents in A whose certain field does not exist in any of the Documents in B. In SQL, you would use some thing like this:

SELECT  *
FROM    A
WHERE   NOT EXISTS ( SELECT…

Extracting Tables From Plain Text Files Statistically With Numpy

No rules, no standards. — Mencius

Detect Headers in CSV Tables Statistically

Generally speaking, a CSV table may or may not contain a header, and the header, when…

Visualizing Daily Activities with Moves

Despite privacy concerns, the trending movement known as Quantified Self has really inspired many of us to evaluate our lifestyle in a more accurate and scientific manner.