Read in the data in a Pandas DataFrame like an expert

Pandas DataFrame is widely popular in a typical…

Build a dashboard for every data pipeline

Show them the data; they’ll tell you when it’s wrong

Beware of the Silver Bullet Syndrome

Build Your Identity in Skills and Problem-Solving, not Tools

Know your Latencies

Every data system has three characteristics that uniquely identifies it: the size of the data, the recency of the data, and…

Why Data Science Teams Need Generalists, Not Specialists

In The Wealth of Nations, Adam Smith demonstrates how the division of labor is the chief source of productivity gains using the vivid example of a pin factory assembly line: “One person draws out the wire, another straights it, a…

The Benefits of Codifying and Asserting Architectural Quality

Your continuous delivery build pipeline should be the primary location where agreed-upon architectural qualities for your applications are codified and enforced. However, these automated quality assertions shouldn’t replace…

Know the Value-Per-Byte of your Data

As a data engineer at various data-driven software companies, I saw that new technologies like…