Why Not Just Use Postgres?

My last few posts have focused on Redshift and Athena, two specialized tools for managing and querying Big Data…

A Deep Dive on Redshift Execution Plans

Execution plans are one of the primary tools to optimize your database queries, but they…

Athena Performance Comparison: Avro, JSON, and Parquet

Developing A Coding Test for Data Engineering

Hiring good candidates is difficult. After nearly 40 years in this business, and…

Performance Comparison: Athena vs. Redshift

I’ve always been a fan of database servers: self-contained entities that manage both…

Unbalanced Data in Redshift

I first experienced unbalanced data in a data warehouse thirty years ago. I was working for a mutual fund…

Friends Don’t Let Friends Use JSON (In Their Data Lakes)

Analyzing Glue Jobs with AWS X-Ray

It’s possible to analyze your Glue jobs using just the logs they produce. Possible. But it’s not a…