datamindedbe

How we reduced our docker build times by 40%

This post describes two ways to speed up building your…

Prompt Engineering for a Better SQL Code Generation With LLMs

Demystifying Device Flow

Implementing OAuth 2.0 Device Authorization Grant with AWS Cognito and…

Cross-DAG Dependencies in Apache Airflow: A Comprehensive Guide

Exploring four methods to effectively…

Clear signals: Enhancing communication within a data team

The building blocks of successful Data Teams

Based on my experience I will elaborate on key criteria…

Use dbt and Duckdb instead of Spark in data pipelines

Upserting Data using Spark and Iceberg

Use Spark and Iceberg’s MERGE INTO syntax to efficiently store…

Authentication on GCP with Docker: Application Default Credentials

How applications magically…