How to Build Your Own Apache Airflow DAG Factory

This DAG Factory will utilize yaml file to define a…

Apache Airflow Dynamic Task Mapping: Tricks That Distinguish Seniors from Juniors

How to Set Up a VPN on GCP

Background

Mastering ETL: Integrating CSV Data Into an OLAP Database with Pandas

How to Upload Files from Flask to MinIO on Docker

Building a Simple Pipeline with Python Using Kimball’s Models in Snowflake Data Warehouse

Defusing Data ‘Time Bombs’ with DataHub Observability

Data is like garbage, You’d better know what you are going to do…

Navigating Data Quality Maze with Great Expectations, DBT, and Trino

Migrating Data from SQLite to Snowflake Using Airflow

Introduction

Understanding Data Masking Techniques in Talend

Data’s value rise makes it vulnerable to theft and…