<![CDATA[The Data Movement - Medium]]> https://medium.com/the-data-movement?source=rss----41e2a55ea1cd---4 https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png The Data Movement - Medium https://medium.com/the-data-movement?source=rss----41e2a55ea1cd---4 Medium Sat, 30 May 2026 09:19:00 GMT <![CDATA[Real-Time Data Engineering, Part 1: What Is Real-Time Data Engineering and Why Does It Matter?]]>

Real-time data engineering has shifted from a niche capability used by trading systems and social media giants to a standard expectation…

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/real-time-data-engineering-part-1-what-is-real-time-data-engineering-and-why-does-it-matter-ea0b8e449c6e?source=rss----41e2a55ea1cd---4 https://medium.com/p/ea0b8e449c6e Fri, 21 Nov 2025 18:31:09 GMT 2025-11-21T18:31:09.172Z <![CDATA[Do You Really Need Airflow? Why dbt Cloud Scheduling Might Be All You Need]]>

Spoiler: If you just want to run your dbt project every 2 hours, dbt Cloud already has everything you need.

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/do-you-really-need-airflow-why-dbt-cloud-scheduling-might-be-all-you-need-486877d9db50?source=rss----41e2a55ea1cd---4 https://medium.com/p/486877d9db50 Fri, 04 Jul 2025 07:17:06 GMT 2025-07-04T07:17:06.036Z <![CDATA[Enterprise-Level dbt Governance: Access Control, Auditing, and Lineage Tracking]]>

🚀 The Hidden Risks in Your dbt Project

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/enterprise-level-dbt-governance-access-control-auditing-and-lineage-tracking-f7b751e466ee?source=rss----41e2a55ea1cd---4 https://medium.com/p/f7b751e466ee Mon, 17 Mar 2025 18:07:39 GMT 2025-03-17T18:07:38.927Z <![CDATA[Handling dbt Failures in Production: Debugging Common Errors and Failed Runs]]>

The Dreaded dbt Failure — A Data Engineer’s Nightmare

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/handling-dbt-failures-in-production-debugging-common-errors-and-failed-runs-471389486e32?source=rss----41e2a55ea1cd---4 https://medium.com/p/471389486e32 Mon, 17 Mar 2025 17:56:43 GMT 2025-03-17T17:56:43.281Z <![CDATA[Handling DBT Star Schema Dependencies: When Facts Update Faster Than Dimensions]]>

The Challenge: Fact Tables Moving Faster Than Dimensions

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/handling-dbt-star-schema-dependencies-when-facts-update-faster-than-dimensions-d5bc6f72a145?source=rss----41e2a55ea1cd---4 https://medium.com/p/d5bc6f72a145 Tue, 04 Mar 2025 17:44:23 GMT 2025-03-04T17:44:23.637Z <![CDATA[DBT Snapshots vs. Incremental Models: Which One Should You Use?]]>

The Challenge: Tracking Changes in a Sales Table

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/dbt-snapshots-vs-incremental-models-which-one-should-you-use-e4014c7715ec?source=rss----41e2a55ea1cd---4 https://medium.com/p/e4014c7715ec Mon, 03 Mar 2025 16:58:06 GMT 2025-03-03T16:58:06.166Z <![CDATA[DBT Incremental Model Duplicates? The Ultimate Fix-It Guide!]]>

The Problem: Duplicates in Your Incremental Model

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/dbt-incremental-model-duplicates-the-ultimate-fix-it-guide-19dd68f0ff9a?source=rss----41e2a55ea1cd---4 https://medium.com/p/19dd68f0ff9a Mon, 03 Mar 2025 16:40:47 GMT 2025-03-03T16:40:47.392Z <![CDATA[Enterprise-Level dbt Governance: Access Control, Auditing, and Lineage Tracking]]>

As dbt adoption scales within an organization, ensuring strong governance becomes essential.

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/enterprise-level-dbt-governance-access-control-auditing-and-lineage-tracking-715e73862b2b?source=rss----41e2a55ea1cd---4 https://medium.com/p/715e73862b2b Fri, 28 Feb 2025 18:32:59 GMT 2025-02-28T18:32:59.830Z <![CDATA[Scaling dbt for Large Teams — Structuring dbt Projects in Multi-Team Environments]]>

🚀 As your data team grows, so does the complexity of your dbt project.

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/scaling-dbt-for-large-teams-structuring-dbt-projects-in-multi-team-environments-bd0b85cc4caa?source=rss----41e2a55ea1cd---4 https://medium.com/p/bd0b85cc4caa Fri, 28 Feb 2025 18:15:56 GMT 2025-02-28T18:15:56.099Z <![CDATA[Day 24: Version Control for dbt Projects — Git Best Practices, Branching Strategies, and…]]>

🚀 Welcome back to our dbt series!

Continue reading on The Data Movement »

]]> https://medium.com/the-data-movement/day-24-version-control-for-dbt-projects-git-best-practices-branching-strategies-and-c39fd752dda6?source=rss----41e2a55ea1cd---4 https://medium.com/p/c39fd752dda6 Thu, 27 Feb 2025 09:41:44 GMT 2025-02-27T09:41:44.568Z