The Prefect Blog
Published in

The Prefect Blog

Orchestrating ELT with Prefect and dbt — a Flow of Flows (Part 1)

How to manage dependencies between data pipelines

Illustration of an ELT flow using Prefect and dbt
Table of contents:
· Describing the problem
· The desired solution
· Demo: orchestrating EL pipelines and dbt transformations with Prefect
· Preparing the environment
· Extract and load flow
· dbt flow
· Dashboards flow
· A flow of flows: where the real orchestration happens
· Extending the flow of flows to new use cases
· Next steps

Describing the problem

The desired solution

Demo: orchestrating EL pipelines and dbt transformations with Prefect

Preparing the environment

Extract and load flow

dbt flow

Dashboards flow

A flow of flows: where the real orchestration happens

Extending the flow of flows to new use cases

Next steps

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store