The Prefect Blog
Published in

The Prefect Blog

Modular Data Stack — Build a Data Platform with Prefect, dbt and Snowflake (Part 6)

Coordinate ML, analytics & BI reporting data platform workflows with Prefect, dbt, Snowflake, and modular building blocks

Prefect as a blue bot coordinating ML, analytics & BI reporting workflows in the dataflow universe
Table of contents· Run code from other repositories
Motivation
dbt repository for analytics engineers
🤖 Creating a private dbt repository
🤖 Creating a personal access token in GitHub
🤖 Creating a GitHub block
Using the GitHub block with dbt
🤖 Triggering a dbt build using the GitHub block
📚 Summary: orchestrating code from multiple repositories
· Flows for analytics & reporting
Orchestrate anything after dbt transformations
Example reporting workflow
· Flows for ML and forecasting
Example ML workflow
Where ML flows fit within a data platform orchestration
· Next steps

Run code from other repositories

Motivation

dbt repository for analytics engineers

🤖 Creating a private dbt repository

🤖 Creating a personal access token in GitHub

🤖 Creating a GitHub block

Using the GitHub block with dbt

🤖 Triggering a dbt build using the GitHub block

python flows/transformation/jaffle_shop/dbt_repo.py
The terminal output of a Prefect flow running dbt build from a cloned dbt repository

📚 Summary: orchestrating code from multiple repositories

Flows for analytics & reporting

Orchestrate anything after dbt transformations

Example reporting workflow

Flows for ML and forecasting

Example ML workflow

Where ML flows fit within a data platform orchestration

Next steps

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store