Homepage
Open in app
Sign in
Get started
The Prefect Blog
Updates
Prefect.io
Follow
Featured
Beyond Scheduling: Event-Driven Flows with Prefect
Beyond Scheduling: Event-Driven Flows with Prefect
Forget about Time
Will Raphaelson
Jul 10, 2023
More Memory, More Problems
More Memory, More Problems
The single Postgres setting that almost took down our database
Christopher White
May 16, 2023
Supercharge your Python Code with Blocks
Supercharge your Python Code with Blocks
Introducing Blocks: open source, modular, reusable, and sharable configuration plus code
Jeff Hale
Sep 21, 2022
Serverless Prefect Flows with Azure Container Instances
Serverless Prefect Flows with Azure Container Instances
It just got easier to run serverless Python flows on Azure — without thinking about servers, clusters, or pods.
Ryan Peden
Oct 20, 2022
Read More
A Platform Approach to Workflow Orchestration
A Platform Approach to Workflow Orchestration
Customized workflow orchestration for self-service data teams
Jeff Hale
Dec 6, 2023
Keeping 👀 on AI tools with Marvin
Keeping 👀 on AI tools with Marvin
Since March 14, when I posted about instrumenting LLM tools with Prefect, a whole lot has happened in the AI tooling landscape.
Nate Nowack
Jun 16, 2023
Picking March Madness Winners Using Prefect
Picking March Madness Winners Using Prefect
I grew up loving college basketball and the magic that is March Madness. The excitement of seeing buzzer-beaters and Cinderella stories…
Robert
Mar 15, 2023
Keeping Your Eyes on Your AI Tools
Keeping Your Eyes on Your AI Tools
Observing LangChain with Prefect
Nate Nowack
Mar 14, 2023
Coordinate ELT in 2023 with Airbyte, dbt and Prefect
Coordinate ELT in 2023 with Airbyte, dbt and Prefect
Orchestrate data ingestion and transformation for Snowflake data warehouse with Airbyte, dbt, and Prefect
Nate Nowack
Jan 31, 2023
Explain Your Python Exceptions with OpenAI
Explain Your Python Exceptions with OpenAI
How to build an AI assistant to help you troubleshoot your Python applications
Andrew Huang
Jan 26, 2023
Are You an Accidental Data Engineer?
Are You an Accidental Data Engineer?
Many software engineers take on data engineering tasks without intending to. Are you one of them? Let’s find out.
Ryan Peden
Jan 23, 2023
Top 10 New Prefect Features of 2022
Top 10 New Prefect Features of 2022
Python dataflow coordination enhancements you don’t want to miss!
Jeff Hale
Jan 3, 2023
How to use Kubernetes with Prefect: Part 3
How to use Kubernetes with Prefect: Part 3
Store your flow code in your Docker Image
Jeff Hale
Dec 7, 2022
How to use Kubernetes with Prefect: Part 2
How to use Kubernetes with Prefect: Part 2
Creating custom Kubernetes Job blocks
Jeff Hale
Nov 30, 2022
How to use Kubernetes with Prefect
How to use Kubernetes with Prefect
Part 1: Up and running
Jeff Hale
Nov 21, 2022
Serverless Prefect Flows with Google Cloud Run Jobs
Serverless Prefect Flows with Google Cloud Run Jobs
Spend more time building data pipelines and less time maintaining infrastructure!
Ryan Peden
Nov 2, 2022
Why not Cron?
Why not Cron?
Scheduling, with or without cron, is only a small part of the data coordination puzzle
Jeff Hale
Oct 3, 2022
How to Self-Host Prefect with Postgres Using Docker Compose
How to Self-Host Prefect with Postgres Using Docker Compose
Prefect is like air traffic control for your data. Docker Compose is like air traffic control for you containers. They make a great team!
Ryan Peden
Sep 15, 2022
Deploy Prefect Pipelines with Python: Perfect! 🐍
Deploy Prefect Pipelines with Python: Perfect! 🐍
How to quickly make a Prefect Python deployment file
Jeff Hale
Sep 1, 2022
Migrating Databricks Tasks from Prefect 1 to Prefect 2
Migrating Databricks Tasks from Prefect 1 to Prefect 2
From Task Library to Databricks Collection
Andrew Huang
Aug 25, 2022
Orchestrating Airbyte with Prefect 2.0
Orchestrating Airbyte with Prefect 2.0
Introducing the prefect-airbyte collection
Nate Nowack
Aug 22, 2022
Sending Slack Notifications in Python with Prefect
Sending Slack Notifications in Python with Prefect
Get Updated with the Progress of Your Python Code with Slack Notifications
Khuyen Tran
Jul 20, 2022
Orchestrate Your Data Science Project with Prefect 2.0
Orchestrate Your Data Science Project with Prefect 2.0
Make Your Data Science Pipeline Resilient Against Failures
Khuyen Tran
Jun 29, 2022
Continuous Data Validation with Great Expectations and Prefect
Continuous Data Validation with Great Expectations and Prefect
See the video companion to this article here.
Alexander J Streed
Apr 12, 2022
Easy Event-Driven Workflows With AWS Lambda V2 Featuring Serverless Framework
Easy Event-Driven Workflows With AWS Lambda V2 Featuring Serverless Framework
Prefect makes it easy to do hard work.
George Coyne
Mar 29, 2022
Introducing Prefect-ML: Orchestrate a Distributed Hyperparameter Grid Search on Dask
Introducing Prefect-ML: Orchestrate a Distributed Hyperparameter Grid Search on Dask
Use Prefect as a machine learning experiment tracker by leveraging mapping and artifacts.
Kevin Kho
Mar 1, 2022
Logs, the Prefect Way
Logs, the Prefect Way
Introducing Orion logging: A Pythonic logging system designed to maximize observability with a minimum of effort.
Andrew Brookins
Feb 16, 2022
A modern ETL pattern using Prefect’s S3 Storage and Kubernetes runtime
A modern ETL pattern using Prefect’s S3 Storage and Kubernetes runtime
Since I’m fond of cats, the Great British Baking Show, and dragging out analogies… I’ll say “there are many ways to bake a cake” when it…
Nate Nowack
Feb 2, 2022
Getting Started with Prefect Flows
Getting Started with Prefect Flows
Welcome to using Prefect! This guide is here to help you step through 7 simple steps to get started running a simple flow using Prefect…
Kalise Richmond
Dec 22, 2021
About The Prefect Blog
Latest Stories
Archive
About Medium
Terms
Privacy
Teams