When driving, you keep safe by checking your mirrors and being aware of your surroundings — What’s in front, what’s behind, and, as you continue driving, you keep checking your mirrors regularly so you can adapt to the changing condition of the traffic. dbt tests are car mirrors Car mirrors are your dbt tests —…

We know that you don’t always have the luxury of time for adding a new tools to your stack. …

When you open a pull request on your team’s dbt project, you need to verify what impact your code changes have on your data: Did you lose any rows? Was downstream adversely affected? Are all changes within the expected impact radius? Are historical metrics unchanged? dbt projects aren’t getting any…

Reviewing changes on a dbt data project with multiple people all editing branches at the same time can be difficult. …

tl;dr Get a Lineage-Diff for your dbt project in 10-seconds in PipeRider Cloud (no account or login required). Drag and drop two manifests, one from before making code changes, one from after, and get your Lineage Diff in seconds. Lineage-Diff helps visualize the data impact-radius of code change The most important thing when making data modeling changes to your…

As a data engineer working on a dbt project, it can be difficult to understand how the code changes you are working on will impact downstream models. …

PipeRider is the open-source “code review for data” tool for dbt data projects. Use it for data impact-assessment prior to merging changes into production. PipeRider is designed for use in data applications with business-critical data and when a bad merge could mean downtime for the business or serious financial loss. …

The DataTalks.Club Data Engineering Zoomcamp recently wrapped up. It was a way for data folks to learn and hone their skills, and provided a series of free modules that take you through the whole process of building a data pipeline, from data ingestion to dashboard. There’s no reason you still…

Do you want a way to track your BigQuery usage costs? Check out this interesting proof of concept for dbt. Data warehouse usage isn’t getting any cheaper and, as dbt continues to gain in popularity, cloud warehouse usage is on the up, with more and more transformations done in the…