Data Engineering

Cut data warehouse costs with run caching

As we’ve mentioned before, one of the core design goals of Dataform is to make project…

CI/CD for ETL/ELT pipelines

One of Dataform’s key motivations has been to bring software engineering best practices to teams building…

Testing data quality with SQL assertions

Ensuring that data consumers can use their data to reliably answer questions is of…

Introducing Dataform

Data is the lifeblood of many businesses. Managing it is one of the most critical…

Consider SQL when writing your next processing pipeline

Once a team or organization has some data to manage — customer data, events to be fed into some machine learning system, or whatever else — they almost immediately find themselves writing, running, and maintaining processing…