Video: DBT as a Self-Service for Data Lake Gold Layer (Hebrew)

As a component of our Medallion architecture, we aimed to develop a self-service tool with deploying and testing pipelines that allow our different departments to generate tailored Gold layer tables for their specific needs. To do so, we decided to use DBT (Data Build Tool), a powerful tool for managing data transformations in modern data architectures.

In this talk, we showed how, by using DBT with Databricks, you can easily create and manage data pipelines, transformations, and workflows in a scalable and efficient way.
By the end of the talk, you will know how to quickly and easily build a high-quality Gold layer that is optimized for performance and accuracy, giving you the confidence to make informed decisions based on reliable data.

About the speaker:
Tal Peretz is a Data Engineer at Riskified. His expertise lies in developing data pipelines, building scalable infrastructure, data science and implementing data quality frameworks, enabling Riskified to make data-driven decisions and prevent fraud effectively. As a Harry Potter and data engineering fan, Tal combines his love for technology and entertainment, appreciates the magic of storytelling, and strives to contribute to the data engineering field.