PinnedSteve RussoinBetter ProgrammingI Asked ChatGPT to Build a Data Pipeline, and Then I Ran ItYour job might be safe. For now…·5 min read·Apr 5, 2023--10--10
PinnedSteve Russo5 Books that Make You a Better Data EngineerAnd one book that you didn’t know you needed·7 min read·Jul 1, 2022--10--10
Steve RussoinBetter ProgrammingWriting PySpark UDFs in RustPerformance comparison of different UDF methods·4 min read·May 2, 2023----
Steve RussoPassing the Databricks Professional Data Engineer ExamHow to prepare for the Databricks Data Engineer Professional Exam·9 min read·Mar 27, 2023--4--4
Steve RussoinBetter Programming4 Delta Lake Metadata Queries You Should KnowGet all the metadata you could want about your Lakehouse·3 min read·Oct 26, 2022----
Steve RussoinBetter ProgrammingBuild a FastAPI on the LakehouseCreate a FastAPI on the Databricks Lakehouse with full CRUD capabilities·4 min read·Jul 18, 2022--2--2
Steve RussoinBetter ProgrammingHow to Integrate Great Expectations with DatabricksGet better data quality metrics with one change to Great Expectations·5 min read·Jul 7, 2022--3--3
Steve Russo3 Methods for Dealing with Bad Data QualityDesign to handle bad data before it poisons your platform!·5 min read·Jun 30, 2022----
Steve RussoinBetter Programming3 Examples of Motifs with Spark GraphFramesFind specific relational patterns in a graph·3 min read·Jun 18, 2022--1--1
Steve RussoEasily Pass the Databricks Certified Developer for Apache Spark ExamWhat is and isn’t covered in the exam, the specific exam topics, study materials, and types of questions you’d see on the exam·4 min read·Jun 7, 2022--2--2