Nicholas HurtinMicrosoft AzureInjecting lineage and attributes into Microsoft PurviewLearn how to programmatically enrich your data assets to help your data consumers find and trust the data they’re looking for!14 min read·Jul 27, 2022----
Nicholas HurtinMicrosoft AzureJust-in-time Azure Databricks access tokens and instance pools for Azure Data Factory pipelines…Introduction11 min read·Jun 8, 2020--1--1
Nicholas HurtReplicating changes from SQL Managed Instance to the Data Lake using Change Data Capture and Azure…Introduction11 min read·Mar 29, 2020--1--1
Nicholas HurtinMicrosoft AzureBuilding your Data Lake on ADLS gen2Planning a data lake may seem like a daunting task. This blog aims to provide guidance to those embarking on their data lake journey.17 min read·Mar 1, 2020--2--2
Nicholas HurtinMicrosoft AzureSecuring access to Azure Data Lake gen2 from Azure DatabricksThere are a number of ways to configure access to Azure Data Lake Storage gen2 (ADLS) from Azure Databricks (ADB). This blog attempts to…13 min read·Jan 19, 2020--4--4
Nicholas HurtinMicrosoft AzureAnalytics and the importance of the data lake on AzureWhen embarking on an analytics project, the data lake is unlikely to be the first thing that comes to mind…10 min read·Apr 9, 2019----
Nicholas HurtinMicrosoft AzureHow to run durable, fault tolerant & resilient workloads in Azure DatabricksWhat options are there to prevent loss of data or in-memory state. in the event of work node or cluster failure?7 min read·Feb 28, 2019----
Nicholas HurtinMicrosoft AzureAn Introduction to Streaming ETL on Azure Databricks using Structured Streaming & Databricks…Part 1 — Intro to streaming ETL on Azure Databricks10 min read·Feb 22, 2019--2--2
Nicholas HurtAn Introduction to Streaming ETL on Azure Databricks using Structured Streaming & Databricks Delta…Part III — run a streaming ETL pipeline using Spark, running on Azure Databricks16 min read·Feb 22, 2019--2--2
Nicholas HurtAn Introduction to Streaming ETL on Azure Databricks using Structured Streaming & Databricks Delta…Part II — Build out the architecture in Azure to support an end-to-end streaming ETL demonstration.9 min read·Feb 22, 2019----