PinnedLackshu BalasubramaniamRe-platforming from Hadoop based Systems into Azure Part 1IntroductionAug 8, 2021Aug 8, 2021
Lackshu BalasubramaniamCaveats around Delta Live Tables (DLT)Delta Live Tables have been popularly touted as an option for Data Lakehouse solutions. I had also written in the past about Delta Live…Apr 9, 20231Apr 9, 20231
Lackshu BalasubramaniamImporting Snowflake Data via Azure Data Factory into Azure Data Lake StorageIf you’re looking to import Snowflake Data into your data lake to as part of building a Lakehouse, Azure Data Factory is a good option.Jul 7, 2022Jul 7, 2022
Lackshu BalasubramaniamAzure Data Factory Integration into Delta Live Table (DLT) WorkflowDatabricks Delta Live Table (DLT) workflows are great for creating ELT workflows for your Lakehouse. I love the fact that they can be put…Jun 18, 20221Jun 18, 20221
Lackshu BalasubramaniamA Case for Delta Live Table as the Workflow for Lakehouse — Integrating Source DataA Lakehouse requires a reasonably good workflow mechanism to manage the movement of data and to understand the dependencies between the…Apr 19, 2022Apr 19, 2022
Lackshu BalasubramaniamImplementing Data Lakehouse in an EnterpriseData Lakehouse is considered the next leap in making data more accessible and more consumable in the enterprise. At a conceptual level it…Mar 6, 2022Mar 6, 2022
Lackshu BalasubramaniamWhy Data Engineering As A Career ChoiceThe above is a good question to ponder on before jumping into a Data Engineering role.Jan 17, 2022Jan 17, 2022
Lackshu BalasubramaniamRe-platforming from Hadoop based Systems into Azure Part 22nd part of my write-up around lifting and shifting from Hadoop based systems into Azure and Databricks platform.Aug 13, 2021Aug 13, 2021
Lackshu BalasubramaniamPySpark DataFrame : An OverviewI started out my series of articles as an exam prep for Databricks, specifically Apache Spark 2.4 with Python 3 exam. These have now…Aug 23, 2020Aug 23, 2020
Lackshu BalasubramaniamWhat I’m doing now(This is a now page, and if you have your own site, you should make one, too. The idea came from Derek Sivers)Jun 8, 2020Jun 8, 2020