Lackshu Balasubramaniam – Medium

Lackshu Balasubramaniam

Pinned

Lackshu Balasubramaniam

Re-platforming from Hadoop based Systems into Azure Part 1

Introduction

Aug 8, 2021

Re-platforming from Hadoop based Systems into Azure Part 1

Aug 8, 2021

Lackshu Balasubramaniam

Caveats around Delta Live Tables (DLT)

Delta Live Tables have been popularly touted as an option for Data Lakehouse solutions. I had also written in the past about Delta Live…

Apr 9, 2023

Caveats around Delta Live Tables (DLT)

Apr 9, 2023

Lackshu Balasubramaniam

Importing Snowflake Data via Azure Data Factory into Azure Data Lake Storage

If you’re looking to import Snowflake Data into your data lake to as part of building a Lakehouse, Azure Data Factory is a good option.

Jul 7, 2022

Importing Snowflake Data via Azure Data Factory into Azure Data Lake Storage

Jul 7, 2022

Lackshu Balasubramaniam

Azure Data Factory Integration into Delta Live Table (DLT) Workflow

Databricks Delta Live Table (DLT) workflows are great for creating ELT workflows for your Lakehouse. I love the fact that they can be put…

Jun 18, 2022

Azure Data Factory Integration into Delta Live Table (DLT) Workflow

Jun 18, 2022

Lackshu Balasubramaniam

A Case for Delta Live Table as the Workflow for Lakehouse — Integrating Source Data

A Lakehouse requires a reasonably good workflow mechanism to manage the movement of data and to understand the dependencies between the…

Apr 19, 2022

A Case for Delta Live Table as the Workflow for Lakehouse — Integrating Source Data

Apr 19, 2022

Lackshu Balasubramaniam

Implementing Data Lakehouse in an Enterprise

Data Lakehouse is considered the next leap in making data more accessible and more consumable in the enterprise. At a conceptual level it…

Mar 6, 2022

Implementing Data Lakehouse in an Enterprise

Mar 6, 2022

Lackshu Balasubramaniam

Why Data Engineering As A Career Choice

The above is a good question to ponder on before jumping into a Data Engineering role.

Jan 17, 2022

Why Data Engineering As A Career Choice

Jan 17, 2022

Lackshu Balasubramaniam

Re-platforming from Hadoop based Systems into Azure Part 2

2nd part of my write-up around lifting and shifting from Hadoop based systems into Azure and Databricks platform.

Aug 13, 2021

Re-platforming from Hadoop based Systems into Azure Part 2

Aug 13, 2021

Lackshu Balasubramaniam

PySpark DataFrame : An Overview

I started out my series of articles as an exam prep for Databricks, specifically Apache Spark 2.4 with Python 3 exam. These have now…

Aug 23, 2020

PySpark DataFrame : An Overview

Aug 23, 2020

Lackshu Balasubramaniam

What I’m doing now

(This is a now page, and if you have your own site, you should make one, too. The idea came from Derek Sivers)

Jun 8, 2020

What I’m doing now

Jun 8, 2020

Lackshu Balasubramaniam

Lackshu Balasubramaniam

I’m a data engineering bloke who’s into books. I primarily work on Azure and Databricks. My reading interest is mostly around psychology and economics.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams