Debu Sinha – Medium

Debu Sinha

Debu Sinha

Scaling Entity Resolution in the Modern Data Ecosystem using BERT, MLflow and Databricks

Entity Resolution (ER) is a crucial task in data processing that involves identifying and linking records across one or more datasets that…

Apr 2

Scaling Entity Resolution in the Modern Data Ecosystem using BERT, MLflow and Databricks

Apr 2

Debu Sinha

Exploring Advanced Custom Transformers in Apache Spark for Enhanced Machine Learning Workflows on…

In the dynamic field of machine learning, the ability to craft efficient and robust pipelines is crucial, especially when dealing with…

Mar 18

Exploring Advanced Custom Transformers in Apache Spark for Enhanced Machine Learning Workflows on…

Mar 18

Debu Sinha

Optimizing ML Model Serving with Pre-logged NLTK Downloads in MLflow on Databricks

I encountered a significant challenge while collaborating with a client on a Natural Language Processing (NLP) project. The machine…

Nov 18, 2023

Optimizing ML Model Serving with Pre-logged NLTK Downloads in MLflow on Databricks

Nov 18, 2023

Debu Sinha

Scaling your single node Machine Learning Model training using Pandas Function API on Databricks…

Introduction

May 2, 2023

Scaling your single node Machine Learning Model training using Pandas Function API on Databricks…

May 2, 2023

Debu Sinha

Using and scaling SHAP on Databricks for turbocharging your model explainability. (Part 1)

I have been working in ML and AI for the past 10+ years. As a Specialist Solutions Architect at Databricks, I get opportunities to work…

Apr 5, 2023

Using and scaling SHAP on Databricks for turbocharging your model explainability. (Part 1)

Apr 5, 2023

Debu Sinha

Understanding Loss Functions in ML

This blog is part of my 30 days of ML series, where I will cover the fundamental concepts of ML while going into detail on technical topics…

Dec 30, 2022

Dec 30, 2022

Debu Sinha

Understanding Recurrent Neural Networks

Recurrent neural networks (RNNs) are a type of neural network that are designed to process sequential data. This means they are…

Dec 30, 2022

Understanding Recurrent Neural Networks

Dec 30, 2022

Debu Sinha

All you need to know about writing custom UDF using Python in Apache Spark 3.0.

If you want to work with Apache Spark and Python to perform custom transformations on your big dataset in a distributed fashion, you will…

Mar 13, 2022

Mar 13, 2022

Debu Sinha

Deploying your first ML model as a REST endpoint using Flask and Bootstrap.

As a Senior Solutions Architect at Databricks outside of my client interactions, I regularly give talks and write articles about ML, MLOps…

Jan 24, 2022

Deploying your first ML model as a REST endpoint using Flask and Bootstrap.

Jan 24, 2022

Debu Sinha

Cheatsheet on understanding ZOrder and OPTIMIZE for your Delta tables.

Introduction

Nov 15, 2021

Nov 15, 2021

Debu Sinha

Debu Sinha

I am a Lead ML Engineer (Gen AI Solutions) at Databricks focused on implementing/optimizing machine learning and deep learning capable pipelines at scale.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams