Ravindra Kumar – Medium

Ravindra Kumar

Pinned

Ravindra Kumar
in
Python in Plain English

Mastering Slowly Changing Dimensions (SCD) Pythonic Way in Data Warehousing with PySpark and Delta…

Oct 8, 2023

Mastering Slowly Changing Dimensions (SCD) Pythonic Way in Data Warehousing with PySpark and Delta…

Oct 8, 2023

Pinned

Ravindra Kumar
in
Python in Plain English

Implementing the Open-Closed Principle in Data Processing: Organizing Code with pythonic Modular…

In the world of software engineering, adhering to solid design principles is essential for building maintainable, scalable, and efficient…

Oct 8, 2023

Implementing the Open-Closed Principle in Data Processing: Organizing Code with pythonic Modular…

Oct 8, 2023

Pinned

Ravindra Kumar
in
Python in Plain English

How to Automate Databricks Job Triggers Pythonically with Apache Airflow: A Custom Operator…

Oct 2, 2023

How to Automate Databricks Job Triggers Pythonically with Apache Airflow: A Custom Operator…

Oct 2, 2023

Pinned

Ravindra Kumar
in
Python in Plain English

Crafting Robust Data Pipelines with SOLID Principles: Python’s Approach to Data Engineering

In the bustling world of data engineering, the art of crafting robust, maintainable, and scalable pipelines is a feat not easily achieved…

Aug 24, 2023

Crafting Robust Data Pipelines with SOLID Principles: Python’s Approach to Data Engineering

Aug 24, 2023

Ravindra Kumar

Unlocking the Hidden Power of Databricks: The _metadata Column

In the ever-evolving world of data engineering, finding hidden gems that can streamline your workflows is always exciting. One such gem in…

Jul 20

Unlocking the Hidden Power of Databricks: The _metadata Column

Jul 20

Ravindra Kumar

Streamline PySpark/Spark Debugging and Job Management with Custom Job Descriptions

Introduction

Apr 13

Streamline PySpark/Spark Debugging and Job Management with Custom Job Descriptions

Apr 13

Ravindra Kumar

Optimizing Apache Spark with External Shuffle Service

Apache Spark’s shuffle operation is a critical yet resource-intensive process required for a wide range of data transformation tasks…

Apr 8

Apr 8

Ravindra Kumar

Data Engineering and Design Patterns: Simplifying the Workflow with the Factory Pattern

In the intricate world of data engineering, managing diverse data formats and sources is a common challenge. The factory pattern offers a…

Nov 13, 2023

Nov 13, 2023

Ravindra Kumar
in
Python in Plain English

Python UDTFs in PySpark: A Practical Guide to Crafting and Utilizing Advanced Data Solutions

Nov 10, 2023

Python UDTFs in PySpark: A Practical Guide to Crafting and Utilizing Advanced Data Solutions

Nov 10, 2023

Ravindra Kumar
in
Python in Plain English

Mastering PySpark’s Elegance: Navigating Efficient Resource Management with the Singleton Design…

Introduction

Oct 26, 2023

Oct 26, 2023

Ravindra Kumar

Ravindra Kumar

Data engineering | Data strategy | Data product | Data Quality | Data Governess | Scalability | Optimization | https://www.linkedin.com/in/kumar-ravindra/

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams