Change Data Capture (CDC) Realtime Streaming with Postgres, Debezium, Kafka, Apache Spark, and Slack

Running a PostgreSQL and Pgadmin4 Instance using Docker Compose.

Photo by Florian Krumm from Unsplash.

Pydantic and Airflow: Data Validation in Python and the cloud

How to run custom Pydantic models in…

Exactly-once Semantic Kafka with Nifi Finally Enabled !

Step-by-step guide to implement real-time…

Apache Flink for Sales Analytics — End to End Data Engineering

Easy Guide on Scraping LinkedIn With Python

LinkedIn is a huge source of data that’s publicly available for users and non-users alike, but it’s quite difficult to scrape, especially because it serves its content dynamically.

Synapse Real-Time Analytics: Harnessing the Speed of Now with Microsoft Fabric

Explore the…

When to use partitioning and when to use bucketing?

Learn how to apply Data organization techniques…

SQL Real time Interview questions.

SQL query to identify the top-selling product, characterized by the…

Calling an Azure ML endpoint using Apache Airflow and the Azure ML provider package

How to score your Machine Learning model that is deployed to an Azure ML endpoint using Apache Airflow and an Azure ML…