PinnedPublished inPython in Plain EnglishKubernetes for Data Engineering: An End-to-End GuideJan 26, 2024A response icon3Jan 26, 2024A response icon3
PinnedPublished inStackademicTop 5 Data Engineering Projects You Can’t Afford to MissAs we embark on the journey through 2024, the realm of data engineering is undergoing a transformation like never before. With the advent…Feb 6, 2024A response icon2Feb 6, 2024A response icon2
Pinned7 End to End Data Engineering Projects That Sets you Apart from the RestIn the ever-evolving field of data engineering, standing out from the crowd is about demonstrating practical skills and innovative…Dec 1, 2023A response icon4Dec 1, 2023A response icon4
Published inPython in Plain EnglishReal-Time Stock Market Anomaly Detection Using Machine Learning: An End-to-End Data Engineering…Identifying anomalies in real-time can make or break trading strategies especially in a fast paced industry like the stock market. From…Oct 2, 2024Oct 2, 2024
Published inPython in Plain EnglishBuilding Realtime Data Warehouse with Apache Airflow, Redpanda, Pinot and SupersetThe modern data landscape is increasingly driven by real-time insights and interestingly, traditional batch processing is no longer meeting…Sep 29, 2024Sep 29, 2024
Published inTowards Data EngineeringDecodable vs. AWS Managed Service for Apache Flink (MSF): An End-to-End Data Engineering ShowdownIn recent times, realtime data processing is becoming more and more essential. The ability for the business to proactively react to…Sep 1, 2024A response icon1Sep 1, 2024A response icon1
Published inTowards Data EngineeringEnd to End Data Engineering for Data Lakehouse with Airflow, Minio, Kafka, Apache Spark, Apache…In the last section we discussed the important details about Data Lakehouse, the what, how, and why it is important in modern data…May 11, 2024May 11, 2024
Published inTowards Data EngineeringEnd to End Data Engineering for Data Lakehouse with Airflow, Minio, Kafka, Apache Spark, Apache…Data Lakehouses (in term and usage) have been around for more than a decade but the potentials are most recently being actualised with the…May 3, 2024May 3, 2024
Published inTowards Data Engineering10 Steps to Data Mastery: The Ultimate Guide to Achieving Data MasteryData has become the new currency in today’s digital age, and achieving mastery in data engineering, data science, and data analytics is…Apr 1, 2024Apr 1, 2024