PinnedShashwath ShenoyinDev GeniusChoosing Datahub for Data Engineering: A Comprehensive Comparison with Open MetadataIn today’s data-driven world, effective data management is crucial for businesses to gain insights and make informed decisions. We recently…Jul 1, 20236Jul 1, 20236
PinnedShashwath ShenoyMy Journey into the field of Big Data — Data EngineeringAs a Big Data Architect with 12+ years of industry experience, I have had the privilege of witnessing firsthand the tremendous growth and…Mar 29, 2023Mar 29, 2023
PinnedShashwath ShenoyDifferences between Mediocre and Excellent Data engineers!In the ever-evolving world of data engineering, mediocrity is the enemy of progress. After 13 years at the helm of data engineering, I’ve…Nov 6, 20231Nov 6, 20231
PinnedShashwath ShenoyJourney to 10K Followers: A Data Engineering Leader’s Guide to Building an Engaged CommunityEmbarking on a journey of knowledge-sharing has been a cornerstone of my 13-year career in data engineering. LinkedIn, as a professional…Nov 12, 2023Nov 12, 2023
PinnedShashwath ShenoyImplementing Change Data Capture (CDC) in MySQL: A Journey of Data Engineering Leader!Change is the only constant, and in the data-driven world, nowhere is that more true than in the realm of databases. I’ve been working in…Dec 17, 2023Dec 17, 2023
Shashwath Shenoy7 Database Schema Design Traps and How to Dodge Them: A Guide for Data Engineers!Designing a database schema is a critical task that can significantly impact the performance, scalability, and maintainability of your…5d ago5d ago
Shashwath ShenoyinDev GeniusAdvantages of Using CI/CD Pipelines in Data Engineering!In the realm of software development, Continuous Integration and Continuous Deployment (CI/CD) pipelines have transformed the way we…5d ago5d ago
Shashwath ShenoyImplementing an LRU Cache in Python!In this article, we will dive deep into the implementation of an LRU (Least Recently Used) cache in Python.Jul 2Jul 2
Shashwath ShenoyinDev GeniusThe Importance of Docker and Kubernetes in Data Engineering!As a Data Engineering leader and mentor, I’ve noticed a recurring theme in the queries from my mentees: the significance of Docker and…Jun 23Jun 23
Shashwath ShenoyThe Art of Building Resilient Data Pipelines: Embracing Change and Iteration!Building a robust and stable software system is the cornerstone of good engineering practices. However, in the dynamic world of data…Jun 16Jun 16