Eric KyawDesigning Batch Data Engineering Pipelines: Exploring Designs and Patterns for Medallion…In today’s data-driven world, the ability to process, refine, and analyse data efficiently has become crucial for businesses looking to…1d ago1d ago
Eric KyawUnderstanding Microsoft’s Capacity Units for Blasting and SmoothingIn today’s cloud-driven landscape, effectively managing computational resources is crucial for maintaining both performance and cost…Aug 28Aug 28
Eric KyawDatabricks Unity Catalog: A Pillar of the Unified Data Platform ConceptIn the rapidly evolving landscape of big data and advanced analytics, the need for a unified approach to data management and governance has…Aug 8Aug 8
Eric KyawThe Evolution of Universal Big Data Formats: Delta Lake, Apache Iceberg, and Apache HudiThe landscape of big data is continuously evolving, and with it, the formats and frameworks we rely on to store, manage, and analyse vast…Jul 31Jul 31
Eric KyawUnified Data Platform Concept for Big Data and Advanced AnalyticsIn today’s data-driven world, organisations face the challenge of managing vast amounts of data efficiently. One of the biggest hurdles is…Jul 18Jul 18
Eric KyawUnderstanding Modern Data Modelling Techniques in the Big Data WorldIn the realm of Big Data, the choice of modelling technique is pivotal in crafting a reliable, extendable, and scalable data platform. From…Jul 11Jul 11