PinnedMariusz KujawskiData Lakehouse vs Data Warehouse vs Data Lake-Comparison of data platformsFor decades, data warehouses have been the dominant architectural approach for building data platforms in enterprises. However, with the…16 min read·Jul 24, 2023--4--4
PinnedMariusz KujawskiData Modeling Techniques For Data WarehouseData modeling is a process of creating a conceptual representation of the data and its relationships within an organization or system…11 min read·Jun 19, 2023--3--3
Mariusz KujawskiExploring Python Libraries for Data Engineering in MS Fabric: Pandas, Polars, DuckDB, and PySparkMicrosoft Fabric integrates various analytical services into a unified platform capable of supporting multiple activities, from data…8 min read·May 13, 2024--1--1
Mariusz KujawskiBuilding an Efficient ETL/ELT Process for Data Delivery“Data is the new oil” — a statement that has underscored our approach to data management over the past decade. We’ve dedicated ourselves…15 min read·Apr 22, 2024--4--4
Mariusz KujawskiUnit Testing and Code Modularization in DatabricksNotebooks are a popular way to work with data in Databricks. A notebook user can quickly read, transform, and interactively explore data…7 min read·Apr 8, 2024--2--2
Mariusz KujawskiMigration from Oracle Data Warehouse to Databricks LakehouseMigration from an old data warehouse to a public cloud may initially appear scary. After years of reliance on a single database engine…12 min read·Mar 12, 2024--1--1
Mariusz KujawskiIntroduction to Databricks: A Beginner’s GuideIn this guide, I’ll walk you through everything you need to know to get started with Databricks19 min read·Feb 26, 2024--1--1
Mariusz KujawskiExploring the Medallion Architecture in Microsoft FabricThe Medallion architecture stands out as one of the most popular frameworks for constructing a data lake or lakehouse. Its core concept…9 min read·Feb 5, 2024--2--2
Mariusz KujawskiFrom Database to AI: The Evolution of Data PlatformsLet’s explore potential stages of data platform evaluation to derive meaningful conclusions and identify the criteria needed to transition…13 min read·Jan 8, 2024--7--7
Mariusz KujawskiPython for Data EngineeringPython plays a crucial role in the world of data engineering, offering versatile and powerful libraries. It has been adopted in various…13 min read·Dec 4, 2023--6--6