Rui CarvalhoinArt of Data EngineeringWhy Data Engineers Need to Understand DevOpsLearn why adopting DevOps is essential for faster deployments, better data quality, and scalable systems.3d ago3d ago
Rui CarvalhoinThe Data TherapyDatabricks — Iceberg Support in Delta Lake: What’s about?A year ago, Databricks introduced a feature that promised to make life easier for data engineers: support for Apache Iceberg within Delta…6d ago6d ago
Rui CarvalhoinThe Data TherapyLoad and Transform Data from OpenWeather API into Azure Blob Storage using Apache AirflowLearn the step-by-stepSep 42Sep 42
Rui CarvalhoinLearning SQLUnderstanding SQL’s ROW_NUMBER() and PARTITION BY: Benefits and ConsiderationsLearn how they can optimize your data sorting, pagination, and deduplication tasks, along with important performance and complexity…Aug 26Aug 26
Rui CarvalhoinTowards Data EngineeringWhy You Must Start Partitioning Your Data Today!Learn why it’s essential, with practical steps and real-world examples, to manage large datasets effectively.Aug 19Aug 19
Rui CarvalhoinArt of Data EngineeringUnderstanding Apache Spark: A Deep Dive into Big Data ProcessingLearn why Spark is the go-to choice for data engineers and data scientists.Aug 12Aug 12
Rui CarvalhoinThe Data TherapyTurn Back Time using Fabric Warehouse Time TravelExplore past data effortlessly, ensure accurate audits, and enhance decision-making.Aug 8Aug 8
Rui CarvalhoinThe Data TherapyOptimizing Data Management with Lakehouse Schemas in Microsoft FabricDiscover how Lakehouse schemas help you transform data organization in Microsoft Fabric.Aug 1Aug 1
Rui CarvalhoinData Engineer ThingsPerfect Data Pipeline: How to Build Them Nearly FlawlessGreat for data engineers aiming to optimize data workflows and decision-making processes in their projects.Jul 26Jul 26
Rui CarvalhoinTowards Data EngineeringWhat Every Data Engineer Needs to Know About Data OrchestrationEssentials of data orchestration and how it transforms your data management.Jul 24Jul 24