Agile Lab Engineering

The Role of Training in Successful FinOps Adoption

This article explores the role proper training can have on organizations endeavouring to adopt FinOps. The increasingly complex and ever-expanding cloud operations will soon make FinOps mandatory for large enterprises.

Scaling Data Products with Newton

In this article from 2022, I explained why in Data Engineering we should aim for a better balance…

Why Building Your Own Data Product Management Platform Doesn’t Make Economic Sense

Internet of Things: handling MQTT messages with AWS IoT Core

Introduction

Data Contract Implementation Patterns

I’ve realized that it’s crucial to explore data contracts in greater depth because, beyond…

Building Data Fabric starting from Data Products

Run Dremio with AWS Glue locally

In this article, I’ll show you how to replicate a cloud-based or…

Build your own Spark frontends with Spark Connect — Part 1: The CLI tool

Tip: This article is part of a…

FinOps Architecture for Data Products

This article wants to provide a practical reference architecture to manage costs for data…