Homepage
Open in app
Sign in
Get started
datamindedbe
Making Data Delightful
Follow
Trending blogs
How we reduced our docker build times by 40%
How we reduced our docker build times by 40%
This post describes two ways to speed up building your Docker images: caching build info remotely, using the link option when copying files
Niels Claeys
Oct 4, 2023
Quack, Quack, Ka-Ching: Cut Costs by Querying Snowflake from DuckDB
Quack, Quack, Ka-Ching: Cut Costs by Querying Snowflake from DuckDB
How to leverage Snowflake’s support for interoperable open lakehouse technology — Iceberg — to save money.
Jonathan Merlevede
May 15
Use dbt and Duckdb instead of Spark in data pipelines
Use dbt and Duckdb instead of Spark in data pipelines
Dbt has become very popular for transformation on top of your data warehouse. We see potential to use dbt with Duckdb on top of a data…
Niels Claeys
Apr 11, 2023
Cross-DAG Dependencies in Apache Airflow: A Comprehensive Guide
Cross-DAG Dependencies in Apache Airflow: A Comprehensive Guide
Exploring four methods to effectively manage and scale your data workflow dependencies with Apache Airflow.
Frederic Vanderveken
Jul 3, 2023
Debugging Running Pods on Kubernetes
Debugging Running Pods on Kubernetes
Exploring Kubernetes’s debugging feature, kubectl debug, and extending kubectl debug to support volume mounts
Jonathan Merlevede
Oct 25, 2023
How to organize a data team to get the most value out of data
How to organize a data team to get the most value out of data
To state the obvious: a data team is there to bring value to the company. But is it this obvious? Haven’t companies too often created a…
Wannes Rosiers
Mar 29
Short feedback cycles on AWS Lambda
Short feedback cycles on AWS Lambda
A Makefile that enables to iterate quickly
Robbert
Jun 18
Harnessing AWS MSK and AWS EMR for Real-time Analytics
Harnessing AWS MSK and AWS EMR for Real-time Analytics
A Deep Dive into Building a Scalable Analytics Pipeline, automating the infrastructure with Terraform
Ana Escobar
Sep 10, 2023
Latest blogs from Dataminded
Prompt Engineering for a Better SQL Code Generation With LLMs
Prompt Engineering for a Better SQL Code Generation With LLMs
Picture yourself as a marketing executive tasked with optimising advertising strategies to target different customer segments effectively…
Raghid Bsat
May 29
Age of DataFrames 2: Polars edition
Age of DataFrames 2: Polars edition
In this publication, I showcase some Polars tricks and features.
Wouter Gins
May 23
The building blocks of successful Data Teams
The building blocks of successful Data Teams
Based on my experience I will elaborate on key criteria for building successful data teams
Niels Claeys
May 2
Querying Hierarchical Data with Postgres
Querying Hierarchical Data with Postgres
Hierarchical data is prevalent and simple to store, but querying it can be challenging. This post will guide you through the process of…
Wietsche Calitz
Apr 15
Unlock Insights & Learnings: Data Minded Newsletter — March/April 2024 Edition
Unlock Insights & Learnings: Data Minded Newsletter — March/April 2024 Edition
Welcome to the March — April 2024 edition of the Data Minded Newsletter! We’re thrilled to share some exciting updates, valuable insights…
Sofia Iamskaia
Apr 9
Becoming Clout* certified
Becoming Clout* certified
Hot takes about my experience with cloud certifications
Rushil Daya
Mar 20
You can use a supercomputer to send an email but should you?
You can use a supercomputer to send an email but should you?
Discover the next evolution in data processing with DuckDB and Polars
Niels Claeys
Mar 12
Two Lifecycle Policies Every S3 Bucket Should Have
Two Lifecycle Policies Every S3 Bucket Should Have
Abandoned multipart uploads and expired delete markers: what are they, and why you must care about them thanks to bad AWS defaults.
Jonathan Merlevede
Mar 7
How we used GenAI to make sense of the government
How we used GenAI to make sense of the government
We built a RAG chatbot with AWS Bedrock and GPT to answer questions about the Flemish government
Rushil Daya
Feb 26
My key takeaways for building a data engineering platform
My key takeaways for building a data engineering platform
Having been a member of a product team for two years, I aim to share three valuable insights that I have gained.
Niels Claeys
Feb 15
About datamindedbe
Latest Stories
Archive
About Medium
Terms
Privacy
Teams