Niels Claeys – Medium

Home

Following

Library

Reading history

Stories

Stats

Niels Claeys

Published in
Conveyor Data

Are your AKS logging costs too high? Here’s how to reduce them

Explore how to reduce the cost of logging on Azure by analyzing your applications and investigating Basics log analytics tables in Azure.

Mar 10

Are your AKS logging costs too high? Here’s how to reduce them

Mar 10

What a month of SQL challenges taught me

While participating in Advent of SQL, I learned that practice really makes perfect, issues with time, ChatGPT outperforms me and more…

Dec 30, 2024

What a month of SQL challenges taught me

Dec 30, 2024

Published in
Dataminded

Running thousands of Spark applications without losing your cool

I explain how to troubleshoot and detect problematic Spark applications at scale as well as show how this can be used to reduce your costs.

Dec 12, 2024

Running thousands of Spark applications without losing your cool

Dec 12, 2024

Published in
Dataminded

The building blocks of successful Data Teams

Based on my experience I will elaborate on key criteria for building successful data teams

May 3, 2024

The building blocks of successful Data Teams

May 3, 2024

Published in
Dataminded

You can use a supercomputer to send an email but should you?

Discover the next evolution in data processing with DuckDB and Polars

Mar 12, 2024

You can use a supercomputer to send an email but should you?

Mar 12, 2024

Published in
Dataminded

My key takeaways for building a data engineering platform

Having been a member of a product team for two years, I aim to share three valuable insights that I have gained.

Feb 15, 2024

My key takeaways for building a data engineering platform

Feb 15, 2024

Published in
Dataminded

Quacking Queries in the Azure Cloud with DuckDB

This post describes 2 Duckdb extensions that enable you to read data from Azure blob storage. It also shows code for both Python and dbt.

Jan 10, 2024

Quacking Queries in the Azure Cloud with DuckDB

Jan 10, 2024

Published in
Dataminded

How we reduced our docker build times by 40%

This post describes two ways to speed up building your Docker images: caching build info remotely, using the link option when copying files

Oct 4, 2023

How we reduced our docker build times by 40%

Oct 4, 2023

Published in
Dataminded

Head-to-head comparison of dbt SQL engines

Compare usage and performance of dbt against 3 popular open-source SQL engines, namely: Spark, Trino and Duckdb

Sep 8, 2023

Head-to-head comparison of dbt SQL engines

Sep 8, 2023

Published in
Dataminded

Use dbt and Duckdb instead of Spark in data pipelines

Dbt has become very popular for transformation on top of your data warehouse. We see potential to use dbt with Duckdb on top of a data…

Apr 12, 2023

Use dbt and Duckdb instead of Spark in data pipelines

Apr 12, 2023

Niels Claeys

Niels Claeys

Data (platform) engineer @Data Minded with a fondness for distributed systems. I love AWS, Kubernetes, Spark, Duckdb. and write about day-to-day challenges.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Rules
Terms
Text to speech