Dataminded
Getting Data Done
Latest blogs
Trending blogs from Dataminded
Prompt Engineering for a Better SQL Code Generation With LLMs
Prompt Engineering for a Better SQL Code Generation With LLMs
Picture yourself as a marketing executive tasked with optimising advertising strategies to target different customer segments effectively…
Debugging Running Pods on Kubernetes
Debugging Running Pods on Kubernetes
Exploring Kubernetes’s debugging feature, kubectl debug, and extending kubectl debug to support volume mounts
The Mystery of Folders on AWS S3
The Mystery of Folders on AWS S3
The difference between objects and files, and what the AWS Console really does when you press the “create folder” button.
Use dbt and Duckdb instead of Spark in data pipelines
Use dbt and Duckdb instead of Spark in data pipelines
Dbt has become very popular for transformation on top of your data warehouse. We see potential to use dbt with Duckdb on top of a data…
Upserting Data using Spark and Iceberg
Upserting Data using Spark and Iceberg
Use Spark and Iceberg’s MERGE INTO syntax to efficiently store daily, incremental snapshots of a mutable source table.
Are your AKS logging costs too high? Here’s how to reduce them
Are your AKS logging costs too high? Here’s how to reduce them
Explore how to reduce the cost of logging on Azure by analyzing your applications and investigating Basics log analytics tables in Azure.
How to Effectively Structure Data for Self-Service Data Teams
How to Effectively Structure Data for Self-Service Data Teams
For years, data platforms — particularly data lakes and lakehouses — have relied on the medallion architecture. This tiered system…
You can use a supercomputer to send an email but should you?
You can use a supercomputer to send an email but should you?
Discover the next evolution in data processing with DuckDB and Polars