Data Platform Engineering

Data Platform Engineering

Ankitsharma

Auto Scaling Celery Via Kubernetes

If you’ve been using Celery for a while to schedule and execute your tasks, you know how effective it can be for managing background jobs…

Oct 10, 2024

Auto Scaling Celery Via Kubernetes

Oct 10, 2024

Priyansh Khodiyar

Why Choosing Between Delta and Iceberg Shouldn’t Be a Problem Anymore

Introduction

Sep 27, 2024

Why Choosing Between Delta and Iceberg Shouldn’t Be a Problem Anymore

Sep 27, 2024

Sandeep Devarapalli

How Decoupling Storage from Compute Saves Big Money for Large Organizations

In the world of big data, every dollar counts. Companies handling vast amounts of data — think billions of documents and terabytes of…

Sep 24, 2024

How Decoupling Storage from Compute Saves Big Money for Large Organizations

Sep 24, 2024

Priyansh Khodiyar

Everything You Need to Know About MongoDB Oplogs

If you’ve worked with MongoDB and dived deep into how it syncs and replicates data, you’ve probably come across the term “oplog.” It’s…

Sep 17, 2024

Everything You Need to Know About MongoDB Oplogs

Sep 17, 2024

Priyansh Khodiyar

Apache Paimon vs. Apache Iceberg: A Detailed Comparison

Apache Paimon and Apache Iceberg stand out as two prominent table formats designed to address challenges with managing large-scale data

Sep 16, 2024

Apache Paimon vs. Apache Iceberg: A Detailed Comparison

Sep 16, 2024

Data Platform Engineering

This publication is dedicated to professionals and enthusiasts in the field of data platform engineering.

Editors

Sandeep Devarapalli

Priyansh Khodiyar

I write highly researched technical articles on things I daily learn, sometimes code, and interview people. My DevOps publication - unyaml.com

Sign up for The Data Brief

By Data Platform Engineering

Your weekly update on the latest happenings in data Take a look.

By signing up, you will create a Medium account if you don’t already have one. Review our Privacy Policy for more information about our privacy practices.

Medium sent you an email at to complete your subscription.

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech