Vu Trinh – Medium

Vu Trinh

Pinned

Published in
Data Engineer Things

AutoMQ: Achieving Auto Partition Reassignment In Kafka Without Cruise Control

AutoMQ’s stateless brokers and its self-balancing feature

Nov 20

AutoMQ: Achieving Auto Partition Reassignment In Kafka Without Cruise Control

Nov 20

Pinned

Published in
The Deep Hub

How AutoMQ Reduces Nearly 100% of Kafka Cross-Zone Data Transfer Cost

Producing data with the broker in the same availability zone with S3 WAL, self-balancing, and leveraging Kafka rack-awareness

Oct 22

How AutoMQ Reduces Nearly 100% of Kafka Cross-Zone Data Transfer Cost

Oct 22

Pinned

Published in
The Deep Hub

How do we run Kafka 100% on the object storage?

Let’s see how AutoMQ makes this dream come true.

Aug 27

How do we run Kafka 100% on the object storage?

Aug 27

Pinned

Published in
Data Engineer Things

I spent 8 hours learning Parquet. Here’s what I discovered

I finally sat down and learned about it.

Aug 24

I spent 8 hours learning Parquet. Here’s what I discovered

Aug 24

Pinned

Published in
Data Engineer Things

How does Uber build real-time infrastructure to handle petabytes of data every day?

All insights from the paper: Real-time data infrastructure at Uber

Mar 23

How does Uber build real-time infrastructure to handle petabytes of data every day?

Mar 23

Published in
Data Engineer Things

I spent 4 hours learning how Netflix operates Apache Iceberg at scale.

Iceberg The Backbone At Netflix Data Platform Architecture

2d ago

I spent 4 hours learning how Netflix operates Apache Iceberg at scale.

2d ago

Published in
Data Engineer Things

How does Netflix ensure the data quality for thousands of Apache Iceberg tables?

The Write-Audit-Publish pattern with Iceberg Branches

6d ago

How does Netflix ensure the data quality for thousands of Apache Iceberg tables?

6d ago

Published in
Data Engineer Things

I spent 8 hours relearning the Delta Lake table format

The format, Read/Write process, Concurrency, Data Mutation and more

Nov 23

I spent 8 hours relearning the Delta Lake table format

Nov 23

Published in
Data Engineer Things

DataHub: The Metadata Platform Developed at LinkedIn

How did LinkedIn manage the data catalog at scale?

Nov 19

DataHub: The Metadata Platform Developed at LinkedIn

Nov 19

Published in
Data Engineer Things

I spent 8 hours learning the ClickHouse MergeTree Table Engine

Concepts, The Write/Read Process, The Mutation and The replication

Nov 16

I spent 8 hours learning the ClickHouse MergeTree Table Engine

Nov 16

Vu Trinh

Vu Trinh

🚀 My newsletter vutr.substack.com 🚀 Subscribe for weekly writing, mainly about OLAP databases and other data engineering topics.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams