Vu Trinh – Medium

Vu Trinh

Pinned

Published in
Data Engineer Things

AutoMQ: Achieving Auto Partition Reassignment In Kafka Without Cruise Control

AutoMQ’s stateless brokers and its self-balancing feature

Nov 20

AutoMQ: Achieving Auto Partition Reassignment In Kafka Without Cruise Control

Nov 20

Pinned

Published in
The Deep Hub

How AutoMQ Reduces Nearly 100% of Kafka Cross-Zone Data Transfer Cost

Producing data with the broker in the same availability zone with S3 WAL, self-balancing, and leveraging Kafka rack-awareness

Oct 22

How AutoMQ Reduces Nearly 100% of Kafka Cross-Zone Data Transfer Cost

Oct 22

Pinned

Published in
The Deep Hub

How do we run Kafka 100% on the object storage?

Let’s see how AutoMQ makes this dream come true.

Aug 27

How do we run Kafka 100% on the object storage?

Aug 27

Pinned

Published in
Data Engineer Things

I spent 8 hours learning Parquet. Here’s what I discovered

I finally sat down and learned about it.

Aug 24

I spent 8 hours learning Parquet. Here’s what I discovered

Aug 24

Pinned

Published in
Data Engineer Things

How does Uber build real-time infrastructure to handle petabytes of data every day?

All insights from the paper: Real-time data infrastructure at Uber

Mar 23

How does Uber build real-time infrastructure to handle petabytes of data every day?

Mar 23

Published in
Google Cloud - Community

How does Vortex, the BigQuery storage engine work behind the scenes?

Vortex: The BigQuery’s Stream-Oriented Storage Engine (Part 2)

2d ago

How does Vortex, the BigQuery storage engine work behind the scenes?

2d ago

Published in
Google Cloud - Community

I spent 4 hours learning the architecture of BigQuery’s storage engine

Vortex: The BigQuery’s Stream-Oriented Storage Engine (Part 1)

6d ago

I spent 4 hours learning the architecture of BigQuery’s storage engine

6d ago

Published in
Data Engineer Things

I spent 4 hours learning how Netflix operates Apache Iceberg at scale.

Iceberg The Backbone At Netflix Data Platform Architecture

Nov 30

I spent 4 hours learning how Netflix operates Apache Iceberg at scale.

Nov 30

Published in
Data Engineer Things

How does Netflix ensure the data quality for thousands of Apache Iceberg tables?

The Write-Audit-Publish pattern with Iceberg Branches

Nov 26

How does Netflix ensure the data quality for thousands of Apache Iceberg tables?

Nov 26

Published in
Data Engineer Things

I spent 8 hours relearning the Delta Lake table format

The format, Read/Write process, Concurrency, Data Mutation and more

Nov 23

I spent 8 hours relearning the Delta Lake table format

Nov 23

Vu Trinh

Vu Trinh

🚀 My newsletter vutr.substack.com 🚀 Subscribe for weekly writing, mainly about OLAP databases and other data engineering topics.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams