Ralph Brendlerinproject44 TechBlogExperiments in Kafka CompressionOur use of Kafka at Project44 has continued to expand over the past several years, to the point where a large portion of our product…Sep 7, 20231Sep 7, 20231
Ralph Brendlerinproject44 TechBlogUnintended Consequences (Kafka Edition)When Auto-Create Goes WrongJun 6, 2023Jun 6, 2023
Ralph Brendlerinproject44 TechBlogMoving a Busy Kafka Cluster (Part 3)In previous installments, we set up XDCR to migrate the data for a busy Kafka cluster onto entirely new infrastructure, and updated the…Dec 6, 2022Dec 6, 2022
Ralph Brendlerinproject44 TechBlogMoving a Busy Kafka Cluster (Part 2)In our last installment, we migrated the data for a busy Kafka cluster onto entirely new infrastructure without downtime. With the cluster…Nov 1, 2022Nov 1, 2022
Ralph Brendlerinproject44 TechBlogMoving a Busy Kafka Cluster (Part 1)At project44, we use Kafka for lots of things: logging, pipelines, event ingestion, streaming APIs, asynchronous job processing, and much…Oct 5, 2022Oct 5, 2022
Ralph Brendlerinproject44 TechBlogMicro-Partitioning: An Alternative Circuit Breaker for KafkaOne of the first things a new engineer learns when they start at project44, is that we use Kafka. A LOT of Kafka…Aug 2, 2022Aug 2, 2022
Ralph Brendlerinproject44 TechBlogData Migration Using Kafka ConnectOne of the trickier refactorings that we commonly encounter is migrating an existing service’s underlying data store to a new database or…May 10, 20221May 10, 20221
