Published in Klaviyo Engineering·Jan 23, 2019Scaling Klaviyo’s Event processing Pipeline with Stream ProcessingPart I — Enter Abacus — Klaviyo has been growing at an incredible rate for the last few years — doubling our customer base and ingesting an order of magnitude more data every year. To handle the increasing event volume, we developed a system named Abacus to replace the initial version of Klaviyo’s real-time event aggregation…Counting11 min read
Published in Klaviyo Engineering·May 1, 2018Auditing and replaying billions of streaming events with AWS AthenaKlaviyo’s event processing pipeline(AKA 🤔the thinking pipe), tasked with ingesting billions of events from various sources every week, faces data consistency challenge like any other stream processing pipeline. …AWS7 min read
