Understanding Pulsar Message TTL, Backlog, and Retention

Ming Luo
Ming Luo
Jun 23, 2020 · 7 min read

Originally published on the Kesque blog on June 22, 2020.

I’ve noticed some confusion out there around message deletion and retention in Pulsar (for example, in order to keep messages indefinitely what should be configured in the backlog quota or the retention policy or both). So I thought I’d put together a quick primer on how Pulsar manages message life cycle, and a few of the ways you can fine-tune it to manage backlog queues and message retention policies.