In this article I gonna show how to control the throughput of a queue in a distributed task queue based systems, or, in a simpler language, how to set its rate limit. As an example, I’ll take python and my favorite Celery + RabbitMQ kit, although the algorithm that I use does not depend on these tools and can be implemented on any other stack.

So what’s the problem?

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store