Understanding the Raison D’être of the Mighty Queue

Knowing when and how to deploy this simple and versatile tool can be an extremely powerful option in data system design.

Paul Singman
Whispering Data

--

The following scenario truthfully occurred in my career, and was the moment the queue’s purpose in a system “clicked” and became clear in my mind. I hope that sharing this problem, the resulting struggle, and how I eventually solved it has a similar effect on you.

Friday Afternoon

Photo by Tomasz Rynkiewicz on Unsplash

It’s a Friday afternoon at the office (remember those?) and you are getting ready for the weekend. You have already closed your laptop and are mingling with your co-workers to see where the happy hour spot is this week.

Suddenly, Brett from the marketing department approaches you — a respected senior engineer at the company — and says, “Sorry, but I have a favor to ask. We need to send a $15 off in-app coupon to all our customers in the past year before Monday, can you do it? The leadership team is concerned about sales numbers this quarter and really wants this promotion to go out.”

Although you’ve already accomplished several impressive things during your time at the company, you remain eager to further prove yourself, especially on something with such senior…

--

--

Paul Singman
Whispering Data

Data @ Meta. Whisperer of data and productivity wisdom. Standing on the shoulders of giants.