Latency vs Throughput

Bosco Noronha
Jul 23, 2018 · 1 min read

Latency: Elapsed time of an event.

eg. Walking from point A to B takes one minute, the latency is one minute.

Throughput: The number of events that can be executed per unit of time.

eg. Bandwidth is a measure of throughput.

We can increase bandwidth to improve throughput but it wont improve latency.

Take the RPC case — There are two components to latency of message communication in a distributed system, the first component is the hardware overhead and the second component is the software overhead.

The hardware overhead is dependent on how the network is interfaced with the computer, this is managed mostly by the network controller.

How do we reduce the software overhead? That’s a question every product owner needs to ask themselves to improve their product.

Bosco Noronha

Written by

Self-made. Engineer. Investor. Mountaineer. Fearless 3x immigrant. Growing. Present. Alive.

More From Medium

Also tagged Programming

Also tagged Cloud Computing

Also tagged Cloud Computing

Testing Serverless Workflows

Apr 7 · 8 min read


Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade