Framing Metrics for Success

Phil Dempster
Apr 9, 2019 · 5 min read

“Measure what matters” — John Doerr

For many Organisations there is a tendency to see value in measuring every and anything that is measurable, without investing time evaluating each metric to understand the why, the value it provides and the potential consequences.

Image for post
Image for post

Metrics are regularly used as ways to control outcomes and behaviors, the more metrics the better! I routinely see metrics chosen without consideration of their possible benefits, negative side effects, or their relevance to their target audience.

Some examples of metrics and measures that I’ve seen to encourage or drive particular outcomes and behaviors include;

  1. Incentivising individuals on revenue goal — with the desired intent of driving sales to improving the company’s available cash.
  2. Goal developers on lines of code produced — with the belief this will increase productivity and speed of value to customers.
  3. Reward (or punish) teams by focusing on error rate — to ensure quality.

At first glance these seem simple, sensible and logical metrics to measure and they WILL control behaviors but maybe not with the intended results. Let’s have a quick look again at each of the above

  1. The behaviour I saw was people started making less profitable and higher maintenance sales which eroded margins, hence reducing available cash
  2. Developers started cutting and pasting large amounts of code without thinking about the longer term maintenance, testability, readability, or quality of the code, reducing the overall value delivered.
  3. Measuring errors resulted in a slowdown of work done and a reduction in outcomes released from teams as new inbound work was rejected on the basis it required more discovery or elaboration in order to reduce errors;

There is a lot of information about metrics, and observation systems that let us collect metrics and measure just about anything: people, teams, leaders, sales, e-commerce performance, business performance, finances and the list goes on.

The challenge is not that there aren’t enough things to measure, it’s ensuring we are using and measuring the right metrics to accomplish what we are trying to achieve. How can we be consistent on the type or value of the metric, how do we attempt to detect a metric that cause bad behavior and how do we create a culture where metrics are used for continuous improvement and achieving.

When thinking about a metric I strongly suggest an upfront discussion clarifying the language used, ensuring a common understanding of measures, the why and the expectation. Share this information throughout the organisation to ensure everyone is starting from the same solid base. Noting that this is not about the actual metric but its definition, intent and scope. My strong recommendation is to start framing up metrics with the template below to create the base.

Framing a Metric

Valuable

Achievable

Realistic

Real Time

Opposite

Observer

Measurable

Once there is agreement and alignment on the framing of a metric, it’s time to decide on which metrics to use. I have found that it is best to start by creating two or three categories, even if there is only one or two metrics in each category, then collect some data on these metrics. Also make sure you have captured you framing outcome so that others may quickly understand the metric and your intent. An example of three categories could be Technical or Delivery Metrics, Customer or Business Metrics, and then Team Metrics.

Remembering that you can add more metrics and information about your metric as you learn, as well as remove metrics that fade in relevance, are not realistic, drive unwanted outcomes or no longer measurable. Actually, collecting data is important as it helps to make the metrics real, which in turn evolves the thinking of the metrics purpose and collection process early during their creation. A common trap is for teams or entire business units to get stuck in excessive planning that gets wasted once data gets collected and fails to meet the expectations of the plan.

My goal is to also share some examples of framed metrics, the need to pair metrics, displaying metrics as well as some ideas and metrics I have historically used.

I hope that the time you have invested has returned value to you and encourage you to provide real-time and measurable feedback! A comment or simple thumbs up lets me know how I’m doing.

Orchestrated

Relating to Mapper — Orchestrated’s Team Management…

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store