Reducing education to vanity metrics

Byron Scaf
Aug 25, 2018 · 2 min read

Why does so much educational software measure “number of questions answered”?

I’m ashamed to admit it, but we’ve done it before too.

It is a classic ‘quality over quantity’ vanity metric. “Your students have answered 5000 questions this week” sounds impressive… like students are doing some serious learning. But are they?

Judging student outcomes or even engagement by ‘questions answered’ makes as much sense as judging an essay favourably by its large word count.

Like word count, ‘number of questions answered’ is easy for computers to measure. Certainly a lot easier than what really counts — whether we’ve adequately prepared our students for the Real World™.

But if those questions were easy, if they were largely testing basic recall of facts, what have we really achieved?

Here’s what I think matters, and I hope you agree:

Fostering a generation of scientifically literate citizens, able to critically evaluate and analyse complex issues, and able to creatively solve tomorrow’s problems.

We want students to think, and sometimes that’s hard. Sometimes, there isn’t instant gratification. Sometimes, the questions we pose to students might require research, or extended contemplation of more than one side of an issue (shocking, I know).

This depth of thinking can’t, at least today, be measured well by computers. And it certainly can’t be reduced to a metric like “number of questions answered”.

Image for post
Image for post
(Adobe Stock)

Stile Blog

Byron Scaf

Written by

Entrepreneur and science nerd. CEO at Stile, where we're engaging young citizens in the power and wonder of science.

Stile Blog

We blog about education, science, shiny new tech and where these three meet.

Byron Scaf

Written by

Entrepreneur and science nerd. CEO at Stile, where we're engaging young citizens in the power and wonder of science.

Stile Blog

We blog about education, science, shiny new tech and where these three meet.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store