How data ensures that we deliver “Better Together”

Western Cape Game Changer Series Part 3

Penelope Tainton
Aug 24, 2017 · 8 min read

In Part One of this Series, I explored the reasons that Premier Zille chose to drive delivery using a very specific methodology, namely Deliverology. (The Deliverology methodology was developed by Sir Michael Barber, head of the first Prime Minister’s Delivery Unit in the UK in 2001. Sir Michael is currently Managing Partner of Delivery Associates, and is well known author of How to Run A Government: So that Citizens Benefit and Taxpayers Don’t Go Crazy)

An important component of the Deliverology approach is the development of a comprehensive Roadmap. This document is effectively a high-level and public communication of, and commitment to, each of the various aspects of the relevant project. Importantly, the Roadmap pulls together the details contained in the Delivery Plan. As a public, cabinet-approved document, it also commits the relevant government departments to specific deliverables by specifying the accountable persons and setting strict time lines.

The Delivery Triangle

Deliverology is, at its core, a data-driven methodology. Clear targets and trajectories, agreed key performance indicators (KPIs) and detailed data plans are integral to managing the delivery process. There is, after all, little point in a government investing money and resources into priority projects, and then not measuring the impact of these until the end of the Premier’s term of office. At this stage it is too late to make adjustments if the desired benefits are not being realised.

A great deal of thinking and collaboration with relevant teams of officials has taken place to ensure that we have identified all of the reasonable data required to prove success. The proposals have been checked and approved by leading Monitoring & Evaluation experts at Stellenbosch University, South Africa. As an example, the eLearning Game Changer seeks to enhance the teaching and learning experience of Western Cape learners, particularly in Mathematics and Languages, through the use of technology, and has six simultaneous streams of delivery.

KPIs

Resulting from an in-depth analysis to identify how we would track success in the eLearning Game Changer, we have adopted five high-level Key Performance Indicators (KPIs) that will be measured. These are:

· WAN usage statistics at a user level

· Number of school ICT labs that have been refreshed or replaced

· Number of teachers integrating ICT into their pedagogy

· Digital content that is accessed or downloaded

· Improved learner results

Five KPIs to prove success

Sample Schools

A great deal of time has been spent in selecting an appropriate and diverse set of sample schools from amongst our 1 500 educational institutions which will be the focus of our data collection for the three Education-focused Game Changers.

We have taken into account geographic spread and the urban versus rural nature of schools across the Province. We have also ensured that an equal number of primary and secondary schools are included in the set of sample schools. Further, the full range of different social-economic environments is covered by our sample schools. This is important because, as explained in my previous post, we still struggle with the legacy of an unequal education system. Our schools are major sites of shifting demographics and change and we need to track what impact our interventions are having in this complex space. Every learner must benefit from the significant investments being made by government.

Quantitative Data

As could be expected, much of the data required to track progress through the KPIs is of a quantitative nature. Data such as attendance records, academic results, technology and broadband usage, number of digital resources available and number of teachers trained should all be available and accessed from systems, both new and existing, that sit within the department’s core functions. As we implement better digital administration systems and as our Wide Area Network matures, new solutions are being sourced to allow for automation and electronic tools to facilitate quality data collection.

Historically there has been little standardisation of systems and no collection of granular, learner-level data from schools. Only consolidated data has previously been held at Provincial level. As a result, collecting the detailed quantitative data from across the Education Department and from multiple schools has proven challenging. Nevertheless, given that this is a significant part of proving the impact of these Game Changers, and that there is simultaneously a benefit to the Education Department to inform better decision-making, this is a subject of sustained focus and drive for accurate information that is available at regular intervals.

Qualitative Data: Measuring Non-Academic Indicators

Far more difficult to access, but equally important, are the qualitative data required to test awareness, perceptions, attitude, behaviour and understanding. All of these are critical indicators for tracking success in the three Education-focused Game Changers, and require responses from school leadership, teachers, programme managers, learners, as well as parents.

While there are obviously numerous survey tools available on the market, we have increasingly identified the need for a product that could meet a number of criteria:

We want an electronic tool that is education-focused, and that can be applied across all of the different stakeholder groups: principals, teachers, learners, parents.

This tool will link responses across the Game Changers, and will provide a clear analysis of the results, easily readable by people who are not M&E experts.

We want the ability to extract raw data so that we can conduct additional statistical analysis of the results, linking it with the quantitative data already gathered.

Critically, we would like to build a partnership with a team of people who reflect a similar set of values, who are passionate about making a contribution to improving education, and who are able to provide us with expert guidance. Our partners will support us in getting deeper insights into how our programmes are being implemented in schools and what impact we are achieving.

We recognise that through our education-focused Game Changers, we are breaking new ground in South Africa, and quite possibly in Africa. There are therefore many lessons that we could learn through engagement with a partner who has an international view.

At the same time, as countries across the globe face new challenges such as those of diverse languages, culture, religion and great inequalities — both social and economic — we believe that what we are doing on this southernmost tip of Africa could be important to assist and guide. And so, ideally, our partner would be able to support us in building a network with access to a global community, sharing experiences and building best practice.

Finally, the survey tools and platforms we use must provide a feedback loop, providing relevant information and analysis to the various levels engaged in processing of data, from the school principal, to district officials to the provincial authorities. This means that we want to select a platform that is well-acquainted with the education environment. The survey tool must be easily accessible to key stakeholders and data partners on various technology platforms, and provide different views on the data depending on the user’s role.

We anticipate that providing relevant feedback will have a two-pronged benefit:

  1. It will encourage ownership of data collection activities at the school level, which ultimately impacts on the efficiency of collection and quality of data.
  2. This will ensure greater utilisation of data at the school and district level, resulting in planned interventions based on evidence instead of guesswork.

This is exactly the kind of change we want to see come out of our Game Changers — better informed, more insightful, immediate and valuable interventions that impact positively on education.

And this is what Edurio is offering us as we track the progress of our Game Changers.

The team has engaged with us as a true partner, providing guidance and support, and showing a real interest in identifying solutions to our challenges. Where we have needed adjustments to suit our environment, they have quickly and efficiently provided revised options. They have given considered and useful feedback on every survey generated. Their quality product has proven easy to implement in our schools, and we are excited to see how, going forward, principals and district officials may find other projects where this platform will support their work.

Edurio’s vision is to contribute to a higher quality of education around the world, which aligns with our vision in the Western Cape. Their passion and commitment is present in every conversation. They have met our criteria in terms of providing an electronic, education-focused tool that provides analysis of the results. They are genuinely interested in being our partners on this journey, providing expert guidance and supporting us to obtain the insights we want. They share our values of closing the gaps of inequality, and of making their product accessible to everyone, in multiple languages and across all platforms — even mobile. They have a global view, and are building networks across the industry that allow us to share our experiences with others. And very importantly, they are as excited as we are at providing quality feedback to school managers, supporting informed interventions to provide a better education.

“The best partnerships aren’t dependent on a mere common goal but on a shared path of equality, desire, and no small amount of passion.”

-Sarah MacLean (American author)

Better Together

Edurio’s practical, hand-on approach has made it so easy for us to start down this challenging road to collect qualitative data from our schools, and have given effect to the Western Cape Government’s slogan of “Better Together”.

As we go about our mission of moving our country forward, we are very serious about addressing the challenge to equip all of our young people with support and the skills that they need to live a life of dignity and equality. The three Western Cape Game Changers that focus on improving education and opportunities for our young people are proof positive of that commitment, and we will succeed in building a better future through these priority policy interventions.


This is the third post in a series sharing the Western Cape’s forward-thinking approach to delivering on its ambitious Game Changer strategic goals. If you haven’t yet read Part 1 and Part 2, go back and check them out for more information about Western Cape’s Game Changer goals.

Insights

The official Edurio blog. Our team sharing insights into data, feedback and innovation in education - as well as our latest company news and product updates.

)

Penelope Tainton

Written by

Lead of eLearning and After School Game Changers, Office of the Premier, Delivery Support Unit, Western Cape Government. Improving lives, reducing inequalities.

Insights

Insights

The official Edurio blog. Our team sharing insights into data, feedback and innovation in education - as well as our latest company news and product updates.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade