Assessing the Implementation of Indonesia’s National Nutrition Information System

How We Combine Data Analytics & Service Design Blog Series

Illustration by Swastika Exodian & Lia Purnamasari | UN Global Pulse

Emerging digital technologies are enabling faster and more efficient data collection on a range of development issues, leading to more timely analysis and action. To support the National Movement for Stunting Reduction, the Indonesian Ministry of Health developed an application for recording and reporting on community nutritional status. Known in short as e-PPGBM or Pencatatan dan Pelaporan Gizi Berbasis Masyarakat Elektronik in Indonesian, this application is designed to identify and monitor nutritional data in a timely, systematic and sustainable way. With early assessments pointing to challenges in implementing this system, UN Global Pulse through Pulse Lab Jakarta has been collaborating with UNICEF Indonesia and the Indonesian Ministry of Health to gain an in-depth understanding of the implementation gaps.

Reducing implementation gap

The e-PPGBM module is part of a larger nutritional system called SIGIZI, which was designed to aid nutrition-oriented programme implementers and policymakers in making informed decisions. Early observations from the Ministry of Health’s Nutrition Surveillance team have revealed issues related to the use of e-PPGBM. These issues range from a lack of clarity in follow-up mechanisms, to inefficient data utilisation among districts and provinces health offices.

Given the use of e-PPGBM in recording data that can be used to reduce stunting, it is critical to understand the various causes contributing to the suboptimal use of the system. Therefore, our goals were to systematically identify and better understand the gaps in e-PPBGM implementation; identify areas for improvement; and provide recommendations on actions that can be taken to improve optimization of the tool.

To do so, we applied a mixed-methods approach, integrating an online quantitative survey combined with qualitative research using service design principles. By leveraging a service design approach, we are able to methodically organise various components (such as people, technology, and procedures) in order to increase service quality and the user experience. This approach enables a holistic assessment as all parts of the service are examined, from the architecture and supporting infrastructure, to the stakeholders involved (who are critical for ensuring that the service keeps serving the needs of its users).

Understanding the experience of e-PPGBM users

Based on literature review and discussions with relevant stakeholders, we mapped the various user flows. The data collection for e-PPGBM involves monthly measurement and recording weight data in physical registers at health posts managed by the community, known as posyandu. From here, inputting the data into the e-PPGBM module becomes the responsibility of the puskesmas (community health centre) officers, which eventually becomes a growth and nutrition monitoring data source. By design, e-PPGBM’s main users include puskesmas officers, district health officials, provincial health officials and Ministry of Health officials — all with different roles.

Fig 1. Users of e-PPGBM. By applying service design principles, we can better understand the roles and responsibilities of each user and stakeholder of e-PPGBM.

Next, we conducted an online survey involving 1677 survey respondents from puskesmas, as well as district and provincial health offices. The responses indicated that most users of e-PPGBM find the system to be a helpful resource in assisting them to complete their nutritional surveillance tasks. However, there are several limitations preventing them from fully utilising the system, such as human resources needed to collect and input the data.

Once the survey results were compiled and analysed, we conducted a series of in-depth interviews online, coupled with observations at posyandu and puskesmas. To delve into the user experience and the challenges faced by users when utilising e-PPGBM, we divided the user flow in six phases: 1. Data collection; 2. Data entry; 3. Data analysis; 4. Intervention; 5. Dissemination; and 6. Socialisation and evaluation.

With these six phases, we were able to understand in more detail how users interacted with the touchpoints and interface of the e-PPGBM system.

Fig 2. The user journey throughout each phase of e-PPGBM use. Service design is also useful to look into how users utilise the system — enabling us to better understand their pain points.

Based on the data collected and synthesised, we unearthed several insights related to the implementation gap of e-PPGBM:

1. The design of the e-PPGBM system relies heavily on the puskesmas nutritionists to ensure data is collected and recorded accurately. The system was initially designed to help puskesmas officers collect and report nutritional data more efficiently. However, with limitations related to human resources, capacity, data collection standards and technology, it has been challenging for puskesmas nutritionists to utilise the system thoroughly, especially for data collection.
2. The main challenges with e-PPGBM data entry for puskesmas nutritionists are twofold: i) inputting of large volumes of data each month into ii) an error-prone system. There are volumes of data that need to be inputted into the system each month. Moreover, the system often experiences unexpected errors that cause delays, and for some users the system interface is not intuitive.
3. There is a gap between users’ ability to access the data and their ability to leverage it to propose interventions accordingly, which may be described as a data-action gap. The platform does not bridge the data collected with the analysis and insights necessary for users to plan the nutrition-related interventions needed, although there are opportunities to do so.
4. The support on e-PPGBM use is still focused on data entry, and its design does not encourage users to report interventions into the system. The reporting of interventions into e-PPGBM is as essential as inputting the nutritional data, whereby the underreporting of interventions could mean inaccuracy in the system’s data.
5. There are additional beneficiaries and policy makers who could potentially benefit from e-PPGBM’s data, but concerns about the quality of the data remains an obstacle.
6. The socialisation and evaluation of e-PPGBM occur regularly; however, the feedback provided on the users’ experiences are rarely translated into improvements.

How might we improve the system and user experience?

Following this service design assessment, we developed several recommendations. These recommendations ranged from longer-term steps that can be taken to improve the system, to immediate adjustments that can be made. The longer-term efforts are related to aligning the e-PPGBM system with the Ministry of Health’s recently launched Digital Health Transformation Strategy. Once implemented, this strategy will help address some of the current issues observed with e-PPGBM, such as data standardisation, interoperability, and integration of health information systems, especially at the puskesmas level.

In addition, we offered a list of immediate follow-up steps that the e-PPGBM service owners might take. The recommendations we put forward include the following:

1. Posyandu data recording template: a paper-based standardised template for all posyandu in Indonesia. Having this template throughout all posyandu could help reduce inconsistency about the data collection and recording process at posyandu and puskesmas facilities.
2. Image-to-excel converter: a mechanism to convert analogue posyandu records into a digital sheet that will enable faster data reporting and entry into e-PPGBM.
3. Data anomaly alert function: a feature in e-PPGBM which automatically identifies possible data anomalies once data is entered and directly alerts users. The feature could help reduce the effort needed from puskesmas nutritionists for data verification.
4. Recommendation generator: a feature in e-PPGBM that provides detailed recommendations on intervention options once data is entered and analysed by e-PPGBM.
5. Intervention feedback mechanism: this would provide feedback to users once intervention data are recorded into e-PPGBM.
6. Moderated Q&A platform: an online bulletin board facilitated by the service owner and provincial government, where users can post questions related to e-PPGBM usage.

Services are co-produced with users

Understanding the experiences of users in employing a service is important, particularly as services are generally co-produced with the users. As a methodology, service design allows us to delve into what may often seem like a complex interaction among various components within a service. It also helps us to understand how the service fits in a larger system — making the invisible visible and showing what is behind the scene as well as on the front and back stages. It is envisaged that the ideas and insights generated from this assessment will help to improve the functionalities of e-PPGBM, improve user experience, and ultimately produce value by aiding nutritionists, health workers and policy makers in their work.

This research was conducted by UN Global Pulse through Pulse Lab Jakarta’s team, with the generous support from UNICEF Indonesia and the Indonesian Ministry of Health. Let us know about your experiences applying service design in your work! Get in touch with us: plj@un.or.id

Author: Aaron Situmorang (Research Coordinator), with editorial support from Dwayne Carruthers (Public Advocacy Manager).

UN Global Pulse — Pulse Lab Jakarta Project Team: Aaron Situmorang (Research Coordinator), Lia Purnamasari (Design Researcher), Rizqi Ashfina (Social Systems Analyst), Maesy Angelina (Social Systems Lead) and Rajius Idzalika (Data Scientist).

Pulse Lab Jakarta is grateful for the generous support from the Government of Australia