Skip to main content

Gavi’s Zero-Dose Learning Hub IRMMA Aligned Interventions: Semiannual Update (October 2023)

Reporting Period:
January 2023 to June 2023

The Zero-Dose Learning Hub (ZDLH) mechanism is rapidly underway to improve how data and evidence are used to successfully identify and reach the millions of children who have not yet received a single routine vaccine shot, known as “zero-dose” (ZD) children, and the missed communities in which they live. This ZDLH semiannual update informs Gavi, the Vaccine Alliance Board (Gavi Board) and other stakeholders about the mechanism’s work to use evidence to better understand the factors influencing implementation and performance of approaches to identify and reach ZD and under-immunized (UI) children and missed communities.

The ZDLH helps generate, synthesize, and share ZD data and evidence at both the global and country levels. The structure is a hub-and-spoke model, where learning and evidence at the global level is managed by a global learning partner, and four country learning hubs (CLHs) (in Bangladesh, Mali, Nigeria, and Uganda) comprised of local partners/consortiums work that capture and use county-level programmatic data and evidence that contribute to performance reporting to the Gavi Board and other key stakeholders. The CLHs are implemented with the support of local organizations that have strong capacity to generate evidence, convene local stakeholders, and understand the national context and policies. They deploy resources to augment monitoring with implementation research (IR), along with other data collection activities. The CLHs are motivated to explore why children and communities are systematically missed and to evaluate effective practices to identify and reach those children. Each country is focused on targeted subnational geographies and will produce timely evidence on what is working, what is not working, what it takes to implement the approaches, and how processes can improve the use of evidence generated to ultimately inform future outreach strategies to better reach ZD children.

In the Gavi 5.0 Strategy, the Alliance moved to a more targeted, differentiated, and systematic approach to programming to reach ZD and under-immunized (UI) children. The Alliance recognized the lack of complete answers on how to reach communities that have been systematically missed for generations, including those in complex country contexts, such as urban areas, remote communities, and populations in conflict settings. In 2020, the CLH approach was proposed to the Programme and Policy Committee (PPC) and the Gavi Board as an initiative to address the knowledge gaps. To this end, the CLHs were established to generate, synthesize, and share data and programmatic learnings at both the country and global levels across the IRMMA (Identify – Reach – Monitor – Measure – Advocate) Framework and to provide data to complement Gavi’s implementation monitoring approach. This approach includes a cross-cutting focus on gender equity, focusing on targeted subnational settings with high numbers or proportions of ZD children and across a diversity of settings, including rural, urban, conflict, and refugee settings.

Findings and learning generated through the CLHs will help identify: (1) effective strategies and approaches that should continue for ZD measurement and programming, (2) which strategies and approaches should be scaled up, and (3) what strategies and approaches are not effective and should be discontinued. Each CLH consists of local partners focused on three key objectives:

  1. Generate and synthesize learnings based on the barriers to reach ZD children and apply these learnings to program planning and tailoring equitable approaches.
  2. Strengthen the evidence base of effective approaches to identify and reach ZD children.
  3. Improve metrics, measures, and methods to access and use data on a regular basis to improve outreach to ZD children and missed communities.

In addition to the four CLHs, the ZDLH mechanism includes a global consortium led by JSI Research & Training Institute, Inc. (JSI), in partnership with the International Institute of Health Management Research, New Delhi (IIHMR) and The Geneva Learning Foundation (TGLF) (see Figure 1). The global consortium provides technical and operational support to the CLHs and disseminates learnings at the community, regional, national, and global levels.

 

Figure 1. Timeline of Global and CLH Awards

Figure 1. Timeline of Global and CLH Awards

 

The four CLHs include:

  1. Bangladesh: Led by the International Center for Diarrhoeal Disease Research, Bangladesh (icddr,b) with partners Jhpiego and RedOrange Communications.
  2. Mali: Led by GaneshAID with the Center for Vaccine Development-Mali (CDV-Mali).
  3. Uganda: Led by Infectious Diseases Research Collaboration (IDRC) with partners PATH and Makerere University School of Public Health (MakSPH).
  4. Nigeria: Led by the African Field Epidemiology Network (AFENET) with the African Health Budget Network (AHBN).

The CLH countries were selected to ensure variation by region and context, including rural, urban, conflict, or refugee, and based on a relatively high number and proportion of ZD children. Other considerations included feasibility and risk mitigation. Table 1 illustrates different coverage estimates of the first dose of the Diphtheria-Tetanus-Pertussis vaccine (DTP1) and numbers of ZD children in the four CLH countries in 2022. The table highlights how estimates of ZD children can vary based on the data source due to a variety of reasons, including data quality and survey frequency (for estimates such as World Health Organization [WHO]/United Nations Children’s Fund [UNICEF] Estimates of National Immunization Coverage (WUENIC) that combine survey and administrative data).

Table 1. Comparison of Different Estimates of DTP1 Coverage (2022) in Children 12-23 Months of Age in Gavi CLHs

 BangladeshMaliNigeriaUganda
Percent of DTP1 coverage (Administrative data 2022)1221079194
Percent of DTP1 coverage (Official estimate 2022)n/a787094
Percent of DTP1 coverage (WUENIC 2022)99827094
Estimated Number of ZD children in 2021 (WUENIC 2022)29,405160,6262,271,265100,096

Currently, the CLHs are conducting a rapid assessment of data and interventions across the IRMMA Framework in their subnational targeted areas; engaging stakeholders; defining learning agendas; conducting data systems assessments; and designing IR studies. Through their planned research and programming activities, the CLHs will also provide insights into the use of the behavioral and social drivers (BeSD) tools, costing of programs to reach ZD children, and ways to improve data systems for monitoring and measurement.

In March 2023, the ZDLH online platform launched to orient visitors to the purpose of the ZDLH, raise awareness of the IRMMA Framework, and connect to the ZD Community of Practice (CoP). A press release featured the website along with the formal announcement of the ZDLH and four CLH awards. The website includes a robust resource library featuring tools and materials to support ZD practitioners. The ZDLH resource repository already includes more than 40 resources, such as the ZDLH’s recently published Typhoid Conjugate Vaccine (TCV) case study, Bangladesh and Mali Country Landscapes, and FHI 360’s Pro-Equity Evidence Map. New resources will continue to be added, and the new website will work to serve ZD practitioners by acting as a global resource to increase access to key tools, learning, and evidence generation aligned with the IRMMA Framework.

In May 2023, the ZDLH hosted its first inter-country learning exchange, (ZDLH-X1), which featured Bangladesh and Mali and engaged nearly 2,000 immunization practitioners, primarily from the district- and facility-levels and directly involved in ZD work. Topics included identifying ZD and missed communities in Chattogram City in Bangladesh, and community engagement in urban and rural remote areas, and in areas of insecurity.

Insights and learning exchanges from the ZDLH-X1 session focused on rapid convenience monitoring, microplanning, gender-related barriers and ensuring equity, and community ownership. Engagement with frontline staff through peer learning is powerful and can identify ‘what works’ and ‘how’ at the local levels and strengthen approaches for knowledge translation and evidence use. Progress on the second ZDLH-X event, ZDLH-X2, featuring CLHs in Uganda and Nigeria, will be included in the next semiannual update.

In June 2023, a ZDLH launch meeting held in Kampala, Uganda convened stakeholders from Gavi; the JSI-led global ZDLH consortium; CLH providers from Bangladesh, Mali, Nigeria, and Uganda; and the Uganda Ministry of Health (MOH) to increase alignment across the initiative and operationalize the peer-to-peer support component of the CLH model. The meeting focused on establishing common measures, strengthening existing monitoring systems, and tailoring program activities based on country-specific contexts. Key outputs included:

  • Coordination with the JSI Monitoring, Evaluation, and Learning (MEL) team to convene ongoing meetings to harmonize; ensure alignment with the IRMMA Framework; and finalize country-level theories of change, monitoring and learning (M&L) plans, and measurements in line with the GAVI 5.0 Strategy and learning questions.
  • Agreement that the birth cohorts for the rapid assessment across the four CLH countries consisted of 18 weeks to 23 months (as adopted by the Bangladesh CLH), and provided a grace period of four weeks following expected uptake of the third dose of the Diphtheria-Tetanus-Pertussis (DTP3) vaccine.
  • Establishment of a knowledge management system to support collaboration across the global consortium and CLHs and disseminate contextualized country-specific information. The attendees also determined next steps to contribute evidence to capture, synthesize, and disseminate learning through a gender- and equity-focused lens.

In 2024 and 2025, initiative activities will yield insights into progress in implementing ZD strategies through strengthened and more timely monitoring data, IR, and additional learning activities. Evidence use will be facilitated through a clear understanding of the review fora and timing, and targeted knowledge translation activities that include subnational staff, who are a recognized sources of local expertise and end-of-chain implementers who test evidence validity and applicability, alongside national partners. Critical users include partners developing Gavi funding applications, such as Full Portfolio Planning (FPP) and Equity Accelerator Funding (EAF), or justifying funding reallocation and annual performance review activities, including joint appraisals (JAs).

Part of the ZDLH scope of work is to provide more timely monitoring data at the global level on key indicators (e.g., the number of children vaccinated with DTP1, DTP1 coverage rates, and dropout from DTP1 to DTP3) from the targeted subnational level in the CLH countries. Bringing this data forward is intended to provide more timely insight about progress in reaching ZD children. This information, combined with other learning about the interventions and the intensity of their implementation, will help global stakeholders understand what works and how to reach those children at risk of ZD or under immunization. WUENIC and country official estimates of the key indicators noted above are available in July of the following year. While the estimates are generally accepted to be more accurate because of how they are estimated, they are not timely, may not provide enough disaggregation to identify where pockets of ZD children are located, and do not provide information about what policies and program are driving change. Disaggregating data on key indicators by subnational level can help with some of this interpretation if one has information about the context and intensity of implementation of interventions, although disaggregated subnational data is not usually widely available at the global level except through occasional surveys or modeling.

To improve timely monitoring, the CLHs rely on routinely collected administrative data, such as data available through the District Health Information Software 2 (DHIS2), which are available on a more regular basis and at subnational levels in countries. But those data often suffer from poor data quality as indicated by coverage rates greater than 100 percent. The reasons for poor data quality are often due to inaccurate denominators, for example, estimating the number of surviving infants in a geographic area. Additionally, there could be inaccuracies with the numerator caused by the incorrect recording of immunization doses administered, which may be caused by several reasons, including the lack of data recording tools or human error. Moreover, data can fluctuate widely from month to month based on both supply- and demand-side factors such as vaccine stock outs, holidays, poor weather, health worker strikes, etc. Regular review of these data by health workers familiar with the context can reveal what those factors may be so they can propose and implement remedies. Nevertheless, at the global or even national level, all of these factors challenge our ability to interpret routinely collected data to understand the effect of interventions designed to identify and reach ZD children.

CLHs will be regularly reviewing and reporting administrative data for their targeted subnational areas (e.g., upazila in Bangladesh, Local Government Area [LGA] in Nigeria, and district in Uganda and Mali) which will allow us to examine subnational progress every six months and dive into the issues and root causes of important trends. Given the limitations noted above, the CLHs are taking the following steps: CLHs will provide administrative data for analysis of six-month trends, comparison of trends over time, and comparison against previous years’ trends. Data available on other variables, such as stock outs and number of immunization sessions planned versus conducted, can provide some insight on the corresponding dips or peaks in immunization coverage. CLH activities such as systems assessments, activity implementation monitoring, and data reviews can help improve interpretation of trends, but also improve the availability and quality of ZD-relevant data over time. Information pulled from system assessments can also help determine actionable steps for addressing gaps in monitoring and measuring ZD and improve data quality. Therefore, a key benefit of the CLHs is not only the availability of more granular monitoring data, but also the analysis, interpretation, and use of the data for action at both the local and global levels, plus improvements in data quality and reliability in CLH study areas.

The vision of success for the CLHs is reflected in the measurement and learning (M&L) plans at the global level (ZDLH) and with each CLH, and includes monitoring performance to describe successes and challenges of the model and approach. The ZDLH mechanism is working toward the outcome of timely, increased, and sustainable use of evidence to improve global, regional, and country immunization programs and policies in alignment with the Gavi 5.0 Strategy and IRMMA Framework.

M&L plan outputs include:

  • CLHs have strong networks, technical expertise, and practices
  • Cross-country evidence generated
  • Evidence and learning available and accessible to identify and track ZD children and missed communities through a gender and immunization equity lens
  • Project-generated evidence and learnings translated for use in local policy and programming
  • Learnings around ZD barriers and effective interventions communicated globally to partners, stakeholders, and immunization practitioners

As mentioned above, the four CLHs came onboard at different times and are in different stages of implementation, which affects the depth of reporting for each CLH in this update. Nevertheless, several common findings are emerging across the four CLHs that merit follow-up in the second year of the initiative:

  • There is a lack of demand-side insights based on validated instruments such as the BeSD tools in all CLH countries, particularly at the subnational level where insights are needed for specific geographic and sociodemographic contexts. The CLHs are responding to this gap by incorporating guidance and indicators from the BeSD tools in their planned research to understand reasons for low vaccination uptake and to inform planning priorities and intervention design.
  • In all CLH countries, triangulation of existing data and identification of ZD children relies primarily on administrative data. The CLH data system landscapes and diagnoses currently underway are revealing similar results of data quality issues with numerators and denominators, and yet this is the main source of monitoring data going forward.
  • While stakeholder engagement models are different in each CLH, they all recognize the importance of partner engagement at national and subnational levels and the need to engage frequently to influence policy decisions.
  • The IR component in all CLHs is dependent on government and/or Gavi funding for the targeted interventions. The timing and scope of funding is outside the control of the CLHs, which is a risk worth noting.

Download the IRMMA Aligned Interventions: Semiannual Update (October 2023) (PDF) to read the country summaries: Bangladesh, Mali, Nigeria, and Uganda.