Consultant, MLE Strategy (Immunization Demand Generation Pilot)

About Evidence Action

At Evidence Action, we deliver data-driven interventions that transform lives at an unprecedented scale. We identify neglected global health issues and deploy proven solutions, forging healthier futures for generations.

Our model operationalizes leading academic research (including from Nobel-winning economists). We measure progress and outcomes at every stage to ensure we’re making a real impact for people living in poverty and suffering from preventable or treatable health issues. Operating across 11 countries, our team of 900+ has reached over 500 million people, working closely with governments to scale these interventions.

• Our Deworm the World program has delivered over 2 billion treatments, significantly reducing worm prevalence and generating more than $23 billion in lifetime productivity gains. 
• Through Safe Water Now, we’ve saved the lives of over 15,000 children. 
• Our Accelerator explores untapped opportunities in global health, testing low-cost interventions with the greatest potential to save and improve lives. 

About the Consultancy

The MLE Strategy team optimizes Evidence Action’s programming through versatile and right-fit monitoring and evaluation solutions and insights. Working closely with other global and regional teams, we are responsible for developing MLE frameworks and strategies that improve programs and further our understanding of programmatic impact. With the work our team does, Evidence Action is uniquely able to adapt its programs based on the evidence we generate and share.

Evidence Action is preparing to pilot an Immunization Demand Generation (IDG) program in Nigeria, focused on increasing routine childhood vaccination coverage by boosting demand among caregivers of children under two. The intervention comprises three components: (1) digital reminders (text and voice) to caregivers about vaccination schedules, (2) community ambassadors who encourage vaccination uptake through trusted social networks, and (3) targeted incentives for caregivers in areas with low baseline vaccination rates. The pilot will be implemented across 10 LGAs in two Nigerian states. Supervised by the Associate Director of MLE Strategy, this consultancy will design, develop, and implement the MLE system for the IDG pilot, with a focus on three primary functions: (1) formative research design and analysis, (2) MLE system design and tool development, and (3) data analysis and reporting.

Scope Of Work

Pilot timelines are not yet firm. At the time a consultant is hired, we will confirm the final scope of work based on program activities at the time. The scope below reflects current planning assumptions.

• Phase 1 - Formative Research and Early MLE Design (roughly months 1 to 2 of engagement)
• Revised pilot MLE concept note - Review the existing MLE documentation, pilot proposal, and budget; identify gaps, outdated assumptions, and areas requiring alignment with the program team; produce a revised concept note signed off by the Global MLE-S team and program leads 
• Formative research design and report - Design in-country formative research (timing dependent), including development of data collection tools (structured observation guides, health worker, caregiver, and community health worker interview guides) to assess preferences and proposed pilot design; support in-country data collection and analysis; document findings and implications in a formative research report
• Pilot MLE framework - Begin drafting the MLE framework, including indicator definitions, sampling approach, sample size calculations, evaluation methodology, and data flow documentation. Refine sample size calculations based on evolving pilot design and treatment variation decisions, in coordination with J-PAL where applicable
• Phase 2 - MLE Design Finalization, Baseline, and Pre-Pilot (roughly months 3 to 5 of engagement)
• Independent Monitoring Firm Selection and IRB Preparation - Support selection of an IM firm for the pilot data collection and IRB preparation for the pilot, including contributing to the pilot IRB protocol 
• Data collection instruments package - Develop all data collection instruments ready for piloting at the start of Phase 2: baseline and endline surveys, phone validation surveys, ambassador and caregiver surveys, and data validation tools; include community survey instruments if community-level coverage data is determined to be a priority during the framework design
• Finalized instruments and data quality assurance protocols - Oversee pilot-testing of all data collection instruments, make revisions as needed, and produce data quality assurance protocols including data verification approaches
• Baseline report - Oversee baseline survey implementation including enumerator training and quality monitoring; deliver a baseline report with findings and implications for program design
• Phase 3 - Pilot Implementation and Monitoring (roughly months 6 to 12 of engagement)
• Process monitoring outputs - Implement the process monitoring approach, producing summary outputs for the program team at the frequency established in the design
• Program performance reports - Conduct periodic data quality checks and support troubleshooting of data collection systems; Support interim data analysis and produce summary outputs for program team use and donor reporting
• Phase 4 - Pilot Endline analysis, reporting, and closeout (roughly months 12 to 15 of engagement)
• Endline survey and data validation report - Oversee endline facility survey implementation including enumerator training and quality monitoring; conduct data validation exercises to assess the accuracy and completeness of data collected during endline
• Pilot report - Support production of the pilot report, including evaluation analysis, data quality findings, cost-effectiveness inputs, and recommendations for program adaptation and scale-up decisions
• Learning synthesis - Contribute to a synthesis covering what worked, what did not, and what would need to change for potential scale-up

Through Pilot  Work

• Participate in regular coordination meetings with the Global MLE-S team and country program team, including scheduled check-ins and ad hoc calls as needed, and be available for meeting scheduled during the West Africa time zone working hours (UTC+1)
• Contribute MLE inputs to discussions and pilot development throughout the program
• Flag emerging issues, timeline risks, or scope changes proactively to the Global MLE Strategy Associate Director
• Accommodate periodic meetings across West Africa and US Eastern time zones as agreed with the team
• The consultant must be available for at least one in-country trip to Nigeria, likely during the baseline data collection phase.

Requirements

• You hold an advanced degree in public health, epidemiology, statistics, public policy, or a related field
• You have 5 - 7 years of MLE experience in global health programs, with demonstrated experience designing and implementing MLE systems for facility-based and community-based health programs in low- and middle-income countries
• You have quantitative skills, including experience with sampling design, survey implementation, and data analysis (proficiency in Stata or equivalent required)
• You have experience developing data quality assessment and verification methodologies
• You are able to work independently and manage MLE workstreams with limited in-country support
• You can produce clear, decision-oriented reports for program and donor audience

Location

This consultancy is fully remote.