Thanks to all contributors for providing so many interesting insights.
The Gavi pro-equity evidence map on supportive supervision that Jenny mentions gives a nice summary of the main issues and is worth reading. The study labels the evidence for supportive supervision’s effectiveness as “inconclusive”. However, this review is focused specifically on "whether supportive supervision led to improved data utilization, data collection, and decision-making". It does not consider the effectiveness of supportive supervision on improving overall HCW performance or immunization service-delivery (or health outcomes).
The focus on data for decision-making reflects a common problem encountered when trying to synthesise the findings of supportive supervision interventions - namely, that success tends to be measured differently for each. Success in one may be improved HCW motivation, but it may be vaccine knowledge, cold chain management operations or reduced wastage in another. This perhaps relates to Xavier's idea of prioritising "standards for health systems research".
A systematic review from 2020 on successful supportive supervision interventions in LMICs (Deussom et al.) reached similar conclusions and gave the following recommendations on what interventions with the best chance of success should look like (these give a few clues as to what might be in the "secret sauce" Rebecca mentions):
- integrate evidence-based, QI tools and processes;
- integrate digital supervision data into supervision processes;
- increase use of health system information and performance data when planning supervision visits to prioritize lowest performing areas;
- scale and replicate successful models across service delivery areas and geographies;
- expand and institutionalize supervision to reach, prepare, protect, and support frontline health workers, especially during health emergencies;
- transition and sustain supervision efforts with domestic human and financial resources, including communities, for holistic workforce support.
For me, the most striking observation from the review was that 44 of the 57 studies were externally funded pilot projects. I wonder how many were sustained or integrated into national health systems? Probably very few. This supports Xavier's advice that we should "abandon the fallacy that some system interventions can substitute the shortcomings of health services operating under unacceptable baseline conditions" and Rebecca's that supportive supervision can't solve "deeper problems".
Findings from EVM assessments, now including almost 3000 health facilities across 75 countries, offer useful insights into the prevalence of supportive supervision of HCWs in LMICs and the obstacles that restrict this provision. The EVM framework, which considers the inputs, outputs, and performance of individual ISC functions, provides a ready-made, standardised conceptual model. For reference I have attached an export of the 21 input and output requirements in 'M3 Supportive supervision' that EVM assesses. More information on all 874 EVM requirements can be found here:
https://evm2.who.int/Public/Requirements
Another very interesting paper relevant to the above is this one. It supports the idea that evidence on the effectiveness of supportive supervision is mixed and identifies “contextual, institutional and logistical challenges” to the successful implementation of supportive supervision (EVM C1-6), notably over-reliance on externally funded pilot projects (EVM C6) and lack of clearly defined oversight and accountability processes (EVM Outputs).
---
Avortri, G.S., Nabukalu, J.B. and Nabyonga-Orem, J. (2019) “Supportive supervision to improve service delivery in low-income countries: is there a conceptual problem or a strategy problem?,” BMJ Global Health, 4(Suppl 9), p. e001151. Available at: https://doi.org/10.1136/bmjgh-2018-001151.
Deussom, R. et al. (2022) “Systematic review of performance-enhancing health worker supervision approaches in low- and middle-income countries,” Human Resources for Health. BioMed Central Ltd. Available at: https://doi.org/10.1186/s12960-021-00692-y.