Incentives for Accurate Diagnosis: Improving Health Care Quality in Mali

Lead Research Organisation: Brown University
Department Name: Economics

Abstract

Finding ways to deliver high-quality health care to low-income populations in developing countries is a critical policy challenge. Our initial ESRC-funded project found that reducing user fees (by providing primary health care for free) does substantially increase Malian households' use of this care. However, we also find evidence that much of this care may be unnecessary or mis-targeted: our data suggest that children seeking care in government-run community clinics (CSCOMs) are frequently prescribed antimalarials and antibiotics when they do not need the treatment. This is particularly striking for malaria, since the Malian government has mandated that malaria diagnoses be confirmed by diagnostic testing. Our findings are consistent with a large body of economic literature, which on the one hand provides theoretical underpinnings for the problem of over-prescription and over-treatment, and on the other documents low levels of doctor effort and quality of care in both the public and private sectors across the developing world. Our implementing partner, Mali Health, has indicated that the increase in program costs due to over-prescription and the need for close monitoring and quality checks are a key barrier to scaling up the free-care intervention.

We propose to conduct a follow-on project to identify the leading causes behind over-treatment, and test whether alternative incentive regimes can improve care outcomes without producing unnecessary costs. Our analytical framework is motivated by economic models of an "informed expert" selling "a credence good": the doctor has knowledge about the patient's illness and need for treatment that is not verifiable, and the patient must buy the treatment without knowing if it is truly what he or she needs. The model clarifies how doctor incentives, patient incentives, observability of diagnostic test results, and beliefs about test accuracy interact to produce care outcomes in this context.

This analysis informs the design of a randomized controlled trial (RCT), which we will use to empirically test the model (as well as alternative theories for over-treatment) and identify promising strategies for improving care outcomes in the Malian public sector. Our primary application will be malaria, since high-quality, low-cost rapid diagnostic tests for the disease are readily available. However, given the striking rates of antibiotic use in our data, we also propose to use part of the new grant to conduct additional scoping work and expand the project to include bacterial illness if possible.

The RCT will be conducted at 48 CSCOMs in the Bamako area and will allow us to evaluate the relative importance of test verifiability, provider beliefs about diagnostic test accuracy, and patient education about testing; provider incentives to diagnose and adhere to test results; and patient incentives to follow doctor advice and purchase medications. Over the course of the RCT we will construct a unique dataset that captures detailed information about patient demographic characteristics, symptoms, and treatment outcomes (tests and prescriptions given, medications purchased). We will also conduct home-based follow-up surveys to obtain information about patients' true malaria status, compliance with treatment, and provider satisfaction. This will allow us to estimate how alternative incentive and information regimes impact over-treatment and care outcomes in the public sector.

We propose to forge a close collaboration with Malian health officials, to ensure that our project has maximal policy impact. Aside from its immediate relevance for the Malian public health system, this project will be of broad interest to researchers and policymakers working in the fields of economic development and public health.

Planned Impact

Ensuring cost-efficient, high quality health care in developing countries has been a worldwide policy goal since the establishment of the United Nations Millennium Development Goals in 2000.Yet greater access to powerful drugs in regions with low regulatory oversight has contributed to overuse of these drugs and the resulting growth of new resistant strains of parasites and bacteria.

Our research project speaks to a need for policy approaches that can tackle the over-treatment problem in developing country contexts, which cannot rely on large-scale centralized monitoring efforts. By providing information on the causes over-treatment and under-diagnosis, our results will contribute directly to the design of such policies.

Our research will have an impact for four groups of beneficiaries. First, we expect the project to make significant contributions in the academic fields of public health, development economics, and demography. Second, we expect that our research will help local and national governmental bodies to design and implement effective public sector healthcare policies to address over-treatment problems. The citizens of these countries will also benefit through better quality, lower cost healthcare. Third, policy organizations working to promote better access to health care in the developing world will benefit from our work, especially those that work on malaria prevention, like the President's Malaria Initiative. By helping to improve the efficiency of the programs run by these organizations, our research will increase their capacity to provide aid, benefiting those covered by the resulting expansion. Fourth, the clients of the community health clinics we are planning on working with will benefit from higher quality care, better use of diagnostics for the prescription of antimalarials and antibiotics, and lower healthcare costs as a result.

Our primary strategy for maximizing impact will be to disseminate our results to policymakers and health providers in an accessible, informative way. Mali Health will use the results of our study to optimize their programs and adjust their current work on health system strengthening in collaborating CSCOMs. Mali Health also plays a key role in our strategy to influence national and regional policymakers. The organization has an established set of contacts at institutions involved in providing health care throughout Mali. At an international level, Mali Health is part of several networks of aid organizations such as Partners in Health which can be used to disseminate results.

A second pillar in our strategy for dissemination of results to policymakers is Dr. Seydou Doumbia, a senior investigator on the project. Dr. Doumbia is Professor and Dean of the Faculty of Medicine at the University of Bamako, and has been involved in several community-based research projects designed to improve the health system in Mali. His department provides support to the Ministry of Health and tests feasibility of scaling up new health intervention strategies, providing a direct channel to policymakers within Mali.

Our third dissemination channel is IPA and its sister organization, the Abdul Latif Jameel Poverty Action Lab (JPAL). Both organizations have the shared mission to promote the use of rigorous impact evaluations in policy-making. They publicize the design and results of all their projects on their website and regularly host large regional conferences and local dissemination workshops. IPA and JPAL work actively at the global level to promote the scale-up of successful interventions and to disseminate information to policy makers.

Finally, the PIs of this study plan on disseminating their research results through academic conferences and peer-reviewed publications, which in turn will influence policy. We also intend to disseminate our work in a format that is more directly accessible and relevant to policy makers, for example by presenting our work in policy forums.

Publications

10 25 50
 
Description After extensive piloting and scoping work, we focus in this project on the over-prescription of antimalarial drugs. We carried out four interventions:
- Patient information: on randomly selected days, patients at the clinic watched an informational video on malaria symptoms and testing while waiting for their doctor appointment.
- Doctor information: up to 4 doctors and nurses at each CSCOM enrolled in the study were invited for a malaria policy and testing refresher training. Providers from a random subset of clinics were additionally trained on the accuracy of RDT testing and the negative consequences of overtreatment with an antimalarial.
- ACT vouchers:
1) Patient vouchers: upon entering the clinic, patients received a voucher which provided them with a free course of the recommended treatment for simple malaria (artemisinin combination therapy, or ACT), provided the voucher was signed by a doctor to verify need for treatment.
2) Doctor vouchers: doctors were given the same vouchers and could hand them out to patients at their discretion.
During the intervention phase, we conducted intake and exit interviews with patients, and additionally selected a sub-sample of patients for home survey visits, at which we conducted a rapid diagnostic test for malaria (RDT) to verify patients' malaria status.

There are three key findings:
First, we used the home-based RDTs to quantify the extent to which patients are over-treated for malaria. We find large amounts of over-treatment: 42% of patients who we found to be malaria-negative at the home test nonetheless received malaria treatment. Moreover, 20% of malaria-negative patients and 54% of malaria-positive cases received treatment for severe malaria, which involves expensive injections with artemisinin derivates and is estimated to be needed for at most 10% of malaria cases (PMI 2015).
Second, we use the voucher interventions to discern which side of the market (doctors or patients) drives this high incidence of overtreatment. Anecdotal reports point to strong demand from patients for treatment with injections and powerful drugs. On the other hand, doctors have financial incentives to over-treat and may overweight the immediate risk of a false negative (under-treatment) relative to the more diffuse risks of a false positive (over-treatment). While the vouchers should increase demand for ACTs in both treatments, when vouchers are given to doctors, they have the option to "steer" the patient's demand towards their preferred outcome (higher or lower prescription rates). We find evidence that patients play an important role in driving demand for antimalarials: antimalarial vouchers are 30 percent (8 percentage points) more likely to be used when patients know about vouchers before seeing the doctor. The share of patients purchasing antimalarial treatment also increases by almost 7 percentage points when vouchers were given to patients. This increase in concentrated among patients least likely to have malaria based on symptoms.
Third, we ask whether improving doctor or patient knowledge of malaria testing and treatment improves treatment outcomes. This analysis is ongoing and very preliminary. We find muted impacts, with some evidence that doctor information improves targeting of malaria treatment.
Exploitation Route We plan on disseminating results through IPA and J-PAL as outlined in our "pathways to impact" plan. One of the PIs is now Director of Research at J-PAL and will be able to present results at policy and impact events directly. Moreover, we are sharing our results with the Health Ministry, the National Program for the Fight against Malaria (PNLP), and our partner organization Mali Health. Our doctor training had positive effects on doctor beliefs and knowledge, so we plan to share this result with the Malian government so they can use the training materials going forward.
Sectors Communities and Social Services/Policy,Healthcare

 
Description We have begun to share our results with research and policy audiences in Sub-Saharan Africa and beyond. Our results have contributed to policy discussions regarding cost-sharing and pricing of prescription drugs in the public sector. We are planning further engagement with government stakeholders in Mali once our analysis of the doctor training intervention is complete, since this training appears to improve adherence to RDT tests and could be scaled country wide.
First Year Of Impact 2018
Sector Healthcare
Impact Types Policy & public services

 
Title Doctor pre- and post-training beliefs and knowledge 
Description This survey was conducted pre and post the doctor information intervention to gauge treatment effectiveness. 
Type Of Material Database/Collection of data 
Year Produced 2017 
Provided To Others? Yes  
Impact The data shows that the information intervention that is part of this project was effective. 
URL https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/CLGN7Z&version=1.0
 
Title Doctor/clinic endline survey 
Description Data on beliefs and treatment practices of 162 doctors in 60 participating clinics. 
Type Of Material Database/Collection of data 
Year Produced 2017 
Provided To Others? Yes  
Impact Key input into studying our interventions. 
URL https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/CLGN7Z&version=1.0
 
Title Patient survey data 
Description As part of the grant, we collected data on over 2500 patients at 60 clinics in Bamako, Mali. This data contains survey data as well as (for a subset of patients) malaria test results collected at home. 
Type Of Material Database/Collection of data 
Year Produced 2017 
Provided To Others? Yes  
Impact This data will be key in evaluating the effect of our interventions. 
URL https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/CLGN7Z&version=1.0
 
Description Programme Nationale de la Lutte contre le Paludisme (PNLP) 
Organisation National Program for the Fight against Malaria
Country Mali 
Sector Public 
PI Contribution Part of our interventions for this grant were doctor and patient trainings. We produced training materials and a video for patients that teach doctors and patients about malaria testing and Malian treatment policy.
Collaborator Contribution PNLP contributed expertise and logistical support, including training materials and access to their roster of trainers. They also participated in a one-day workshop to design the doctor training in collaboration with other malaria policy organizations in Mali.
Impact - Training materials (slides and schedules) for health workers at public health clinics - A short information video for patients on malaria testing and treatment
Start Year 2016
 
Description EASST Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Simone Schaner presented the study at the 7th Annual East African Social Science Translations (EASST) Collaborative Summit. Over 150 Ph.D. and masters students, post-docs, and professors attended, along with policy makers, NGO workers, and members of the Ugandan media. Attendees were largely drawn from East and West African universities. The presentation was followed by Q&A; there was lively interest in both the study and conducting future research in the topical area.
Year(s) Of Engagement Activity 2018
URL http://cega.berkeley.edu/events/2018-east-africa-evidence-summit/
 
Description Malaria Day blog post 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The PI team wrote a blog post summarizing preliminary results from the study. The blog post was timed to be released on World Malaria Day. We plan to submit a longer, more detailed blog post in the near future.
Year(s) Of Engagement Activity 2018
URL http://www.theimpactinitiative.net/news/news-problem-overtreatment-why-antimalarials-are-being-used-...
 
Description Mali Training Design Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Policymakers/politicians
Results and Impact Around 20 people from the Ministry of Health, NGOs, health policy institutions, and the University of Bamako and Brown University attended a work shop with the goal of informing participants of the ongoing study and first pilot results and designing a training for doctors on the use of malaria tests, prescription policy, and rapid detection test quality and reliability.
Year(s) Of Engagement Activity 2016
 
Description VoxEU invited blog post on overtreatment. 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Invited blog post on VoxEU on patient driven overprescription.
Year(s) Of Engagement Activity 2019
URL https://voxeu.org/article/contribution-patients-and-providers-overuse-prescription-drugs