The design and evaluation of a mobile learning intervention for the training and supervision of community health workers

Lead Research Organisation: University College London
Department Name: London Knowledge Lab

Abstract

This project relates to the Information and Communications Technology and Development theme of the call.

Through this innovative 2-year mobile learning project, the Institute of Education, University of London (IoE) and the African Medical and Research Foundation (AMREF) aim to advance the training and supervision of community health workers (CHWs) in Kenya, resulting in improved access to primary health care for the marginalised communities of Makueni County and the Kibera informal settlement. This is important because supporting poor communities gain access to health care by training CHWs and connecting them to the local health system can help reduce poverty.

CHWs are community members who provide basic medical services. Research consistently evidences CHWs pivotal role in providing equitable health access in support of poverty alleviation by preventing and diagnosing diseases like malaria and HIV, treating minor ailments, referring patients and providing support and care for pregnant women and babies.

This project will work closely with CHWs and their supervisors to collaboratively design, develop implement and evaluate a mobile learning intervention that better connects CHWs and supervisors. The innovative nature of this intervention will mean that for the first time CHWs will have a mobile portfolio of their practice, easily accessible reference material on their phone and the ability to share practice related questions and resources with their colleagues through activities which promote peer learning and reflection. Supervisors will be better informed of CHWs' training needs and AMREF will gain a better insight into the nature and frequency of their two-way interaction and into the specifics of on-the-ground support structures needed for intervention implementation. Kenyan policymakers will benefit from policy briefings demonstrating how our mobile intervention supports affordable, equitable and effective access to health care.

The improved mobile-based supervision and training will link CHWs more closely to the local primary healthcare system so as they can be more effective in reducing poverty through improving the access of local communities to health care.

Planned Impact

Who will benefit from this activity?
The project's research questions address five groups of beneficiaries. The three direct beneficiaries will be: (i) the 64 CHWs and (ii) 8 supervisors directly involved in the project and (iii) AMREF in Kenya. The two indirect beneficiaries will be (iv) the Kenyan Ministry of Public Health and Sanitation (MOPHS) and (v) the communities the CHWs serve in Makueni County and the Kibera informal settlement in Southern Nairobi.

How will they benefit from this activity?
(i) CHWs will benefit from increased communication with their supervisors thus improving their integration with the local primary healthcare system.
(ii) Supervisors will also benefit from the improved communication links and will be able to better tailor their support to CHWs as they will have asynchronous access to CHWs' personal practice data (including the points where they requested help) for the first time.
(iii) For AMREF the main benefits will be (a) access to a grounded dataset to better understand and analyse CHWs learning needs (b) an evidence-base of how CHW service delivery is improved by the intervention and (c) specifics of the on-the-ground support structures needed for intervention implementation.
(iv) The Kenyan MOPHS will benefit from iterative policy briefings on the role of mobile learning in CHW supervision and training, inputting into specific implementation strategies at community level.
(v) The communities in Makueni County and Kibera will benefit from improved access to health care.

What will be done to ensure that they have the opportunity to benefit from this activity?
(i) In order to build capacity at the NGO level, the project researchers will share their research methods expertise and AMREF staff will be encourage to take part in data analysis according to their skills and interests.
(ii) In support of this training, two members of AMREF staff will undertake a two capacity-building trips to the IoE.
(iii) The participatory action research (PAR) approach ensures that CHWs and their supervisors will be participants in the entire research process, with the priorities of CHWs and their supervisors addressed through genuine collaboration and the co-construction of knowledge.
(iv) The stakeholder inception workshop, held at month 1, will ensure that the project is fully grounded in the local context and focuses on the poverty-relevant practices of CHWs.
(v) The mobile application wil be made freely available under a creative commons licence.
(vi) Findings will be reported back to all participants in appropriate formats (e.g. story narratives and case studies) using venues arranged through the support of local community organisations.

The legacy of the research will be managed building on the expertise of AMREF in developing their nurse training eLearning programme in a public-private partnership with Accenture, the Nursing Council of Kenya and the MOPHS and then passing it over to the Nursing Council to scale-up and run independently. We will learn from and build on this strategy for seeking wider use and uptake of our mobile learning intervention as opportunities arise.
 
Description This project set out to advance the training and supervision of community health workers (CHWs) in Kenya. It addressed this by developing an accessible mobile learning intervention that encouraged more supportive supervision and helped to link this more closely to CHW practice. This consisted of three inter-related parts: Mobile webapps, face-to-face training and community support.

The project generated significant new knowledge in the following areas:

1. How to use a participatory action research approach to develop mHealth applications for CHWs and their supervisors (known as community health extension workers, or CHEWs) working in low-resource settings;
2. How a protocol for the assessment of child development stages can be used for decision support by CHWs as part of a mobile app. Aligned to this, the project showed how mobile messaging apps (i.e. Whatsapp) can be used for mentorship and improved social support;
3. How to develop mobile apps that support the professional development of CHWs, moving beyond a simple information acquisition model of learning to one focused on successful social participation;
4. How mobile-based supervision and training can be successfully embedded within the existing structures of community-based care;
5. How a 'theory of change' approach to evaluation can be used to detail the ways in which CHW and supervisor actions are changed by the addition of a mobile app to their practice.

Two mobile webapps were developed in consultation with paediatricians in Kenya and in the UK: the REFER app and the ALPHA app.
• The REFER app built capacity by teaching 100 community health workers the skills of how to assess the motor, cognitive and social development of children under five. The app enabled supervisors to provide feedback on the CHWs' assessments and practices, so as to enhance their skills and improve their performance. This was the first time that these CHWs were trained in skills around the developmental assessment of children.
• The second app, ALPHA, allowed supervisors and Public Health Officers to design their own mobile training apps, without the need to code.
For the marginalised communities of Makueni County and the Kibera informal settlement in Nairobi, the project resulted in:
• Improved access to primary and community-based health care for children with disabilities and their families;
• Training of CHWs and CHEWs in assessing child development in under-5s, resulting in the identification of over 40 families with a disabled child. Neither CHWs nor CHEWs had received any training on the development of children under five prior to the project. In addition, both CHWs and CHEWs received training in the use of smartphones;
• CHW, CHEW and household knowledge of the development milestones of children under five has increased substantially;
• Through workshops on child development and disability, the supervision and mentorship skills of CHEWs have been improved;
• Improved referral decision-making by CHWs, resulting in more efficient use of medical time and resources.

Project partnership supported capacity building, through community exchange visits, and training for Amref researchers in the UK. This enabled the research in mHealth to inform practice in the Kenyan context.
Exploitation Route The next step to take forward this work is to understand how mobile interventions in health care training can be better linked to broader conceptualisations of poverty alleviation. While most measures of poverty alleviation focus on income, research in development studies has consistently shown that trying to understand poverty alleviation by focusing on economic measures alone ignores the bigger picture. Work remains to be done on using this broader conceptualisation to inform the evaluation of mHealth interventions as tools for poverty alleviation.

The role of mHealth interventions in addressing the "treatment gap", where health services only reach a very small minority of those in low-income settings, remains an under-explored area. There is great potential in partnering with health workers and hospitals to explore how this can be addressed by investigating the take-up of mHealth interventions at scale in real-word settings.

With respect to policy, and in response to the call from the Ministry of Health in Kenya, a welcome next step would be support for more co-ordination between mHealth research projects so they can pool their findings, resources and expertise. In particular, expertise on transferring combined research findings from funded projects into high-level policy discussions would be welcome. This could be done with NGOs and the private sector.
Sectors Digital/Communication/Information Technologies (including Software),Education,Healthcare,Other

URL http://www.mchw.org/?page_id=14
 
Description For dissemination by the University of Oxford, see: http://www.ox.ac.uk/research/research-impact/using-mobile-learning-technology-improve-access-healthcare-east-africa As an ESRC Impact Case Study: http://www.esrc.ac.uk/news-events-and-publications/impact-case-studies/the-mobile-app-supporting-kenyan-healthcare/
First Year Of Impact 2016
Sector Electronics,Healthcare
 
Description Amref 
Organisation Amref Health Africa
Country Kenya 
Sector Charity/Non Profit 
PI Contribution Kenyan collaborator - in charge of liasing on the ground with community health workers and the Kenyan Ministry of Health
Collaborator Contribution Set up the fieldwork, with our involvement, and kept the relationships on the ground in Kenya going while we were not in the country.
Impact see relevant sections of the form
Start Year 2013
 
Title REFER app 
Description Smartphone app developed in collaboration with the study participants in this project. The app, which is based on the Malawi Development Assessment Tool (MDAT) helps community health volunteers assess the development of children under five, and to make a decision of whether or not to refer a child to the nearest health facility. It allows for the supervisor of the CHV to feedback on the CHVs decision, and for the assessment details to be reviewed and stored for future assessments. 
Type Of Technology Webtool/Application 
Year Produced 2014 
Impact Please see the impact narrative part for this description. 
 
Description Educational Asset Management 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The talk led to interdisciplinary discussions and talks

The resulting interdisciplinary links had an impact
Year(s) Of Engagement Activity 2013
 
Description Exchange visits between the study participants of the two communities 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Study participants or study members
Results and Impact The two exchanges visits took place in each of the communities. The goal of these visits was to offer the opportunity for study members of each community (community health workers and their supervisors) to better understand the practices of study members of the other community. Both communities greatly enjoyed the visits and said it brought them closer together and made them understand their own practices in a better way / from a different perspective.
Year(s) Of Engagement Activity 2014
 
Description How can mobile learning improve education in Africa? 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Invited by Rt Hon Lord Paul Boateng, the talk informed policymakers in the House of Lords about the impact of mobile learning in Africa

Exposure of project to policy makers; informed their decision making
Year(s) Of Engagement Activity 2013
 
Description ICT for Development 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk lead to new interdisciplinary links

Built links between Education and International Development
Year(s) Of Engagement Activity 2014
URL https://www.youtube.com/watch?v=64kQDLbH5oE
 
Description Mobile learning for Development 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Talk at the Commonwealth Telecommunications Union that inspired a useful discussion

Aligned to CTO's strategic plan
Year(s) Of Engagement Activity 2014
URL http://www.youtube.com/watch?v=cAMFWnOZ21A
 
Description Presentation to the Chancellor of the University of London, The Princess Royal, HRH Princess Anne 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Supporters
Results and Impact Presented research to the Chancellor of the University of London, The Princess Royal, HRH Princess Anne

Additional dissemination and awareness rasing of the project due to the media present
Year(s) Of Engagement Activity 2014
URL http://www.lkl.ac.uk/cms/index.php?option=com_content&task=blogsection&id=1&Itemid=107&limit=6&limit...
 
Description The Future of Mobile Learning 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Discussions between policy makers and practitioners after talk

Linked policy and practice and informed decision making of policy makers
Year(s) Of Engagement Activity 2013
 
Description The impact of mobile technologies on education in low- and middle-income countries: A mixed-methods systematic review 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Discussion of early work on the results of the first systematic review undertaken of mobile leanring in development.

Evidence-based researchers became involved in critiquing the nature of evidence generated by development researchers and practitioners in the field of mobile learning in low-income countries.
Year(s) Of Engagement Activity 2014
 
Description mchw.org 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The mchw.org blog was started at the beginning of the project. Posts were updated regularly, informing stakeholders and interested parties about the progress of the project, the outputs and other activities organised. The blog received very good feedback and a number of guest-bloggers from Kenya contributed their views and experiences on certain topics related to the project.
Year(s) Of Engagement Activity 2013,2014,2015,2016
URL http://www.mchw.org