Technology, Monitoring and Teacher Support in Niger

Lead Research Organisation: Tufts University
Department Name: Economics

Abstract

Despite improvements in school enrolment over the past 20 years, 757 million adults worldwide are still unable to read and write in any language (UNESCO 2015). In Niger, the subject of this study, less than 30% of the population is considered to be literate (IMF 2013).
While a substantial body of research has focused on increasing school participation, there is still considerable debate about how to improve learning in a cost-effective way. One constraint that has consistently emerged is teacher absenteeism: In West Africa, teacher absenteeism rates range between 27-40% (TI 2013). Empirical research in economics has found that teacher monitoring can lead to improvements in teacher attendance, with mixed results on learning (Guerrero et al 2013, Duflo et al 2012, Cilliers et al 2014). Some governments have shifted to community teachers, who are hired on short-term contracts renewable upon performance. Yet oversight remains a challenge, especially in countries with high transport costs and weak institutions. In a previous adult education program in Niger, community teachers missed 1/3 of their classes (Aker et al 2016).
The growth of mobile phone technology throughout sub-Saharan Africa has the potential to affect the relationships between teachers, communities and education service providers in remote rural areas. By allowing governments and NGOs to communicate with remote areas on a regular basis, mobile phones can improve monitoring of teachers' attendance. Mobile phones can also allow the community to provide feedback to education providers, thereby increasing community engagement. And finally, mobile phones could be used to provide more frequent "long distance" pedagogical support to teachers.
Our research team ran a randomized evaluation in Niger between 2014-2016, which showed that a mobile phone monitoring intervention in the context of an adult education program - whereby teachers, students and village chiefs were called on a weekly basis - significantly improved students' test scores (Aker et al 2016). Although the intervention did not include financial incentives for teachers, mobile monitoring increased teachers' attendance and motivation. At the same time, teachers often asked for pedagogical support, which the monitoring team was unable to provide.
This proposal builds upon this initial research in five ways. First, it will expand the program to more villages in order to test the intervention at a larger scale. Second, the research will test different types of mobile monitoring - i.e., calling the teacher only, as compared with calling the teacher, the village chief and students - to determine which approach is the most effective in increasing teacher performance and learning. Third, the program will assess the potential for using mobile phones to provide pedagogical support to teachers. Fourth, our research will seek to understand how education and technology affect intra-village dynamics, as well as the dynamics between the teacher, community and education service providers. And finally, these interventions will be piloted in a small number of primary schools in order to understand whether the dynamics of teacher monitoring and support are different in a primary school setting and with governmental institutions.
This research contributes to the existing literature in several ways. First, the intervention uses a low-cost technology that does not require specialized software. It also builds upon existing research on teacher performance by including pedagogical support and omitting the financial incentive. Finally, our research will focus on adult education programs, a highly neglected entry point for education interventions.
This research will be achieved through a unique collaboration between governmental, non-governmental, university and research firm partners in Niger, the US and Europe.

Planned Impact

There are two primary direct beneficiaries of this research: adult education students and teachers in Niger. The adult education program will directly target 15,000 non-literate adults, allowing them to acquire basic literacy and numeracy skills. 300 adult literacy teachers will receive monitoring or pedagogical support (or both), potentially strengthening their labor market skills. The program will also target 35 primary school teachers in a pilot.
Indirect beneficiaries are other household members, as having a literate adult can improve household socio-economic outcomes. Other indirect beneficaries are non-benficiary households in the villages, who may benefit from having a more highly educated population and a more highly skilled teacher. Additional indirect beneficiaries are village chiefs, who will be participating in the mobile monitoring component and thus more informed of local activities.
There are six sets of stakeholders who will also benefit. The first is CRS, the primary implementing partner. This research will inform CRS about the effectiveness of its adult education program, as well as the impact of mobile monitoring and technical support on learning. Since CRS has programs in over 80 countries and several adult education programs in West Africa, it is likely that it will replicate the approach in other countries if successful. CRS has also expressed interest in testing these approaches with field agents and service providers in other sectors.
The second stakeholder is the Nigerien government, particularly the Ministries of Non-Formal and Primary Education (IRP). Cost-effective adult education and pedagogical support are priorities for the government, yet the ministries face challenges in managing and providing technical support to teachers in remote rural areas. The ministries will use the results from this research to determine whether mobile monitoring and pedagogy should be integrated into their curricula. As the adult education methodology in Niger is similar to other programs in francophone West Africa, this research could benefit programs in those countries.
A third stakeholder is the University of Abdoul Moumouni, particularly the collaborating professor (Dr. Malam) and graduate students. Dr. Malam will co-author one of the academic papers, and we will jointly conduct impact evaluation workshops for UAM faculty and students. Project data will also be available to graduate students for their theses.
A fourth set of stakeholders is donors, international organizations and private sector enterprises interested in learning about technology-related adult and non-formal education programs, such as USAID, DFID, UNESCO, the World Bank and VotoMobile.
A fifth stakeholder is Sahel Consulting, the team's data collection partner. Sahel will be involved in all aspects of planning and implementing the surveys, as well as participate in the UAM impact evaluation workshops and exchange visits, thereby increasing their capacity to conduct impact evaluations within Niger for other organizations.
A final set of stakeholders is researchers in the fields of economics, international education and information technology. This research will provide additional evidence on the impacts of information technology on learning and welfare and hopefully stimulate further research in this area.
Engagement and impact with these groups will take place through our written project outputs (papers, policy briefs), blog posts, annual stakeholder meetings, impact evaluation workshops, final policy conference, dissemination workshops with teachers and village chiefs, conference presentations, film and exchange visits. These activities are described in more detail in the "Pathways to Impact" document. The first stakeholder workshop in Niger will include the PI, CRS, MNFE, Sahel and UAM, and will review the research questions, research design and data collection plan, set out the work plan and identify roles.

Publications

10 25 50
 
Description Making simple telephone calls to teachers, principals and PTA members once a week during the school year can increase teacher and school principal attendance in the short-term. However, it does not have an impact on student learning in the first two years, for several reasons. First, the magnitude of the attendance results - while statistically significant - are not large. Second, because measuring learning outcomes is difficult. And third, because even if attendance increases, teachers may face constraints to the quality of their teaching. At the same time, the calls did seem to increase teachers' motivation and sense of appreciation, and also increased parents' involvement in school and in their children's learning.
Exploitation Route This could potentially be used and tried by other Ministries of Primary Education in other countries, as well as other sectors.
Sectors Education,Government, Democracy and Justice

URL https://voxdev.org/topic/health-education/how-simple-technologies-can-improve-learning-evidence-niger
 
Description Our preliminary findings have been shared with the Ministry of Primary Education, the data collection team in Niger (Sahel Consulting), JPAL at MIT, with PhD students and professors at Tufts, and IFPRI. We will also soon be presenting at Oxford with CSAE.
First Year Of Impact 2020
Sector Education
Impact Types Economic,Policy & public services

 
Description Co-wrote an article for the Impact Initiative Impact Story
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in other policy documents
 
Description Hitachi Center
Amount $10,000 (USD)
Organisation Tufts University 
Sector Academic/University
Country United States
Start 04/2018 
End 06/2019
 
Title Attendance registries 
Description Taking attendance is a challenge in most countries, and is even more challenging without attendance records. We worked with the Ministry to develop attendance books, which are large books with removable pages that allow the school director to take attendance. We then printed this books. 
Type Of Material Improvements to research infrastructure 
Year Produced 2018 
Provided To Others? No  
Impact The directors have noted that this greatly facilitates their work, and the teachers have noticed this. 
 
Title Attendance dataset 
Description The dataset is a weekly dataset of teacher attendance between November and now for all teachers in 84 primary schools. 
Type Of Material Database/Collection of data 
Year Produced 2018 
Provided To Others? No  
Impact We are currently analyzing the data, there are no impacts as of yet. 
 
Title Household Survey of Parents with Children in Primary School 
Description This is a two-year panel survey between 2019 and 2020, which surveys parents of children in primary schools where the calling intervention has taken place. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? No  
Impact The data are being used to analyze the impact of the intervention 
 
Title Student EGRA and EGMA Test Scores in Niger 
Description This is a dataset of the test scores of approximately 1300 school-aged children in 2019 and 2020 who participated in the intervention of calling teachers. 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? No  
Impact The data are currently being used to measure the impact of the intervention on student learning. 
 
Description Sahel Consulting 
Organisation Sahel Consulting Agriculture & Nutrition
Country Nigeria 
Sector Private 
PI Contribution Provided material and capacity-building support
Collaborator Contribution Fully participated in research, worked with local partners, helped to organize and implement research and policy conference.
Impact Completed all surveys Completed all data Produced policy conference Produced video
Start Year 2014
 
Description University partnership 
Organisation Abdou Moumouni University
Country Niger 
Sector Academic/University 
PI Contribution We provided training in impact evaluation and data to the university professors and students.
Collaborator Contribution Attended the training, provided feedback on research and participated in policy conference.
Impact Impact evaluation workshop Shared data Policy conference
Start Year 2016
 
Description Meetings with School Directors and Ministries 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact We presented the results of the first year of the research to the Ministry and the school directors.
Year(s) Of Engagement Activity 2020
 
Description Presentation of preliminary results to academic seminar at Tufts 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact The presentation was to present the preliminary results of the research on the activities under this grant, and to get feedback.
Year(s) Of Engagement Activity 2016,2020
 
Description Presentation to Ministry of Education 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Policymakers/politicians
Results and Impact The intended purpose was to understand the Ministry's constraints, present the results of previous research and discuss possibilities for collaboration with the Ministry in the future.
Year(s) Of Engagement Activity 2018