Reading and socio-emotional skills in challenging school contexts: Evidence from South African primary schools

Lead Research Organisation: Stellenbosch University
Department Name: Economics

Abstract

Learning to read for meaning is the most important skill that children learn in primary school. Yet children in 90% of South African schools are not acquiring this skill by the end of grade 4 (Spaull & Pretorius, 2019). The most recent Progress in International Reading Literacy Study (2016) (PIRLS-Literacy) indicates that almost one in every eight grade 4 students in South Africa cannot read for meaning in any language, despite the curriculum assuming that students can read in both their home language and English by the end of grade 4 (Howie, et al., 2017). Against this context, 'reading for meaning' among young children has recently been identified by South African President Cyril Ramaphosa as a top five national priority (South African Government, 2019). In adopting this new priority goal, South Africa needs to significantly advance the local body of knowledge on reading in African languages, identifying why children can't read, how reading could be improved, and how much improvement we could reasonably expect.

In this study, we aim to fill some gaps in this body of knowledge. First, we will explore reasons for why children are failing to read with comprehension in African languages and English. Comprehension is what reading is all about - and this is what is measured in nationally representative surveys. However, reading comprehension is just the 'tip of the iceberg' with respect to underlying skills required to read (Spaull, et al., 2018). Necessary but not sufficient skills for comprehension include oral language, vocabulary knowledge, print awareness and decoding components such as phonemic awareness, letter-sound knowledge, word reading and oral reading fluency (Hoover & Gough, 1990). Using new emerging datasets on reading in African languages in South Africa, we will identify to what extent children can master these basics of reading across different languages. We will be able to construct a clearer picture of which of the reading 'building-blocks' children do and don't have, how these differ by language and whether reading skills systematically differ by poverty levels and gender.

Fortunately these new datasets testing reading in African languages and English collect assessment data for the same children over time. With this data researchers can explore how reading skills develop and what gains in skills are acquired by initially low achievers, medium achievers and higher achievers. By observing best possible reading gains, it will be possible to get a better idea of the feasibility of attaining the presidential reading goal under current conditions or when conditions for improvement are created in schools.

The constraints to learning at the school, teacher and classroom level are well understood in South Africa (see for example van der Berg, et al., 2016; Fiske & Ladd, 2004; Carnoy & Chisholm, 2012) with projects underway to address these constraints. But little is understood about underlying individual factors that may enhance or limit children's proficiencies in reading. Bullying, for example, is a very big concern in primary schools with South Africa recording some of the highest levels of bullying across all countries participating in PIRLS (Howie, et al., 2017). Bullying may reflect low underlying socio-emotional skills among children. Yet, international evidence and preliminary evidence from South Africa suggests that socio-emotional skills may be particularly important in fostering academic performance, including reading comprehension skills (Wills & Hofmeyr, 2018; Durlak, et al., 2011; Zins, et al., 2004). We will use available datasets to explore evidence on socio-emotional skills among primary school children in South Africa and identify whether indicators for socio-emotional skills (such as Duckworth's (2007) concept of 'grit') are linked to learning and reading skills in challenging contexts.

Planned Impact

South Africa needs to urgently address the reading crisis it faces in schools. If schooling is to promote the potential of young people, equalise access to opportunities across poorer and wealthier parts of society and ultimately contribute to a society equipped with skills to compete internationally, significant improvements must be made in the teaching and assessment of reading. The ultimate aim of this research is to develop research that will indirectly lead to improvements in reading among young children in South Africa.

Beyond academia, the Department of Basic Education (DBE) and other key planning departments will directly benefit from this research. The DBE is coordinating teams both internally and externally to develop norms, benchmarks and targets in African languages. This proposed research will directly support this larger initiative, supporting the work of policymakers and curriculum specialists in realizing plans to improve reading outcomes. This work will indirectly benefit teachers, as curriculum materials could be amended to include clearer reading goals at different grade levels and in different languages that can be used to guide assessment and instructional improvements. Parents may also indirectly benefit as reading norms, benchmarks and targets could eventually be communicated to improve their knowledge of their children's reading development and in turn inform them on the quality of reading instruction in schools. The first step, however, is to provide policymakers with more evidence on the current status of reading in African languages and English.

The proposed work on socio-emotional skills and its links to reading and literacy is of interest not only to the academic community but is directly aligned to the research needs of curriculum design specialists as they re-evaluate the current compulsory Life Orientation and Life Skills programmes in South Africa. Depending on the results, the work may reinvigorate discussions about the importance of developing socio-emotional skills in schools and whether the curriculum could be leveraged to develop these skills. The general public, including parents, are also likely to find this research of value.

The proposed research is well aligned with policymakers' demands for more research on African languages and reading in general in the early grades. This encourages research uptake. Ensuring policymakers are directly engaged in the research process from design to dissemination is also critical to uptake. One of the co-investigators works directly in the DBE as the deputy director of Research, Monitoring and Evaluation and was involved in the initial research project. Additionally, the research process has been designed to allow for collaborations and multiple engagements with other policymakers through presentations, conferences and the dissemination of policy-briefs.

The research team also includes members of the Funda Wande team who are developing materials to train teachers in the teaching of reading in African languages. This is a flagship programme that has the buy-in of the Eastern Cape Education Department and will be rolled out to more provinces in the future. As new insights emerge, these researchers and one of the co-investigators are strategically positioned to incorporate new knowledge on African language reading proficiencies (or realisable classroom goals for reading) into teaching materials. This is one way to develop increased awareness among teachers (and eventually parents) of what skills children can and should be able to master in reading.

To maximise the reach of the research, at least 2 op-eds will be written with the intention of targeting a range of editorials ranging from the more academic Conversation to the Sunday Times with its more general readership.

Publications

10 25 50
publication icon
Ardington C (2021) Benchmarking oral reading fluency in the early grades in Nguni languages in International Journal of Educational Development

publication icon
Ardington C (2021) COVID-19 learning losses: Early grade reading in South Africa in International Journal of Educational Development

publication icon
Hofmeyr H (2022) Why do girls do better? Unpacking South Africa's gender gap in PIRLS and TIMSS in International Journal of Educational Development

publication icon
Mohohlwane, N. (2022) Early Grade Reading in South Africa

 
Description We report on our findings in relation to three areas:
1) Developing early grade reading norms and benchmarks in African languages in South Africa;
2) Identifying the reading trajectories of early grade learners in African languages
3) Identifying the impacts of Covid-19 on reading trajectories
3) Measuring socio-emotional or non-cognitive skills among primary school learners in South Africa and how this is related to learning outcomes.

1) Reading benchmarks and thresholds are numerical measures of proficiency in specific reading skills, that may be used to monitor whether children are on a successful reading development trajectory or at risk of reading failure. They provide a standard against which teachers can measure learners' reading subskills and identify early-on learners who are at risk of not learning to read for meaning by age 10. Additionally, as specific learners reach different benchmarks, this can help teachers adapt their instructional focus to meet the learners' needs at their reading level. While reading benchmarks exist in English, there is scant research guiding the development of Nguni language reading benchmarks or thresholds. To fill this gap in this literature, a multidisciplinary research team drew on learner assessment data from five different studies to compile the largest available source of information on early grade reading in three Nguni languages: isiZulu, isiXhosa and siSwati. When combined, these data contain multiple assessment points which can be compared over time for nearly 16,400 unique learners across 660 schools. Applying a new non-parametric method developed for this study, we examine the relationship between accuracy and speed and then the relationship between fluency and comprehension to identify critical thresholds in early reading skills. The non-parametric method avoids imposing a priori assumptions about these relationships in understudied Nguni languages. The study identifies the following thresholds and benchmarks for both oral reading fluency (correct number of words per minute of connected text) and the foundational skill of letter sound knowledge in Nguni languages which are being adopted by the South African Department of Basic Education:
- By the end of grade 1 all learners should be able to read 40 letter-sounds correctly per minute.
- By the end of grade 2, all learners should be able to read at least 20 correct words per minute.
- By the end of grade 3, all learners should be able to read 35 words correctly per minute.
Longitudinal data is then used to assess the predictive validity of thresholds or benchmarks for future reading success. Meeting the proposed thresholds or benchmarks is shown to be predictive of learners' future reading proficiency scores. Through a close analysis of current norms in reading, we show that while the thresholds and benchmarks are attainable, large proportions of children do not meet them even in grades well beyond the first three years of school.

2) Using a large corpus of early-grade reading data for more than 40,000 South African learners, mostly from no-fee schools, Wills, Ardington & Sebaeng (2022) provide were able to provide the most authoritative evidence to date of what we know about foundational language and decoding skills in Nguni and Sesotho-Setswana home languages. We document levels of decoding skills among Foundation Phase learners (Grades 1-3), identify the oral language skills with which learners start Grade 1, and consider how oral reading fluency develops to the end of primary school. We find that far too many children in under-resourced schools enter school with under-developed oral language skills in their home language. Furthermore, the development of decoding skills remains slow, with most learners entering school with virtually no knowledge of the code of their home language, despite spending a year in Grade R. Slow and low mastery of letter-sounds and complex consonant sequences, as well as slow fluency development in the Foundation Phase, is evidence that most children in no-fee schools are neither receiving effective, systematic phonics instruction, nor being given opportunities to read extended texts. This has significant implications for fluency development in later years.

2) Drawing on the longitudinal dataset used to develop early grade reading benchmarks, supplemented with more reading data collected in Nguni languages and English during the first year of the pandemic, we were able to explore trajectories in reading subskills and how they have been impacted by COVID-19 disruptions to schooling. In Ardington, Wills & Kotze (2021) published in the International of Educational Development, and cited in two World Bank reports, we show that in no-fee schools across two South African provinces, grade 2 students lost between 57% and 70% of a year of learning, and grade 4s between 62% and 81%. These estimates reflect losses in letter-sound knowledge and word reading in Setswana and word reading in English. There is also evidence from the grade 4 sample that girls and those with stronger initial reading proficiency have been most negatively affected in terms of flattening gains in reading despite having higher reading levels.

3) Using existing datasets such as the Progress in International Reading and Literacy Study, The Trends in International Mathematics and Science Study and a local South African "Leadership for Literacy" dataset, this study revealed that student attitudes such as confidence in mathematics or reading or constructs such as "grit" appear to be the strongest observable determinant of learning outcomes among South African students. However, the extent to which 'grit' is associated with improved reading performance is mitigated by levels of school functionality. Hofmeyr (2022) was also able to unpack the extent to which the significant gap in reading performance across boys and girls in South Africa, is attributed to differences in "non-cognitive" skills such as attitudes in reading. She finds that South African girls display more of the traits and behaviours that are associated with school achievement than boys. Interestingly, these factors explain a larger proportion of the pro-girl gap in Grade 4 reading than Grade 5 mathematics. The results further indicate that although part of South Africa's pro-girl gap in PIRLS and TIMSS is attributable to a female advantage in grade completion in the early grades, there is still much about South Africa's pro-girl advantage in education that remains unexplained. Hofmeyr (2022) then considers what this, and other local literature imply for carving a research pathway for improved measurement and inclusion of non-cognitive skills in the economics of education literature in South Africa. Key to taking this research agenda forward will require improvements in measuring non-cognitive skills and longitudinal data collection efforts. With regard to measurement, Hofmeyr's findings along with research by O'Riordan (2021), demonstrate that school surveys should move away from using negatively worded items in the measurement of learner confidence, attitudes and other non-cognitive skills.

Relevant Urls:
https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Summary%20Report%20V06.pdf?ver=2020-10-28-141736-203
https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Technical%20Report%20V06.pdf?ver=2020-10-28-141752-997
https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/The-launch-of-reading-benchmarks-for-African-Languages-1122.aspx#:~:text=The%20launch%20took%20place%20at,during%20the%202020%20school%20calendar.
https://resep.sun.ac.za/new-paper-published-on-covid-19-learning-losses-in-south-africa/
https://www.econ3x3.org/node/464
https://resourcehub.oxford.co.za/higher-education/resources-higher-education/early-grade-interventions/
https://www.ekon.sun.ac.za/wpapers/2020/wp172020
https://www.ekon.sun.ac.za/wpapers/2020/wp062020
https://www.sciencedirect.com/science/article/abs/pii/S0738059322000980
https://resep.sun.ac.za/wp-content/uploads/2022/03/On-the-interpretation-of-non-cognitive-skills-Implications-for-the-South-African-economics-of-education.pdf
https://www.sciencedirect.com/science/article/abs/pii/S0738059321000298
Exploitation Route The Nguni language reading benchmarks established through our project have been adopted by the Department of Basic Education in South Africa. Additionally, the methodology that we developed to establish these reading benchmarks was applied to new reading data to establish reading benchmarks in Sesotho-Setswana languages, Afrikaans and English as a First Additional Language. Efforts are now being led by the Department of Basic Education and supported by various stakeholders to use the same methodology to develop reading benchmarks for two more languages in South Africa (Tshivenda and Xitsong). Furthermore, our method could be used to establish early grade language benchmarks in other developing country contexts (particularly in Africa), as it has various advantages over existing approaches to setting reading benchmarks using early grade reading assessment data that have been used in other contexts. Our method is independent of the difficulty level of reading comprehension passages. It is also contextually sensitive and does not impose any assumptions about the nature of reading in different languages.

When the established threshold and benchmarks are attached to a national systemic evaluation programme to measure early grade reading skills, their efficacy in monitoring learning improvements in line with SDG 4.1 will be increasingly realised. In addition to ensuring reading benchmarks are available in all South African languages, efforts should be given to training teachers on how to test fluency and apply benchmarks to track their student's reading skills. This requires both a future piece of research and new practices.

The extension of our reading subskills analysis, to the impacts of COVID-19 disruptions on reading development, has opened-up further research opportunities to track how reading and learning in general has been impacted by COVID-19, and whether these losses can be remediated over time. Nationally, we will need to consider how existing inequalities in reading development have been exacerbated through the pandemic and what can be done to close these gaps.

Our work on the links between socio-emotional learning and cognitive skills and how they relate to learning outcomes is laying the foundation for future debate, discussion and experimentation with how investing in the socio-emotional development of learners can foster improved learning. This is a particularly pertinent issue as children have had to navigate the challenges of COVID-19 disruptions to schooling and negative pandemic impacts on their home environments.
Sectors Education,Government, Democracy and Justice

URL https://resep.sun.ac.za/new-paper-published-on-covid-19-learning-losses-in-south-africa/
 
Description In early 2019 South African president Cyril Ramaphosa articulated a new and clear expectation for basic education: every child should be able to read for meaning by age 10. While reading for meaning is the goal of reading, reading is a complex and hierarchical process. A range of foundational reading subskills need to be mastered before one can comprehend or understand what is in a text. To prevent children from falling behind in the developmental sequence of reading, a shared vision of what reading success looks like at each step is required. A multi-disciplinary team from SALDRU at the University of Cape Town, RESEP at Stellenbosch University and NORC at the University of Chicago have collaborated to inform this shared vision through the establishment of benchmarks for foundational reading skills in three Nguni languages. The summary and technical benchmarking reports were launched by the Department of Education as part of their workshop on Reading Benchmarks for African Languages on 7 October 2020. The Nguni languages benchmark reports and publication established a method and best practice process for how reading subskills can be benchmarked empirically in other languages. More recently in November 2022, early grade reading benchmarks in Sotho-Setswana languages, Afrikaans and English as a First Additional Language were developed and launched using the methodology developed to create Nguni language benchmarks through this specific grant project. Supporting wider national reading efforts, this study provides simple metrics that can be used by policymakers, teachers and parents to clarify reading success in the early grades. The benchmarks provide a standard against which teachers can measure students' reading subskills and identify early on students who are at risk of not learning to read. This, in turn, supports remediation at an earlier age. At the national level, the suggested thresholds and benchmarks provide clear and measurable standards to track whether cohorts are developing foundational reading skills. This is necessary where the South African school curriculum has been silent on how to measure a student's achievement in specific reading subskills in African languages. The benchmarks are to be formally incorporated into the new curriculum to be launched in 2025. The South African Human Rights Commission is also using this work as a key reference in establishing through the South African courts, a human right to read and write. Future national reading assessments compared against benchmarks/ thresholds may impose high levels of accountability on the education system in ensuring that resources and implementation measures are dedicated to addressing South Africa's reading crisis. Our findings on COVID-19 impacts on reading skills (fluency and letter-sound knowledge) have been referred to in media briefings locally, presented at large stakeholder forums run by the Department of Basic Education, referenced in two World Bank reports on learning losses globally and systemic reviews of global learning losses. This was the first published piece on learning losses from a developing country. The COVID-19 learning losses findings provided important information to inform policy-makers on the devastating impacts of school closures and prolonged rotational scheduling systems that were finally removed at the start of 2022. The evidence has been referenced in a new Reading Panel report, a background document to establish a Reading Panel of education and business experts to promote political will to address South Africa's reading crisis.
First Year Of Impact 2020
Sector Communities and Social Services/Policy,Education,Government, Democracy and Justice
Impact Types Cultural,Societal,Economic,Policy & public services

 
Description African language early grade reading benchmarking report contributes to a review establishing a human right to read and write in South Africa
Geographic Reach National 
Policy Influence Type Citation in systematic reviews
URL https://fundawande.org/img/cms/news/The%20Right%20To%20Read%20and%20Write%20Report%20(12%20Aug%20202...
 
Description COVID-19 learning losses in reading paper cited in recommendations of the Global Education Evidence Advisory Panel in a World Bank, Unicef and FCDO report.
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in systematic reviews
URL https://documents1.worldbank.org/curated/en/114361643124941686/pdf/Recommendations-of-the-Global-Edu...
 
Description COVID-19 learning losses in reading paper cited in review on "Girls' Education at Scale"
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in systematic reviews
URL https://www.cgdev.org/sites/default/files/girls-education-scale-PDF.pdf
 
Description COVID-19 learning losses in reading paper contributes evidence to World Bank, UNICEF and UNESCO report on a pathway forward for the global education crisis
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in systematic reviews
URL https://documents1.worldbank.org/curated/en/416991638768297704/pdf/The-State-of-the-Global-Education...
 
Description COVID-19 learning losses in reading paper contributes to background report for newly established Reading Panel of education and industry leaders in South Africa
Geographic Reach National 
Policy Influence Type Citation in systematic reviews
URL https://www.readingpanel.co.za/_files/ugd/65ee04_e0737da3d6c04c999fc1e6961f291098.pdf
 
Description Citation in Systematic Review in Nature Human Behaviour
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in systematic reviews
 
Description Data collected through the Leadership for Literacy project contributes to establishing early grade reading benchmarks in Nguni and Sotho languages
Geographic Reach National 
Policy Influence Type Implementation circular/rapid advice/letter to e.g. Ministry of Health
Impact Until recently, there have been no clearly established standards as to what constitutes an on-track reading development trajectory for early grade readers in African languages. Clear norms and benchmarks for fluency exist in English (Hasbruck and Tindal 2006, 2017; University of Oregon, 2021), but these benchmarks cannot be transferred to other languages with vastly different linguistic characteristics. The establishment of benchmarks will help to create clear standards for effective literacy development (and teaching) through a grade 1 letter-sound benchmark, grade 2 fluency threshold and grade 3 fluency benchmark in Nguni and Sotho languages. Work is also underway to establish benchmarks in English First Additional Language (EFAL). When linked to a national programme of testing early grade reading skills, they will be useful in monitoring national progress in ensuring children meet grade specific reading benchmarks, and in tracking progress towards quality improvements in literacy as reflected under SDG 4.1.
URL https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Summary%20Report%20V06....
 
Description Early grade reading benchmarks established for Nguni languages
Geographic Reach Africa 
Policy Influence Type Implementation circular/rapid advice/letter to e.g. Ministry of Health
URL https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/ReadingBenchmarksnAfricanLanguages.a...
 
Description Presentation on learning losses at National Department of Basic Education Lekgotla to support removal of Covid-19 related rotational school schedules
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
Impact Rotational school schedules that were in place until January 2022 were removed as evidence on learning losses (particularly in reading), together with legal cases and recommendations from a broader health community on the safety of returning to schools, came together.
URL https://www.news24.com/citypress/news/cabinet-approves-resumption-of-full-time-school-attendance-202...
 
Description COVID generation
Amount R4,000,000 (ZAR)
Organisation Allan Gray Orbis Foundation Endowment 
Sector Charity/Non Profit
Country South Africa
Start 02/2022 
End 12/2024
 
Description Early Learning Project
Amount R1,000,000 (ZAR)
Organisation Allan Gray Orbis Foundation Endowment 
Sector Charity/Non Profit
Country South Africa
Start 01/2020 
End 12/2021
 
Title Early grade reading benchmarks established in Nguni languages 
Description Through this project we have established early grade reading benchmarks in Nguni languages. These benchmarks have been adopted by the Department of Basic Education. The method developed to create these benchmarks has also been used to establish benchmarks in Sesotho-Setswana languages and in English First Additional Language. 
Type Of Material Physiological assessment or outcome measure 
Year Produced 2020 
Provided To Others? Yes  
Impact The Reading Benchmarks provide an important standard for the education system, researchers, teachers and parents to use to monitor children's reading development and determine whether they are on track to read for meaning by age 10. 
URL https://www.oxford.co.za/book/9780190751715-early-grade-reading-in-south-africa#.Y_xt53ZByCg
 
Title Non-parametric techniques to establish early grade reading benchmarks 
Description The researchers' approach to benchmarking is based on a conceptualisation of different stages of reading development where different cognitive processes come into play as reading proficiency increases (see Figure 1). The importance of some earlier processes diminish as proficiency increases and they are replaced by qualitatively different processes. Yet across all the components, accuracy develops first, followed by increased processing speed, which then leads to automaticity (processing without effort or conscious attention). Fluency frees-up cognitive resources (e.g. working memory and attention) to be allocated to constructing meaning from text. The study therefore first examines the relationship between accuracy and speed and then the relationship between fluency and comprehension. To avoid imposing a priori assumptions about the nature of these understudied relationships in Nguni languages, the study adopts non-parametric techniques to explore these relationships and to identify critical thresholds in early reading skills (see Figure 2). The study identifies thresholds and benchmarks for both oral reading fluency (correct number of words per minute of connected text) and the foundational skill of letter sound knowledge. Unlike traditional methods of benchmarking which are used in developing countries that benchmark fluency to a fixed level of comprehensions, our method is invariant to the problem of establishing comprehension difficulty. We are also careful to ensure that thresholds and benchmarks are theoretically appropriate, contextually relevant and attainable by students. Longitudinal data is then used to assess the predictive validity of thresholds or benchmarks for future reading success. Meeting the proposed thresholds or benchmarks is shown to be predictive of learners' future reading proficiency scores. The study also establishes concurrent validity by examining the alignment of the proposed thresholds and benchmarks against the performance of the same learners on written comprehension assessments. We are able to apply a similar approach to establishing benchmarks in letter sounds. To date, no reliable empirically established method has existed to establish letter sound benchmarks. This non-parametric approach, has subsequently been shown to be applicable to benchmarking early grade reading skills in Sotho languages and in English First Additional language. It could be applied to other African languages to support benchmarking initiatives in other African states. 
Type Of Material Improvements to research infrastructure 
Year Produced 2020 
Provided To Others? Yes  
Impact We have been in close consultation with Research Triangle International - a leader in early grade benchmarking about our method and the advantages that it yields over existing methods that are highly biased by the comprehension difficulty level of questions used in early grade reading assessments. RTI have acknowledged the benefits of this approach. Our method is contextually and more culturally sensitive to language differences, and differences in reading capabilities of children across countries. Existing methods, based on setting oral reading benchmarks using a fixed comprehension level, are highly problematic to implement especially in low literacy contexts and may result in benchmarks that are out of reach for most children. We are hopeful that our work will establish new ground for improved benchmarking exercises in other developing and particularly African contexts. 
URL https://doi.org/10.1016/j.ijedudev.2021.102433
 
Description Close collaboration with the Department of Basic Education in developing reading benchmarks in African languages 
Organisation Department of Basic Education
Country South Africa 
Sector Public 
PI Contribution Over the years, ReSEP has formed a strong collaboration with colleagues at the Department of Basic Education (DBE), South Africa in the research and monitoring, coordination and evaluation unit. With regards to the establishment of early grade reading benchmarks in African languages we have been working closely with Nompumelelo Mohohlwane - the Deputy Director of Research, Monitoring, Evaluation and Coordination unit at the DBE. She is also a Co-investigator on this project. She has been able to build further collaborations within the the DBE, advocating for the adoption of benchmarks established by our team among the curriculum units for example. She also hosted a large virtual dissemination event when our work on reading benchmarks was released. Through our initial research collaboration with Prof. Cally Ardington, she is closely collaborating with the DBE, and ourselves to extend the Nguni language benchmarking initiative to Sotho languages.
Collaborator Contribution The Department of Basic Education have endorsed our reports on early grade reading benchmarks in African languages, making them available on the DBE website.
Impact https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/ReadingBenchmarksnAfricanLanguages.aspx https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Summary%20Report%20V06.pdf?ver=2020-10-28-141736-203 https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Technical%20Report%20V06.pdf?ver=2020-10-28-141752-997
Start Year 2020
 
Description Collaboration with Khulisa Management Services and Research Triangle International on reading benchmarks 
Organisation Khulisa Management Services
Country South Africa 
Sector Private 
PI Contribution Using the methodology we developed for establishing reading benchmarks in Nguni languages, we are able to apply this method to establishing early grade reading benchmarks in other languages. In a USAID funded project titled "Data collection and analysis for the early grade reading study, the reading support project and benchmarking", overseen by Khulisa Management Services, we are collaborating with Research Triangle International and Dr Cally Ardington from the University of Cape Town to establish early grade reading benchmarks in Setswana and English First Additional Language. Data from two impact evaluations will be used to contribute towards early grade reading benchmarks for another of South Africa's official languages.
Collaborator Contribution Khulisa Management Services were awarded the contract - although our team at ReSEP (Stellenbosch University) and RTI are consortium members of this larger project.
Impact We were significantly involved in the process of designing African language data collection instruments. In the design of instruments, we collaborated with officials from the Department of Basic Education, home language Setswana specialists and linguists. Data collection took place in October 2021. We have completed all analysis and report writing. The report will be publicly available by April 2022.
Start Year 2020
 
Description Collaboration with Khulisa Management Services and Research Triangle International on reading benchmarks 
Organisation Research Triangle Institute International
Country United States 
Sector Charity/Non Profit 
PI Contribution Using the methodology we developed for establishing reading benchmarks in Nguni languages, we are able to apply this method to establishing early grade reading benchmarks in other languages. In a USAID funded project titled "Data collection and analysis for the early grade reading study, the reading support project and benchmarking", overseen by Khulisa Management Services, we are collaborating with Research Triangle International and Dr Cally Ardington from the University of Cape Town to establish early grade reading benchmarks in Setswana and English First Additional Language. Data from two impact evaluations will be used to contribute towards early grade reading benchmarks for another of South Africa's official languages.
Collaborator Contribution Khulisa Management Services were awarded the contract - although our team at ReSEP (Stellenbosch University) and RTI are consortium members of this larger project.
Impact We were significantly involved in the process of designing African language data collection instruments. In the design of instruments, we collaborated with officials from the Department of Basic Education, home language Setswana specialists and linguists. Data collection took place in October 2021. We have completed all analysis and report writing. The report will be publicly available by April 2022.
Start Year 2020
 
Description Collaboration with Khulisa Management Services on COVID-19 impacts and Socio-Emotional Learning, funded by USAID 
Organisation Khulisa Management Services
Country South Africa 
Sector Private 
PI Contribution We have been strongly involved in designing instruments to support data collection efforts to understand the impacts of COVID-19 on teacher, principal and children's social emotional welfare. We have been involved in analysing data collected on this through the Early Grade Reading Study and Reading Support Project to explore the impacts of COVID-19 school disruptions on lost contact teaching time, lost learning, and socio-emotional impacts on teachers, parents and children.
Collaborator Contribution Khulisa Management Services on-boarded a psychologist to assist with question development, and distress protocols. They also coordinated data collection.
Impact Outputs are only expected in late 2021. This work is multidisciplinary involving educations, economists and psychologists.
Start Year 2020
 
Description Collaboration with officials from the Department of Basic Education to document early grade reading skills (and Covid-19 related reading losses) using available data 
Organisation Department of Basic Education
Country South Africa 
Sector Public 
PI Contribution Collaborating with an official from the Department of Basic Education, we are working together to pull together available data on early grade reading skills in Nguni and Sotho languages to document evidence on what we know about foundational reading subskills since 2015. I and our research team are compiling the data together - identifying similarities across different study datasets and running analyses to summarise evidence on decoding skills using various assessment tasks.
Collaborator Contribution Our DBE research partners bring linguist expertise and knowledge of the languages in question, as they are are home language African speakers. They are also able to guide the research process in a manner that is relevant to policy makers and accessible to a wider policy audience.
Impact We are writing a book chapter which will be published in a volume of Early Grade Reading, with contributions from various educations, in November 2022.
Start Year 2021
 
Description Multi-university and multi-funder collaborations to support the development of national benchmarks in early grade reading in Nguni languages 
Organisation United States Agency for International Development
Country United States 
Sector Public 
PI Contribution It was evident at the start of this research grant, that a number of organisations have been interested in furthering research in reading in African languages in South Africa, including funders, government and academics. I convened meetings and various calls with groups involved in furthering work on reading benchmarks in South Africa, to determine to what extent we could collaborate on research efforts, pooling data across current studies to produce highest quality research that works towards a unified government objective of establishing reading benchmarks in African languages. By pooling academic efforts and funder priorities, the net result would be using more data from a variety of studies and pooling expertise to support benchmarking. We successfully managed to bring together a much larger team of highly competent academics to work on establishing early grade reading benchmarks in three of South Africa's 9 official African indigenous languages, including the two most widely spoken language benchmarks. Due to this unified approach taken, consulting various stakeholders and bringing on board an extremely competent team, the Department of Basic Education were pleased to endorse our work on reading benchmarks. Our reports were in fact published as Department of Basic Education outputs.
Collaborator Contribution Prof Alicia Menendez and Prof Cally Ardington, had been running an RCT (Story Powered Schools) funded by USAID which resulted in collecting the largest source of data on early grade reading outcomes in isiZulu and isiXhosa in South Africa from two provinces. They agreed to collaborate with our research team to produce a report on reading benchmarks in South Africa. We worked collaboratively in determining a new methodological framework, pooling together various data sources and in producing a report on reading benchmarks in the two most widely spoken indigenous languages. These benchmarks have been adopted as national benchmarks for early grade reading in isiXhosa, isiZulu and siSwati. This collaboration was also supported by USAID who wanted the Story Powered Schools Data to be used to support national reading benchmarking efforts.
Impact https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/ReadingBenchmarksnAfricanLanguages.aspx This is the Department of Basic Education description of the work done. https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Summary%20Report%20V06.pdf?ver=2020-10-28-141736-203 This is a summary report of a larger technical report outlining the process by which we derived early grade reading benchmarks in Nguni languages.
Start Year 2020
 
Description Multi-university and multi-funder collaborations to support the development of national benchmarks in early grade reading in Nguni languages 
Organisation University of Cape Town
Department Southern Africa Labour and Development Research Unit (SALDRU)
Country South Africa 
Sector Academic/University 
PI Contribution It was evident at the start of this research grant, that a number of organisations have been interested in furthering research in reading in African languages in South Africa, including funders, government and academics. I convened meetings and various calls with groups involved in furthering work on reading benchmarks in South Africa, to determine to what extent we could collaborate on research efforts, pooling data across current studies to produce highest quality research that works towards a unified government objective of establishing reading benchmarks in African languages. By pooling academic efforts and funder priorities, the net result would be using more data from a variety of studies and pooling expertise to support benchmarking. We successfully managed to bring together a much larger team of highly competent academics to work on establishing early grade reading benchmarks in three of South Africa's 9 official African indigenous languages, including the two most widely spoken language benchmarks. Due to this unified approach taken, consulting various stakeholders and bringing on board an extremely competent team, the Department of Basic Education were pleased to endorse our work on reading benchmarks. Our reports were in fact published as Department of Basic Education outputs.
Collaborator Contribution Prof Alicia Menendez and Prof Cally Ardington, had been running an RCT (Story Powered Schools) funded by USAID which resulted in collecting the largest source of data on early grade reading outcomes in isiZulu and isiXhosa in South Africa from two provinces. They agreed to collaborate with our research team to produce a report on reading benchmarks in South Africa. We worked collaboratively in determining a new methodological framework, pooling together various data sources and in producing a report on reading benchmarks in the two most widely spoken indigenous languages. These benchmarks have been adopted as national benchmarks for early grade reading in isiXhosa, isiZulu and siSwati. This collaboration was also supported by USAID who wanted the Story Powered Schools Data to be used to support national reading benchmarking efforts.
Impact https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/ReadingBenchmarksnAfricanLanguages.aspx This is the Department of Basic Education description of the work done. https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Summary%20Report%20V06.pdf?ver=2020-10-28-141736-203 This is a summary report of a larger technical report outlining the process by which we derived early grade reading benchmarks in Nguni languages.
Start Year 2020
 
Description Multi-university and multi-funder collaborations to support the development of national benchmarks in early grade reading in Nguni languages 
Organisation University of Chicago
Country United States 
Sector Academic/University 
PI Contribution It was evident at the start of this research grant, that a number of organisations have been interested in furthering research in reading in African languages in South Africa, including funders, government and academics. I convened meetings and various calls with groups involved in furthering work on reading benchmarks in South Africa, to determine to what extent we could collaborate on research efforts, pooling data across current studies to produce highest quality research that works towards a unified government objective of establishing reading benchmarks in African languages. By pooling academic efforts and funder priorities, the net result would be using more data from a variety of studies and pooling expertise to support benchmarking. We successfully managed to bring together a much larger team of highly competent academics to work on establishing early grade reading benchmarks in three of South Africa's 9 official African indigenous languages, including the two most widely spoken language benchmarks. Due to this unified approach taken, consulting various stakeholders and bringing on board an extremely competent team, the Department of Basic Education were pleased to endorse our work on reading benchmarks. Our reports were in fact published as Department of Basic Education outputs.
Collaborator Contribution Prof Alicia Menendez and Prof Cally Ardington, had been running an RCT (Story Powered Schools) funded by USAID which resulted in collecting the largest source of data on early grade reading outcomes in isiZulu and isiXhosa in South Africa from two provinces. They agreed to collaborate with our research team to produce a report on reading benchmarks in South Africa. We worked collaboratively in determining a new methodological framework, pooling together various data sources and in producing a report on reading benchmarks in the two most widely spoken indigenous languages. These benchmarks have been adopted as national benchmarks for early grade reading in isiXhosa, isiZulu and siSwati. This collaboration was also supported by USAID who wanted the Story Powered Schools Data to be used to support national reading benchmarking efforts.
Impact https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/ReadingBenchmarksnAfricanLanguages.aspx This is the Department of Basic Education description of the work done. https://www.education.gov.za/Portals/0/Documents/Reports/Nguni%20Languages%20Summary%20Report%20V06.pdf?ver=2020-10-28-141736-203 This is a summary report of a larger technical report outlining the process by which we derived early grade reading benchmarks in Nguni languages.
Start Year 2020
 
Description Article in the Conversation on the importance of Grit for learning to read, even in poor South African school contexts 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Following from her work on exploring how socio-emotional skills impact on learning, Heleen Hofmeyr published a piece in The Conversation titled "Grit matters when a child is learning to read, even in poor South African schools".
Year(s) Of Engagement Activity 2021
URL https://theconversation.com/grit-matters-when-a-child-is-learning-to-read-even-in-poor-south-african...
 
Description COVID-19 impacts on learning outcomes - contribution to ECON 3x3 newsletter and blog 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact In May 2021, we published a paper in the International Journal of Educational Development on COVID-19 learning losses. We were approached by ECON 3x3 - which provides accessible policy-relevant research and expert commentaries on unemployment, income distribution and inclusive growth in South Africa- to write an article on the impacts of COVID-19 on learning for a wider non-education audience. The article has already had 573 reads and led to further interviews.

This article is based on the authors' paper, Covid-19 learning losses: Early grade reading in South Africa,
published in the International Journal of Educational Development, October 2021. It can be found here:
https://doi.org/10.1016/j.ijedudev.2021.102480

https://www.econ3x3.org/sites/default/files/articles/Ardington%2C%20Kotz%C3%A9%20%26%20Wills_COVID-19%20Measure%20of%20learning%20losses.pdf
Year(s) Of Engagement Activity 2021
URL https://www.econ3x3.org/node/464
 
Description COVID-19 impacts on reading outcomes contributes evidence to Reading Panel to address reading crisis 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact A panel of experts has been convened by Dr Nic Spaull to make sure all South African children can read by 2030. The panel consists of not only education persons, but key leaders in the business world and other individuals that are able to shape political debate on the current reading crisis in South Africa. See
https://www.dailymaverick.co.za/article/2022-02-07-education-business-and-policy-leaders-weigh-in-on-how-to-tackle-sas-reading-crisis/

Our research on COVID-19 losses in reading were added as evidence in submission to the Reading Panel to further nuance how the reading crisis in South Africa has been further exacerbated by COVID-19.
Year(s) Of Engagement Activity 2022
URL https://www.dailymaverick.co.za/article/2022-02-07-education-business-and-policy-leaders-weigh-in-on...
 
Description Early grade reading benchmark dissemination event to policy makers 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact On 7 October 2020, the Department of Basic Education hosted a virtual event for our research team to present its findings on establishing early grade reading benchmarks in African languages.
At least 50 Department of Basic Education officials, located across all nine of South Africa's provinces were present at the event.
At least 10 different non-governmental organisations actively involved in projects to promote literacy advancement were also present at the event.

The event was a great success. Despite the sensitivities of setting benchmarks in African languages, and heated debates that surround reading, there was a unanimous agreement about the benchmarks we proposed and the method by which this was done.
Year(s) Of Engagement Activity 2020
 
Description Interview for National news on COVID-19 impacts on reading outcomes 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Our academic research on COVID-19 impacts on reading losses (https://www.econ3x3.org/node/464) has been referred to in media releases in South Africa, particularly in the lead up to the South African Department of Basic Education Lekgotla. There have also been requests for interviews in this regard.
Year(s) Of Engagement Activity 2022
URL https://mybroadband.co.za/news/trending/431728-grade-1s-in-south-africa-cant-work-out-4-minus-1.html
 
Description Launch of early grade reading benchmarks in South Africa 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact The mobilisation of resources required to improve learner reading outcomes for early grades in South Africa has gained ground. Basic Education Deputy Minister, Dr Reginah Mhaule, joined by South African academics and reading practitioners, funders and international benchmarking specialists, launched the Reading Benchmarks for the Sesotho-Setswana Language Group, Afrikaans Home Language and English as a First Additional Language (EFAL) reports, aimed at promoting reading across the curriculum at GET level. The launch took place at the DBE Conference Centre in Pretoria on 9 November 2022. This follows the first benchmarks for the Nguni language group that were launched virtually during the 2020 school calendar.
Year(s) Of Engagement Activity 2022
URL https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/The-launch-of-reading-benchmarks-for...
 
Description Presentation on learning losses in reading at a workshop on COVID-19 and well-being at the National Department of Basic Education 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Presented on learning losses at a May 2022 workshop at the Department of Basic Education (Pretoria) in collaboration with DBE colleagues, Khulisa Management Services and USAID.
Year(s) Of Engagement Activity 2022
 
Description Presentation to all stakeholders in the Department of Basic Education on COVID-19 impacts and negative impacts of rotational schedules - DBE Lekgotla 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Annually, the Department of Basic Education holds a Lekgotla at the start of the school year. The South Africa president Cyril Ramaphosa was the keynote speaker.

The Lekgotla address key issues in education, pressing concerns, major goals and aims for the year. High on the 2022 agenda was the continuation of rotational schedules of attendance which was having dramatic impacts on learning outcomes. Nompumelelo Mohohlwane and fellow colleague Dr. Janeli Kotze presented at the meeting and were able to articulate clearly to policymakers including the Minister of Basic Education how learning has been affected through COVID-19 disruptions and particularly rotational schedules. Both of these presentations referred to collaborative work on COVID-19 impact to which Gabrielle Wills, Cally Ardington and Heleen Hofmeyr have contributed.

Along with recommendations from National Command Councils on COVID-19, the rotations were abolished less than a week after the meeting. https://www.news24.com/news24/southafrica/news/new-covid-19-regulations-its-back-to-school-for-all-pupils-cabinet-20220131
Year(s) Of Engagement Activity 2022
URL https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/Motshekga-addresses-2022-lekgotla.as...
 
Description Presentation to policymakers, funders and academics on the building blocks of reading for meaning 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Dr Gabrielle Wills presented new research on what we know about foundational reading skills in African languages, showing empirically using reading data from 40,000 students, just how fundamental the acquisition of foundational reading skills is (alphabetic knowledge and fluency) in the first two years of school for being able to read for meaning by the time children transition out of primary school.
Year(s) Of Engagement Activity 2022
URL https://resep.sun.ac.za/breaking-into-spring-with-the-2022-quantitative-education-research-conferenc...
 
Description Provided evidence on learning losses for National Department of Basic Education Lekgotla which resulted in removal of COVID-19 rotational schooling schedules 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Collaborated on initial findings on learning losses with Colleagues in the Department of Basic Education. These findings were used as key input for the Department of Basic Education's January 2022 Lekgotla, and providing evidence to inform the removal of rotational schedules in schools. This evidence showing very large losses in reading was presented at the end of January 2022 DBE Lekgotla through a clear presentation of evidence of these learning losses by DBE colleague Nompumelelo Mohohlwane.

A week after the Lekgotla, all schools were instructed (and directives were gazetted) to return to normal daily attendance.
Year(s) Of Engagement Activity 2022
URL https://www.education.gov.za/ArchivedDocuments/ArchivedArticles/Lekgotla-sector-recovery-plan.aspx
 
Description Reading benchmark workshop 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Supporters
Results and Impact On the 14th of September 2020, our research team along with Prof Cally Ardington virtually met with USAID leads in South Africa, colleagues from the Department of Basic Education, and Khulisa Management services to discuss progress that has been made on work done on reading benchmarks in African languages as well as considering how best to disseminate our research to wider policy audiences.
Year(s) Of Engagement Activity 2020
 
Description Stellenbosch and Bath University workshop on new findings in education research in four developing countries 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact A two-day workshop was held at Stias, Stellenbosch University between 20-21 February. Co-PIs of this project were significantly involved. New research on quantitative findings on learning in South Africa were shared as well as presentations from Dr Robin Shields and Arif Naveed (University of Bath), Gayathri Krishna (Tata Institute of Social Sciences, Mumbai) and Ashik Singh (Tribhuvan University, Kirtipur Nepal) and Swati Banerjee (Tata Institute of Social Sciences, Mumbai). Present at the workshop was the Deputy Director, Director and Chief Director of Research, Coordination, Monitoring and Evaluation at the Department of Basic Education as well as advisor to the Minister of Basic Education (Dr Martin Gustaffsson).

The research workshop encouraged knowledge sharing of education systems across four countries - South Africa, India, Nepal and Pakistan. Each of these countries were spoken about by researchers from each of these nations.

Dr Gabrielle Wills hosted and planned this event with Prof. Servaas van Berg.
Year(s) Of Engagement Activity 2020