GCRF: Pseudo-Panels for Long Period Analysis of African Household Surveys

Lead Research Organisation: University of Nottingham
Department Name: Sch of Economics

Abstract

National household surveys have become the standard source of data for analysis of poverty in developing countries. A major limitation of these surveys for Africa, in terms of the potential to analyse poverty dynamics, is that they are not a panel - different households are surveyed in each wave so they constitute repeated cross sections. It is therefore not possible to track the same households over time to investigate the drivers of poverty reduction. This creates challenges for analysis with endogenous variables, such as interactions between household size and poverty or migration, remittances and household income. The absence of a panel also limits analysis of determinants of household welfare over long periods.

The strategy we propose to address this data restriction is to identify representative household types to construct pseudo panels making use of the repeated cross section household surveys (see the Case for Support). Analysis of the pseudo panel allows one to track similar households and complements household-level analysis for each survey. The project will develop methods for constructing pseudo-panels that can be applied, with suitable modifications for specific features of the surveys, in any country with three or more national household surveys. In principle, the methods are also applicable to census and Demographic and Health Survey data. Although the project focuses on Uganda (1992-2012 using eight existing surveys), the methods for constructing and analysing pseudo-panels can be applied to other African countries. Utilising established links with local research partners, hence largely 'off-budget', the pseudo-panel method will be applied to Ghana (1991-2013 using 6 surveys) and Tanzania (1991-2012 using 4 surveys).These three countries all have managed to roughly halve headcount poverty since the early 1990s.

We use the repeated cross-section survey data to form a pseudo panel of 'representative' households by grouping individual households (the observational units) into cohorts on the basis of time invariant characteristics (location, gender and birth cohort of household head). The cohorts are then traced over time as they appear in successive surveys, forming a pseudo panel with 'lagged values'. As the cohort fixed effect is correlated with cohort (household) characteristics that are unobserved and not constant over time due to the changing membership of the cohorts in each survey, an errors-in-variables estimator is used to correct the cohort means as estimates of the unobservable population means. The lagged dependent variable is constructed from an auxiliary regression with an augmented instrumental variables estimator using time-invariant instruments. The pseudo panel therefore permits a long (20 years or more) analysis of determinants of household welfare and poverty reduction, with the potential to generate internal instruments for endogenous variables and to identify effects of policy changes (such as Universal Primary Education in Uganda).

The project is expected to make a number of contributions. First, methods for constructing and using pseudo-panels will be developed, tried and tested generating a transferable method of potential use for most developing countries, especially in Africa where there are many surveys but few panels. Second, the pseudo-panel will be used to provide new insights on the drivers of poverty reduction in Uganda, with more limited applications (during the life of this project) to Ghana and Tanzania. Third, through training and research collaboration we will support building research capacity in Africa (specifically Uganda). To support these aims, an inception workshop in Kampala will include a variety of stakeholders with focus groups to identify the important research and policy issues; there will be dissemination in country and through AERC; and training will be provided to local researchers.

Planned Impact

The dissemination strategy to ensure impact will target three main groups: academic researchers (addressed under academic beneficiaries); government officials and donors concerned with devising effective national poverty reduction strategies; NGOs and civil society communities concerned with poverty. Co-ordinated strategies will be used to target the latter two groups.

The inception meeting with stakeholders in Kampala at the start of the project (possibly March 2017 but no later than May) will help determine the core questions to be addressed in the econometric analysis for Uganda (consultation with local researchers will identify issues for Ghana and Tanzania). The intention is to invite 50 participants to the workshop and hold a series of focus group meetings afterwards (with officials, researchers and NGOs). We will explain the benefits of the pseudo-panel for long period analysis and discuss with participants what issues should be addressed (e.g. are particular groups, regions or sectors of economic activity of special importance). The focus groups will provide more detailed information for the design of the research. Obviously, stakeholders may have some concerns that cannot be addressed given the data but we will identify feasible and relevant research questions and issues.

We have a number of contacts in Kampala who can assist in identifying participants for the workshop and focus groups. The PI (Morrissey) has 20 years research experience in Uganda; two of his PhD students are now at Makerere University and another is with the Bank of Uganda and all are willing to assist in identifying officials and researchers to engage in the stakeholder workshop and focus groups. A colleague at Nottingham, Dr Trudy Owens, has extensive links with NGOs in Uganda through over a decade of research; she surveyed NGOs in 2002 and 2008 and has plans for another survey, so does have a list of registered NGOs with contact details (there are some 1000 listed on the Ministry of Internal Affairs NGO Registration List, but most of these are very small and/or specialized or inactive). Through a recent project fitting orthotic equipment she has excellent links with the major umbrella disability NGOs, the National Union of Disabled People in Uganda (NUDIPU) and the Uganda National Action on Physical Disability (UNAPD). The NGOs can offer important contributions to the issues to be addressed in the research as although they lack research capacity they request policy relevant research and analysis. For example, disability NGOs in Uganda lament the lack of quantitative data on the welfare status of (households with) disabled persons. These established local contacts ensure the feasibility of active participation in the workshops and take-up of the research.

The primary channel to disseminate to stakeholders will be the workshop in Kampala in 2018, to which we will invite the stakeholders who attended the inception meeting. In conjunction with this, a number of Policy Briefs will be prepared summarising results on a number of particular policy areas (some for government officials, some for NGOs - the number and topics will be determined after the inception meetings). These will be co-produced with the Ugandan researcher (who will visit Nottingham for six weeks in late 2017), where appropriate and feasible in consultation with local stakeholders.

As a core objective is to provide methods for constructing and estimating pseudo-panels, the dissemination workshop will be followed by a one-week training workshop at Makerere University delivered by the CI (Khan) with the Ugandan researcher. We envisage ten Ugandan participants and will invite two participants from each of Kenya and Tanzania. This will build local capacity to continue research using the methods developed and sustain impact for policy and stakeholders. Other capacity building and dissemination will take place through presentations at AERC and the University of Ghana.
 
Description The rWeesearch project constructed a pseudo-panel for six Ugandan national household surveys over 1992 to 2013: 1992/93, 1999/00, 2002/03, 2005/06, 2009/10 and 2012/13. This yields a constructed panel of representative households classified according to region; rural or urban; gender, age, and education of the household head. The pseudo-panel is being used to study changes in household welfare since 1990, with a specific focus on the role of labour diversification (number and types of sources of income for household workers). Household welfare is measured in terms of consumption (adult equivalent expenditure), and relative welfare is in comparison with national mean consumption levels for the relevant survey year. The analysis considers five sources of household income: remittances, and four relating to labour [types of economic activity] - agriculture (farming); agricultural (off-farm) wage; non-agricultural self-employment; and non-agricultural wage. Analysis also distinguishes households with at least one member engaged in the activity and the number of activities the household engages in.
The research finds that households with more diversified income sources tend to lower consumption welfare, indicating diversification has mainly been due to push factors (the need for income pushing people into low earning activities). This is because much of the diversification has been into the agricultural wage sector, particularly amongst the poorest households who have also experienced reductions in remittances. Welfare (in terms of adult equivalent expenditure) is higher for households engaged in the non-agricultural wage sector, but growth in wage employment has been very low. This is one of the first studies to look at household welfare and income diversification at the national level (rural and urban) over such an extended period of time.

Five main findings:
• The number of income-earning activities (jobs) that households engage in has increased, on average from 1.5 in 1992 to 2 in 2013 (although the number of adults in households has not increased on average).
• Income diversification (households engaging in more income activities) is primarily due to push factors: lower income households need to engage in more activities (even though this is associated with lower per capita consumption).
• The adverse welfare effects are associated with agricultural wage employment: this has become increasingly the low paid activity of need.
• Non-agricultural self and wage employment are significantly associated with higher welfare, but growth of non-agricultural wage employment is too slow to raise welfare for significant numbers of households.
• Higher levels of education (of the head) are associated with greater household welfare, but the premium from post-primary education is diminishing over time.
Exploitation Route The 18 month project was under the SDAI call with a specific focus on developing new methods for analysing secondary data, in this case constructing a pseudo-panel of representative households to link a number of Ugandan household surveys (over 1992/93 to 2012/13). Given the nature of the research, one intended impact was research capacity building, with the primary beneficiaries being African (and other) researchers using survey data to analyse household poverty and welfare. The research developed statistical tests to select between alternative ways of constructing pseudo-panels to identify which would give the most reliable (unbiased) estimates in econometric analysis. These have been developed and applied for Uganda but can be applied in other countries (the researchers have recently begun a project on Tanzania). To promote this research capacity building, the researchers delivered a two-day Training Workshop at Makerere University on 11-12 September 2018 to over 20 researchers (all Ugandan except for Dr Leyaro from University of Dar-es-Salaam who is interested in applying the methods). Participants were provided with course materials and access to Ugandan household survey data to implement the methods for constructing pseudo-panels. The researchers also provided a session to advise local researchers on their own work.
Two data sets were made available on the UKDataservice (listed elsewhere under resources)
Sectors Education

URL https://www.nottingham.ac.uk/credit/news/papers/1905.aspx
 
Description Although the focus of the research was scientific impact (methods and data reported elsewhere) we engaged with the research and policy community in Uganda throughout the project. An Inception Workshop was held at Makerere University on 02 May 2017 with over 40 attendees (mostly government officials and researchers). The aims and objectives of the project were presented, followed by discussion of issues of interest to Ugandans and focus group sessions. We also had a discussion with Lt Gen Charles Angina, Deputy Chief Coordinator of Operation Wealth Creation in the Office of the President of Uganda. The analysis of labour diversification and household welfare in Uganda over 1992-2013 yielded new insights of interest to analysts and the policy community in Uganda, in particular the growth of agricultural wage employment and evidence that females are more likely to be pushed into this low-earning employment. Initial results were presented at a Dissemination Workshop at Makerere on 10 September 2018 that over 40 public officials and researchers attended. The researchers (Morrissey and Khan) and some participants were interviewed by John Odyek from New Vision newspaper (full page article published on 04 October, p 29). The project funding ended in 2018, although the researchers (Khan and Morrissey) have continued working on and extending the analysis and writing papers for publication. Our ability to follow-up in Uganda to support policy impact was severely limited by the lack of post-project funding for further dissemination. However, Morrissey visited Kampala in November 2019 (for another project) and give a seminar on results from this project at the African Development bank offices. Participants from the AFDB, the International Growth Centre (Kampala office), Bank of Uganda and Makerere University attended. Although it is not possible to identify a specific non-academic impact the research and findings have been disseminated in discussions with the policy community. In 2020 we applied similar analysis to Tanzania as part of a WIDER project and published a WIDER Working paper (WP2020-110). I also published a WIDER Policy Brief, 'Better livelihoods through income diversification in Tanzania', with Milla Nyyssölä (2021) which has been disseminated in Tanzania and through the WIDER web pages.
First Year Of Impact 2018
Sector Education
Impact Types Policy & public services

 
Title Construction of Pseudo-Panels 
Description As part of the project we will construct a pseudo-panel to link, in a consistent manner (for representative households) the national Ugandan household surveys from 1991/92 to 2013/14, and will make this freely accessible. We will also make the previously unavailable 1991/92 household survey publicly available in a usable format. We will also write and make freely available (in published accessible form) documents on constructing pseudo-panels, with statistical test criteria, and appropriate econometric methods to use for analysis. 
Type Of Material Database/Collection of data 
Year Produced 2018 
Provided To Others? No  
Impact The database is not yet available, although a working paper setting out the method and application has been published. Further papers and the database will be available by the end of 2018. 
 
Title Pseudo-Panels 
Description Ugandan pseudo-panels constructed for the six surveys from 1992/93 to 2012/13, using various criteria (regions, urban-rural, gender of head, education level of head, and alternative age ranges for head of household). 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? Yes  
Impact Can be used by researchers, especially those working on Uganda with an interest in pseudo-panels. 
URL https://reshare.ukdataservice.ac.uk/cgi/users/home?screen=EPrint::View&eprintid=853516
 
Title Survey 1992/93 
Description The 1992/93 Ugandan National Household Survey was updated from SAS format to Stata format (anonymised) , with full labelling of variables. 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? Yes  
Impact Can be used for research (the previous version was not accessible to researchers, except by requesting from the Ugandan Bureau of Statistics. 
URL https://reshare.ukdataservice.ac.uk/cgi/users/home?screen=EPrint::View&eprintid=853512
 
Description Dissemination Workshop 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Held a Dissemination Workshop at Makerere University, Kampala on 10 September 2018. Over 40 public officials and researchers attended, key findings were reported and discussed. The researchers (Morrissey and Khan) and some participants were interviewed by John Odyek from New Vision newspaper, and there was a full page article (published on 04 October, p 29).
Year(s) Of Engagement Activity 2018
 
Description Inception Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Inception Workshop and focus group discussions with politicians, policy-makers and researchers. Held at Makerere University, Kampala on 02 May 2017 with about 40 participants over six hours. We gave a presentation of our research - what we planned to do and how, and the issues we could address relevant to long-run trends and determinants of household welfare in Uganda. We then held two focus group meetings, one with policymakers and one with researchers, to get their views on issues to address and have a more detailed discussion on methods. We also had a meeting with the Deputy Chief Coordinator of Operation Wealth Creation in the Office of the President. The primary purpose was to get the views of Ugandan users on the most important issues on which to focus the research.
Year(s) Of Engagement Activity 2017
 
Description Seminar in Kampala 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Presented a research seminar on "Income Diversification and Household Welfare in Uganda", to the International Growth Centre (IGC) in partnership with The African Development Bank (ADB), held at the ADB office in Kampala on the morning of 29 November 2019.The audience (ten participants) included researchers and staff from IGC, ADB, Bank of Uganda and Makerere University.
Year(s) Of Engagement Activity 2019
 
Description Training Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Delivered a two-day Training Workshop at Makerere on 11-12 September 2018 to over 20 researchers (all local except for one from University of Dar-es-Salaam). This provided an introduction to the econometric theory for pseudo-panels; explained issues in construction and how to apply the statistical tests; went through applications with Ugandan pseudo-panels; and held an open session to discuss issues with the researchers. Presentation slides and datasets were provided to the participants.
Year(s) Of Engagement Activity 2018