Survey Data Collection Methods Collaboration: Securing the Future of Social Surveys

Lead Research Organisation: University of Essex
Department Name: Inst for Social and Economic Research

Abstract

The survey data collection community is facing severe challenges in implementing surveys using pre-pandemic approaches. There are knowledge gaps regarding the advantages and disadvantages of different data collection techniques and approaches such as push-to-web, knock-to-nudge and video-interviewing, and particularly in the mixed-mode context. And there is limited capacity both of skilled interviewers and of research professionals. Recent developments are leading to changes in commissioner requirements for face-to-face data collection as well as having implications for fieldwork costs and the role of interviewers. In several areas of survey methodology, the need for development of improved methods and the need to identify and communicate best practice is urgent.

The Survey Data Collection Methods Collaboration (SDCMC) is a response to these challenges and aims to deliver a step change in approaches to collecting population survey data in the UK to ensure that it will remain possible to carry out high quality social surveys of the kinds required by the public and academic sectors to monitor and understand society, and to provide an evidence base for policy. It will do this primarily through a rigorous programme of research focused on ensuring large-scale social surveys in the UK can innovate and adapt in a changing environment and continue to deliver high quality and inclusive data.

The primary aim of the programme of work is to assess the quality implications of the most important survey design choices relevant to future UK surveys and provide good practice guidance and practical training materials, while a secondary aim is to identify promising ways to improve the capacity and skillset of both interviewers and research professionals and take steps towards making those improvements.

The SDCMC will generate a range of research and training outputs and will engage in a programme of dissemination and promotion activities. Outputs will have a strong practical orientation, consisting of good practice guidance for survey design, survey implementation, survey commissioners and survey data users, all backed up by rigorous and well-documented research and with a range of associated activities to ensure that the lessons are disseminated to all relevant stakeholders and, where appropriate, embedded in institutional practice in a timely manner. The project will also seek to enable a whole community dialogue and collaborative response to wider strategic challenges and issues, as well as incorporating a strong training and capacity building component. To realise the vision of the SDCMC will require leadership, commitment and active participation of a broad range of stakeholders including those who commission surveys, those who implement them, those who use survey data and those involved in research and development of survey methods. Constructive dialogue and collaboration will be crucial to the successful delivery of the ambitious range of activities and outputs that we envisage. We have assembled an experienced project team including academics and survey practitioners (39 people from 14 institutions), who are committed to the necessary constructive collaboration and we will engage a wider range of other stakeholders during the course of the grant to ensure that our outputs directly benefit a wide range of audiences.

Impact will be achieved not only on survey research and survey practice but also on a broad range of disciplines within the social sciences and beyond which employ social survey data for analysis through raised awareness and knowledge of issues and opportunities.

Publications

10 25 50
 
Description Contribution of written evidence to the House of Commons Public and Constitutional Affairs Select Committee Inquiry: Transforming the UK's Evidence Base
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
URL https://committees.parliament.uk/work/7808/transforming-the-uks-evidence-base/
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation City of London
Country United Kingdom 
Sector Public 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation Ipsos MORI
Country United Kingdom 
Sector Private 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation Kantar Group
Country United Kingdom 
Sector Private 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation London School of Economics and Political Science (University of London)
Country United Kingdom 
Sector Academic/University 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation National Centre for Social Research
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation Office for National Statistics
Country United Kingdom 
Sector Private 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation Ulster University
Country United Kingdom 
Sector Academic/University 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation University College London
Country United Kingdom 
Sector Academic/University 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation University of Lausanne
Country Switzerland 
Sector Academic/University 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation University of Manchester
Country United Kingdom 
Sector Academic/University 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation University of Southampton
Department ESRC National Centre for Research Methods
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation University of Southampton
Country United Kingdom 
Sector Academic/University 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Survey Futures: The UK Survey Data Collection Methods Collaboration 
Organisation University of Warwick
Country United Kingdom 
Sector Academic/University 
PI Contribution I lead this collaboration as Director.
Collaborator Contribution The expertise and experience of the many and varied partners have helped to shape the research programme and the engagement activities. Six partner organisations are represented on the Senior Leadership Team of the project, while others contribute in a range of ways, including as partners on specific research sub-projects.
Impact In the first 8 months of the collaboration, we have held 5 engagement/consultative events, made a number of presentations to various bodies and have produced one research output. The core members of the collaboration are survey practitioners and academic researchers with backgrounds in sociology, economics and health. The wider collaboration group includes survey commissioners and survey data users, from government, academia, and the private and third sectors.
Start Year 2023
 
Description Advice to a United Nations Working Group 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Participation (both presentation, discussion and advice) to the United Nations/ World Bank inter-secretariat joint working group on household surveys meeting on updating advice documentation/materials on carrying out household surveys, particularly in developing countries. Considerable discussion ensued and I received an invitation from the UN to become a member of the Project Core Group.
Year(s) Of Engagement Activity 2024
URL https://unstats.un.org/iswghs
 
Description Engagement Webinar on Survey Futures 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Webinar to introduce the objectives and work plan of Survey Futures to a broad audience including practitioners from government, private, third and academic sectors, both in the UK and overseas.
Year(s) Of Engagement Activity 2023
URL https://www.youtube.com/watch?v=jdhAQ3rDqHs
 
Description Presentation to Radical Statistics Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presentation on groups that are under-represented in social survey data, what impact this under-representation might have on research findings, and what could be done to reduce the under-representation. Presentation sparked a lot of discussion (both formally during the session and also later during lunch and coffee breaks) amongst activists, students and NGOs.
Year(s) Of Engagement Activity 2024
URL https://www.radstats.org.uk/conference/london2024/
 
Description Survey Practice Forum #1 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 83 people, mainly survey practitioners, but also survey commissioners and survey data users, attended a Survey Practice Forum event held in central London, to debate the current challenges facing survey data collection in the UK and to identify information needs that could be addressed through further research.
Year(s) Of Engagement Activity 2023
URL https://surveyfutures.net/events/2023/09/21/survey-practice-forum-2/
 
Description Survey Practice Forum #2 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 74 people, mainly survey practitioners, but also survey commissioners and survey data users, attended a Survey Practice Forum event held in central London, to debate the current challenges facing survey data collection in the UK, including from an international perspective, and to identify the top priorities for further research that could be commissioned through this award.
Year(s) Of Engagement Activity 2023
URL https://surveyfutures.net/events/2023/09/08/survey-practice-forum/
 
Description Training and Capacity Building Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This workshop aimed to identify training needs and capacity challenges facing the UK survey research community, particularly as relates to data collection methods. The outcome was a report setting out the identified needs.
Year(s) Of Engagement Activity 2023
URL https://surveyfutures.net/events/2023/09/21/training-and-capacity-building-forum-in-person-2/
 
Description Webinar on post-pandemic role of interviewers 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact A webinar to present and discuss emerging findings from the Survey Futures project to understand the future role(s) of survey interviewers. The aim was both to disseminate findings and to obtain input from practitioners to influence the next stages of the research.
Year(s) Of Engagement Activity 2024
URL https://www.city.ac.uk/news-and-events/events/2024/february/thinking-about-the-post-pandemic-role-of...