The Use of Paradata (Field Process Data) in Cross-Sectional and Longitudinal Surveys

Lead Research Organisation: University of Southampton
Department Name: Statistical Sciences Research institute

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.

Publications

10 25 50
 
Description The key objectives of this research grant were to explore the uses of paradata for cross-sectional and longitudinal surveys with the aim of gaining knowledge that leads to improvement in field process management and responsive survey designs. The development of methodology to make best use of such paradata in statistical models also played a key role. The research project was organised into three interlinked subprojects with the specific aims of: 1) investigating the use of call record data and interviewer observations to study nonresponse in cross-sectional and longitudinal surveys, 2) providing insights into the effects of interviewing strategies and attributes on response, and 3) gaining knowledge about the measurement error properties of paradata.
The study has produced a wealth of findings which are outlined in detail in the 12 papers from this project. The key findings are described for each subproject:
1.) Paradata exhibits a complex multilevel structure which needs to be reflected in a statistical model analysing such data. Multilevel discrete time event history models were developed to analyse best times to establish contact and cooperation. Time varying call record information, such as features of the call history and of the current call, play a key role in predicting the outcome of each call. Interviewer observations, e.g. on the type and condition of the house and the presence of dependent children, proved to be useful for predicting the likelihood of cooperation. The novel application of sequence analysis of call record data identified a categorisation of sequences based on length and outcome. Subsequently the project developed models to predict length and final outcome of call sequences. We found that including information from the most recent call outcome very significantly improves prediction. The models developed are currently being used by Statistics Sweden to reduce the number of unproductive calls in the Swedish Labour Force Survey.
When analysing the risk of nonresponse bias during data collection, the R-indicator, a measure commonly used after data collection, was shown not to perform well and the use of the delta index and the coefficient of variation are recommended instead. A key finding is that survey estimates tend to stabilise after about 5 calls indicating potential to stop calling after that reducing the number of unproductive calls made.
2.) The research developed multilevel cross-classified and multiple membership models to analyse interviewer effects in a longitudinal survey. The substantive results indicated strongly that the most recent interviewer has the highest influence of nonresponse across waves of a longitudinal survey contrasting earlier findings. The substantive findings confirm that interviewer experience, grade and continuity are significant predictors of non-response, whereas a significant role of interviewer personality traits could not be proven. Regarding the analysis of doorstep interactions, interviewer's experience and confidence of the interviewer were found to play a key role with more experienced and more confident interviewers showing higher likelihoods to achieve cooperation.
3.) Whilst paradata may be subject to measurement error our study revealed a generally high agreement between the interviewer observations and the Census reports, which implies that the interviewer observations we analyzed suffer from minimal measurement error.
Exploitation Route The project reached out to a wide academic audience, comprising researchers in Statistics and Survey Methodology, and researchers in social science disciplines using data from social surveys. The impact of the research has been through academic publications and working papers (15 so far), an edited special issue in an international journal, more than 35 conference papers, 4 sessions at international conferences, an international research symposium and a short course.
Sectors Government, Democracy and Justice,Other

URL http://www.southampton.ac.uk/s3ri/research/projects/the_use_of_paradata_in_cross_sectional_and_longitudinal_surveys.page#overview
 
Description We had text here before but this has disappeared. Please have a look at the earlier entry. The research findings and scientific impacts all had wide ranging implications for survey practice. Methods to use paradata and survey process data, for example to reduce nonresponse and to make survey more efficient, are of relevance to any survey researcher, social scientist and data analyst concerned with the presence and use of paradata. Economic and societal impact therefore has to be seen in terms of returns to improvements in the quality and efficiency of sample surveys. Specific impacts have been achieved by advising survey organisations to reduce the number of calls /visits made to a household in interviewer administered surveys without much estimated loss in data quality. More specifically, the ONS reduced their number of calls made on some surveys for cost and efficiency savings.
First Year Of Impact 2017
Sector Government, Democracy and Justice
Impact Types Societal,Economic,Policy & public services

 
Description Survey Methodology contribution
Geographic Reach National 
Policy Influence Type Influenced training of practitioners or researchers
Impact We advised the Office for National Statistics to reduce the number of contact or calls made to a household in interviewer-administered surveys. The ONS has subsequently reduced the number of calls in some key surveys (at least the Labour Force Survey) which led to a reduction in costs without impact on data quality.
 
Description Collaborative Methodological Research Project "The future of online surveys: Evaluating data quality in the UK probability-based online panel"
Amount £80,000 (GBP)
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 03/2018 
End 08/2018
 
Description Secondary Data Analysis Grant 'Understanding survey response behaviour in a digital age: mixed-device online surveys and mobile device use'
Amount £125,000 (GBP)
Funding ID ES/P010172/1 
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 01/2018 
End 10/2019
 
Description The ESRC National Centre for Research Methods - Workpackage 1
Amount £6,249,253 (GBP)
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 01/2015 
End 12/2019
 
Description Network Collaboration with Statistics Netherlands and the University of Utrecht 
Organisation Statistics Netherlands
Country Netherlands 
Sector Public 
PI Contribution We had several collaborative meetings where we discussed progress on various new forms of data collection, including online data collection using mixed-device surveys. We discussed new forms of paradata and in particular methods for modelling such data using also Bayesian modelling techniques. We wrote a joint network grant application which was successful (Leverhulme grant). We wrote a joint research paper that we submitted to an international journal (Journal of Survey Statistics and Methodology). A further working paper on Bayesian methods for modelling paradata is also available but not yet submitted to a journal.
Collaborator Contribution We wrote a joint research paper that we submitted to an international journal (Journal of Survey Statistics and Methodology). They had the initial idea to use a Bayesian Modelling approach.
Impact Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology. ; Durrant, G. B., Kibuchi, E., Maslovskaya, O. and Sturgis, P. (2017) Bayesian methods in adaptive survey designs, working paper (not yet submitted).
Start Year 2015
 
Description US Census Bureau via the BADEN project 
Organisation Government of the United States of America
Department U.S. Census Bureau
Country United States 
Sector Public 
PI Contribution We wrote a joint paper: Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology ; we discussed our work at several practitioner workshops and at conferences and meetings (also as part of the BADEN project).
Collaborator Contribution We wrote a joint paper.
Impact Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology
Start Year 2015
 
Description University of Michigan 
Organisation University of Michigan
Country United States 
Sector Academic/University 
PI Contribution We wrote a joint research paper (Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology)
Collaborator Contribution We wrote a joint research paper
Impact Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology
Start Year 2016
 
Description 1-day International conference organised at the RSS: 'Paradata: From Theory to Practice' 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The day saw a range of invited presentations from national and international presenters (including Frauke Kreuter, Natalie Shlomo, Barry Schouten, Patrick Sturgis, Mario Callegaro and Ulrich Krieger).

The conferences was attended by a wide range of participants from different backgrounds, including academia, statistical offices (such as the Office for National Statistics), research institutes and market research organisations (e.g. Ipsos-Mori).
We received very positive feedback from the day and with some participants saying that they will try out some of the techniques presented in their own research.
Year(s) Of Engagement Activity 2014
URL http://www.southampton.ac.uk/s3ri/news/events/2014/06/26_paradata_from_survey_research_to_practice.p...
 
Description Conference Presentation: When to stop calling? Using call record data to assess nonresponse bias in a longitudinal study 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked interest in assessing nonresponse bias using call record data.
Year(s) Of Engagement Activity 2014
URL http://www.nonresponse.org/c/510/2014_Reykjavik_Iceland/?preid=488
 
Description Conference presentation - Modelling Change of Interviewer: Effects on Nonresponse in Cross-Sectional and Longitudinal Surveys 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentations encouraged a range of questions as well as comments.

The talk sparked interest in modelling change of Interviewer when looking at effects on nonresponse in cross-sectional and longitudinal surveys.
Year(s) Of Engagement Activity 2013
 
Description Conference presentation- Using call record to analyse the process leading to cooperation or refusal: experience from six household surveys. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged a range of questions as well as comments.

The talk sparked interest in using call record to analyse the process leading to cooperation or refusal, with applications to six household surveys. Valuable discussions raised from the audience, improving a revised version of the paper.
Year(s) Of Engagement Activity 2011
URL http://www.csdiworkshop.org/index.php/2011-workshop
 
Description Conference presentation: Evaluating the Measurement Error of Interviewer Observed Paradata 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk raised interest in evaluation of measurement error of interviewer observed paradata, leading to interesting suggestions to improve the paper.
Year(s) Of Engagement Activity 2012
 
Description Conference presentation: Using Sequence Analysis to Better Understand Interviewer Calling Patterns: An Example from the UK Understanding Society Survey 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked interest in studying interviewer calling patterns using sequence analysis in a longitudinal study.
Year(s) Of Engagement Activity 2013
URL http://www.europeansurveyresearch.org/conference/ljubljana-2013
 
Description Conference presentation: A simulation study of the effect of sample size and level of interpenetration on inference from cross-classified multilevel logistic regression models 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentations encouraged a range of questions as well as comments.

The talk raised discussions on the effect of sample size and level of interpenetration on inference from cross-classified multilevel logistic regression models, with interesting suggestions to the paper.
Year(s) Of Engagement Activity 2012
URL http://www.ncrm.ac.uk/RMF2012/home.php
 
Description Conference presentation: An Investigation of Interviewer Effects on Measurement Error 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.


The presentation stimulated discussions on interviewer effects on measurement error.
Year(s) Of Engagement Activity 2014
URL http://www.amstat.org/meetings/jsm/2014/program.cfm
 
Description Conference presentation: Analysing Call Record Data in Longitudinal Surveys 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact My talk on modelling length and outcome of call sequences sparked a range of questions as well as comments. In particular I received suggestions on using ROC curves, sensitivity and specificity for further analysis which we subsequently implemented. We believe this improved the paper.

The talk sparked interest in modelling length and outcome in longitudinal surveys.
Year(s) Of Engagement Activity 2014
URL http://panelsurveymethods.wordpress.com/
 
Description Conference presentation: Analysing and Modelling Paradata 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.


The talk sparkled interesting discussions on how to analyse and model paradata information.
Year(s) Of Engagement Activity 2012
URL http://www.ncrm.ac.uk/RMF2012/home.php
 
Description Conference presentation: Analysing interviewer call record data using a multilevel multinomial modeling approach to understand the process leading to cooperation or refusal. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The talk encouraged a range of questions as well as comments.

The talk sparked interest in fitting multilevel multinomial modeling to interviewer call record data to understand the process leading to cooperation or refusal. Valuable comments from the audience have been incorporated in the revised versions of the paper.
Year(s) Of Engagement Activity 2011
URL http://www.amstat.org/meetings/jsm/2011/
 
Description Conference presentation: Assessing Nonresponse Bias using Call Record Data with Applications to a Longitudinal Study 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged a range of questions as well as comments from the audience.

Ideas for further research have been suggested, such as conducting a simulation study to assess nonresponse bias focusing on hard to reach cases.
Year(s) Of Engagement Activity 2014
URL http://www.isi2015.org/
 
Description Conference presentation: Assessing the Relative Importance of Current and Previous Interviewers on Wave Nonresponse in Longitudinal Survey 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged a range of questions as well as comments.


The talk raised interest in the topic, with suggestions from the audience on how to assess the importance of interviewers on wave nonresponse in longitudinal surveys.
Year(s) Of Engagement Activity 2013
URL http://www.europeansurveyresearch.org/conference
 
Description Conference presentation: Controlling for prior call record information in adaptive and responsive survey designs 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked interest in accounting for prior call record information when implementing adaptive and responsive survey designs.
Year(s) Of Engagement Activity 2014
 
Description Conference presentation: Evaluation of Interviewer Effects on Nonresponse Bias 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked interest in the field of interviewer effects on nonresponse bias, with valuable comments for the audience to improve the research.
Year(s) Of Engagement Activity 2012
URL http://www.amstat.org/meetings/jsm/2012/program.cfm
 
Description Conference presentation: Improving Process Efficiency in Panel Surveys with Paradata 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked discussions on investigating paradata to improve the process efficiency in panel surveys with interesting suggestions to improve the paper.
Year(s) Of Engagement Activity 2012
URL http://www.ncrm.ac.uk/RMF2012/home.php
 
Description Conference presentation: Interviewer Effects on Measurement Error 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked interest in assessing interviewer effects on measurement errors.
Year(s) Of Engagement Activity 2014
URL http://www.isi2015.org/
 
Description Conference presentation: Interviewer Effects on Wave Non-response in a Longitudinal Survey: A Multilevel Analysis 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked interest in modelling Interviewer Effects on Wave Non-response in a Longitudinal Survey using Multilevel models.
Year(s) Of Engagement Activity 2011
URL http://www.isi-web.org/32-publ/publ/174-proceedings
 
Description Conference presentation: Interviewer Effects on Wave Nonresponse in Longitudinal Surveys 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged a range of questions as well as comments.


The talk sparked interest in interviewer effects on wave nonresponse in longitudinal surveys, originating valuable comments from the audience to improve the paper.
Year(s) Of Engagement Activity 2011
URL http://www.europeansurveyresearch.org/conferences/lausanne-2011
 
Description Conference presentation: Interviewer Effects on the Process Leading to Cooperation or Refusal Using Interviewer Call Record Data 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged a range of questions as well as comments.

The talk sparked interest in interviewer effects on the process leading to cooperation or refusal using interviewer call record data. Several valuable comments have been incorporated in revised versions of this paper.
Year(s) Of Engagement Activity 2011
URL http://www.isi-web.org/32-publ/publ/174-proceedings
 
Description Conference presentation: Investigating Call Record Data using Sequence Analysis: Some Practical Considerations 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked discussions on how to use sequence analysis to investigate call record data, with interesting suggestions on practical aspects of the study.
Year(s) Of Engagement Activity 2013
URL http://www.nonresponse.org/c/503/2013_London_UK/?preid=510
 
Description Conference presentation: Modelling Final Outcome and Length of Call Sequences 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.


The talk sparked discussions in modelling final outcome and length of call sequences , which interesting suggestions to improve the paper.
Year(s) Of Engagement Activity 2013
 
Description Conference presentation: Modelling Final Outcome and Length of Call to Improve Efficiency in Call Scheduling 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk sparked interest in modelling outcome and length of calls for call scheduling efficiency and interesting suggestions have been made for future research in this field.
Year(s) Of Engagement Activity 2014
URL http://www.isi2015.org/
 
Description Conference presentation: Modelling call record data using multilevel modelling: Examples from cross-sectional and longitudinal surveys 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The presentation encouraged a range of questions as well as comments.

The talk raised interest in modelling call record data using multilevel modelling with examples from cross-sectional and longitudinal surveys.
Year(s) Of Engagement Activity 2011
 
Description Conference presentation: Modelling final outcome and length of call to improve efficiency in call scheduling 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentations encouraged a range of questions as well as comments.

The talk sparked interest in modelling final outcome and length of calls for call scheduling efficiency.
Year(s) Of Engagement Activity 2014
URL http://www.southampton.ac.uk/s3ri/news/events/2014/06/26_paradata_from_survey_research_to_practice.p...
 
Description Conference presentation: Sequence analysis as a graphical tool for investigating call record data 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.

The talk raised interest and discussions in using graphical tools for investigating call record data.
Year(s) Of Engagement Activity 2014
URL http://www.southampton.ac.uk/s3ri/news/events/2014/06/26_paradata_from_survey_research_to_practice.p...
 
Description Conference presentation: Using Sequence Analysis to Better Understand Interviewer Calling Patterns: Analysing the UK Understanding Society Survey 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards.


The talk sparked interest in using sequence analysis in the context of interviewer calling patterns.
Year(s) Of Engagement Activity 2013
URL http://www.nonresponse.org/c/503/2013_London_UK/?preid=510
 
Description Short course: Using Paradata to Enhance Survey Design and Analysis (as part of CASS) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The activity was a two day intensive short course. The course participants were very interested in the course and found the course to be directly related to their current research and survey practice work. The majority of course participants came from statistical offices and statistical agencies, from within the UK, Europe and overseas (e.g. Office for National Statistics, Statistical Office of the Republic of Slovenia, Iceland and Ireland). A number of course participants came from market research organisations such as Ipsos Mori.
Course participants comments included: "course handout/packs very good and useful" "very good resource pack, structure and theory then some in-depth analysis for learning process"; sequence analysis and modelling was regarded as particularly useful; "I think that students had very different amounts of prior knowledge. every speaker was able to perfectly include everyone. That is really amazing"; "the webparadata session was great, Mario was really good and the first session on second day was very useful for my work (Gaby and Olga)."; "excellent course very well taught, thank you!"
Based on the answers from the course evaluation forms, all course participants agreed or strongly agreed that the content was interesting; that the event was well structured; the course material was useful; the speaker's level of knowledge was good or very good, the clarity of explanations were clear or very clear.



New developments in the area of paradata have been provided to an international audience and to representatives of international statistical offices. Participants said that they will implement some of the methods in their own research.
Year(s) Of Engagement Activity 2013
URL http://www.s3ri.soton.ac.uk/cass/showcourse.php?id=12102070
 
Description Using paradata to develop hierarchical response propensity models 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Paper presented at the International Workshop on Household Nonresponse, in Slovenia.

Establishing contact is an important part of the response process and effective interviewer calling patterns are critical in achieving contact and subsequent possible cooperation. Recent developments in the survey data collection process have led to the collection of so-called process data or paradata, which greatly extend the basic information on interviewer calls. The project to be presented aims to bui

The paper received high interest from the audience.
Year(s) Of Engagement Activity 2013
 
Description Workshop presentation (Manchester): Modelling length and final response outcome of call sequences in the Swedish Labour Force Survey 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk sparked questions and discussion afterwards

stimulated ideas for further work
Year(s) Of Engagement Activity 2015
 
Description presentation to survey practitioners and market researchers 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact presentation to practitioners: Durrant, G.B., Maslovskaya, O. and Smith P.W. (2018) Uptake and Data Quality in UK Mixed-Device Online Surveys: Results from an Experiment in an ONS Online Household Study, presented at the General Online Research (GOR) conference, March 2018, Cologne. outcome: several survey practitioners (e.g. from the Statistical Office in Germany) talked to me about our findings and had numerous questions and needed further advice.. I am now as a result embedded in a research collaboration with that statistical office.
Year(s) Of Engagement Activity 2018
 
Description presentation to survey practitioners and market researchers 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact presentation to practitioners: Maslovskaya, O., Durrant, G.B., and Smith P.W. (2018) Response quality in mixed-device online survey: Evidence from the Understanding Society Innovation Panel Wave 9 data, presented at the General Online Research (GOR) conference, March 2018, Cologne. - outcome: several survey practitioners (e.g. from the Statistical Office in Germany) talked to me about our findings and had numerous questions and needed further advice.. I am now as a result embedded in a research collaboration with that statistical office.
Year(s) Of Engagement Activity 2018