The Use of Paradata (Field Process Data) in Cross-Sectional and Longitudinal Surveys
Lead Research Organisation:
University of Southampton
Department Name: Statistical Sciences Research institute
Abstract
Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.
Publications
Bruin L
(2018)
A Bayesian analysis of survey design parameters
Casas-Cordero C
(2013)
Assessing the measurement error properties of interviewer observations of neighbourhood characteristics.
in Journal of the Royal Statistical Society. Series A, (Statistics in Society)
Durrant G
(2017)
Using Prior Wave Information and Paradata: Can They Help to Predict Response Outcomes and Call Sequence Length in a Longitudinal Study?
in Journal of Official Statistics
Durrant G
(2015)
Modeling Final Outcome and Length of Call Sequence to Improve Efficiency in Interviewer Call Scheduling
in Journal of Survey Statistics and Methodology
Durrant G
(2014)
Doorstep Interactions and Interviewer Effects on the Process Leading to Cooperation or Refusal
in Sociological Methods & Research
Durrant G
(2013)
Editorial: The use of Paradata in Social Survey Research
in Journal of the Royal Statistical Society Series A: Statistics in Society
Durrant G
(2013)
Analysing Interviewer Call Record Data by using a Multilevel Discrete Time Event History Modelling Approach
in Journal of the Royal Statistical Society Series A: Statistics in Society
Durrant, G.B.
(2018)
Sequence Analysis: A Graphical Tool for Investigating Call Record Data
Durrant, G.B.
(2014)
Modelling Final Outcome and Length of Call to Improve Efficiency in Call Scheduling
Kibuchi E
(2018)
Bayesian methods in adaptive survey designs
Maslovskaya O
(2018)
What do we know about mixed-device online surveys in the UK?
Moore J
(2018)
Correlates of Record Linkage and Estimating Risks of Non-Linkage Biases in Business Data Sets
in Journal of the Royal Statistical Society Series A: Statistics in Society
Moore Jamie C.
(2018)
Correlates of record linkage and estimating risks of non-linkage biases in business data sets
in JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY
Sinibaldi J
(2013)
Evaluating the Measurement Error of Interviewer Observed Paradata
in Public Opinion Quarterly
Vassallo R
(2017)
Separating Interviewer and Area Effects by using a Cross-classified Multilevel Logistic Model: Simulation Findings and Implications for Survey Designs
in Journal of the Royal Statistical Society Series A: Statistics in Society
Vassallo R
(2015)
Interviewer Effects on Non-Response Propensity in Longitudinal Surveys: a Multilevel Modelling Approach
in Journal of the Royal Statistical Society Series A: Statistics in Society
| Description | The key objectives of this research grant were to explore the uses of paradata for cross-sectional and longitudinal surveys with the aim of gaining knowledge that leads to improvement in field process management and responsive survey designs. The development of methodology to make best use of such paradata in statistical models also played a key role. The research project was organised into three interlinked subprojects with the specific aims of: 1) investigating the use of call record data and interviewer observations to study nonresponse in cross-sectional and longitudinal surveys, 2) providing insights into the effects of interviewing strategies and attributes on response, and 3) gaining knowledge about the measurement error properties of paradata. The study has produced a wealth of findings which are outlined in detail in the 12 papers from this project. The key findings are described for each subproject: 1.) Paradata exhibits a complex multilevel structure which needs to be reflected in a statistical model analysing such data. Multilevel discrete time event history models were developed to analyse best times to establish contact and cooperation. Time varying call record information, such as features of the call history and of the current call, play a key role in predicting the outcome of each call. Interviewer observations, e.g. on the type and condition of the house and the presence of dependent children, proved to be useful for predicting the likelihood of cooperation. The novel application of sequence analysis of call record data identified a categorisation of sequences based on length and outcome. Subsequently the project developed models to predict length and final outcome of call sequences. We found that including information from the most recent call outcome very significantly improves prediction. The models developed are currently being used by Statistics Sweden to reduce the number of unproductive calls in the Swedish Labour Force Survey. When analysing the risk of nonresponse bias during data collection, the R-indicator, a measure commonly used after data collection, was shown not to perform well and the use of the delta index and the coefficient of variation are recommended instead. A key finding is that survey estimates tend to stabilise after about 5 calls indicating potential to stop calling after that reducing the number of unproductive calls made. 2.) The research developed multilevel cross-classified and multiple membership models to analyse interviewer effects in a longitudinal survey. The substantive results indicated strongly that the most recent interviewer has the highest influence of nonresponse across waves of a longitudinal survey contrasting earlier findings. The substantive findings confirm that interviewer experience, grade and continuity are significant predictors of non-response, whereas a significant role of interviewer personality traits could not be proven. Regarding the analysis of doorstep interactions, interviewer's experience and confidence of the interviewer were found to play a key role with more experienced and more confident interviewers showing higher likelihoods to achieve cooperation. 3.) Whilst paradata may be subject to measurement error our study revealed a generally high agreement between the interviewer observations and the Census reports, which implies that the interviewer observations we analyzed suffer from minimal measurement error. |
| Exploitation Route | The project reached out to a wide academic audience, comprising researchers in Statistics and Survey Methodology, and researchers in social science disciplines using data from social surveys. The impact of the research has been through academic publications and working papers (15 so far), an edited special issue in an international journal, more than 35 conference papers, 4 sessions at international conferences, an international research symposium and a short course. |
| Sectors | Government, Democracy and Justice,Other |
| URL | http://www.southampton.ac.uk/s3ri/research/projects/the_use_of_paradata_in_cross_sectional_and_longitudinal_surveys.page#overview |
| Description | The work from this project has informed the design and use of paradata in responsive survey designs in a number of governmental statistical offices/settings. |
| First Year Of Impact | 2017 |
| Sector | Government, Democracy and Justice |
| Impact Types | Societal,Economic,Policy & public services |
| Description | Survey Methodology contribution |
| Geographic Reach | National |
| Policy Influence Type | Influenced training of practitioners or researchers |
| Impact | We advised the Office for National Statistics to reduce the number of contact or calls made to a household in interviewer-administered surveys. The ONS has subsequently reduced the number of calls in some key surveys (at least the Labour Force Survey) which led to a reduction in costs without impact on data quality. |
| Description | Collaborative Methodological Research Project "The future of online surveys: Evaluating data quality in the UK probability-based online panel" |
| Amount | £80,000 (GBP) |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 03/2018 |
| End | 08/2018 |
| Description | Secondary Data Analysis Grant 'Understanding survey response behaviour in a digital age: mixed-device online surveys and mobile device use' |
| Amount | £125,000 (GBP) |
| Funding ID | ES/P010172/1 |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 01/2018 |
| End | 10/2019 |
| Description | The ESRC National Centre for Research Methods - Workpackage 1 |
| Amount | £6,249,253 (GBP) |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 01/2015 |
| End | 12/2019 |
| Description | Network Collaboration with Statistics Netherlands and the University of Utrecht |
| Organisation | Statistics Netherlands |
| Country | Netherlands |
| Sector | Public |
| PI Contribution | We had several collaborative meetings where we discussed progress on various new forms of data collection, including online data collection using mixed-device surveys. We discussed new forms of paradata and in particular methods for modelling such data using also Bayesian modelling techniques. We wrote a joint network grant application which was successful (Leverhulme grant). We wrote a joint research paper that we submitted to an international journal (Journal of Survey Statistics and Methodology). A further working paper on Bayesian methods for modelling paradata is also available but not yet submitted to a journal. |
| Collaborator Contribution | We wrote a joint research paper that we submitted to an international journal (Journal of Survey Statistics and Methodology). They had the initial idea to use a Bayesian Modelling approach. |
| Impact | Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology. ; Durrant, G. B., Kibuchi, E., Maslovskaya, O. and Sturgis, P. (2017) Bayesian methods in adaptive survey designs, working paper (not yet submitted). |
| Start Year | 2015 |
| Description | US Census Bureau via the BADEN project |
| Organisation | Government of the United States of America |
| Department | U.S. Census Bureau |
| Country | United States |
| Sector | Public |
| PI Contribution | We wrote a joint paper: Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology ; we discussed our work at several practitioner workshops and at conferences and meetings (also as part of the BADEN project). |
| Collaborator Contribution | We wrote a joint paper. |
| Impact | Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology |
| Start Year | 2015 |
| Description | University of Michigan |
| Organisation | University of Michigan |
| Country | United States |
| Sector | Academic/University |
| PI Contribution | We wrote a joint research paper (Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology) |
| Collaborator Contribution | We wrote a joint research paper |
| Impact | Bruin, L., Schouten, B., Mushkudiani, N., Shlomo, N., Coffey, S., Durrant, G.B., Lundquist, P., Pratt, D. and Wagner, J. (2017) A Bayesian analysis of survey design parameters, submitted to Journal of Survey Statistics and Methodology |
| Start Year | 2016 |
| Description | 1-day International conference organised at the RSS: 'Paradata: From Theory to Practice' |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The day saw a range of invited presentations from national and international presenters (including Frauke Kreuter, Natalie Shlomo, Barry Schouten, Patrick Sturgis, Mario Callegaro and Ulrich Krieger). The conferences was attended by a wide range of participants from different backgrounds, including academia, statistical offices (such as the Office for National Statistics), research institutes and market research organisations (e.g. Ipsos-Mori). We received very positive feedback from the day and with some participants saying that they will try out some of the techniques presented in their own research. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.southampton.ac.uk/s3ri/news/events/2014/06/26_paradata_from_survey_research_to_practice.p... |
| Description | Conference Presentation: When to stop calling? Using call record data to assess nonresponse bias in a longitudinal study |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in assessing nonresponse bias using call record data. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.nonresponse.org/c/510/2014_Reykjavik_Iceland/?preid=488 |
| Description | Conference presentation - Modelling Change of Interviewer: Effects on Nonresponse in Cross-Sectional and Longitudinal Surveys |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentations encouraged a range of questions as well as comments. The talk sparked interest in modelling change of Interviewer when looking at effects on nonresponse in cross-sectional and longitudinal surveys. |
| Year(s) Of Engagement Activity | 2013 |
| Description | Conference presentation- Using call record to analyse the process leading to cooperation or refusal: experience from six household surveys. |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged a range of questions as well as comments. The talk sparked interest in using call record to analyse the process leading to cooperation or refusal, with applications to six household surveys. Valuable discussions raised from the audience, improving a revised version of the paper. |
| Year(s) Of Engagement Activity | 2011 |
| URL | http://www.csdiworkshop.org/index.php/2011-workshop |
| Description | Conference presentation: Evaluating the Measurement Error of Interviewer Observed Paradata |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk raised interest in evaluation of measurement error of interviewer observed paradata, leading to interesting suggestions to improve the paper. |
| Year(s) Of Engagement Activity | 2012 |
| Description | Conference presentation: Using Sequence Analysis to Better Understand Interviewer Calling Patterns: An Example from the UK Understanding Society Survey |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in studying interviewer calling patterns using sequence analysis in a longitudinal study. |
| Year(s) Of Engagement Activity | 2013 |
| URL | http://www.europeansurveyresearch.org/conference/ljubljana-2013 |
| Description | Conference presentation: A simulation study of the effect of sample size and level of interpenetration on inference from cross-classified multilevel logistic regression models |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | National |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentations encouraged a range of questions as well as comments. The talk raised discussions on the effect of sample size and level of interpenetration on inference from cross-classified multilevel logistic regression models, with interesting suggestions to the paper. |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.ncrm.ac.uk/RMF2012/home.php |
| Description | Conference presentation: An Investigation of Interviewer Effects on Measurement Error |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The presentation stimulated discussions on interviewer effects on measurement error. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.amstat.org/meetings/jsm/2014/program.cfm |
| Description | Conference presentation: Analysing Call Record Data in Longitudinal Surveys |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | My talk on modelling length and outcome of call sequences sparked a range of questions as well as comments. In particular I received suggestions on using ROC curves, sensitivity and specificity for further analysis which we subsequently implemented. We believe this improved the paper. The talk sparked interest in modelling length and outcome in longitudinal surveys. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://panelsurveymethods.wordpress.com/ |
| Description | Conference presentation: Analysing and Modelling Paradata |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | National |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparkled interesting discussions on how to analyse and model paradata information. |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.ncrm.ac.uk/RMF2012/home.php |
| Description | Conference presentation: Analysing interviewer call record data using a multilevel multinomial modeling approach to understand the process leading to cooperation or refusal. |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The talk encouraged a range of questions as well as comments. The talk sparked interest in fitting multilevel multinomial modeling to interviewer call record data to understand the process leading to cooperation or refusal. Valuable comments from the audience have been incorporated in the revised versions of the paper. |
| Year(s) Of Engagement Activity | 2011 |
| URL | http://www.amstat.org/meetings/jsm/2011/ |
| Description | Conference presentation: Assessing Nonresponse Bias using Call Record Data with Applications to a Longitudinal Study |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged a range of questions as well as comments from the audience. Ideas for further research have been suggested, such as conducting a simulation study to assess nonresponse bias focusing on hard to reach cases. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.isi2015.org/ |
| Description | Conference presentation: Assessing the Relative Importance of Current and Previous Interviewers on Wave Nonresponse in Longitudinal Survey |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged a range of questions as well as comments. The talk raised interest in the topic, with suggestions from the audience on how to assess the importance of interviewers on wave nonresponse in longitudinal surveys. |
| Year(s) Of Engagement Activity | 2013 |
| URL | http://www.europeansurveyresearch.org/conference |
| Description | Conference presentation: Controlling for prior call record information in adaptive and responsive survey designs |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in accounting for prior call record information when implementing adaptive and responsive survey designs. |
| Year(s) Of Engagement Activity | 2014 |
| Description | Conference presentation: Evaluation of Interviewer Effects on Nonresponse Bias |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in the field of interviewer effects on nonresponse bias, with valuable comments for the audience to improve the research. |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.amstat.org/meetings/jsm/2012/program.cfm |
| Description | Conference presentation: Improving Process Efficiency in Panel Surveys with Paradata |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | National |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked discussions on investigating paradata to improve the process efficiency in panel surveys with interesting suggestions to improve the paper. |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.ncrm.ac.uk/RMF2012/home.php |
| Description | Conference presentation: Interviewer Effects on Measurement Error |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in assessing interviewer effects on measurement errors. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.isi2015.org/ |
| Description | Conference presentation: Interviewer Effects on Wave Non-response in a Longitudinal Survey: A Multilevel Analysis |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in modelling Interviewer Effects on Wave Non-response in a Longitudinal Survey using Multilevel models. |
| Year(s) Of Engagement Activity | 2011 |
| URL | http://www.isi-web.org/32-publ/publ/174-proceedings |
| Description | Conference presentation: Interviewer Effects on Wave Nonresponse in Longitudinal Surveys |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged a range of questions as well as comments. The talk sparked interest in interviewer effects on wave nonresponse in longitudinal surveys, originating valuable comments from the audience to improve the paper. |
| Year(s) Of Engagement Activity | 2011 |
| URL | http://www.europeansurveyresearch.org/conferences/lausanne-2011 |
| Description | Conference presentation: Interviewer Effects on the Process Leading to Cooperation or Refusal Using Interviewer Call Record Data |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged a range of questions as well as comments. The talk sparked interest in interviewer effects on the process leading to cooperation or refusal using interviewer call record data. Several valuable comments have been incorporated in revised versions of this paper. |
| Year(s) Of Engagement Activity | 2011 |
| URL | http://www.isi-web.org/32-publ/publ/174-proceedings |
| Description | Conference presentation: Investigating Call Record Data using Sequence Analysis: Some Practical Considerations |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked discussions on how to use sequence analysis to investigate call record data, with interesting suggestions on practical aspects of the study. |
| Year(s) Of Engagement Activity | 2013 |
| URL | http://www.nonresponse.org/c/503/2013_London_UK/?preid=510 |
| Description | Conference presentation: Modelling Final Outcome and Length of Call Sequences |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked discussions in modelling final outcome and length of call sequences , which interesting suggestions to improve the paper. |
| Year(s) Of Engagement Activity | 2013 |
| Description | Conference presentation: Modelling Final Outcome and Length of Call to Improve Efficiency in Call Scheduling |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in modelling outcome and length of calls for call scheduling efficiency and interesting suggestions have been made for future research in this field. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.isi2015.org/ |
| Description | Conference presentation: Modelling call record data using multilevel modelling: Examples from cross-sectional and longitudinal surveys |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | The presentation encouraged a range of questions as well as comments. The talk raised interest in modelling call record data using multilevel modelling with examples from cross-sectional and longitudinal surveys. |
| Year(s) Of Engagement Activity | 2011 |
| Description | Conference presentation: Modelling final outcome and length of call to improve efficiency in call scheduling |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentations encouraged a range of questions as well as comments. The talk sparked interest in modelling final outcome and length of calls for call scheduling efficiency. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.southampton.ac.uk/s3ri/news/events/2014/06/26_paradata_from_survey_research_to_practice.p... |
| Description | Conference presentation: Sequence analysis as a graphical tool for investigating call record data |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk raised interest and discussions in using graphical tools for investigating call record data. |
| Year(s) Of Engagement Activity | 2014 |
| URL | http://www.southampton.ac.uk/s3ri/news/events/2014/06/26_paradata_from_survey_research_to_practice.p... |
| Description | Conference presentation: Using Sequence Analysis to Better Understand Interviewer Calling Patterns: Analysing the UK Understanding Society Survey |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The presentation encouraged and stimulated engagement with the topic, raised questions from the audience and discussions afterwards. The talk sparked interest in using sequence analysis in the context of interviewer calling patterns. |
| Year(s) Of Engagement Activity | 2013 |
| URL | http://www.nonresponse.org/c/503/2013_London_UK/?preid=510 |
| Description | Short course: Using Paradata to Enhance Survey Design and Analysis (as part of CASS) |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The activity was a two day intensive short course. The course participants were very interested in the course and found the course to be directly related to their current research and survey practice work. The majority of course participants came from statistical offices and statistical agencies, from within the UK, Europe and overseas (e.g. Office for National Statistics, Statistical Office of the Republic of Slovenia, Iceland and Ireland). A number of course participants came from market research organisations such as Ipsos Mori. Course participants comments included: "course handout/packs very good and useful" "very good resource pack, structure and theory then some in-depth analysis for learning process"; sequence analysis and modelling was regarded as particularly useful; "I think that students had very different amounts of prior knowledge. every speaker was able to perfectly include everyone. That is really amazing"; "the webparadata session was great, Mario was really good and the first session on second day was very useful for my work (Gaby and Olga)."; "excellent course very well taught, thank you!" Based on the answers from the course evaluation forms, all course participants agreed or strongly agreed that the content was interesting; that the event was well structured; the course material was useful; the speaker's level of knowledge was good or very good, the clarity of explanations were clear or very clear. New developments in the area of paradata have been provided to an international audience and to representatives of international statistical offices. Participants said that they will implement some of the methods in their own research. |
| Year(s) Of Engagement Activity | 2013 |
| URL | http://www.s3ri.soton.ac.uk/cass/showcourse.php?id=12102070 |
| Description | Using paradata to develop hierarchical response propensity models |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Paper presented at the International Workshop on Household Nonresponse, in Slovenia. Establishing contact is an important part of the response process and effective interviewer calling patterns are critical in achieving contact and subsequent possible cooperation. Recent developments in the survey data collection process have led to the collection of so-called process data or paradata, which greatly extend the basic information on interviewer calls. The project to be presented aims to bui The paper received high interest from the audience. |
| Year(s) Of Engagement Activity | 2013 |
| Description | Workshop presentation (Manchester): Modelling length and final response outcome of call sequences in the Swedish Labour Force Survey |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | Yes |
| Geographic Reach | International |
| Primary Audience | Other academic audiences (collaborators, peers etc.) |
| Results and Impact | Talk sparked questions and discussion afterwards stimulated ideas for further work |
| Year(s) Of Engagement Activity | 2015 |
| Description | presentation to survey practitioners and market researchers |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | presentation to practitioners: Durrant, G.B., Maslovskaya, O. and Smith P.W. (2018) Uptake and Data Quality in UK Mixed-Device Online Surveys: Results from an Experiment in an ONS Online Household Study, presented at the General Online Research (GOR) conference, March 2018, Cologne. outcome: several survey practitioners (e.g. from the Statistical Office in Germany) talked to me about our findings and had numerous questions and needed further advice.. I am now as a result embedded in a research collaboration with that statistical office. |
| Year(s) Of Engagement Activity | 2018 |
| Description | presentation to survey practitioners and market researchers |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | presentation to practitioners: Maslovskaya, O., Durrant, G.B., and Smith P.W. (2018) Response quality in mixed-device online survey: Evidence from the Understanding Society Innovation Panel Wave 9 data, presented at the General Online Research (GOR) conference, March 2018, Cologne. - outcome: several survey practitioners (e.g. from the Statistical Office in Germany) talked to me about our findings and had numerous questions and needed further advice.. I am now as a result embedded in a research collaboration with that statistical office. |
| Year(s) Of Engagement Activity | 2018 |