Aiming for construct equivalence in cross-national social surveys: developing best practice protocols for cross-national cognitive interviewing

Lead Research Organisation: City, University of London
Department Name: School of Social Sciences

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.

Publications

10 25 50
 
Description Cognitive interviewing is a technique used to see how people answering questionnaires understand them. This project developed a method for implementing that technique when testing questionnaire across different countries and languages. It also led to the development of a typology that allows researchers to identify the source of any problem eg poor translation or conceptual challenge.
Exploitation Route The methodology for conducting cognitive interviews cross-nationally has been adopted by researchers at the National Centre for Health Statistics in the USA. The methodology has also been adopted on the European Social Survey (but note PI of this project is ESS Director).
Sectors Energy,Environment,Healthcare,Government, Democracy and Justice,Other

URL http://www.city.ac.uk/arts-social-sciences/sociology/research/centre-for-comparative-social-surveys
 
Description The methodology for conducting cognitive interviews on cross-national projects has been adopted by the National Centre for Health Statistics in the USA. It has also become included in pre-testing for rounds of the European Social Survey. This in turn has led to improved measures in surveys conducted internationally. As a result there is better comparative measurement of key societal topics. The work has also been cited by leading scholars in the filed (eg Collins et al 2014) and it is hoped this will lead to increased knowledge and interest in the topic.
First Year Of Impact 2009
Sector Energy,Environment,Healthcare,Government, Democracy and Justice
Impact Types Societal

 
Description European Research Infrastructure Connsortium
Amount € 2,300,000 (EUR)
Organisation European Social Survey: European Research Infrastructure Consortium (ESS ERIC) 
Sector Charity/Non Profit
Country European Union (EU)
Start 12/2013 
End 05/2017
 
Title Cross-National Error Source Typology (CNEST) 
Description A typology to identify errors specific to cross-national questionnaire design and implementation. 
Type Of Material Improvements to research infrastructure 
Year Produced 2009 
Provided To Others? Yes  
Impact The tool has been used in pre-testing for the European Social Survey. 
URL http://www.city.ac.uk/__data/assets/pdf_file/0014/125132/CCSS-Working-Paper-No-01.pdf
 
Title Method for conducting cross-national cognitive interviewing 
Description A methodology for conducting cross-national cognitive interviewing in an equivalent manner. 
IP Reference  
Protection Protection not required
Year Protection Granted 2009
Licensed Yes
Impact The method for conducting cross-national cognitive interviewing has been adopted by researchers at the National Centre for Health statistics in the USA.
 
Description Fitzgerald R & Miller K (2009), 'Design and Analysis of Cognitive Interviews for Cross-National Testing', Invited paper presented at the 6th CSDI Workshop, Ann Arbor USA, 5-7 March, 2009 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk sparked comparisons with scholars who had done related work in this area. Fitzgerald R & Miller K (2009), 'Design and Analysis of Cognitive Interviews for Cross-National Testing', Invited paper presented at the 6th CSDI Workshop, Ann Arbor USA, 5-7 March, 2009

Work as been cited by other scholars working in the field.
Year(s) Of Engagement Activity 2009
URL http://csdiworkshop.org/v2/images/2009/CSDI_202009_20Program-FINAL.pdf
 
Description Fitzgerald R, Prestage Y, Gatrall L (2013), 'A Versatile Tool? The Cross National Error Source Typology (CNEST): An Application to Triangulated Pre-test Data' American Association of public Opinion Research Conference, Boston 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk sparked questions and discussions afterwards.

Not aware of any impact to date.
Year(s) Of Engagement Activity 2013