Training Workshops on Modelling Mechanisms of Change Using Longitudinal Archived Data

Lead Research Organisation: University of Ulster
Department Name: Sch of Psychology

Abstract

Many social scientists are interested in investigating longitudinal change. For example, a educational researcher may be interested in how academic ability develops during childhood, an economist may be interested in how levels of personal debt changes during a recession, or a political scientist may be interested in how attitudes towards political parties change. There are now statistical methods available which are useful in describing the patterns of longitudinal change, both at the group level of the individual level. Latent growth models provide a powerful and flexible approach to describing longitudinal change.

Current developments in statistical modelling now allow social science researchers to move beyond simply describing longitudinal change and model the mechanisms and processes that underlie such changes. So, for example, a researcher could examine those individual (e.g. self-esteem, personality), social (e.g. socioeconomic status, parental educational achievement), and contextual (e.g. school and teacher characteristics) factors that may influence, or predict, how academic ability develops during childhood. This allows for the mechanisms and processes that determine change to be better understood. Such models can be formulated and tested using a flexible and powerful statistical framework known as latent variable modelling (LVM).

Although UK social scientists can avail of training in descriptive models of longitudinal change using LVM, there is no provision for comprehensive training in the use of those models that allow for the mechanisms and processes to be examined. This project aims to provide high quality training for UK social scientists in the application of these models. Workshops will be delivered three times a year, for three years, in three different locations (Belfast, London, and Stirling). Each workshop will last two days and comprise lectures and practical sessions. One important aspect of the workshops is that they will be based on datasets from the UK Data Archive which provides the largest collection of data in the social sciences in the UK. The benefits of using secondary data analysis have been demonstrated when there is clear integration of statistics and substantive issues. In order to maximise the impact of the workshops there will be follow-up webinars, the training materials from the workshops will also be archived on a dedicated website, and the specialist software will remain with the host institutions.

The programme of training will provide UK researchers and research students the opportunity to take part in training in state of the art statistical methods that allow complex hypotheses relating to the nature and mechanisms of change to be formulated and tested.

Planned Impact

The outcomes of the training activities will produce:
*More social science researchers and research students with a broader knowledge and understanding of statistical models for the analysis of change and mechanisms of change.
*More social scientists that will be critical consumers of research published findings that employ longitudinal multivariate analysis.
*The potential for teaching academics who will incorporate more contemporary longitudinal multivariate analysis into their curriculum.
*An accessible resource of teaching and support materials to enhance analytic skills and knowledge in the area of longitudinal analysis.
*A portal to access the main sources of archived datasets in the UK.
*A long term understanding that data analysis is an integral part of the research process.
*Ongoing support and access to specialised software as a legacy of the project.

Publications

10 25 50
 
Description The primary aim of this training programme was to "Provide high quality training in advanced multivariate statistical models that can elucidate processes and mechanisms of change". We have found that the 2-day training programme that we ran in Ulster (Ulster University), London (University of East London) and Scotland (Stirling) during September 2015 met this main objective. Each of the workshops was oversubscribed which indicated that that there is significant unmet need for such training. Furthermore, the vast majority of those that attended the courses reported that they agreed or strongly agreed that the course "was useful in developing understanding of latent variable modelling" (87.5%). In addition there was evidence that the attendees intended to use latent variable modelling in their research (66.7%), use latent variable modelling in publications and reports (59.6%), and that the course made them better researchers (92.6%).

The workshops ran again in 2016 with high levels of demand: Ulster (Ulster University:12/12), London (University of East London: 11/12) and Scotland (Stirling: 11/12). The feedback on the workshops was positive.

Percentage of participants who Agreed/Strongly Agreed

The training courses was useful in developing my
understanding of statistics in general (100%)
The training courses was useful in developing my
understanding of latent variable modelling (100%)
Since the course I intend to use latent variable
modelling in my research (100%)
Since the course I intend to use latent variable
modelling in publications or reports (100%)
Since the course I have discussed latent variable
modelling with other researchers (84.6%)
I feel more confident now reading journal articles
that use latent variable modelling (92.3%)
The training course helped me become a better researcher (100%)

Percentage of participants who were Satisfied/Very Satisfied
Course materials (100%)
Course delivery (100%)
Course structure (100%)
Practical exercise (100%)
Presenters (100%)
Length of workshop (92.3%)
Exploitation Route The feedback indicates that there is still unmet need in terms of advanced training in quantitative methods.
Sectors Communities and Social Services/Policy,Education,Environment,Healthcare

URL http://modellingchange.com/
 
Description We have been in continued communication and correspondence with many of the researchers that have attended the workshops and it is clear that- 1. There is an increased awareness, and use, of archived data. 2. There has been an increased appreciation of the flexibility and power of testing longitudinal models within a LVM framework. 3. Course attendees from different universities, and different schools within the same universities, have developed research collaborations. 4. The availability of the relevant software has increases the use of LVM techniques. 5. Our contacts at University of East London and Stirling University have both indicated that there has been continued use of the LVM software that was part of the project's legacy.
First Year Of Impact 2015
Sector Education,Healthcare
Impact Types Cultural

 
Description Stirling University 
Organisation University of Stirling
Department Faculty of Psychology
Country United Kingdom 
Sector Academic/University 
PI Contribution Joint delivery of training workshops
Collaborator Contribution Room provision and technical support
Impact Participants on the workshops can- • critically evaluate the statistical analysis used in current literature • access a range of data available in the UK data archives • able to apply a given statistical model, produce output and interpret results • understand the range of statistical models that can be used • develop further their analytic skills through accessing web-based resources • test more complex social science hypotheses • become more critical consumers of the research literature that employs latent variable modeling • test hypotheses based on large scale, cross cultural data sets • increase quality of publications • access software in both universities • make use of the range of data available in the UK data archive • develop informal networks of researchers and students involved in latent variable modelling. • benefit from research findings that are derived using a strong methodological and statistical approach • further disseminate knowledge and skills obtained in the programme as they take on careers as academics and researchers
Start Year 2014
 
Description University East London 
Organisation University of East London
Department School of Psychology East London
Country United Kingdom 
Sector Academic/University 
PI Contribution Joint delivery of training workshops
Collaborator Contribution Provision of teaching facilities, administrative support and technical support.
Impact Participants on the workshops can- • critically evaluate the statistical analysis used in current literature • access a range of data available in the UK data archives • able to apply a given statistical model, produce output and interpret results • understand the range of statistical models that can be used • develop further their analytic skills through accessing web-based resources • test more complex social science hypotheses • become more critical consumers of the research literature that employs latent variable modeling • test hypotheses based on large scale, cross cultural data sets • increase quality of publications • access software in both universities • make use of the range of data available in the UK data archive • develop informal networks of researchers and students involved in latent variable modelling. • benefit from research findings that are derived using a strong methodological and statistical approach • further disseminate knowledge and skills obtained in the programme as they take on careers as academics and researchers
Start Year 2014