A blended learning course in quantitative methods for UK sociology, social policy and political science undergraduates.

Lead Research Organisation: University of Edinburgh
Department Name: Sch of Social and Political Science

Abstract

We will reconfigure and expand University of Edinburgh's 20 credit M level blended learning course 'Core Quantitative Data Analysis' (CQDA) to provide approximately 60 credits worth of learning resources for use under a creative commons license by any UK HEI for training undergraduates in QM. These resources may be used 'off the shelf' as a complete course in QM (and accessible as such by any UK HEI undergraduate), or individual components can be integrated into existing courses by QM teaching staff.

The CQDA course has been developed over five years, using resources from an Edinburgh University E-learning initiative, to deliver training in QM up to ERSC PG generic requirements level. It is based on the philosophy that students learn QM best when they are presented as a way of resolving problems encountered in research, and learned by repeated practice using real data. It follows Tukey (1977) and Marsh's (1982) emphasis on data exploration, but includes a critical discussion of inference and the value and limits of hypothesis testing. It is highly interactive, using screen animation, videos and question/feedback tests requiring students to use real data to solve problems in order to complete each module. The course aims to show students the relevance and value of QM, as well as giving them confidence to apply QM in practice. The course has delivered improved and excellent results from the cohorts of students taking it (around 150 each year), praise from externals and extremely positive feedback from students. A feature of the course is the way it allows limited staff time to be concentrated on helping students who need most support.

To maximise usability in diverse curriculum contexts, we will migrate the existing course learning resources, authored in Adobe Dreamweaver and Captivate, to a user-friendly open access content management system that will allow teachers and course organisers to rearrange and customise the material to their particular needs with the minimum of effort. Edinburgh will host the resources on its servers, downloadable by users in other HEIs. We will produce new discipline specific content for sociology, criminology, social policy and political science students. We will re-write modules to base all examples and exercises on European Social Survey and World Bank teaching datasets that will not require student or teacher registration for use (currently the course uses GHS, BSAS, SSAS and other datasets). We will separate the course material from the software platform to be used (currently SPSS) allowing the course to be used with SPSS, Stata or R. We will add a much larger volume of self/tutor test exercises at the end of each module which may be used for either self- or summative assessment, and use learning assessment exercises within modules to route students through relevant support material

We will adapt the course content to undergraduate level by producing additional modules on sources of data, on data visualisation, and on secondary data analysis, and by adapting the course materials to a wider range of student abilities. One of the current features of the course is its ability to use its web format to present material that will engage stronger students, but which can safely be ignored by weaker students wishing to concentrate on the basics, and to incorporate material that weaker students require but which stronger students can skip past. The web learning modules thus have a flexibility that is difficult to achieve in lecture or seminar formats.

We will monitor the use of the learning materials, revise and review them in the light of teachers' and students' feedback, and continue to maintain the learning resources server and links for three years. At the end of this period we will curate and archive the materials so that they continue to be available for use.

Planned Impact

The web based learning, teaching and assessment materials will help UK social science departments to either start or expand their QM teaching activity at undergraduate level.
They will make it easier for departments to increase the contact hours associated with QM training, give undergraduates more space in which to practice and develop their QM skills, and to concentrate their support efforts upon the students who most need it.
They will help disseminate best practice in undergraduate QM teaching across UK universities and encourage the shift of methodology towards a more central place in the undergraduate curriculum.
They will encourage more students to consider secondary data analysis in their project work and give the the skills necessary to do such analysis.
They will increase the supply of QM proficient social science graduates able to properly consider and use QM approaches in PG study or in employment.
 
Description We had key findings listed before so I'm not sure where they went!
Exploitation Route By employing the resources and adapting them to different software.
Sectors Education,Government, Democracy and Justice

 
Description We have used the online learning materials both for PG and UG courses as well as for continuous professional development courses delivered by team members. I have broken the uses into groups by type. Used as core teaching material: School of Social and Political Science: Core Quantitative Data Analysis, 200+ PG students each time, 2013, 2014 School of Social and Political Science. Summer Conversion course for students transferring into 4 degrees (Politics with Quantitative Methods, IR with Quantitative Methods, Social Policy with Quantitative Methods, Sociology with Quantitative Methods), 25 students, 2014 Used as a supplementary sources of additional activities: Academy of Government: Analysis for Public Policy, 30 Masters in Public Policy (MPP) students each time, 2013, 2014. Approximately half of the MPP students are civil servants. School of Social and Political Science: Introduction to Political Data Analysis, 160 UG students in 2nd year, 2015 In addition, we have established a website to advertise and distribute the material. The website contains summary information about the project and has had, since early 2014, a sample of the first two modules for those interested in the course. The website now contains these same resources along with two additional resources: documentation to provide those using the course with essential information about hosting the product, downloading it, managing access for students etc; and 3 versions of the course, one for SPSS, one for Stata and one for R. To maximize impact we have advertised this site widely, both to our Edinburgh-based networks such as AQMeN (Applied Quantitative Methods Network) and various UK-wide distribution lists, including through the Political Studies Association's new sub-group on quantitative methods teaching. Team members have also delivered several presentations on the material (to AQMeN, PSA and the European Political Science Association) Summer Conversion course We have used the materials for undergraduate summer conversion course to 'with quantitative methods degrees' in 2014 and 2015
First Year Of Impact 2013
Sector Education,Government, Democracy and Justice
Impact Types Societal,Policy & public services

 
Description Use of blended learning materials by PG and UG students
Geographic Reach National 
Policy Influence Type Influenced training of practitioners or researchers
Impact We have used the learning materials several times: Core Quantitative Data Analysis, 2013, 2014, Analysis for Public Policy, 2013, 2014 Summer School Conversion Course for 20 students pursuing new quantitative methods degrees in the School of Social and Political Science Introduction to Political Data Analysis, 2015 Statistical Literacy, 2014 These opportunities provided us with a varied student population. CQDA is targeted at PG research students (EG MScR and PhD), Analysis for Public Policy is an executive education programme. It is composed primarily of civil servants. The Conversion Course was for students who needed to achieve an intermediate level of knowledge in QM so that they could pursue more advanced quants courses in their degrees. IPDA was an introductory course for 2nd year political science students. Statistical Literacy uses the data visualisation component. It is a course targeted at first years. Each of these will employ the materials again in academic year 2015-2016. Due to our expanded complement of quantitative courses as a result of our successful QStep bid, we have also arranged for the materials to be used in some of the new QStep courses related to the 'with quantitative methods' degrees and the 'regular' degrees: Mathematics for Social Science (All QStep 'with quantitative methods' degrees, 1st year). Primarily first module on maths refresher Introduction to Statistics for Social Science (all QStep 'with quantitative methods' degrees, 1st year) Designing and doing social research (3rd year UG course required for all Social Policy and Sociology joint and single honours students) In addition, Introduction to Politics & International Relations, the 1st year required course for all single and joint honours Politics and IR students (n=200), will include a data visualisation section, which will draw on the material in the online data visualisation module
URL http://www.q-step.ed.ac.uk/home
 
Description Use of blended learning materials by staff
Geographic Reach National 
Policy Influence Type Influenced training of practitioners or researchers
Impact In 2013, when we re-launched the full learning materials for use with the CQDA class in autumn 2013 we advertised the existence of our online learning materials to staff in the School of Social and Political Science, alerting them to the fact that they could pursue this online course at their own pace. Since then 13 staff have requested access to the materials.
 
Description Nuffield QStep Centre
Amount £1,460,000 (GBP)
Organisation Nuffield Foundation 
Sector Charity/Non Profit
Country United Kingdom
Start 01/2013 
End 01/2018
 
Title Blended learning online material 
Description This is the main output of our grant, online learning materials for undergraduate social scientists. The produce is targeted at HEIs who can then select which modules the wish to use. The materials are currently compatible with SPSS, Stata and R There are 12 modules covering different topics from data visualisation to logistic regress to probability. The resources have self test material, an enhanced library and discipline specific examples as well as tutorial activities. All activities use publicly available datasets (in our case the European Social Survey and United Nations Development indicators. We have practice and full versions of datasets to introduce students to the data slowly. 
Type Of Technology Webtool/Application 
Year Produced 2013 
Impact We have used the redesigned material to teach students in academic years 2013-2014 and 2014-2015, reaching approximately 900 students in total. The materials have been evaluated after each use so that improvements could be made. This will all continue in academic year 2015-2016, where we will be using the online materials in all our existing courses as well as four new ones, two targeted at QStep students pursuing 'with quantitative methods' degrees and two targeted at 'regular' students, including a College-wide course in Statistical Literacy. 
URL http://www.ugquants.sps.ed.ac.uk/
 
Title Blending learning material website 
Description We have developed a website to showcase and market our online learning materials so that users may access sample modules and determine if they would be useful for them to acquire. The website began in 2013 and featured introductory information about the project and the online materials, as well as a sample of the first two modules (Introduction and univariate statistics) so that academics and students could test out the material to see if they thought it would be useful for them to employ in whole or in part in their courses. The website now includes two additional sections. First, it now includes full versions of the online learning materials for SPSS, Stata and R, so that users can deploy it in courses using different software. Second, it now includes detailed technical documentation for the IT support staff who will be downloading, installing and managing access to the material. The online learning materials are all distributed free of charge. 
Type Of Technology Webtool/Application 
Year Produced 2013 
Impact We have a growing list of potential users who we keep up to date with a routine newsletter and make them aware of developments and improvements. We have received more invitations to speak at different events than we can accommodate. Details of accepted invitations are listed elsewhere. 
URL http://www.ugquants.sps.ed.ac.uk/
 
Description Conference presentation (AH 2012) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Ailsa Henderson, " Developing a Quantitative Methods Research and Teaching Research Group" Applied Quantitative Methods Network. Talk informed room of 30 participants about developments in QM research and teaching in Edinburgh. Central to this was the development of our ESRC-funded online learning materials.

Participants provided their email addresses and were emailed when the sample module was available online. A handful had offered to read the material and were sent the links early so that they could provide advice on structure.
Year(s) Of Engagement Activity 2012
 
Description Conference presentation (AK 2013) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Alison Koslowski delivered a presentation on the online learning materials and quantitative methods research and teaching group at the University of Edinburgh to the UK's Quantitative Teachers' Workshop held 31 Jan 2013 at the Royal Statistical Society in London.

This provided a useful opportunity to both disseminate information about the project as well as to gather suggestions for the learning materials.
Year(s) Of Engagement Activity 2013
 
Description Conference presentation (AT 2013) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Andrew Thompson "QM Teaching and Research in politics and international relations at the University of Edinburgh";
PSA QM Network Inaugural Conference, Oxford, December 2013 Talk to conference of 50 composed of members of the Political Studies Association who teach on quantitative methods. 50 people in audience.

Useful for establishing contacts with potential users of our online materials.
Year(s) Of Engagement Activity 2013
 
Description Conference presentation (AT and AH 2014) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Andrew Thompson and Ailsa Henderson Blending Quantitative Skills with Substance: Teaching Developments at Edinburgh; European Political Science Association, Edinburgh, June Talk to conference of 500+ political scientists (50 attended talk) about our blended learning online materials. The talk is also hosted on the EPSA site so that other researchers may access it.

Useful for sharing best practice, receiving suggestions for improvements and raising awareness of our online materials.
Year(s) Of Engagement Activity 2014
URL http://www.epsanet.org/general-conference-2014.html
 
Description Conference presentation (JM 2014) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Alison Koslowski was to deliver a presentation on the online learning materials at the July 2014 Research Methods Festival in Oxford. The panel was on Teaching Quantitative Methods. Due to illness the presentation was delivered by John MacInnes.

The presentation provided an opportunity to gather names of possible interested users as well as to learn of possible improvements to the material.
Year(s) Of Engagement Activity 2014
URL http://www.ncrm.ac.uk/RMF2014/programme/session.php?id=I5
 
Description Invitation to Edinburgh to Mona Chalabi 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact To improve our module on data visualisation we invited Mona Chalabi, a former Edinburgh alumna and Guardian journalist to speak about data visualisation 12 Feb 2014. Mona provided a presentation 'Making Numbers Count in the Real World' to interested staff and students at Edinburgh on the importance of data visualisation.

We used some of her suggested tools and best practice within the reworked data visualisation module.
Year(s) Of Engagement Activity 2014