Building capacity in quantitative methods for social science - Survey Skills Quantitative Methods Lecturer Programme (SSQMLP)

Lead Research Organisation: NatCen Social Research
Department Name: Research Department

Abstract

Our proposal is to develop and deliver a one year pilot Survey Skills Quantitative Methods Lecturer programme (SSQMLP) which would, given appropriate funding, be reproducible in subsequent years and replicable across the UK and NI. It will be open to all lecturers and postgraduate students with responsibility for teaching social science undergraduates in the UK HE and FE sector. The programme will be based in 5 localities within the UK and lecturers will join the programme for three academic terms.

The three main objectives of the programme are to:
1. Improve lecturers' confidence in teaching quantitative methods and survey research skills to undergraduate students
2. Extend lecturers knowledge of freely-available research resources such as the ESDS, Administrative Data Service, UK Data Archive etc
3. Extend their knowledge of key survey research methods, teaching resources and techniques.
Participants will form a Local Action Learning Network (LALN) which will be supported and facilitated by the SSQMLP team. Action Learning is a well-tried method of accelerating learning by doing. It brings together a group of people with varied levels of skills and experience to analyse a problem and develop an action plan, working together to solve problems and learn under guidance from a facilitator posing probing questions and supportive challenges.
The SSQMLP team will help participants to identify learning goals, to learn collaboratively building upon their existing experience and knowledge and to provide one another with peer support. The SSPQMLP will also provide a range of capacity-building and training opportunities covering all aspects of the survey research process. The three main components of the programme will be:
Key element 1: Face to face action learning
Members of a LALN will be free to meet as frequently as they choose. However, the SSQMLP will facilitate 6 face-to-face events which will provide networking opportunities in addition to meeting specific action learning objectives. Each term there will be a one-day workshop and a separate early evening networking and learning event. These events will provide:
1. increased awareness of the survey research process and quality indicators
2. awareness and confidence in the use of the range of on line survey research resources available for quantitative teaching purposes
3. greater confidence in teaching quantitative methods
4. new tools and techniques for engaging students in learning related to quantitative research
5. an opportunity to network with and learn from their peers across social science disciplines
6. time to reflect on their teaching practices

Key element 2: On-line resources
All participants will benefit from access to on-line resources. We will develop an online community network for programme participants to pose questions and share their experiences, knowledge and learning. There will be an e-library of online resources to help their teaching - for example:
1. A 'how to' guide to using secondary data sources
2. Key sessions and presentations made available in the form of digital web and pod casts and via webinars for participants unable to attend in person
3. Online signposting to other ESRC and non ESRC training and teaching resources

Key element 3: Optional individual placements
The current Survey Skills Programme has built excellent relationships with the major UK survey organisations. The SSQMLP will build on these relationships to provide participants with optional individual placements to gain a first-hand insight into the survey process in the 'real world' and to improve their skills and understanding of survey research methods. These placements could include:
1. Accompanying an interviewer
2. attending a briefing for interviewers
3. shadowing a survey team from one of the survey organisations or working on a specific element of the survey process

Planned Impact

There are five groups of key beneficiaries i) lecturers on the programme ii) their students iii) lecturers across the UK who can make use of the online resources and case studies iv) universities from improved quantitative skills in their students v) the wider research community - better informed researchers joining the profession, better use of evidence in all sectors.; vi) employers more widely through employing graduates with increased numeracy and data awareness.

Lecturers on the SSQMLP will benefit from increased skills, knowledge and confidence in teaching QM to undergraduates. Participation in the programme will improve their skills in survey research, deepen their understanding of the challenges of running a survey in the field and enhance their knowledge about key survey research methods, teaching resources and techniques.

The undergraduates taught by lecturers who are or have been on the programme will benefit from enthusiastic knowledgeable lecturers who are using appropriate resources.

The universities will benefit from improved quantitative skills in their lecturers and students, improving the reputation for their courses and their ability to produce graduates with recognised QM skills.

The wider research community will benefit from better informed researchers joining the profession and better use of evidence in all sectors.

Employers will benefit more widely through employing graduates with increased numeracy and data awareness. In strengthening the teaching of quantitative skills to undergraduates during their degree, the SSQMLP will contribute to a better equipped graduate workforce. This will benefit employers in the commercial, public and third sectors who are demanding improved numeracy and quantitative skills from their graduate recruits. In turn this will bridge the gap between academics and applied policy and will develop the pool of graduates equipped to enter survey research in the UK and in doing so benefit the wider research community. Graduates with better QM skills will produce more robust analyses which will ensure that decisions in all sectors are made based on appropriate evidence.

Publications

10 25 50
 
Description The main objectives of this project were to:

- Support QM lecturers with teaching quantitative methods and survey research skills by extending their repertoire of teaching methods, building their confidence, and deepening their knowledge of existing survey data resources and teaching techniques
- Develop a network of champions who are actively promoting undergraduate QM teaching

We delivered 16/18 events (three per year in each of the three regional locations) planned. In total 76 lecturers took part in the programme across the two years despite recruiting over 220 in total. We developed an online forum for network members to use as a locus for sharing information, resources and as a place to host discussions. Most participants signed up as members but active usage was low.

The face to face workshops included:
- a speaker discussing a specific topic (we had eight external speakers covering topics as diverse at data visualisation, scaffolding for curriculum innovation and teaching statistics)
- action learning sets around challenges/issues identified by participants
- discussion of specific pedagogical issues

The action learning sessions worked really well, participants came with a specific challenge or issue and then worked with other set members to explore their issue and come up with solutions or fresh approaches. The sets took up two-thirds of each workshop and have proved valuable in moving participants forward.

The end of programme evaluation identified the following as areas where participants found the greatest value:
- 94% felt more confident about making QM lectures more engaging and stimulating
- 75% were more confident about teaching statistics
- 70% were more confident about teaching research methods
- 38% felt they had expanded their own personal knowledge of different research methods and 40% of different teaching strategies

The greatest gains in knowledge and skills were also found in these five areas, hitting the key targets of the programme.

Overall, 78% of survey respondents felt the programme had increased their knowledge of teaching research methods and 64% felt it had increased their capability to teach students quantitative methods. 86% said they would recommend the programmes to colleagues.

"Very professionally run, some excellent speakers, good networking opportunities. A great idea"

"Really, really good. I am still implementing some of the ideas I had in the workshops"

"I had an excellent experience and gained a lot of knowledge and more confidence in approaching quantitative methods."

Participants reported greater confidence in their own knowledge of quantitative methods, how to teach methods in a more engaging and accessible manner and greater confidence in their toolkit of teaching strategies. The action learning sets have provided a close-knit community of peer support for early-career lecturers which will continue through individual relationships as an informal group for peer support on Google+. We expect students to notice an appreciable change in their lecturers approach to teaching methods and that this will have an impact on overall achievement and engagement with quanitative methods. We hope the social network on Google+ will grow and be made available to other quantitative lecturers and we will make the teaching materials from formal taught sessions available to others. We will also share our learning from using action learning sets as a way to encourage lecturers to change and transform their existing teaching practice.
We will be using a case studpedadogical approaches to support research methods teaching and teachers in the forthcoming special pedagocial issues of the International Jounral of Social Research.

We presented the model and outcomes to the wider CI/RDI network at an event in September 2014 and would be happy to share our learning with new Q-Step centres who have recently appointed a tranche of quantitative methodology

Through producing a cohorts of students better equipped to manage quantitative data we expect the CI/RDI programmes, ours included will lead to a better skilled workforce.
Exploitation Route The programme has applicability to all social science programmes in the UK and we can provide guidance and support to HEIs keen to implement a similar programme for their lecturers.
Sectors Education

 
Description The project was a capacity building programme for lecturers, the lecturers have returned to their HEIs to apply the knowledge and skills learnt in their teaching. We provided a poster presentation to the RDI/CI conference on the 24th September 2014 to further disseminate the findings. We will be submitting articles using this project as a case study of developing quantitative teaching methods over the next few months.
First Year Of Impact 2014
Sector Education
Impact Types Policy & public services