Network on Intrapersonal Research in Education (NIRE)

Lead Research Organisation: University of Oxford
Department Name: Education

Abstract

Modern technology allows researchers to collect vast amounts of data through self-reports and automated applications. Data and analytic methodologies are complex. Although society is interspersed by a Zeitgeist of the "quantified self", there is not yet a coherent view of how we can enhance and understand learning processes through the innovative use of technology. The primary concern of the seminar is to analyse key methodological advances and challenges to study learning processes, to consider the potential of rapidly advancing technology in multiple disciplines, and to explore the implications for policy and practice of the conclusion.

Learning in defined as a process that takes place in a series of situations linked together over time. Our focus is on an intrapersonal approach to research on educational processes, meaning that we concentrate on sequences of learning situations, states of mind, and events in real-time. Students do experience the learning process in real-time, not in average situations. There is evidence that effective formative feedback (i.e., teacher feedback aimed at the forwarding students' learning) and enhancement of children's meta-cognition (i.e., the learners' understanding of their own ways of learning) are linked with academic performance. As the forthcoming change in curricula for primary and secondary schools in the UK, starting autumn 2014, places increased responsibility of formative assessment with the teacher and the school, the development and implementation of technological tools which enhance learning processes appear timely.

Our network is grounded in existing research collaborations (co-authorships, academic visits, workshops and presentations at conferences), particularly between researchers in the UK (University of Oxford and York), Finland (Universities of Jyväskylä and Helsinki) and Germany (University of Darmstadt, Munich and Konstanz). We propose a series of six seminars to which we will invite international experts from various backgrounds, early career researchers, educational practitioners and policy makers to share knowledge with each other. We will invite 30 participants to each seminar. We will arrange seminars in four locations chosen for existing links with educational practitioners (Oxford and York), and for their centrality and easy access for policy makers (London and Helsinki, Finland). The themes of the seminars are:

Seminar 1 Oxford, February 2015: Educational processes: theoretical and conceptual models

Seminar 2 York, May/June 2015: Technology enhanced data collection

Seminar 3 Helsinki, October 2015: Intensive longitudinal data and statistical methods

Seminar 4 Oxford, February 2016: Process data in different disciplines

Seminar 5 Oxford, May/June 2016: Diaries and intensive longitudinal data in intervention designs

Seminar 6 London, October 2016: Implications for policy and practice

We invite practitioners: teachers, teacher educators and representatives of parent groups; and policy makers through existing and well-developed networks at our institutions. We will prepare podcasts of all talks in the seminar series, a user-friendly end-of-project report on best research practice and a summary of evidence of effective teaching practice that has emerged in this rapidly developing innovative field of research.

Planned Impact

In order to maximise impact of the seminar series six groups of beneficiaries are identified: (1) teachers at all levels, with an emphasis on teachers in primary and secondary schools, (2) school leaders and heads, (3) teacher educators, (4) school providers, (5) Third Sector think tanks, and (6) policy makers. We will invite members of all these groups to the seminars.

The teacher is the key person to provide formative feedback on students' learning processes and learning outcomes. The ways in which innovative use of technology could be used for optimising such feedback, and to promote students' self-monitoring through automated feedback, would be valuable to disseminate. Such dissemination would be through existing networks of the Teacher Education departments at Oxford and York, and by providing the end of project report to teacher education department's nationally through UCET and the National College for Teaching and Leadership (NCSL), as well as through teacher education departments in Jyväskylä and Helsinki.

The seminars will build incrementally on each other in order to form a cumulative body of knowledge. Edited digital recordings of the seminars will be uploaded on the seminar series' website. In order to integrate end-user points of view rapporteurs will follow group discussions during seminars and record participants' comments. Examples of good practice and their pros and cons will be collated into a user-friendly end-of-series report. A draft version of this report will be disseminated prior to the final (sixth) seminar. The final seminar will be based in London in order to maximise participation of policy officials. At this seminar the draft-end-of-project report will be scrutinised and commented on by policy makers, third sector think tanks (e.g., Institute of Public Policy Research, IPPR, and Centre for Marketing and Public Organisations, CMP).

The policy contexts in the three countries share communalities, distinct current key issues are evident. The UK appears to be moving towards an increase in testing of academic performance while placing the responsibility of formative feedback on the teacher (Dfe, 2013a, 2013b). As the forthcoming change in curricula for primary and secondary schools in the UK, starting autumn 2014, places increased responsibility of formative assessment with the teacher and the school, the development and implementation of technological tools which enhance learning processes appear timely. Finland has had decentralised educational system since the 1980s, but is currently concerned with low student motivation despite high performance in international comparisons (PISA). Germany has after its "PISA shock" (i.e., relatively low mathematics) moved towards establishing federal standards on quality of teaching, and some decentralisation of responsibilities from Ministries to schools.

The ultimate beneficiaries of innovative technology in schools are naturally the students. Plausible future uses of innovative technology that enhances various forms of student-teacher interaction, students self-monitoring, and self-assessment through interactive or solo use, can equip the growing generation with optimal abilities and skills needed in their future lives.

Publications

10 25 50

publication icon
Malmberg L (2020) Intraindividual structural equation models for learning experiences in International Journal of Research & Method in Education

 
Description NIRE is the first multi-disciplinary seminar series to bring together in the UK the world's international leading intra-personal researchers in education. It has provided the foundation for an on-going UK and international network of researchers using intra-personal approaches in education. All our seminars were followed as webinars in at least four countries (Germany, UK, Finland, The Netherlands) and presentations are made available to a wider audience at:
http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/. The seminar series has spurred a range of networking activities, grant proposals, and publications.

New understandings generated by the seminar series

Finding 1: Theoretical models of cognitive and behavioural processes of learning were contrasted.

Key theoretical were contrasted in the first seminar (Molenaar, Schmitz, Vermunt, Pekrun). For education the key issues are to investigate (a) the shape and form of individual students' learning trajectories and (b) how instruction can support learning trajectories. Students' experiences of learning can be positively enhanced through problem based learning (Schnieder), interventions with teachers (Lerkkanen) and students' self-monitoring (Perels, Schmitz).

Finding 2: We have compiled best practice on the collection of intensive longitudinal data by means of modern technology,

Technology (e.g., tablets, mobile devices, learning portals) offers immense opportunities for data-collection of both self-report and ambulatory data. The power of real-time data is key for reducing retrospection bias in research. Future challenges include how to make use of all collected rich data.

Finding 3: State-of-the-art quantitative methods for analyses of intrapersonal data are being introduced in educational research
Acknowledgement of the hierarchical nature of intrapersonal data (i.e., time-points nested in persons) and whether to treat time as discrete (e.g., time-point 1 occurs before time-point 2, which occurs before time-point 3 ) or continuous (e.g., 10:05, 11:15, 12:00, 13:20) are essential for both planning of intrapersonal studies and analyzing data. Statistical techniques that incorporate both aspects are important for the educational research community.

Finding 4: Results from intrapersonal studies promote policies of personlised learning

Findings from intrapersonal studies support the view that (a) learning and students' experiences of learning cannot be captured in averages (e.g., league table) only, and (b) interventions attempting to enhance group-average cannot address individual student's needs. "One-size-fits-all" teaching is unrealistic as "every moment of every day matters". Teachers' sensitivity to individual student's needs can be enhanced through training. Recognition of students individual needs in learning situations can enable teachers to capitalize on teachable moments (which all students have), refrain from labeling students ("good" or "bad" students) as these do not sufficiently describe situation-specific learning experiences.

Continuation
Continuation of the NIRE is being planned, through networking, conference and publication activities.

Directions for future research were identified such as:
Single-case and multiple-case intervention designs using state-of-the-art statistical methods would be advantageous for revealing match between individual student needs and
Dissemination of state-of-the-art statistical methods, for capacity building among educational researchers.
Links between intensive self-reports and biophysiology (e.g., heart rate, galvanic skin response, activity/rest level).

Have you met your original objectives? Please select the most appropriate response from the available options. Only one option may be selected.

YES

There were five objectives as stated in the application:
(Aim 1) Bring together experts and early career researchers from different disciplinary backgrounds to share knowledge with each other and with practitioners and policy makers,
(Aim 2) Develop and disseminate theoretical models of cognitive and behavioural processes of learning
(Aim 3) Compile best practice on the collection of intensive longitudinal data by means of modern technology,
(Aim 4) Amalgamate state-of-the-art quantitative methods for analyses of such data
(Aim 5) Provide user-friendly guidelines for designing interventions in which intensive data-collection are used
Exploitation Route The fully realised seminar builds the path to understanding and improvement of educational contexts, both within the UK and overseas. The seminar is multidisciplinary-bringing together education, psychology, and learning sciences.
(a) Increased cross-disciplinary research awareness by involving presenters and participants in various disciplines (e.g., education, psychology, learning sciences, computational science).
(b) Increased applied researcher awareness by involving policy-influencing education researchers in critiquing the methodological advances from policy perspective
(c) Increased awareness amongst UK postgraduate students through involvement in a seminar environment where postgraduate students were able to interact with senior researchers and international experts in an intimate and collegial atmosphere
Sectors Education

URL http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/
 
Description NIRE social and economic impact As can be seen in our research fish uploads there has been a significant academic impact of this seminar series. Through bringing together a diverse range of academic communities, and including academics at all career stages the series has had a significant impact on capacity building in academia in this important and emerging area of research. Throughout the project we committed to making a wider impact amongst other stakeholders, including policy makers and practitioners, who were invited and encouraged to attend events. However, it became increasingly apparent throughout the series of seminars that there was much work to do in consolidating a coherent academic narrative around this new research area, and it was important to create a cohesive set of ideas and practices that could then be communicated to and discussed with the wider public, commercial and educational sectors. Our sixth and last seminar summarized evidence in support of an "individualized learning" agenda for education in England/UK. Particularly, the within-student variability of students' learning experiences suggests that all students have their ups and downs in terms of engagement in classroom activities. The role of the teacher is to capitalize on teachable moments, avoid categorizing students ("clever", "disengaged") in favour of understanding situational variability. In the same way educational interventions should not focus on a "one size fits all" paradigm. Instead we advocate dosage-based interventions suited to each student's needs. The current educational policy is moving away from the individualized learning agenda, instead advocating more frequent and harder exams. The personalisation agenda is very limited in terms of how is it being conceptualised and delivered by schools. In order to make that agenda more meaningful and impactful, there is a need for more academic research to fully propose a way forward. As an important step towards this goal, we have begun a range of activities beyond the seminar series that further develop the academic basis and community around the topic, in order to connect with a wider range of stakeholders. For example, we published an APA-blog post in the well-known psychology today has at the time of writing already attracted over 900 reads, and more than 35 Facebook "likes": https://www.psychologytoday.com/blog/psyched/201704/how-education-research-can-track-intrapersonal-changes. We have also widened the academic conversation through e.g., Goetz's special issue in the European Journal of Psychological Assessment, and widened the reach of the research via discussions and presentations outside academia e.g. Eynon's meeting with senior academic and government officials from Upper Austria.
First Year Of Impact 2017
Sector Education
Impact Types Societal

 
Description Caro, D., & Malmberg, L-E. (2017). Models for longitudinal data. (Research methods courses for graduate students)
Amount £7,500 (GBP)
Organisation University of Oxford 
Department Social Sciences Division
Sector Academic/University
Country United Kingdom
Start 05/2017 
End 05/2017
 
Description Extension of: The potential of biophysiology for understanding learning and teaching experiences (EARLI Emerging Fields Group) (€ 5000; 2020 - 2022)
Amount € 5,000 (EUR)
Funding ID The potential of biophysiology for understanding learning and teaching experiences, part 2 (extension) 
Organisation Jacobs Foundation 
Sector Charity/Non Profit
Country Switzerland
Start 09/2020 
End 08/2022
 
Description Eynon, R (2016) Examining the social implications of the use of Big Data in education.
Amount £7,250 (GBP)
Funding ID 151/064 
Organisation University of Oxford 
Department John Fell Fund
Sector Academic/University
Country United Kingdom
Start 01/2016 
End 05/2017
 
Description Malmberg, L.-E., de Vos, M., & Saunders, K. (2016). Activity, Rest and Learning Experiences (ARLE) John Fell Fund
Amount £7,500 (GBP)
Funding ID 152/070 
Organisation University of Oxford 
Sector Academic/University
Country United Kingdom
Start 05/2016 
End 07/2017
 
Description The potential of biophysiology for understanding learning and teaching experiences (EARLI Emerging Fields Group)
Amount € 20,000 (EUR)
Organisation University of Oxford 
Sector Academic/University
Country United Kingdom
Start 09/2018 
End 08/2020
 
Description Seminar: Diaries and intensive longitudinal data in intervention designs 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Seminar (with webinar access) with six internationally know speakers:

* Franziska Perels (Saarland University, Germany): Self-monitoring to support self-regulated learning

* Prathiba Natesan (University of North Texas, USA): Single case designs

* Kate Saunders (University of Oxford, UK): Intervention, outcome measure or self-management tool: mood and activity monitoring in clinical trials

* Anna Rönka (University of Jyväskylä, Finland): Applying mobile diaries in intervention designs: experiences from pilot studies

*Theodore Walls (University of Rhode Island, USA): Inferences involving time-scales in intensive longitudinal data (streamed live from the USA)

* Florian Schmiedek (German Institute for International Educational Research): Experimental manipulation "in the wild": Proposing a within-person encouragement design
Year(s) Of Engagement Activity 2016
URL http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/seminar-5-oxford-m...
 
Description Seminar: Innovations in online learning environments: Intrapersonal perspectives (17th March, 2016, Univeristy of York, York, UK) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact We hosted the seminar in York (with webinar access). Six internationally known speakers presented intrapersonal perspectives on their innovative online learning environments.

*Han L. J. van der Maas (University of Amsterdam, The Netherlands): Adaptive practice and monitoring systems for education and research

*Ulla Richardson (University of Jyväskylä, Finland): Challenges and possibilities of analyzing game log data from the digital online environment, GraphoGame

*Tom Stafford (University of Sheffield, UK): Factors influencing optimal skill learning: data from a simple online game

*Katharina Scheiter (Universität Tübingen, Germany): Self-regulated learning from multiple representations: Using eye-tracking to uncover and support students' processing in online learning environments

*Manolis Mavrikis (University College London, UK): Affect-aware support for exploratory learning environments.

*Henrik Bellhäuser (University of Darmstadt, Germany): Traces of Self-Regulated Learning: An Intrapersonal Perspective on Log File Data
Year(s) Of Engagement Activity 2016
URL http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/seminar-4-york-feb...
 
Description Seminar: Intrapersonal research: Implications for policy and practice 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Seminar in London (Goldsmith's University) 31st October, 2016, with seven internationally known speakers:

* Barbara Schneider (Michigan State University, USA): Title TBC

* Andrew Martin (University of New South Wales, Australia): Motivation and engagement in mathematics and English during a month at school: every minute of every day for every student matters - again!

* Lars-Erik Malmberg (University of Oxford, UK): Lessons learned from the Learning Every Lesson study

* Rebecca Eynon (University of Oxford, UK): Big data for tracing learners over time: promise or peril

* Nigel Guenole (Goldsmiths, University of London, UK): Personalised approach to measuring well-being in workplaces

* Marja-Kristiina Lerkkanen (University of Jyväskylä, Finland): Tracing teacher development and enhancing teaching through observation data

* Kathryn Asbury (Discussant; University of York, UK): Approaches to personalised learning
Year(s) Of Engagement Activity 2016
URL http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/seminar-6-london-o...
 
Description The first seminar in the Network in Intrapersonal Research in Education (NIRE) titled: Seminar 1. Educational processes: theoretical and conceptual models, held in Oxford, March 19th, 2015 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Seminar 1. Educational processes: theoretical and conceptual models was held in Oxford, March 19th, 2015. Our speakers were:
Jan Vermunt (University of Cambridge, UK), Processes and strategies of student and teacher learning
Peter Molenaar, (The Pennsylvania State University, USA), Ergodicity: The end of averaging across persons
Bernhard Schmitz, (University of Darmstadt, Germany), The study of learning processes using time-series analyses
Reinhard Pekrun (University of Munich, Germany), Intrapersonal vs. interpersonal models.
Bette Chambers (University of York, UK), Discussant
The first seminar attracted 53 participants on the day, and 16 webinar participants in 2 locations (Jyväskylä and Helsinki, Finland). Recordings of the talks and the powerpoint slides are available at:
http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/


Overall we have had positive feedback for our seminars, and are pleased it was so well received, as an opportunity to share knowledge, e.g., "a really stimulating day- thank you!". We received valuable feedback on formats of discussion groups. Participants suggested future speakers they wished to hear, e.g., Pam Sadler's joystick method, which we realized in the second seminar.
Year(s) Of Engagement Activity 2015
URL http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/seminar-1/
 
Description The second NIRE seminar titled: Technology enhanced data collection 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Six speakers and one discussant:
Thomas Goetz (University of Konstanz and Thurgau University of Teacher Education, Germany), Assessing academic emotions via experience sampling methods.
Neal Lathia (University of Cambridge, UK), Opportunities and challenges of using smartphones for health/behaviour monitoring and intervention.
Andreas Gegenfurtner (Maastricht University, The Netherlands), Eye tracking as online measure of visual expertise.
Anu Karvonen (University of Jyväskylä, Finland), Connecting mental states and bodily events: measuring autonomic nervous system activity
Phil Waters (University of Plymouth, UK), Moving pictures: capturing affect through mobile technology.
Helena Pennings (Utrecht University, The Netherlands), Using Sadler´s joystick method to observe behaviour of teachers and students
Rob Klassen (University of York, UK), Discussion: Digital data collection in classrooms.


Spurred discussion and inquiries about effective modern data collection tools
Year(s) Of Engagement Activity 2015
URL http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/seminar-2-oxford-j...
 
Description Third NIRE seminar titled: Statistical methods for intrapersonal data 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Six speakers and one discussant:
Asko Tolvanen (University of Jyväskylä, Finland), Autoregressive models in the context of structural equation and multilevel modelling
Manuel Voelkle (Max Plank Institute, Berlin, Germany), Continuous time modeling
Ellen Hamaker (Utrecht University, The Netherlands), State-space models
Noona Kiuru (University of Jyväskylä, Finland), Mixture models for intrapersonal data
Jens Asendorpf (Humbolt University, Germany), Intrapersonal data within a multi-level perspective
Kou Murayama (University of Reading, UK), Time-specific random effect and Type-1 error inflation in longitudinal intraindividual data analysis: A mixed-effects model perspective
Lars-Erik Malmberg (University of Oxford, UK), Where do we go from here? Synergies between methodology and research in education.


Much discussion about use of various statistical techniques
Year(s) Of Engagement Activity 2015
URL http://www.education.ox.ac.uk/network-on-intrapersonal-research-in-education-nire/seminar-3-helsinki...