Multimodal Methodologies for Researching Digital Data and Environments

Lead Research Organisation: University College London
Department Name: Culture, Communication and Media

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.
 
Title An Interview with John Knox, Macquarie University, Sydney. 
Description John Knox talks to Carey during the 6th International Conference on Multimodality about his experience around researching online texts and digital news 
Type Of Art Film/Video/Animation 
Year Produced 2013 
Impact Video has been viewed 100+ times. 
URL http://youtu.be/8MCxjvJnJsE
 
Title An Interview with Lorenza Mondada 
Description Lorenza and Jeff discussed multimodal methods for researching social interaction. The interview took place during the 6th International Conference on Multimodality, 2012, where Lorenza also presented a keynote lecture: "Interacting bodies: Multimodal methods for the organisation of social interaction" 
Type Of Art Film/Video/Animation 
Year Produced 2013 
Impact Video has been viewed 240+ times. 
URL http://youtu.be/PwR6jQy7sQg
 
Title An interview with Arlene Archer, University of Capetown, South Africa. 
Description Arlene Archer discusses her experience of multimodal methods and analysis with reference to her keynote lecture "Social Justice and Multimodal Pedagogy" which she gave at the 6th International Conference on Multimodality at the Institute of Education, August 2012. 
Type Of Art Film/Video/Animation 
Year Produced 2013 
Impact Video has been viewed 90+ times. 
URL http://youtu.be/z37TFMWqgUQ
 
Title An interview with Frederick Erickson 
Description Podcast with Fred Erickson 
Type Of Art Artefact (including digital) 
Year Produced 2012 
Impact Number of downloads unknown. 
URL http://www.screencast.com/t/aqVN8r7X
 
Title An interview with Gunther Kress 
Description Interview with Gunther Kress on key concepts in multimodality 
Type Of Art Film/Video/Animation 
Year Produced 2012 
Impact Interview was viewed 5,000+ times. 
URL http://youtu.be/kJ2gz_OQHhI
 
Title Decision making in the operating theatre 
Description Podcast with Jeff Bezemer 
Type Of Art Artefact (including digital) 
Year Produced 2012 
Impact Number of downloads unknown. 
URL http://www.ncrm.ac.uk/resources/podcasts/
 
Title How do surgeons learn to operate? 
Description Impact film showcasing MODE research on surgical education. 
Type Of Art Film/Video/Animation 
Year Produced 2013 
Impact Video has been viewed 870+ times. 
URL http://youtu.be/1ibNuo-Px7c
 
Title Researching embodiment with digital technologies: Fieldwork 
Description We have created a video presentation of the project fieldwork which took place on Clapham Common. The students used a mobile environment on iPads to explore on-site the history of a local common linking with the history curriculum through which to understand how such experiences of mobile technologies can impact on how people think about and construct place. 
Type Of Art Film/Video/Animation 
Year Produced 2013 
Impact The video presentation has been viewed by 200+ people. 
URL http://youtu.be/wLNKcQ4Y-oY
 
Description What have you discovered or developed through the research funded on this grant? Please explain for a non-specialist audience. *

The increased use of digital technologies across society has profoundly changed the multimodal landscape of representation and communication. New technologies generate new types of data that can impact on the ways in which data can be collected and analyzed. MODE used its research findings to develop a set of training and capacity building (TCB) resources to advance the quality and range of multimodal methodological approaches, skills and techniques for investigating digital environments and to promote a step change in the quality of UK social science in this area. The MODE project objectives were fully met.

Objective 1: To establish a strategic focal point for the development, delivery and dissemination of Multimodal research, and TCB.

• MODE is now the established focal point or 'go-to' place for Multimodal research, training and capacity building both nationally and international. We have achieved this through conducting two major research projects, face-to-face training events, and the use of the Internet and social media.
• The MODE website has been developed to host a range of research outputs, working papers, video resources and interviews. It has had nearly 1 million visits building to an average of 140 views per day, while the MODE Blog and the Embodiment blog each has over 5,000 total views.
• The downloadable resources have been well used (e.g. the MODE working paper on video-based research over 1,000 downloads, Video 'What is Multimodality?' over 12,000 views).
• MODE's international presence and standing is evidenced by the requests from people to visit MODE, for the MODE team to give Keynotes, attendance on MODE events, as well as requests to translate MODE working papers and subtitle MODE videos into Spanish and Portuguese, MODE invitations to collaborate on grants, be on advisory boards and so on.
• In line with our exit strategy MODE continues to hold monthly seminars and events to maintain and develop our presence and to host a portfolio of free downloadable resources.
• Two project books have been scheduled for publication with Routledge, An Introduction to Multimodality (January 2016) and Doing Digital Research: A multimodal Approach (August 2016). Both books are based on the findings and resources developed throughout MODE.


Objective 2: To design and conduct exploratory multimodal research that facilitates the development and evaluation of innovative multimodal qualitative research methods appropriate for researching contemporary digital data and environments.

MODE has designed and conducted seven research projects: one major MODE project investigated multimodal interaction and communication in the surgical operating theatre with attention to the use of digital video for multimodal research; the other major project explored embodied learning with emerging digital technologies in the school and museum through three studies focused on mobile, tangible, and whole body interfaces; a project on Trust and GP Online Forums (with NCRM hub); a project on Online Food Blogs and Parenting (with Novella); a Post-Doctoral Fellowship on the use of video in health training contexts; and two linked PhD studies on early years play, and Social Media and style. This research has led to a range of substantive findings:

• How style and identity are realised in the use of Social Media;
• The role of the design affordances of technology platforms play in how people communicate in online environments;
• Extending understanding of the body in the context of ubiquitous computing and education;
• The value of unpacking critical aspects of bodily interaction in digitally mediated physical learning environments that goes beyond notions of fun and engagement;
• The strategies deployed to micro-manage the need in teaching hospitals to provide both high quality and safe surgical service and an optimal learning environment for medical and other trainees;
• Insights gained in ways in which decisions are reached, e.g. while operating also have major implications for patient safety; we have shown who is involved in key decisions and identified factors affecting those arrangements.

MODE facilitated the development of innovative multimodal methods for researching digital data and environments. We report the main high-level results from across these projects in relation to five Thematic Strands (TS) that ran across MODE research.

TS1: Multimodal methods for capturing and analyzing digital data, MODE has:
• Clarified the field of multimodality and identified and refined three distinct approaches to multimodality: Conversation Analysis; Systemic Functional Grammar; and Social Semiotics;
• Refined robust multimodal methods for harnessing a range of data that new technologies make available for social research purposes e.g. the use of specialised video data generated in the Operating theatre, the use of screen capture to 'harvest' online data from blogs and social media;
• Extended and tested multimodal processes and frameworks for the analysis of interaction with a range of technologies, including mobile, tangible, whole body identify the 'embodied' nature of the interaction at different levels of description;
• Established protocols for video research and multimodal frameworks for analyzing gaze and gesture in digital environments;
• Produced clear guidance on ethics and multimodal research;
• Extended the language of description of multimodality in account for the character of interaction in digital environments, for example foregrounding the new roles of touch, and movement (kinekonic mode)
TS2: Multimodal transcription and dissemination of digital data, Mode has:
• Created an extensive online data base of exemplar multimodal transcription protocols;
• Tested, critically assessed and reviewed the impact of different types of transcription on the analytical process, e.g. how to transcribe the temporal flows of movement across different technologies and spaces;
• Contributed to refining and establishing a set of multimodal transcription conventions;
• Explored multimodal methods for representing and disseminating data findings, e.g. the use of video and re-enactment to represent and communicate research findings;
• Produced clear guidance on the collaborative use, sharing and secondary use of video data e.g. when bringing together social science and clinical expertise to understand a digitally produced 'professional vision'.
TS3: Working across disciplinary boundaries, mixing multimodal methods, and integrating digital resources, MODE has been informed by an interdisciplinary approach and has:
• Explored and demonstrated how multimodal approaches can be effectively combined with other theories and methods e.g. external cognition, sociology, human computer interaction, media and film studies;
• Explored methods that integrate qualitative and quantitative data (e.g. combining eye-tracking cognitive approaches with multimodal social semiotics)
• Developed and demonstrated how multimodal micro-analytical methods can connect to macro social issues, e.g. using a micro-analysis of interaction in the surgical operating theatre to explore large scale concerns related to patient safety and surgical training;
• Tested how different interview techniques could be used with video data to 'triangulate' research findings;
• Examined the challenges for cross-disciplinary research between clinical and social science researchers.
TS4: Multimodal methods for researching time, place and space in digital data and environments, MODE has:
• Developed multimodal methods to account for how digital technologies disrupt and reconfigure concepts of time, place and space, e.g. showing how the character of mobile technologies can be exploited to support learners in reimagining spaces.
• Examined ways of analysing the digital practices over time, e.g. through the use of digital archives of blogs and the social semiotic comparison of their resources of layout, colour etc.
• Established analytical protocols that ensure the temporal character of interaction is maintained e.g. by refining the use of turn-taking and sequential unfolding of interaction in multimodal analysis;
• Examined ways to effectively capture and analyze the flow of 'materials' in online social interaction, e.g. how the arrangement of time differs across Pintrest, Tumblr, and Twitter;
• Explored how people's movement, posture and position in digital environments spaces shapes their meaning making and practice e.g. the affect set up of a medical simulation environment, or an operating theatre on communication; or the ways in which children arrange themselves in relation to a digital exhibit shapes their learning experience.
TS5: Multimodal methods for researching physicality and embodiment in digital data and environments, MODE has:
• Reviewed and compared different theoretical approaches to embodiment in the context of multimodal research;
• Developed robust multimodal methodological approaches for investigating embodiment in digital environments, with attention to gaze, body posture, position, etc.
• Examined in depth the ways in which different digital technologies draw on the body in different ways, e.g. comparing mobile, tangible, and whole body interaction in the context of learning;
• Worked to extend multimodal analysis to comment on digital design issues, thus extending the potential of multimodality in HCI;
• Explored the semiotic potentials of touch as an emerging mode of communication.
• Explored how digital technologies shape the character of embodied interaction in digital environments e.g. how the digital technologies of the surgical operating theatre or the museum gallery re-shape the use of talk and gaze.
Objective 3: To provide a coherent programme of training and capacity building activities in multimodal research methods of outstanding quality to support and enable researchers to acquire the capacity to use these methods effectively in their research. MODE has:
• Provided a program of TCB to support and enable participants to develop awareness, knowledge and high-quality skills in multimodal theory and methods. It offered over 100 training days, seminars, participatory data sharing workshops and public lecture series, with a progression pathway from basic knowledge of multimodality, to working knowledge and skills (comprehension and application), to advanced skills in multimodal research (analysis, synthesis and evaluation). Participants consistently evaluated these as outstanding;
• Developed an intensive advanced 5 day Summer School held in 2013, and 2014 attended by participants from the UK, and around the world. MODE also held additional Summer/winter schools in 16 countries around the world;
• Designed a free online open access self-learning MODE training course with lectures, video resources, and learner activities, based on its Summer School;
• Produced a searchable online glossary of key concepts in multimodality, a series of videos describing the use of these terms, as well as a collection of audio-visual resources and presentations to support researchers developing their skills. In addition the MODE website hosts a repository of podcasts, videos, PowerPoints, and how to guides from the training events. These resources have been consistently at the top 100 of NCRM resources.
Objective 4: To expand insights from multimodality to relevant areas of social science to build a multimodal research community that enhances the UK's profile and leading position in multimodal methodology and digital technology focused research, MODE has:

• Established a strong community of multimodal researchers that enhances the UK's leading position in multimodal methodology and digital technology focused research.
• Contributed to a wide range of high level research events at a national and international level, published a range of works that develop the area and build the community, developed a JISC list for multimodality of over 1,000 members, and hosted and organised two major international conferences on aspects of multimodal theory and method to consolidate and grow this community.
• Hosted over 10 international visitors that extend its work Internationally.
• Expanded multimodality as a method to reach beyond its base within linguistics, to connect with ideas and theories within Sociology, Anthropology, and Human Computer Interaction studies, as well as the areas of Health, Museum studies, and technology design.
Exploitation Route The substantive and methodological findings on multimodality, physicality and embodiment, time, place and space and leading edge technologies speak to the broader methodological challenges and opportunities in the field of digital technology and social research in the coming years.

The substantive findings related to learning with digital technologies are likely to be taken up by educational practitioners and policy makers in schools and museums to inform their use of technologies, e.g. on understanding the gains and losses of iPads in the nursery school, the potential of mobile technologies for shaping experiences of place and so on.

Health practitioners will be able to take forward the substantive findings from the work on operating theatres which have significant implications for clinical educational practice and current debates about whether more junior staff can and do speak up when they have concerns or questions about the course of action being pursued by the team. These findings have proven to resonate strongly with surgeons, nurses and other health care professionals as well as members of the general public who participated in the impact activities we have organized.

The substantive findings on the design implications of using technologies to support learning are likely to be taken up by designers of technology for museum and school contexts, e.g. the design of modal relationships in an interface, the different potentials of modes for types of interaction, collaboration and linking of information, and the ways in which exhibits position the user.

The frameworks and methodological developments achieved by MODE are being used and taken forward by researchers within the UK and International social science research community to research complex multimodal digital environments. This will contribute to more robust and coherent research in this area.

In addition, trainers and lecturers of undergraduate and postgraduate social science methods are already making use of the MODE resources in their teaching, e.g. the Glossary and Transcription bank have been used in research methods courses on multimodal research.

We envisage that the methodological and resources of MODE will be taken up by qualitative research in the creative arts, where interest and the need for innovative methods for researching the body in digital environments are gaining ground, e.g. in performance, fashion, and design.
Our Pedagogic model has the potential to make a significant contribution to models of developing successful online resources and video for TCB purposes more generally.
Sectors Digital/Communication/Information Technologies (including Software),Education,Healthcare,Culture, Heritage, Museums and Collections
URL http://MODE.ioe.ac.uk
 
Description The MODE research findings have informed over 100 impact events in the form of training days, data sharing workshops, and seminars around the UK. These have been attended by participants from academia and the public and third sector including researchers, practitioners and educators working with digital technologies across four contexts: Education, Healthcare, Culture, Heritage, Museums and Collections, and Digital communication technologies. Bringing together academic and non-academic beneficiaries together in this way has helped to explore the application of multimodal methods to a range of digital environments: simulation, embodied, online, mobile, tangible, and so on. We have also facilitated 10 specialist impact events (e.g. seminars and workshops) aimed at these four groups to enable on-going engagement and communication with 'non-academics' (many educators and medics are both practitioners and academics). Throughout the project we have liaised with intermediary organisations (e.g. the London Deanery, the British Film Institute, Schools as well as UCL IOE education Centres) to inform and embed our work in these networks, we have also published in practitioner journals (within fields of health and surgery, technology, and education). Through our research we have also worked directly with practitioners in hospital settings, nurseries and schools, and museums, who have benefited directly from the research as discussed below. MODE has worked with Educational practitioners in conferences, workshops, seminars, and specialised training events (e.g. on the use of video for assessment purposes in nursery and primary education). Our research findings have raised awareness of the benefits of attending to multimodal interaction in educational settings (including special needs education). MODE research exemplars have been used to raise awareness of, and demonstrate the children's non-verbal and multimodal engagement with contemporary technologies for learning in the classroom and at home and effective teaching strategies for exploiting and assessing it for learning. Our findings have informed debates on the use and restriction of digital technologies (i.e iPads) for learning, particularly among young children. The MODE team has worked directly with local primary school teachers to develop a Mobile history learning experiences that have a life beyond the study. MODE has contributed to a number of UCL IOE events for educational practitioners, teaching organisations, government policy makers, and industry, including 'What the Research says' events on iPads in the classroom, and tangible technologies, and lectures for international teacher groups visiting the IOE (e.g. a UK lecture tour of 100 Danish educators). MODE events have prompted discussion and debate among teachers and classroom assistants, as well as educational designers. MODE publications in journals read by academics and practitioners. MODE has worked with practitioners within the Culture, Heritage, Museums and Collections sectors, across the private and third sector. We have contributed to a number of impact events including a seminar for Museum staff at the Natural History Museum and the Victoria and Albert Museum to disseminate and discuss MODE research findings on role of multimodal interaction, the design of space, and the place of touch in the museum. This work has sought to engage with and expand the methodologies of museum based research, notably by showing the potential of observing multimodal interaction with digital exhibits for their design and evaluation. This work featured on the Museum Visitor Association blog, and has, along with MODE's work on embodiment more broadly, been taken up by the Miami museum of science towards developing a Science Learning + bid (with Dr Price from MODE). Further this work has led to collaboration with the NHM and V&A on multimodal interaction with digital exhibits (funded by a UCL-IOE partnership bid). In one major MODE project we investigated operating theatres in a major hospital in London. The focus was on the visualisation technologies used there to look inside patient bodies and its potential for researching teamwork at a microscopic level. The aim of this research was threefold: to advance multimodal theory and methods; to develop new insights in learning and communication; and to contribute to current debates about patient safety. These aims have been achieved through: publications in social science and medical journals, contributions to edited volumes, and a monograph; (key note) presentations at major international conferences; and non-academic impact activities, including a workshop at the Wellcome trust for health care practitioners and a simulation based public engagement event at the London Science Museum. In these, we addressed the following questions: How do members of a surgical team communicate? How do surgical trainees learn to operate on real patients without increasing patient risks? How do surgeons come to make critical decisions during operations? The project also features in a short film and impact case study produced by the ESRC. MODE also contributed to an NCRM project on trust in GPs, analysing social media used by patient groups and worked directly with GP forum groups in the process. A one-day MODE event on young children and digital communication run in partnership with Great Ormond Street Hospital, explored the possibilities, and challenges placed on the use of digital technologies by children and young people with life threating long term conditions when patients in hospital, and their families. We explored together the ethnical and privacy dimensions raised. Bringing together technology experts and health care experts, and children's charities enabled us to reimagine the possibilities of technology in the hospital. This event led to the incorporation of digital technologies as a method of data collection and dissemination (led by Jewitt) in a GOSH NIHR proposal 'Pay More Attention' which has just been approved. Throughout MODE we have engaged with a range of commercial and charitable organisations in the Creative economy, with a focus on digital production and communication (e.g. the BFI, BIG BIT game design company, Ministry of Stories, and Creative Cultural Exchange). This has involved meetings to discuss methodologies and findings on a more 1-2-1 basis, and sharing research findings that can inform the design of platforms and products. The MODE Food Blog project also involved us working with the British Library to digitise the sample of blogs, and to share expertise on procedures and ethics when archiving this type of data.
Sector Creative Economy,Digital/Communication/Information Technologies (including Software),Education,Healthcare,Culture, Heritage, Museums and Collections
Impact Types Cultural,Societal
 
Description Brief report on digital literacy in Europe
Geographic Reach Asia 
Policy Influence Type Implementation circular/rapid advice/letter to e.g. Ministry of Health
URL http://www.eli-net.eu
 
Description BERA student bursary
Amount £500 (GBP)
Organisation British Educational Research Association (BERA) 
Sector Academic/University
Country United Kingdom
Start  
 
Description Bloomsbury Studentship
Amount £45,000 (GBP)
Organisation Bloomsbury Colleges 
Sector Academic/University
Country United Kingdom
Start 10/2013 
End 09/2016
 
Description British Academy Postdoctoral Fellowship
Amount £333,374 (GBP)
Organisation The British Academy 
Sector Academic/University
Country United Kingdom
Start 11/2014 
End 10/2017
 
Description ESRC Future Leaders Scheme (Supporting early language development and interest in reading with digital personalised books)
Amount £183,060 (GBP)
Funding ID ES/N01779X/1 
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 01/2017 
End 12/2019
 
Description Froebel Trust Research Grant (Valuing young children's signs of learning: observation and digital documentation of play in early years classrooms)
Amount £34,350 (GBP)
Organisation Froebel Trust 
Sector Charity/Non Profit
Country United Kingdom
Start 09/2017 
End 09/2018
 
Description Global Perspectives on Learning
Amount € 16,600 (EUR)
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 01/2012 
End 05/2014
 
Description InTouch: Digital Touch and Communication
Amount € 1,947,346 (EUR)
Funding ID 681489 
Organisation European Research Council (ERC) 
Sector Public
Country Belgium
Start 10/2016 
End 09/2021
 
Description Methodological Innovation in Digital Arts and Social Sciences
Amount £150,000 (GBP)
Organisation University of Southampton 
Department ESRC National Centre for Research Methods
Sector Charity/Non Profit
Country United Kingdom
Start 01/2012 
End 10/2014
 
Description Multimodality and Embodied Interaction
Amount € 2,500 (EUR)
Organisation German Research Foundation 
Sector Charity/Non Profit
Country Germany
Start 01/2011 
End 12/2014
 
Description NIHR Health Services and Delivery Research Programme, project title Pay More Attention
Amount £592,000 (GBP)
Funding ID 14/21/45 
Organisation National Institute for Health Research 
Department NIHR Biomedical Research Centre
Sector Public
Country United Kingdom
Start 09/2015 
End 09/2017
 
Description Open Call Research Bids
Amount £150,000 (GBP)
Organisation Lankelly Chase Foundation 
Sector Charity/Non Profit
Country United Kingdom
Start 10/2015 
End 09/2016
 
Description Short Term Scientific Mission (Digital Languages: Multimodal meaning-making in Reggio - inspired early years education - K Cowan)
Amount € 1,850 (EUR)
Organisation European Cooperation in Science and Technology (COST) 
Sector Public
Country Belgium
Start 03/2017 
End 03/2017
 
Description The Digital and Multimodal Practices of Young Children (DigiLitEY)
Amount € 560,000 (EUR)
Organisation European Cooperation in Science and Technology (COST) 
Sector Public
Country Belgium
Start 01/2015 
End 01/2019
 
Description UCL IOE Partner, Early Years and Digital Literacies Specialist (R Flewitt)
Amount £1,662,000 (GBP)
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 01/2015 
End 12/2016
 
Description WeDraw research project
Amount € 247,548 (EUR)
Funding ID 732391 
Organisation European Commission 
Department Horizon 2020
Sector Public
Country European Union (EU)
Start 01/2017 
End 12/2019
 
Title MODE Transcription Bank 
Description This free online resource provides a collection of multimodal transcripts accompanied by reflective commentary from the researchers who created them. Arising from the work of the 'Multimodal Transcription' strand of MODE, the Transcription Bank acts as a database showcasing a variety of approaches to the challenge of transcribing the complexities of social interaction. The range of transcripts are accompanied by reflections about how they were made, why they take these particular forms, and how they were used, along with links to the publication in which they appear. 
Type Of Material Data handling & control 
Provided To Others? No  
Impact The Transcription Bank has been used to extend the Training and Capacity Building activities of MODE, such as the transcription workshops, and also as a standalone resource for researchers further afield. This resource supports researchers using (or considering using) multimodal methods, sharing various means of documenting multimodal communication and raising methodological issues for debate. 
URL http://mode.ioe.ac.uk/category/transcription-bank/
 
Description Assessing the trustworthiness of GPs 
Organisation University of Southampton
Department ESRC National Centre for Research Methods
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution MODE contributed to this joint project on trust in GPs by analysing online forums.
Collaborator Contribution Partners used survey research and focus groups respectively to explore trust in GPs
Impact Bezemer J, Domingo M. (2014). 'User generated data' from online patient forums: Potentialities and constraints for social research. NCRM Working Paper.
Start Year 2012
 
Description Multimodal analysis of food blogs 
Organisation Narratives of Varied Everyday Lives and Linked Approaches (NOVELLA)
Country United Kingdom 
Sector Academic/University 
PI Contribution The collaborative project builds on strong methodological synergies between two NCRM Nodes: MODE and NOVELLA. The project aims are methodological - to compare and combine multimodal and narrative frameworks for analyzing blogs - and substantive - to examine the role of food and the construction of mothering and fathering in online visual and textual narratives about feeding families.
Collaborator Contribution Multimodal textual analysis was conducted of food blogs.
Impact Kress, G., Domingo, M., Jewitt, C., Adami, E., O'Connell, R. Elliott, H., & Squire, C. (2014). Development of methodologies for researching online communication: the case of food blogs. NCRM Working Paper.
Start Year 2012
 
Title MODE Virtual Learning Environment 
Description An online methods course focused on multimodal methodologies for digital and data environments. The MODE VLE will introduce multimodal methods for analysing communication and learning with digital technologies. There will be five units of self-supported study that introduce four theoretical perspectives: social action; moving image and film; design, genre and interactivity; and embodied cognition. It is recommended that the course is started by completing the induction unit. This section will provide a tutorial on how to navigate the course structure and access the course contents. The introductory unit is optional and recommended for those who are new to multimodal methods or would like a refresher on key concepts and issues. Any of the other units can be selected to further explore topics related to research interests. Units 1-5 are organised thematically but can also be explored chronologically for those interested in a full course. Each unit is comprised of key readings, guides, case studies and research resources. See the outline below for further details. MODE VLE Programme Outline: Unit 1: An introduction to multimodal methodologies Unit 2: Analysing video recorded face-to-face interaction Unit 3: Analysing embodied cognition and interaction with tangible and mobile devices Unit 4: Analysing digital text making in digital and online environments Unit 5: Analysing moving image and digital film production Each unit will provide readings, learning resources, key concepts and activities to offer both conceptual and applied understanding of the multimodal methods outlined and the theoretical perspectives explored. Case studies and examples drawn from MODE research will also be available for guided instruction of research conducted in different environments, including hospitals, schools, galleries and online platforms. The technologies we explore include digital video devices, Web 2.0 technologies, and mobile and tangible devices. Participants enrolled in this online course have the option to explore all units as an introductory overview or may opt to focus on one or two of the units for more in-depth study of the particular approaches detailed. Videos, visual timelines, transcription banks and glossaries are among the embedded resources in the unit lessons. 
Type Of Technology Webtool/Application 
Year Produced 2015 
Impact The launch is forthcoming (in 2015), however we have already received many enquiries about its availability for students and researchers. 
 
Description Invited paper: 'Multimodal routes into literacy through storytelling and story-acting', Language and Literacy Research Group, Sheffield Hallam University. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Rosie Flewitt's expertise in the field is well known, so she was asked to address a Sheffield Hallam research group, but the event attracted a wide local audience including teachers and doctoral students.


Flewitt has been contacted by a number of attendees for further information about the pedagogy discussed in the talk.
Year(s) Of Engagement Activity 2013
 
Description 'Cambridge Early Years Teaching Schools Conference: To the Baseline and Beyond' 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Tools and ideas for practitioners to use in practice, informed by theory.

Audience engaged in discussion and requested for further information afterwards.
Year(s) Of Engagement Activity 2015
URL http://tscouncil.org.uk/baseline-beyond-ceyts-early-years-conference/
 
Description 'I Was Born in a Cat's Cave': Working with Authorship and Imagination in Early Childhood Outdoor Learning 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Presentation with Deb Wilenski for Pedagogy, Language, Arts and Culture Education Group (PL)ACE, in association with BERA and Cambridge Curiosity and Imagination, at the University of Cambridge, led to a lively discussion.

Continued involvement with the Faculty of Education and Cambridge Curiosity and Imagination.
Year(s) Of Engagement Activity 2013
URL http://talks.cam.ac.uk/talk/index/42629
 
Description 'Multimodal Researchers' Facebook group 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Following the postgraduate 'Multimodal Methods Swap' one-day seminar, international participants expressed a wish to stay in contact to continue discussion of issued related to multimodal research methods, and to arrange future collaborations and events.

The MODE PhD students formed and coordinate a 'Multimodal Researchers' Facebook group, which is an informal yet highly active and accessible means of sharing news of events, publications and funding, in addition to continued discussion of issues arising in our research. There are currently over 45 members from as far afield as Hong Kong, Brazil, South Africa and USA.
Year(s) Of Engagement Activity 2014
 
Description 360° - 5th International Conference: Encompassing the multimodality of knowledge (2014) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The talk, Extending multimodality through interdisciplinary collaboration, sparked much discussion afterwards.

The conference provided an opportunity for networking, increasing interdisciplinary contacts and requests for further information.
Year(s) Of Engagement Activity 2014
 
Description Agenda-setting Seminar: Multimodality across disciplines (2014) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The agenda-setting seminar sparked questions and discussion among professionals from a range of disciplines.

The seminar provided an opportunity to consider new directions for multimodality.
Year(s) Of Engagement Activity 2014
 
Description Analysing Digital Data and Environments - Summer School (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation workshop facilitator
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Workshops sparked questions and discussion.

Workshops received positive feedback and requests for further training by MODE.
Year(s) Of Engagement Activity 2013
 
Description Analysing web-based multimodal texts: The case of news stories MODE/CMR (2013) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Talk sparked questions and discussion afterwards.

Further information on the methodological approaches were received.
Year(s) Of Engagement Activity 2013
 
Description British Human Computer Interaction (workshop) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact the workshop engaged participants in a range of activities that prompted deep methodological thinking and questioning

We made contact with some people who joined the MODE mailing list and attended MODE training events, we also met a researcher who consequently joined another project I led
Year(s) Of Engagement Activity 2012
 
Description Cambridge Early Years Teaching Schools Conference (Topic: 'Observing and Documenting with Video in the Early Years' by K Cowan) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact The workshop sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description Canterbury Christchurch University Annual Early Years Conference (Topic: 'iPads and enabling literacy for children experiencing disability' by R Flewitt) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The keynote sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2016
 
Description Child-Initiated Play with Digital Technology in the Early Years: Transcribing Multimodal Interaction 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Symposium prompted questions and discussions.

Requests for further information were received.
Year(s) Of Engagement Activity 2014
URL https://www.bera.ac.uk/event/bera-conference-2014
 
Description Communication, Language and Literacy in a Nursery Woodland Project 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Talk prompted discussion with practitioners.

Nursery school reflected and refined their approach to recognition of children's communication in their Woodland project.
Year(s) Of Engagement Activity 2012
 
Description Conference: Communication and Teamwork in the Operating Theatre: Challenges and Opportunities 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The conference was organised to showcase our research for a highly selected audience of clinicians, social scientists, and patient safety advocates. This event involved discussion about the application of video-based research in surgical practice. The day sparked discussion, debate, and suggestions as to how to move forward with respect to improving clinical practice.

Suggestions for policy level actions were raised by the audience.
Year(s) Of Engagement Activity 2014
 
Description Consultant for European Declaration of the Right to Literacy for ELINET (R Flewitt) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Increased interest in subject area
Year(s) Of Engagement Activity 2015,2016
URL http://www.eli-net.eu/fileadmin/ELINET/Redaktion/user_upload/European_Declaration_of_the_Right_to_Li...
 
Description Coordinator for international Examples of Good Practice for Digital Literacy for ELINET (R Flewitt) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Increased interest in subject area
Year(s) Of Engagement Activity 2015,2016
URL http://www.eli-net.eu/good-practice/
 
Description Demonstration: Multimodal Transcription of Video. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation workshop facilitator
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Talk sparked discussion and connections between researchers.

New connections were made and requests for further information were received about multimodal transcription.
Year(s) Of Engagement Activity 2014
 
Description DigiLitEY Conference, Tallinn, Estonia (Topic: 'The Digital and Multimodal Practices of Young Children: a multimodal perspective' by R Flewitt) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact The keynote sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description Digital Data Sharing Workshop (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Data workshop sparked discussion and questions afterwards.

Requests for further training and activities.
Year(s) Of Engagement Activity 2013
 
Description Digital Ethnography (2014) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Talk sparked questions and discussion.

Requests for further information with regards to the approach used.
Year(s) Of Engagement Activity 2014
 
Description Doing Video Research in Medical Education (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Use of video in medical settings sparked lots of questions and discussion.

Further requests for video analysis workshops were received.
Year(s) Of Engagement Activity 2013
 
Description Doing video research in medical education - Application workshop (2013) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Health professionals
Results and Impact Video analysis in medical settings sparked many questions from the audience.

Interest in the use of video to study workplace interactions was generated.
Year(s) Of Engagement Activity 2013
 
Description EECERA Annual Conference, Universitat Autònoma de Barcelona (Topic: 'Multimodal Perspective on Child-initiated Play' by K Cowan) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The talk sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description ELINET 2016 European Literacy Conference, Amsterdam, Netherlands (Topic: 'Young children and digital literacy' by R Flewitt) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The keynote sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2016
 
Description Early Literacy and Digital Literacy Expert for ELINET (R Flewitt) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Increased interest in subject area
Year(s) Of Engagement Activity 2015,2016
URL http://eli-net.eu/
 
Description Education Department, Bogaziçi University, Istanbul, Turkey (Topic: 'Celebrating diversity through storytelling and acting' by R Flewitt) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The presentation sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description Embodiment, digital technologies and environments (2014) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Conceptualising the body in research sparked discussion.

Requests for further information were received.
Year(s) Of Engagement Activity 2014
 
Description Ethics, Multimodal Research, Digital Data and Environments (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Talk about ethics sparked lots of discussion.

Requests for further information and training was was received.
Year(s) Of Engagement Activity 2013
 
Description Eye-tracking and Multimodal Research (2013) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Debate about multimodality and eye-tracking sparked a discussion.

Requests for further information.
Year(s) Of Engagement Activity 2013
 
Description Hampshire and Isle of Wight Educational Psychology (HIEP) Annual Conference (Topic: 'Early Literacy Learning in a Digital Age' by R Flewitt) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The workshop sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2016
 
Description Hong Kong and Thailand University Lectures 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Talks sparked discussions and further inquiry from attendees afterwards and key administrators from the visited universities to continue discussion for potential collaborations with their research and teaching staff.

The visit to the leading university in Thailand, Chulalongkorn University, led to a discussion with the Vice President to remain in touch about potential funding they can provide to do collaborative work with their team. This network is going to be pursued with other IOE members in the development of a proposal bid for Next Generation. The work had real impact with students who attended the sessions and resulted in blogs posts and continued discussions about how the talk inspired them as practitioners and/or researchers, i.e.
http://buhk.me/2015/01/31/urban-youth/
http://web.edu.hku.hk/f/event/2642/20150127.pdf
http://www.chula.ac.th/en/archive/4431
http://www.sh.mahidol.ac.th/th/view.php?group=4&id=1467
https://buenglish.wordpress.com/
https://buenglish.files.wordpress.com/2015/01/seminar_myrrh-domingo.pdf
Year(s) Of Engagement Activity 2015
 
Description How do surgeons learn to operate? 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Surgical re-enactment and presentation of research findings in Science Museum prompted lively discussion between general public, social scientists and surgeons.

Brief questionnaire taken before and after event showed majority of participants had changed their view on the patient's safety when being operated on by a surgical trainee under the supervision of a consultant
Year(s) Of Engagement Activity 2013
URL http://youtu.be/1ibNuo-Px7c
 
Description How to Analyse Social Media (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Multimodal approach to the study of representation and communication in digital environments sparked discussion.

The workshop was well received and further training using multimodal approaches was welcomed.
Year(s) Of Engagement Activity 2013
 
Description How to analyse multimodal interactions from video (2014) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation workshop facilitator
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Students found the workshop very useful and practical. It sparked thinking of how video recordings can be analyzed using different approaches.

The facilitator has kept contact with the students after the workshops and there has been interest in follow-on training.
Year(s) Of Engagement Activity 2014
 
Description Introduction to Researching Embodiment in Digital Environments (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation workshop facilitator
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The training day sparked questions and discussion afterwards.

Requests for further information and further training.
Year(s) Of Engagement Activity 2013
 
Description Invited Lecture at the Creative Methods for Learning and Teaching Theory Symposium. Middlesex University, London (Topic: Multimodal Composition in Digital Platforms: Exploring Creative Methods and Research-based Pedagogies for Higher Education by M Domingo) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The lecture sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2016
 
Description Invited Lecture, Universitas Negeri Jakarta, Indonesia (Topic: Internationalisation of Curriculum and Contemporary Communication Environments by M Domingo) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The lecture sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2017
 
Description Invited Lecture, the FIESOLE Symposium at the London School of Economics (Topic: Supporting Academic Writing Development in Contemporary Communication Environments by M Domingo) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The lecture sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2017
 
Description Invited Panel member: International Society for Design and Development in Education (ISDDE) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The invited talk sparked lot of questions.

Requests for further participation were received afterwards.
Year(s) Of Engagement Activity 2014
 
Description Invited Panel member: VIII SIGET - Simpósio Internacional de Estudos de Gêneros Textuais (International Symposium on Genres) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The invited contribution to a panel entitled "Brazilian dialogues in genre studies: grounding and appropriated theories" is forthcoming.

Requests for further information and collaboration have already been received.
Year(s) Of Engagement Activity 2015
 
Description Invited discussant: University of Sheffield 'Everyday Language, Everyday Literacies' Conference. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The discussion on in the field of everyday literacies was well received and generated many questions.

New working relationship with an IOE colleague encountered at the event - working as a team, we recently gained research funding of £140k from a charitable organisation to develop innovatory research methods in this field.
Year(s) Of Engagement Activity 2013
 
Description Invited member of ELINET Sustainability Committee (12 international members) tasked with identifying ways forward for the network (R Flewitt) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Increased interest in subject area
Year(s) Of Engagement Activity 2015,2016
 
Description Invited panel member and discussant: Oxford Education Society, University of Oxford, 'Early literacy and digital technologies: friend or foe?', 1-day conference 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The field of digital literacy sparked good discussion among the panel and audience.


Rosie Flewitt has been contacted by academics and doctoral students for details of my publications, and approached to co-author a paper on the subject (forthcoming).
Year(s) Of Engagement Activity 2014
 
Description Invited paper: ESRC funded seminar series on Genre 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Prof Kress' invited talk sparked many questions afterwards.

Increase in student contacts interested in multimodal genre.
Year(s) Of Engagement Activity 2013
 
Description Invited plenary: 24th European Systemic Functional Linguistics Conference and Workshop, Coventry 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Plenary was well received and generated many questions and dialogue.

Many requests for further information and collaboration were received.
Year(s) Of Engagement Activity 2013
 
Description Invited round table discussant: The importance of verbal visual analysis for the contemporaneous language studies (Sao Paolo, Brazil) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Round table discussion sparked many questions and dialogue.

Requests for further participation were received.
Year(s) Of Engagement Activity 2013
 
Description Keynote at the BAAL Language and New Media SIG Keynote, Queen Mary University of London (Topic: Multimodality in Social Media and Digital Environments by M Domingo) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The keynote sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2016
 
Description Keynote at the Language and Literacies Seminar. Open University, Milton Keynes (Topic: Digital Literacies and Multimodal Composition in Digital Communication Environments by M Domingo) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The keynote sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2016
 
Description Lecture series and workshop on multi modality (Stockholm University) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact A Multimodal methods and digital environments workshop event was held, consisting of a series of three lecturers and three workshop seminars for participants from the Languages department, Informatics department, and Education department of Stockholm University, Sweden. This promoted engagement with new methods and procedures for the analysis of digital data, promoted debate and discussion.


After my talk a delegation from the university visited the MODE team in London to discuss possible future collaborations - in the form of a future EU bid
Year(s) Of Engagement Activity 2013
 
Description Live Radio Interview, BBC Radio 5, 2nd February 2015 (13.30pm approx). 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Approx 30 emails and phone calls from general public and other academics.

Parents have contacted me to say that what I said has helped them reach decisions about their children's use of new technologies. The interview has informed the general public, and presented and discussed reliable evidence. Radio 5 Live has (potentially) 7.1 million listeners.
Year(s) Of Engagement Activity 2015
 
Description MODE Conference at the UCL Institute of Education 2015 (Topic: Multimodal Transcription of Video: Representing Child-Initiated Play by K Cowan) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact The talk sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description MODE Data Sharing Workshop (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation workshop facilitator
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Workshop generated discussion and exchange of perspectives.

The participants were provided an opportunity to analyse their own data and they reported this providing new insight into their own research. Participants requested for further workshops, which we organised in the following year.
Year(s) Of Engagement Activity 2013
 
Description MODE Summer School, UCL Institute of Education (Topic: 'Analysing Video-recorded Face-to-face Interaction' by K Cowan) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact The workshop sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2013,2014
 
Description MODE seminar 'Learning in the Early Years: A Multimodal Perspective', UCL Institute of Education (Topic: 'Recording Learning in Young Children's Play' by K Cowan) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact The workshop sparked discussion and questions afterwards.
Year(s) Of Engagement Activity 2014
 
Description MODE's Multimodal Transcription NCRM Workshops (Topic: 'How to Make a Multimodal Transcript and Exploring Different Approaches to Multimodal Transcription' by K Cowan) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact The workshop sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2013
 
Description Methods workshop (Alborg University, Denmark) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Jewitt, C and Kress, G: Led a two day workshop for Swedish and Danish researchers at the University of Alborg, Denmark, sharing data, providing analytical tools and the opportunity to discuss multimodal theory and methods in depth. This led to a new interest in multimodal research with some participants newly considering it as a viable method for their research

This was a has led to requests for further collaborations and international visits to MODE.
Year(s) Of Engagement Activity 2013
 
Description Multimodal Analysis of Video: Possibilities for Researchers and Teachers in Early Years Education 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact Talk sparked discussion and questions afterwards.

After the talk, new connections were made with others in the field.
Year(s) Of Engagement Activity 2013
 
Description Multimodal Methodology for Examining Online Platforms "Using Multimodal and Narrative Approaches to Study Food Blogs: Studies about Food and Families", Social Research Association, Defra Office, London) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Talked sparked discussions and further inquiry from attendees afterwards .

After the talk, three doctoral students have asked to remain in contact regarding the work and using the framework discussed for their own research of digital data. Correspondence was continued with the three doctoral students and papers shared on the topic.
Year(s) Of Engagement Activity 2015
URL http://the-sra.org.uk/event-registration/?ee=122
 
Description Multimodal Methods Swap: Post-conference workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Participants shared their own data, generating discussions and feedback.

Participants shared their reflections on using multimodal methods through entries to the MODE project blog.
Year(s) Of Engagement Activity 2015
URL http://mode.ioe.ac.uk/2014/07/16/post-conference-student-methods-swap-shop/
 
Description Multimodal Methods for Analysing Communication with Digital Technologies: Summer School (2014) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The summer school sparked lots of questions and discussion.

The summer school was a successful follow-on from the previous year, and resulted in increased student enquires with respect to multimodality and study/research opportunities.
Year(s) Of Engagement Activity 2014
 
Description Multimodal Transcription (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact The workshop provided practical approach to multimodal transcription which was well received.

The workshop was a follow-on for a previous transcription workshop, and requests for further MODE training was received.
Year(s) Of Engagement Activity 2013
 
Description Multimodal Transcription (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact The workshop sparked discussion and questions afterwards.

The course provided practical resources for conducting transcription and received requests for further training.
Year(s) Of Engagement Activity 2013
 
Description Multimodal Transcription of Video: Analysing Child-Initiated Play in the Early Years. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Talk prompted questions and follow-up correspondence.

Following conference, a researcher from Hong Kong decided to visit London to attend the MODE summer school.
Year(s) Of Engagement Activity 2014
URL http://englishpolyu.wix.com/7icom
 
Description Multimodal Transcription of Video: Visualising Child-Initiated Play in the Early Years. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation poster presentation
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Discussions with other NCRM doctoral students.

New contacts were made and many requests for further information was received afterwards.
Year(s) Of Engagement Activity 2014
 
Description Multimodal analysis of social media and websites (2014) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact The analysis of networking sites, blogs and forums sparked questions and discussion.

Increased requests for further information with respect to multimodal approaches.
Year(s) Of Engagement Activity 2014
 
Description Multimodal analysis: The moving image - Theory, Practice and Education (2014) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Multimodality in film and tv analysis sparked a lot of discussion.

Increased requests for further information by educators, researchers and academics working with film.
Year(s) Of Engagement Activity 2014
 
Description Multimodal research seminar and workshop with the Multikul Research Centre 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The two days helped to develop analytical techniques for the participants' research projects, and to frame new bids.

The seminar provided an opportunity to consider new multimodal methods arising from MODE, and applicable to the participants' research; two successful applications for visiting researcher placements at the London Knowledge Lab. The strengthening of methodologies in the participants' research was notable.
Year(s) Of Engagement Activity 2014
 
Description Multimodality and culture - the case of construction toys, Theo van Leeuwen (2013) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The public lecture by Prof Theo van Leeuwen sparked many questions afterwards.

The lecture was well received and requests for further talks were received.
Year(s) Of Engagement Activity 2013
 
Description Multimodality: Methodological Explorations 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This MODE conference was well attended and had many international participants.

The conference was popular among students who had attended MODE summer school in previous years.
Year(s) Of Engagement Activity 2015
 
Description NCRM/MODE 'Methodological Explorations' Conference, UCL Institute of Education (Topic: 'The passion of young children's early storytelling as multimodal sign making' by R Flewitt) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The keynote sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description Online lecture for PGR students in the London Screen Studies Group 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The avatar-based presentation in Second Life on multimodality and film was well received and it complemented more familiar methodologies for film analysis.

The seminar provided an opportunity for PGR students to consider the value of multimodal approaches to film in their research projects. They reported that the delivery of seminar online was particularly effective. Many follow-up requests for further support in the use of multimodal methods were received afterwards.
Year(s) Of Engagement Activity 2014
 
Description Presentation on Multimodal Discourse, "Generating, managing and analyzing multimodal data in online platforms: the case of blogs, discussion forums and social media platforms" (Spain) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Sparked continued webinar discussions; future collaborative project with organisers on the topic .

The group who organised the event GRAPE (Group for Research on Academic and Professional English-http://www.grape.uji.es) have scheduled extra time for discussions on continued work with their team on applying the shared keynote in their development and research of virtual learning environments. They are currently seeking funding to continue to work together on a project that will further develop this strand with my collaboration).
Year(s) Of Engagement Activity 2015
URL http://ujiapps.uji.es/com/agenda/2015/05/25/webinar-grape/
 
Description Presentation: Digital Documentation in the Early Years 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Discussion of ideas, and relation to practice.

Greater connection between IOE research and Early Years practitioners.
Year(s) Of Engagement Activity 2015
URL http://www.sightlines-initiative.com/index.php?option=com_content&view=article&id=167%3Alondon-refoc...
 
Description Psychology Department, Marmara University, Istanbul, Turkey (Topic: 'Early literacy learning in a digital age' by R Flewitt) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The presentation sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description Recognising and Recording Young Children's Forms of Meaning-making: Conversations between Reggio Emilia and Multimodality, UCL Institute of Education (Generous Documentation by K Cowan) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The workshop sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2016
 
Description Research and analysis in mobile technology environments: A multimodal approach (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Workshop focusing on mobile technologies (e.g. smartphones, iPads, augmented reality) in research was well received.

Requests for further MODE training was received.
Year(s) Of Engagement Activity 2013
 
Description Researching Space and Time in Digital Environments: A Multimodal Approach (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The course sparked critical discussion afterwards.

Requests for further training and information.
Year(s) Of Engagement Activity 2013
 
Description Rommetveit summer school (Stord, Norway) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The workshop led by Jewitt, took participants through all stages of the use of video for research. There was excellent discussion throughout with participants discussing the ideas of the course in relation to their own video data, and the difficulties they had experienced in their different research contexts - this sharing of experience, as well as the deep discussion of the use of video was very successful.

to early to tell.
Year(s) Of Engagement Activity 2015
 
Description Seminar: 'Learning in the Early Years: A Multimodal Perspective' 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Seminar prompted discussion between a range of professionals and academics working in the field of Early Years.

Professional connections established.
Year(s) Of Engagement Activity 2014
URL http://mode.ioe.ac.uk/2014/05/01/early-years/
 
Description Sightlines London network, Balham Nursery School (Topic: 'Digital Documentation in Reggio Emilia' by K Cowan) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact The workshop sparked discussion and questions afterwards
Year(s) Of Engagement Activity 2015
 
Description Spaces and embodiment in virtual worlds and games: MODE/DARE (2014) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk sparked questions and discussion afterwards.

Networking increased requests for further collaboration.
Year(s) Of Engagement Activity 2014
 
Description Stories and Embodied Memories in Dementia (2013) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach Regional
Primary Audience Other audiences
Results and Impact Talk sparked questions and discussion afterwards.

Talk raised interest in further research seminars.
Year(s) Of Engagement Activity 2013
 
Description Symposium and paper to be presented at UKLA 51st International Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The event is forthcoming.
Year(s) Of Engagement Activity 2015
 
Description Symposium: Literacy Research Association (LRA) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Great interest during the session and afterwards via email form attendees. Routledge USA Publishers approached us for a book on the symposium topic. This is now commissioned and currently being written. Each paper is being developed separately as a journal article. I have been invited to give two subsequent keynote talks on pedagogies to support inclusive and multimodal literacies.

After the talk about research into Vivian Gussin Paley's pedagogy for social justice, several teachers and teacher trainees have remained in contact and have implemented the programme. Impact on teachers and teacher trainers in USA and UK, and beyond, in terms of building a theory-driven pedagogy for early years education that respects diversity and celebrates child voice. Plans made for further related activity, including co-authoring edited book, suite of journal articles and further invitations to speak e.g. mid-June I have been invited to give a keynote talk at a regional Practitioner Conference in Cambridge.
Year(s) Of Engagement Activity 2013
URL http://www.literacyresearchassociation.org/index.php#
 
Description Symposium: UK Literacy Association (UKLA) 51st International Conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact The event was informed by multimodal research.

The event is forthcoming.
Year(s) Of Engagement Activity 2015
 
Description Talk at International Conference on Conversation Analysis 2014, UCLA 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Talk was well received. The use of video-based methods in the operating theatre continued to spark discussion after the talk.

Korkiakangas was approached by an editor to a book who invited a chapter contribution based on the talk (forthcoming). Other future collaborations were planned.
Year(s) Of Engagement Activity 2014
 
Description Transcription: Issues of Selection and Representation (2014) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact The seminar sparked questions and discussion.

The seminar provided an opportunity to share experiences, which was highly valued by the participants.
Year(s) Of Engagement Activity 2014
 
Description Workshop: European Literacy Policy Network (ELINET) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Workshop sparked active debate and exchange of approaches to digital literacy; links made to other European projects; European networks were forged and re-inforced.

Feedback on the workshop was very positive, at the time and subsequently, from academics, NGOs and policy makers. Many participants have been in touch (20+) requesting more information about my expertise in digital and multimodal literacy in early education. Arrangements have been made for follow-up meetings e.g. in Holland in Jan 2016. Exchanging expertise on national policies on digital literacy, discussing the wide diversity of policy and practice approaches; identifying key dimensions for ensuring policy supports learning for the future with new technologies.
Year(s) Of Engagement Activity 2015
URL http://www.eli-net.eu/about-us/2nd-elinet-conference/
 
Description Workshop: Transcription: Issues of Selection and Representation 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Students related the issues raised to their own research, shared advice and challenges.

Participants reflected on what they had learned, and how the workshop had supported their research, in contributions to the MODE project blog.
Year(s) Of Engagement Activity 2014