DEVELOPING EDUCATIONAL SOFTWARE TO ASSESS IF AUTISTIC CHILDREN CAN BENEFIT FROM ACCESS TO OPEN LEARNER MODELS AND EMOTIONAL FEEDBACK ON LEARNING.

Lead Research Organisation: University of Bath
Department Name: Psychology

Abstract

This proposal brings together research in user interface (UI) design and human computer interaction (HCI), with research in psychology, autism and learning. It is a new collaboration specifically formed to address two novel research questions related to the development and evaluation of technologically mediated learning by children with autistic spectrum disorder (ASD). The first question concerns whether allowing ASD children access to models of their learning held by the system (i.e. open learner models), improves their learning experience and achievements. The second question relates to whether learning in ASD children is facilitated by the presence of an interface persona displaying emotions whilst providing feedback and help on the children's learning achievements. Mathematics is the discipline chosen for investigating the learning achievements, as ASD children have strengths, and therefore confidence, in this subject. Groups of non-ASD children matched on age and ability will act as a baseline or control group. The proposed research is multidisciplinary. From a user interface and HCI perspective there will be an emphasis on user-centred design and usability in designing the functionality, representation of, and interaction with, the open learner models (OLM) and interface personas. From both HCI and psychology perspectives the impacts on learning for both ASD and non-ASD children will be of interest. A further novelty of the research is the intention to investigate the challenges of involving ASD children as partners in designing the learning technology they will use.

Publications

10 25 50
publication icon
Benton L (2012) Developing IDEAS

publication icon
Benton L (2011) IDEAS

publication icon
Brosnan M (2016) Deficits in metacognitive monitoring in mathematics assessments in learners with autism spectrum disorder. in Autism : the international journal of research and practice

publication icon
Grawemeyer B (2012) Intelligent Tutoring Systems

publication icon
Grawemeyer B. (2011) The Impact of Autism Spectrum Disorder on the Categorisation of External Representations in Expanding the Space of Cognitive Science - Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, CogSci 2011

 
Description The project's South West Autism Group (SWAG) is a collaboration between the departments of Psychology and Computer Science. Together we have been working with pupils from both mainstream and Autism Spectrum Disorder (ASD) schools, to design educational software (Maths Island Tutor) to help with the teaching of Key Stage 3 maths.

To make sure the software we designed can teach maths in an exciting and useful way we needed to know the following:

The likes and dislikes of young people.
What motivates young people to learn maths.
The maths topics pupils can do easily and those that they may find difficult.

We designed software that children with ASD liked to interact with and receive feedback from. Although designed for children with ASD, the system can be used by all children learning mathematics.

It was very important to us that the young people who eventually used our software were involved throughout the project, but particularly during the design stage. We were keen to include their ideas and preferences in the software design to ensure the final product met their needs and was something they want to use.

In order to gather these ideas we chose to use a design method called 'Participatory Design'. This method involves running design sessions with both teachers and pupils at our partner schools. These sessions involved lots of different activities, from looking at the benefits and limitations of existing maths software, to thinking up new ideas to drawing out designs of the computer screen using a range of art materials (Benton supervised by Johnson).

The system used an open learner model, so the children can see what they have learned and what is to be learned.

The feedback so far from the teachers and pupils has been positive, and parents have been surprised at what the young people have managed to design.
Exploitation Route The Maths Island Tutor is a great resource for all learners of KS3 maths, especially those with ASD. The principles can be extended to any discipline and any other disorder.
Sectors Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Education

URL http://www.bath.ac.uk/psychology/research/groups/south-west-autism-group/maths-island-tutor/
 
Description The key findings has a link to the software that was developed through the project and is available to use. This supports maths learning in Key Stage 3. The Open Learner Model aspect is novel.
First Year Of Impact 2014
Sector Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Education
Impact Types Cultural

 
Description EPSRC Impact Acceleration Account
Amount £18,000 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 05/2016 
End 08/2016
 
Description digital bubbles 
Organisation University of Southampton
Country United Kingdom 
Sector Academic/University 
PI Contribution We have developed and promoted a free innovative mobile app, ASCmeI.T. using funds from Bath's EPSRC Impact Acceleration Account, related to this project. ASCmeI.T. was co-developed with members of the autistic community based upon the principled developed in this project. The app is free to download (ascme-it.org.uk) and enables anyone to submit ideas about "which technology for autism needs to be invented?", either using their mobile phones, or through the ASCmeI.T., website. The autistic community can therefore input into the very first stages of the technology design process for the first time, and the app is a good example of an e-participation method that could be applied much more widely (Austin et al., 2016; Good et al., 2016; Parsons et al., 2016). ASCmeIT was developed in collaboration with colleagues and fed into an ESRC seminar series entitled 'Digital Bubbles' (see Parsons et al., 2017).
Collaborator Contribution As above, it was a collaboration.
Impact Parsons, S., Yuill, N., Good, J., Brosnan, M., Austin, L., Singleton, C., Bossavit, B. and Barnabear (2016), "What technology for autism needs to be invented? Idea generation from the autism community via the ASCmeI.T. App", paper presented at the 15th ICCHP 2016 Conference, Linz, 13-15 July. Austin, L., Brosnan, M. Good, J., Yuill, N., and Parsons, S. (2016) ASCMEI.T. - AN ONLINE TOOL TO CAPTURE NEW DIGITAL AND TECHNOLOGICAL IDEAS AND FACILITATE THE DEVELOPMENT OF NEW PRODUCTS TO HELP INDIVIDUALS ON THE AUTISTIC SPECTRUM. PETRA '16 Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. Article No. 94. Corfu, Island, Greece - June 29 - July 01, 2016. Good, J., Yuill, N., Parsons, S., Brosnan, M. and Austin, L. (2016), "Putting technology design into the hands of the users with the ASCmeI.T. App", CHI 2016 Workshop on Autism and Technology: Beyond Assistance and Intervention, San Jose, CA, available at: http://igw.tuwien.ac.at/chi16-autismtechnology/attachments/GoodEtAl.pdf (accessed 26 March 2017).
Start Year 2014
 
Description digital bubbles 
Organisation University of Sussex
Country United Kingdom 
Sector Academic/University 
PI Contribution We have developed and promoted a free innovative mobile app, ASCmeI.T. using funds from Bath's EPSRC Impact Acceleration Account, related to this project. ASCmeI.T. was co-developed with members of the autistic community based upon the principled developed in this project. The app is free to download (ascme-it.org.uk) and enables anyone to submit ideas about "which technology for autism needs to be invented?", either using their mobile phones, or through the ASCmeI.T., website. The autistic community can therefore input into the very first stages of the technology design process for the first time, and the app is a good example of an e-participation method that could be applied much more widely (Austin et al., 2016; Good et al., 2016; Parsons et al., 2016). ASCmeIT was developed in collaboration with colleagues and fed into an ESRC seminar series entitled 'Digital Bubbles' (see Parsons et al., 2017).
Collaborator Contribution As above, it was a collaboration.
Impact Parsons, S., Yuill, N., Good, J., Brosnan, M., Austin, L., Singleton, C., Bossavit, B. and Barnabear (2016), "What technology for autism needs to be invented? Idea generation from the autism community via the ASCmeI.T. App", paper presented at the 15th ICCHP 2016 Conference, Linz, 13-15 July. Austin, L., Brosnan, M. Good, J., Yuill, N., and Parsons, S. (2016) ASCMEI.T. - AN ONLINE TOOL TO CAPTURE NEW DIGITAL AND TECHNOLOGICAL IDEAS AND FACILITATE THE DEVELOPMENT OF NEW PRODUCTS TO HELP INDIVIDUALS ON THE AUTISTIC SPECTRUM. PETRA '16 Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. Article No. 94. Corfu, Island, Greece - June 29 - July 01, 2016. Good, J., Yuill, N., Parsons, S., Brosnan, M. and Austin, L. (2016), "Putting technology design into the hands of the users with the ASCmeI.T. App", CHI 2016 Workshop on Autism and Technology: Beyond Assistance and Intervention, San Jose, CA, available at: http://igw.tuwien.ac.at/chi16-autismtechnology/attachments/GoodEtAl.pdf (accessed 26 March 2017).
Start Year 2014
 
Title Maths Island Tutor 
Description Maths tutor for Keys Stage 3. 
Type Of Technology Software 
Year Produced 2013 
Impact Supports children with ASD specifically but can support other groups. Designed by people with ASD. Unique features, e.g. nature of support. Open Learner Model. 
URL http://www.bath.ac.uk/psychology/research/groups/south-west-autism-group/maths-island-tutor/
 
Title ascmeit.org.uk 
Description An app that enables the autistic community to further engage in the participatory design of research. 
Type Of Technology Webtool/Application 
Year Produced 2016 
Impact Engagement with the autistic community. 
URL http://www.bath.ac.uk/research/news/2015/10/01/ascmeit
 
Description ascmeit.org.uk app 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact members of the autistic community interact with researchers to share research ideas for collaboration
Year(s) Of Engagement Activity 2016,2017,2018
URL http://ascmeit.org.uk
 
Description school visit with Aardman 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact Children from a range of school visited the university, trialed our software and took a modelling course with Aardman animators (the made a Gromit dog)
Year(s) Of Engagement Activity 2013
URL http://www.bath.ac.uk/psychology/research/groups/south-west-autism-group/