Fair-AIEd: Participatory design approaches to creating ethical AI for international education and development

Lead Research Organisation: University College London
Department Name: Culture, Communication and Media

Abstract

Warning of a global "learning crisis" in education, the World Bank recently claimed that without learning, education will fail to deliver on its promise to eliminate extreme poverty and create opportunity and prosperity for all. In response, Artificial Intelligence (AI) has been proposed as having the potential to accelerate the process of achieving global education goals by reducing barriers to access education, automating management processes, and optimising methods for improvement of learning outcomes. In order to realise this vision, public and private partnerships (P3s) are being established where artificial intelligence in education (AIEd) initiatives are being rolled out in developing countries in an effort to spur innovative digital transformations in education.

However, while AI in and for education is claimed to bring many benefits, it also potentially brings as many challenges, including social, political, economic, and ethical consequences. While the AI solution has considerable merit, a significant problem facing policy-makers, practitioners, industry and other relevant stakeholders is that there are no tangible indications that AI in education will promote the desired shifts or evidence of the impact that introducing such systems might have on the social life of Global South school communities.

In light of this, the Fair-AIEd project will examine the impact of P3 initiatives on the use of AI in education in two African contexts as examples of emerging market economies (Ghana and South Africa). As well as the implications that AI systems might have for teaching and learning, the project will investigate potential benefits, harms, and risks associated with the leadership roles corporations play in design and use of AI within the educational practices of developing nations. A key successful outcome of this project will lie in establishing a baseline for further research which seeks to understand the impact of AI in education in the Global South. The project is guided by the following questions:

RQ1: What are the social, political, economic, pedagogical, and ethical implications of embedding AI systems into international education and development contexts?
RQ2: How can P3 partnerships most effectively channel machine learning to drive fair-AI innovation for international education and development?
RQ3: How can governments facilitate the creation of ethical AIEd policies for development goals?

Potential impacts will be explored using ethnographic case-studies. Informed by data obtained in the field, stakeholders from industry, government, academia, and civic groups will co-design an Algorithmic Impact Assessment tool that can be responsive to diverse populations. Using fair-ML (Machine Learning) as a point of reference, the framework will identify key cross-cultural values and social issues against which the implications of AI in education can be identified and evaluated. Design of the tool will incorporate a local adjustment resource to accommodate cultural, religious, or other sources of value differences that emerge from field work.

The Impact Assessment will be piloted in six K-12 schools across Ghana and South Africa to determine the effectiveness of the tool. The impacts of AI technologies will be listed, mapped, and analysed to illustrate key issues and concerns in this emerging landscape and to identify potential for positive educational change. Upon identification of benefits, harms and risks as they apply to AIEd, stakeholders will then co-design and develop a Fair-AIEd Trust Mark. The Mark will be useful for the educational leadership of developing nations as they choose corporate partners and technical systems for their schools. Development and use of this tool will also provide guidance to companies who are willing to commit to the ethical principles upon which their educational technology proposals will be judged in terms of localising software and understanding regulatory compliance.

Planned Impact

The Fair-AIEd project works with partners in the UK, Ghana, and South Africa to examine the challenges of implementing Artificial Intelligence in Education (AIEd) in the Global South, and to generate practical solutions for transformational change. The study will engage school leaders, teachers, students, parents, industry, government, and other interested stakeholders in developing models of 'best practice'. Through these partnerships, the project seeks to strengthen capacity for research, innovation, and knowledge exchange in the UK and developing countries. The study has the potential for significant societal impact including and beyond academia:

Impact 1: The generation of new perspectives for future research on educational technology in schools and schooling;
Impact 2: Stimulating research collaboration and common agendas across academic disciplines and other key communities of practice;
Impact 3: Development of Fair AI-Ed research, innovation, and policy making that accounts for societal concerns and expectations;
Impact 4: Encouraging the effective use of knowledge, technology, and innovation to create opportunities for educational development, and community and business engagement, leading to new and improved processes and practices.

Academia: The study is designed to provide a detailed understanding of the impact of P3-driven AI initiatives on schooling. It will highlight whether, how, and why these technologies are being used in schools, and how schools, educational management, and other stakeholders might be better supported to make informed decisions about technology use. In this capacity, the study addresses issues of academic significance, providing a sociologically rigorous account of the role AI plays in international education and development. The project will also contribute to broader understandings of the changing nature of educational institutions, the professional practices of teachers, and the learning practices of students. Furthermore, the innovative methodology used to identify, map, and critically analyse complex socio-technical systems will be general enough to be reproduced in other contexts, representing an important methodological contribution of this project.

Civil society: Educators/practitioners, students, civil society, and interested citizens currently rely on discourses often popularised in pursuit of a specific outcome. Informed public debate requires the context the project seeks to provide: a contribution to public conversations about key ethical issues such as fair-AIEd driven by an intercultural ethics that is sensitive to local needs and expectations. This research has impact in a broader societal capacity by helping citizens understand the nature and implications of AI in schools.

Policy makers: We seek to provide a multi-national evidence base and framework for decision making that treats all stakeholders with appropriate weight. The project has potential to have a direct influence on national and global educational development policy (e.g. UNESCO), as well as on the behaviour of various organisations. Focused on applied policy development, the project will mobilise social science evidence to facilitate the creation of ethical policies and practices for international education and development aims.

Industry: Assessment tools and frameworks will be generated through participatory research to help stakeholders (e.g. Microsoft) comprehend the AI in Education landscape and to guide design of Fair-AIEd systems in the context of ethical and legal frameworks. These tools will be actionable and encourage reflexivity among stakeholders on the relationship between AI in educational development, innovation, and social/ethical concerns, especially by smaller entities lacking the ability to do such research themselves, but who would benefit from open access outputs. Assessment frameworks will inform new ways of thinking through technology development practices.

Publications

10 25 50
 
Description Under the current resource constraint settings that schools find themselves in, the question which has often arisen in the broader AI in Education (AIED) project is whether these children and their teachers can play any role in the global artificial intelligence discourse? How do we ensure that children are not left behind in this fast-changing global and national educational technology space? As we engage, participate and observe, we tend to have more questions than answers. However, it is our goal that the Fair-AI in Education project will bring the much-needed insights and well-weaved policy directions that can support digital acceleration in such communities and beyond.
Exploitation Route These findings can be used to develop policies that are contextually meaningful for the schools they are meant to serve.
Sectors Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Education,Government, Democracy and Justice

 
Description Our findings have been used in research articles and in global governance organisation reports.
First Year Of Impact 2021
Sector Education,Government, Democracy and Justice
Impact Types Societal,Policy & public services

 
Description Consultation with the UN Special Rapporteur on the Right to Education on the theme of Privatisation and the digitalisation of education
Geographic Reach Multiple continents/international 
Policy Influence Type Membership of a guideline committee
 
Description Member of Defend Digital Me Advisory Council
Geographic Reach Europe 
Policy Influence Type Participation in a guidance/advisory committee
Impact The impacts of this influence relate to regulatory changes specific to the digital rights of children. The reach of the impact includes regulatory advancements specifically in the United Kingdom but also extending to Europe: The State of Data Report, October 2020.
URL https://defenddigitalme.org/state-of-data/
 
Description Parliament for COVID-19 Outbreak Expert Database
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
Impact The Knowledge Exchange Unit in POST launched the COVID-19 outbreak expert database in 2020. I participated by contributing to the committee inquiries with recommendations specific to the domain of education. Through the survey, I shared my views about COVID-19 and how it impacted education. Benefits include improved insights into how schooling might be organised in light of the pandemic.
URL https://post.parliament.uk/covid-19-outbreak-what-are-experts-concerned-about/
 
Title Survey instruments to determine access to and use of new technologies in education 
Description Summary: The data collected through this survey instrument will be used to determine an indicator of differences in use and access of ICT across sociological constructs (such as age, gender, religion, SES). It will offer us an idea of the kinds of access state schools have and how such access distributes itself across regions which will be meaningful for informing policy decisions. Data analysis: To understand what the survey reveals about how schools, including principals, teachers and students interact with ICT (i.e. access to, use and ICT skills), responses from both core and optional questions will be subjected to consistency checks and data weighting process to specific data points of interest. Specific codes and commands will be generated using the Stata statistical software to produce estimates based on the sample design and disaggregated along the lines of sociodemographic characteristics. The estimates will be presented as total values, proportions, inferential statistics, and margin of errors, etc. for each indicator of interest. 
Type Of Material Improvements to research infrastructure 
Year Produced 2021 
Provided To Others? No  
Impact The notable impacts that we foresee as arising from the development and use of this research tool relate to informing more equitable and fair educational policy decisions which are context specific. 
 
Description Ethical Funding of Trustworthy AI 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Workshop where the following questions were discussed in an effort to influence policy and practice in the design of proposals for ethical AI:

- What are your thoughts on the acceptability of these proposals as a solution to the identified problem?
- Introduction of a Trustworthy AI Statement, what would effective implementation look like to you?
- Management and Monitoring by Funding Bodies, what would effective governance look like to you?

Feedback from the group session were analysed and used to update a proposed framework. Outcomes disseminated via academic journal articles, blog and a whitepaper.
Year(s) Of Engagement Activity 2021
 
Description Fair-AIEd Stakeholder Roundtable 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Stakeholder roundtable which was organised to introduce key members of the educational community to the aims and objectives of the project. The roundtable was used to share what we have learned thus far during the project and to identify possible steps forward. As the project is participatory, the event aimed to elicit the views of these stakeholders in terms of priorities to focus on. Future activities were planned specific to WP2 and 3.
Year(s) Of Engagement Activity 2021
 
Description Fair-AIEd project website 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I created the project website as a space for dissemination of research, including monthly project updates. These updates cover project aims and objectives; philosophical / theoretical frameworks, methods, general everyday project management tasks, findings, and other related events. The website is also a way for audiences to contact the project if they are interested in collaborations.

The blogging / journaling process is an attempt to share with others an honest and accountable research narrative guided by finding meaningful and ethical solutions for digital education in a way that is respectful of the natural environment and indigenous ways of life. The general aims for the website include the following:
* To explore how to integrate various dimensions of Open into education;
* To offer accounts of my experiences managing my first significant research project as narrative support to others who may find themselves in similar circumstances;
* To curate a multimodal gallery of this research journey as an organic path of data collection and discovery informed by "live" and innovative research methods.
Year(s) Of Engagement Activity 2020,2021
URL http://www.fair-ai.com
 
Description International Seminar on Internet Governance 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact The continuous development of Internet and its growing importance in society has prompted the need to think about the range of challenges around Internet governance. The aim is to improve engagement mechanisms through which various stakeholders can be represented and play their role. The seminar gathered researchers and representatives from diverse sectors with the aim of addressing perspectives, limits and opportunities for the future of Internet Governance, considering its path in the last 20 years since the World Summit on the Information Society (WSIS) that marked the height of its institutionalisation and formalisation.

The event raised awareness of critical issues pertaining to AI in education and governance. Further research collaborations were also discussed.
Year(s) Of Engagement Activity 2021
URL https://www.youtube.com/watch?v=3u5QtFnI5_k
 
Description NER For Social Network Analysis 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Advisory Board Member and research partner, Dr Andreas Vlachidis, presented on 13 May 2021 to the Humanities and Data Science group (Alan Turing Institute) the talk "Named Entity Recognition for Social Network Analysis". The presentation highlighted the role of NER in Fair-AIEd as a method for extracting textual evidence with respect to entities of interest (i.e. Person, Place, Organisation) from annual reports and policy documents relevant to the context of Artificial Intelligence in Education. Such extracted snippets of information are then arranged in form of a social graph for revealing relationships, connection trends and groups which is made publicly available from Graphcommons platform at https://graphcommons.com/graphs/d8581e95-cabf-4847-9435-c81f3f4ddea2.
Year(s) Of Engagement Activity 2021
 
Description Presentation at UCL Knowledge Lab's Intellectual Life session - 'The question concerning [meta]ethics: Biopolitical implications of public-private partnerships (P3) in the context of AI, ethics, and education' 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact In January 2021, I gave a talk at the UCL Knowledge Lab Intellectual Life seminar about my preliminary project findings. My focus was on tasks related to WP1 and RQ3 and began with the UK context:

WP1 - Foundations: Identify important concepts to be examined, and carry out a review of education and development initiatives specific to P3s and AI. The findings from WP1 form the basis for subsequent socio-technical tasks.
RQ3: How can governments facilitate the creation of ethical AIEd policies for development goals?

My presentation generated discussion about AI, ethics and education. It also opened up opportunities for future research collaborations and invitations to participate in external events.
Year(s) Of Engagement Activity 2021
 
Description Public debate on "AI and the future of education". 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact A public debate taking a critical perspective of AI for and in education. The intended purpose was to raise awareness of the critical issues surrounding the use of AI in education. The event also raised awareness of the Fair-AIEd project. We have been invited to engage further with dissemination activities as a result. The debate is on YouTube and continues to accrue views.
Year(s) Of Engagement Activity 2021
URL https://www.youtube.com/watch?v=Epwj1BTt3wM