UnBias: Emancipating Users Against Algorithmic Biases for a Trusted Digital Economy

Lead Research Organisation: University of Nottingham
Department Name: School of Computer Science

Abstract

Contrary to public opinion, young people care about their personal data and want a digital world more transparent, a digital world they can trust. For example, little is known about how Amazon is able to tailor advertisements and recommend products that are actually interesting for potential online customers, or how Facebook decides which news Facebook users may be more inclined to read. All the mechanisms that support this filtering of information and products is obscure and internet users would like to know more about it, such as possible bias in their behaviour and, more importantly, have some control over these recommender systems.

This project aims to closely work with young people to further understand how aware 'digital natives' are about algorithm bias, their attitudes and main concerns and recommendations when interacting with such systems. This information will help us to better understand the way young people interact with such systems and identify youth-led solutions for teaching critical thinking toward digital information systems. We will apply different engagement tools and methodologies including focus groups, workshops and youth 'juries' to facilitate discussion, reflection and a deeper understanding of youth online behaviour and youth-lead software solutions.

Relevant for this project is the development of 'fairer' algorithms with young people or non-experts as well as with experts. To do that, we intend to run a series of hackathons or workshops in which expert programmers and young people will work together to produce and evaluate new fairer algorithms that will produce more transparent and less creepy outputs. We will also run an 'ethicon'; an innovative approach in which scientists and ethicists work together to produce ethically justifiable algorithm design. During this process the project will be able to identify a series of principles that will contribute to the development of a platform that will allow users to have more control over the existing online filtering systems. In other words, this project will provide citizens with the skills and tools to better judge when and how much to trust the information they are given, understand the digital identity that algorithms create from user's personal data as well as protecting the users' privacy and online security.

This project will provide policy recommendations, ethical guidelines and a 'fairness toolkit' co-produced with young people and other stakeholders that will include educational materials and resources co-designed to support youth understanding about online environments as well as raise awareness among online providers about the concerns and rights of young internet users. This project is relevant for young people as well as society as a whole to ensure trust and transparency are not missing from the internet.

The results will be widely disseminated to a variety of audiences ranging from academic peer-review journals to community groups of interest such as secondary schools and youth clubs.

Planned Impact

*General Public:*
The public is at the centre of this project from the initial co-design of scenarios/tasks, through the 'Youth Juries' workshops and focus group sessions that map public concerns, to co-design Hackathons and prototype evaluation sessions.

Educational materials produced as part of the project will be made available to educators, guardians and other stakeholders. These materials will help to empower citizens with skills and tools to reflect upon the behaviour of social media algorithms so that they will be better positioned to know which online services to trust, manage their online identity and privacy and be more secure from unwanted manipulation.

In addition workshop with young people, their guardians and educators, the project will also include dedicated public engagement and communications activities, such as presentations associated at:
- ESRC Research Methods Festival.
- ESRC Festival of Social Science.
- Nesta's Future Fest [futurefest.org], a weekend dedicated to "radical ideas, compelling talks and immersive experiences to inspire, excite and challenge perceptions of the future".
- MozFest in London, an annual hackathon organized by the Mozilla foundation.

*Policy-makers:*
Our findings regarding the cumulative impact of filtering/recommender algorithms on users will be communicated to the Information Commissioner's Office, to facilitate evidence based policy review related to the UK Data Protection Act's 'principle 6' on the "protection of individuals against having significant decisions made about them by wholly automated mean".
A report on teaching critical inquiry of algorithm mediated information will be prepared for presentation to the minister for internet safety and security for contributing towards evidence based policy making.
A report, summarizing our findings on subjective experiences of algorithm 'fairness' and related design guidelines for 'fair' information control algorithms will be produced for industry bodies, to support the development of improved industry guidelines on transparency and responsible innovation.

*Industry:*
There will be a series of workshops for software developers and service providers to encourage thinking about implicit and explicit biases that may affect information control algorithms. It is the hope that these workshops will stimulate innovations that will boost the reputation of the UK Digital Economy as leader in trustworthy, reliable systems.
The project will tap into an existing network of over 200 commercial partners at the Horizon Digital Economy Research institute to disseminate findings and encourage participation in relevant events. One route to engagement with SMEs will be through Continuing Professional Development workshops. Efforts will be particularly focused on sectors where understanding human behaviour and 'fair' unbiased information provision is business-critical, such as market analysis and product evaluation.
Beyond the immediate benefits to citizens, the outcomes will also contribute towards a fairer digital economy by helping to expose anticompetitive practices that might be embedded in algorithm behaviours and which harm SMEs especially.

*Third Sector:*
The educational materials produced by this project will be made available to support programmes by NGOs and Charities, like the Mozilla foundation, in teaching young people how to develop critically inquiring attitudes towards digital systems. Starting from the first year the project will engage with these organizations as an important part of the stakeholders workshops.
The 'Youth Juries' workshops will build on existing links between the Horizon Digital Economy Research institute and the iRights coalition which promotes the rights of young people online.
 
Title Our Future Internet: Free And Fair For All! 
Description This is a short video animation (under 3 minutes) which explains what algorithms are, how they shape our online browsing and how they can create risks of bias. It also describes how the UnBias project seeks to promote a future Internet that is free and fair for all. It was commissioned to a external company but co-created with the UnBias team. 
Type Of Art Film/Video/Animation 
Year Produced 2018 
Impact Since it was launched in May 2018, it has been disseminated by our team in a wide range of activities including: UnBias competition, national and international presentations, the UnBias Showcase event, V&A Digital Design weekend, ESRC and Impact Exploration Grant workshops, and other UnBias related workshops/public engagement events. The feedback we have received from this video animation has been extremely positive. In particular, workshop participants including young people and/or older adults (65 years of age and older) with or without previous knowledge of the concept of algorithms said the content of the video was very clear, fun and educational! 
URL http://bit.ly/OurFutureInternet
 
Title Roots 
Description This was an artistic exhibition organised at the Institute of Mental Health. The purpose of this exhibition was to share the artists' work and inspire others to try art as a means of helping them through difficult times by finding ways to express their emotions and be in the "here and now". 
Type Of Art Artistic/Creative Exhibition 
Year Produced 2017 
Impact Outcomes of "Roots" Exhibition. Artist statement: People have expressly stated how inspired they have been by the art and staff at IMH have stopped and thanked me stating that the light and life the artwork has brought into the building has been inspiring. Many people have stated that they have felt emotional connections to the artworks. Contributions to others and the community: Provided a talk with a group of MA students of Trauma and used the displayed artwork as a talking point for growth and resilience through trauma. Followed up with an individual student interview to assist with dissertation studies Held live discussion with BBC Radio Nottingham (Alan Clifford show) Developed links with the Nottingham Peace Project and planned provision of and gained council funding to lead "expression through art" workshops for young people in Basford (2018) Roots Exhibition Book - my story of Trauma, Resilience and Growth with accompanying paintings 1. Charitable financial benefits: Sales of paintings have raised £800 to provide a Remembrance Bench for Joel Cooke and £300 for Young Minds Trust. A total of £1,100 sales was made between the 10th October 2017 and 5th of January 2018. 2. New friendships and New opportunities: I have had a number of people ask me to show them how I paint different styles and I am starting small workshops at home on the 10th Jan 2018 I am contributing to Prof Stephen Regel's Stories and Narratives Project (2018) I am working with Su Ansell (De Montford University) on producing a short film about resilience, change and growth (2018) 3. Personal Growth, Empowerment, Health and Well-Being: The exhibition has encouraged me to get out and about, meet new people, socialise and converse. Exposure to the environment, particularly travelling on buses was my goal for my trauma treatment. I now have no fear of travelling on buses or passing through Nottingham. My confidence and communication skills are much improved. When I began planning g the exhibition with Elvira I had to take my daughter with me as I struggled with conversation skills. That is no longer the case. I am sure Elvira has noted the differences since we first met. My family and friends often comment on the progress I have made in overcoming my fear of public places and people. I intend to continue to raise funds for charity, raise awareness of how we can rebuild our resilience and growth through art expression. I will continue to inspire others by sharing my story and art. 
URL http://www.institutemh.org.uk/x-about-us-x/art-at-the-institute
 
Title UnBias Fairness Toolkit 
Description The Fairness Toolkit has been developed for UnBias by Giles Lane and his team at Proboscis, with the input of young people and stakeholders. It aims to promote awareness and stimulate a public civic dialogue about how algorithms shape online experiences and to reflect on possible changes to address issues of online unfairness. The toolkit contains the following elements: Handbook, Awareness Cards, TrustScape, MetaMap and Value Perception Worksheets.For more detail about these components please visit https://unbias.wp.horizon.ac.uk/fairness-toolkit/. All components of the Toolkit are freely available to download and print from the UnBias website under Creative Commons license (CC BY-NC-SA 4.0). This output has elicited lots of interest from different sectors National and International: education, third sectors organisations, NGOs, public and private sector, academia, policy development, regulatory bodies, media, online industry and the general public. By the 12th February 2019, 194 decks of Awareness Cards have been given away and/or requested from a wide range of organisations including UNICEF, Mozilla, Microsoft, IBM, Welcome Trust, House of Lords, ISOC UK, national and international NGOs and more than 20 national and international universities, and British schools and academies, etc. 
Type Of Art Artefact (including digital) 
Year Produced 2018 
Impact The toolkit has been co-created with young people- so right from the outset of its development, it helped to stimulate discussion surround fairness and safety online. We have also had the opportunity to revisit some of the young people who were involved in the creation of the fairness toolkit, and host workshops with them to allow them to interact with the fairness cards. This has been received well, and again there has been evidence of good work. The most popular components of this Toolkit so far have been the TrustScapes and the Awareness Cards. We have run more than 20 workshops using these elements and have been very welcomed by participants from different sectors, backgrounds and interests as well as different age groups ranging from 13 to 65 years of age and older. Even though this output was designed to raise awareness and stimulate debate, discussion and critical thinking on issues of online algorithm fairness, they were also design for civic thinking around more general issues of fairness/ethics beyond the online sphere. Feedback we have received so far from people that have used this tool it's been extremely positive. In particular, our research teams working in the UnBias and currently in the ReEnTrust projects (both EPSRC funded) have been using the TrustScapes and Awareness Cards in a series of different workshops and public engagement events. Participants have found them fun and very useful as an educational tool as well as to aid debate in very topical issues related to online fairness and to reflect on the impact of algorithm bias on internet users' experiences. In addition to the extensive programme of user focus groups we have run within UnBias and will run in our current project ReEnTrust, to reach broader audiences, raise awareness and elicit public views on online fairness as well as trust in algorithms across a broad range of individuals, we have and will continue using this Toolkit in public engagement events such as MozFest, the ESRC Festival of Social Science, STEMcity Festival of Science and Curiosity, the annual Women in Computer Science day at Oxford, and other local science and technology festivals in the UK. We believe it is critical that we investigate issues of online fairness giving internet users a supportive space to share their views and provide recommendations on what changes should be done to have better user's online experiences. In particular we are very pleased to make vulnerable users voices - from young people and older adults- heard! and promote change on online policy and regulatory affairs. There is great interest and potential for future use and deployment for the toolkit. 
URL https://unbias.wp.horizon.ac.uk/fairness-toolkit/
 
Description The UnBias Youth Juries methodology introduced to promote digital citizenship led to identifying:
1. The existence of concerns over the contemporary prevalence algorithm driven online platforms
2. A desire for change to improve the user experience of these platforms
3. Opportunities for change - we identified capacity to address unfairness in algorithmic systems through various means, in particular via education, engagement and policy change.
Exploitation Route Our contributions towards policy recommendations include the co-authoring of a report for the European Parliament Science Technology Options Assessment to support a governance framework for algorithmic accountability and transparency. Submitting research findings to the UK Information Commissioners Office Call for Age Appropriate Design Code led to supporting Revealing Reality (the Agency commissioned with developing the code).

We have submitted research evidence to UK Parliamentary inquiries.

Our contributions towards standards setting involve chairing the IEEE P7003 Standard for Algorithmic Bias Considerations Working Group and participating (through the British Standards Institute) in work on setting Standards for Artificial Intelligence by ISO/IEC.

Open source resources - Youth Jury Open Educational Resources, Fairness Toolkit, Video (Our Future Internet - free and fair for all) could be put to use by IT teachers and parents to help understand algorithmic processes in daily life . Requests for resources have been received by a wide range of global organisations including UNICEF, IBM, Internet Society UK, House of Lords etc.
Sectors Digital/Communication/Information Technologies (including Software),Education,Government, Democracy and Justice,Security and Diplomacy

URL http://unbias.wp.horizon.ac.uk/
 
Description The project has led to input to UK and EU government inquiries on topics related to the role of algorithmic accountability, transparency and in decision making processes, the Internet and whether to regulate or not, the impact of algorithmic UnBias and we are engaged in discussions around Baroness Kidron's amendments to the UK DPA around age appropriate design, whilesocial media and screen use on young peoples mental health and well-being and fake news. Evidence submitted in response to the Information Commissioner Office relating to an Age Appropriate Design Code Call led to supporting the work of Baroness Kidron and the 5Rights Foundation to develop the Code. This work is ongoing. Reserach findings fed into three successful grant applications - Telling Tales of Engagement (2017) , Impact Exploration award (2018) and ReEnTrust (2018) to further work in this area. This research project presented opportunities to network and build a strong stakeholder representation with expertise crossing professional, industry, policy, education, NGOs and legislative institutions. This led to an opportunity to Chair the IEEE P7003 working group developing a new standard for algorithmic bias considerations. This work is ongoing. Open source resources have been used at a number of out reach events among varied audiences, have been shared and made publicly available for sustainability beyond the lifecycle of the project.
First Year Of Impact 2017
Sector Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Education,Government, Democracy and Justice
Impact Types Societal,Policy & public services

 
Description AlgoAware workshop. Ansgar Koene, Brussels
Geographic Reach Europe 
Policy Influence Type Participation in a advisory committee
Impact Contribution to high-level expert discussion with representatives from the European Parliament, the European Commission as well as Civil Society. The recent "State of the Art" report on automated decision-making by AlgorithmWatch (https://www.algoaware.eu/state-of-the-art-report/) was launched on this event. The UnBias project gets mentioned as examples of an initiative by academic research groups to develop Policy and technical tools (page 10), in particular with the UnBias "Fairness Toolkit" as a "clear example". The report also includes a summary of the aims of the UnBias project (page 57) and the elements of the "Fairness Toolkit" (with references to the relevant webpages).
URL https://www.algoaware.eu/2018/11/14/29-jan-2019-automating-society-taking-stock-of-automated-decisio...
 
Description Evidence to UK Parliament inquiry. Koene A.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/culture-media-and-s...
 
Description Marina Jirotka invited to sit on the Advisory Board of The Society for Computers and Law
Geographic Reach Multiple continents/international 
Policy Influence Type Membership of a guideline committee
 
Description Marina Jirotka invited to sit on the advisory board of APPG on Data Analytics - Data and Technology Ethics Inquiry
Geographic Reach National 
Policy Influence Type Membership of a guideline committee
 
Description NSF future scoping workshop on Trustworthy Algorithmic Decision-Making
Geographic Reach North America 
Policy Influence Type Participation in a national consultation
URL http://trustworthy-algorithms.org/whitepapers/
 
Description Response to Commons Science and Technology Committee "Impact of social media and screen-use on young people's health" inquiry (SMH0131). McAuley D., Koene A., Perez E-V., Portillo V., Creswick H., Dowthwaite L. and Cano M-G.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/science-and-technol...
 
Description Response to House of Commons inquiry. McAuley D., Koene A., Perez E-V., Jirotka M., Patel M. & Webb H.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/science-and-technol...
 
Description Response to House of Lords Select Communications Committee "The Internet - To Regulate or Not To Regulate?" inquire (IRN0038). McAuley D, Koene A, and Urquhart L.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/communications-comm...
 
Description Response to House of Lords inquiry. Koene A.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/artificial-intellig...
 
Description Response to Information Commissioner's Office (ICO) Age Appropriate Design Code call for evidence.
Geographic Reach National 
Policy Influence Type Participation in a national consultation
URL https://ico.org.uk/media/2260169/horizon-digital-economy-research-insitute-university-of-nottingham....
 
Description Science Technology Options Assessment report for the European Parliament: A Governance Framework for Algorithmic Accountability and Transparency
Geographic Reach Europe 
Policy Influence Type Gave evidence to a government review
URL http://www.europarl.europa.eu/ep-live/en/other-events/video?event=20181025-0930-SPECIAL
 
Description USACM Panel on Algorithmic Transparency and Accountability
Geographic Reach North America 
Policy Influence Type Membership of a guideline committee
URL https://www.acm.org/public-policy/algorithmic-panel
 
Description Biomedica Research Centre fuding
Amount £24,322 (GBP)
Organisation University of Leicester 
Department NIHR Biomedical Research Centre
Sector Hospitals
Country United Kingdom
Start 01/2018 
End 01/2019
 
Description Digital Rights
Amount £57,600 (GBP)
Funding ID TLEF 2017 001045 
Organisation The Legal Education Foundation 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2018 
End 04/2019
 
Description EPSRC- Impact Exploration Grant
Amount £10,000 (GBP)
Funding ID EP/R511730/1 
Organisation University of Nottingham 
Sector Academic/University
Country United Kingdom
Start 09/2018 
End 07/2019
 
Description RPA Digital Futures About Algorithms and beyond
Amount £30,000 (GBP)
Organisation University of Nottingham 
Sector Academic/University
Country United Kingdom
Start 04/2017 
End 05/2018
 
Description RPA Rights and Justice Access to justice in a digital age: suspects' legal rights
Amount £15,000 (GBP)
Organisation University of Nottingham 
Sector Academic/University
Country United Kingdom
Start 04/2017 
End 09/2018
 
Description Smart City Project
Amount £8,000 (GBP)
Organisation University of Nottingham 
Sector Academic/University
Country United Kingdom
Start 05/2017 
End 05/2018
 
Description Chair of IEEE-SA P7003 Standard: Algorithmic Bias Considerations - Dr Ansgar Koene 
Organisation Institute of Electrical and Electronics Engineers (IEEE)
Country United States 
Sector Learned Society 
PI Contribution I proposed the P7003 standard as part of the IEEE Global Initiative for Ethics of Autonomous and Intelligent systems. I chair the IEEE working group for the development of the P7003 Standard for Algorithmic Bias Considerations. The work involves facilitating a monthly conference call, promoting the work to attract working group participants and providing the general outline for the standards documents. Liz Dowthwait from the UnBias project is the P7003 secretary, supporting my work by helping with the monthly agenda and conference minutes.
Collaborator Contribution The IEEE Standards Association (IEEE-SA provides the liaison officer to assist with coordination of the P7003 working group with the wider IEEE Standards activities. IEEE-SA also provides the web-conferencing facilities (WebEx) and online document hosting/collaboration space (iMeet). The IEEE Global Initiative has been facilitating media engagement and policy engagement activities (e.g. ACM/IEEE panel on Algorithmic Transparency and Accountability in Washington DC where I was a panel member)
Impact Dr Ansgar Koene was contacted by the ACM to participate in a panel discussion on Algorithmic Transparency and Accountability in Washington DC on 14th September 2017. https://www.acm.org/public-policy/algorithmic-panel. There was a write-up of the panel discussion, with follow-up interview with Ansgar "IEEE and ACM Collaborations on ATA", published in AI Matters: A Newsletter of ACM SIGAI, on 1 October 2017. Ansgar's role as chair and a summary of the P7003 Standard were mentioned in the article: "The Ethics of Artificial Intelligence for Business Leaders - Should Anyone Care?", in TechEmergence, on 9th December 2017. Ansgar was invited to publish a short paper on the IEEE P7003 activity in IEEE Technology and Society Magazine, "Algorithmic Bias: Addressing Growing Concerns", IEEE Technology and Society Magazine, Volume: 36, Issue: 2, June 2017. [DOI: 10.1109/MTS.2017.2697080]. An interview with Ansgar about P7003 was published in The Institute (The IEEE news source), on 12 September 2017, "Keeping Bias From Creeping Into Code".
Start Year 2017
 
Description ISCO-UK "User Trust" 
Organisation Internet Society (ISOC)
Country United States 
Sector Charity/Non Profit 
PI Contribution In collaboration with ISOC-UK the UnBias team has run two workshop hosted by ISCO-UK. The first workshop was a panel discussion on "Multi-Sided Trust in Multi-Sided platforms" https://unbias.wp.horizon.ac.uk/2018/04/13/isoc-uk-horizon-der-panel-for-multi-sided-trust-on-multi-sided-platforms/ The second workshop was a demonstration of the UnBias "Fairness Toolkit" with a session using the Awareness Cards https://unbias.wp.horizon.ac.uk/2018/11/23/workshop-on-algorithmic-awareness-building-for-user-trust-in-online-platforms/
Collaborator Contribution The ISOC-UK partner published the workshop to its members, and hosted the workshop events.
Impact The collaboration is multi-disciplinary due to the nature of ISCO as a multi-disciplinary membership organization with members from a wide range of industry, civil-society and academic groups who are interested in an open and free internet
Start Year 2018
 
Description Secretary of IEEE-SA P7003 Standard: Algorithmic Bias Considerations 
Organisation Institute of Electrical and Electronics Engineers (IEEE)
Country United States 
Sector Learned Society 
PI Contribution I support the work of the P7003 standard as part of the IEEE Global Initiative for Ethics of Autonomous and Intelligent systems by organising and minuting the monthly working group meetings. The group (EEE working group for the development of the P7003 Standard for Algorithmic Bias Considerations) is chaired by Ansgar Koene, also a member of the UnBias project.
Collaborator Contribution The IEEE Standards Association (IEEE-SA) provides the liaison officer to assist with coordination of the P7003 working group with the wider IEEE Standards activities. IEEE-SA also provides the web-conferencing facilities (WebEx/join.me) and online document hosting/collaboration space (iMeet). The IEEE Global Initiative has been facilitating media engagement and policy engagement activities.
Impact Minutes of all meetings are available at http://sites.ieee.org/sagroups-7003/
Start Year 2017
 
Description "Who is in charge? You or the algorithm?" A. Koene (Explorers Fair- Festival of Science and Curiosity, Nottingham) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact This was a general talk to reflect about how search engines, social networks, news recommender systems, etc., select which information is relevant for the user. The main purpose of this event was to raise awareness of how the internet works in a "language" for all ages. Being part of a Science Festival event for families, the audience was quite broad (from 9 year olds to teenagers, accompanied by their parents).

The audience participated answering and making questions during and at the end of the presentation.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/2017/02/19/unbias-public-engagement-at-the-explorers-fair/#more-368
 
Description Studium Generale presentation at TU Eindhoven. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Invited presentation to undergraduate and general audience, open to the public, at the University of Eindhoven. This talk was part of Holland Design Week at Eindhoven and also qualified for credit for undergraduate students at TU Eindhoven as part of their Technology Impact on Society foundations course. The event was attended by 350 people, student and staff a of TU Eindhoven and eternal people. The talks spakred a lively discussion. After the talk Ansgar was invited to participate in a one-week "Lorentz workshop" at the University of Leiden on "Intersectionality and Algorithmic Discrimination" that took place in December 2017
Year(s) Of Engagement Activity 2017
URL http://www.studiumgenerale-eindhoven.nl/nl/agenda/archief/the-age-of-the-algorithm/0/1109/
 
Description "Civic Tech 101": civic engagement collaboration with Nottingham City Council 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Policymakers/politicians
Results and Impact About 25 people attended a pre-session meeting followed by a live Skype and Q&A conference with Christopher Whitaker, the organiser of Chi Hack Night (Chicago's weekly event to build, share and learn about civic technology). The purpose of the event was to provide some insights into how civic technology could be used in Nottingham to produce online resources that will make complex and important information accessible to Nottingham citizens.

This event brought a wide range of stakeholders together (see "who were the audiences" section, above) aiming to create a multidisciplinary collaborative team. The members for the "Civic Tech 101" Steering Group will be decided on the next meeting (20th March 2017).
Year(s) Of Engagement Activity 2017
 
Description "Interacting with different web browsers & search engines - Do you care?" (Explorers Fair - Festival of Science and Curiosity, Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Seventy pupils attended this drop-in activity at the Explorers Fair Expo, as part of Nottingham Festival of Science and Curiosity (10th February).
Sessions involved hands-on exercises where students, working in pairs, compared results obtained when using different browsers and/or search engines. Participants engaged and discussed about their online preferences and/or concerns regarding: algorithm bias, filtering systems, fairness and privacy issues.

At the end of the sessions, networking with teachers led to establish links with schools to promote other current research activities within our research team (e.g., UnBias Youth Juries). Also, this activity contributed to develop strong links with the organisers of the Science and Curiosity Festival, which takes place annually in Nottingham, and to express our interest to take part in future events.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/explorers-fair-expo/
 
Description "Logan Paul's dead body video reinforces call for better child protection online", in the Conversation 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Elvira to add
Year(s) Of Engagement Activity 2017
URL https://theconversation.com/logan-pauls-dead-body-video-reinforces-call-for-better-child-protection-...
 
Description "Machine gaydar: AI is reinforcing stereotypes that liberal societies are trying to get rid of", in the Conversation 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Impact: Reposted on Digital Leaders blog, and Medium page on 29th November 2017.
Year(s) Of Engagement Activity 2017
URL https://theconversation.com/machine-gaydar-ai-is-reinforcing-stereotypes-that-liberal-societies-are-...
 
Description "What kind of internet do children and young people want?" NSPCC annual conference, London. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Poster presentation to the "How safe are our children?" conference. Our results sparked interesting questions and discussion during the poster session. Networking with other researchers in the field as well as members of third sectors organisations was relevant for our research project. It was a very inspiring conference whose participants included children sharing their online experiences with the audience, as well as key researchers and members of the public sector including Prof. Sonia Livingstone (LSE), Alexandra Evans (5Rights foundation) and Matt Hancock (Secretary of State for Digital, Culture, Media and Sport).
Year(s) Of Engagement Activity 2018
URL https://unbias.wp.horizon.ac.uk/tag/conference
 
Description "they don't really listen to people". Young people's concerns and recommendations for improving online experiences.Helen Creswick, Liz Dowthwaite, Ansgar Koene, Elvira Perez Vallejos, Virginia Portillo, Monica Cano and Christopher Woodard 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This presentation highlighted young people (13-17 years old) concerns in relation to online issues of algorithm bias. In particular users' lack of agency and feelings of disempowerment in young people's internet use, exacerbated by their experiences of online terms and conditions.The audience engaged with interesting questions about the applicability of these findings to the adult population.
Researchers were invited to submit an enhanced version of the research paper to a special issue of the Journal of Information, Communication and Ethics in Society, which has been recently accepted for publication but is not available online yet.
Year(s) Of Engagement Activity 2018
URL https://easychair.org/smart-program/ETHICOMP2018/2018-09-24.html#talk:78107
 
Description ALGORITHMIC DISCRIMINATION: ARE YOU IN OR OUT? 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Blog about algorithm bias and possible discrimination to the users, posted in UnBias website.
Year(s) Of Engagement Activity 2016
URL http://unbias.wp.horizon.ac.uk/2016/10/21/algorithmic-discrimination-are-you-in-or-out/
 
Description Accessible Fun Day- Festival of Science and Curiosity, Nottingham 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Hands-on activity for the general public but in particular for a SEND audience, aimed to bring awareness and to reflect on how personal data is used by online platforms. It was the first time UnBias took part of an activity SEND audience-friendly. Children from different ages and learning abilities, parents, grandparents and careers engaged with creative activities which sparked very interesting discussions and genuine interest from the public about our research topic. This activity received good feedback by online social networking (e.g., on twitter).
Year(s) Of Engagement Activity 2017
 
Description Accountability and regulation of algorithms. EuroDIG2017 conference, Estonia. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact As part of the EuroDIG (European Dialogue on Internet Governance) conference UnBias organized a 30minute 'flash session' on Accountability and Regulation of Algorithms. This session was held on the first day of the conference. EuroDig is a multi-stakeholder dialogue forum bringing together civil-society, government, academic and industry to discuss issued related to the future on the internet. In keeping with the spirit of this conference the UnBias led session consisted of a brief introduction of the issues of algorithmic bias followed by a lively discussion involving representatives from UNICEF, Google, Internet Society, European Commission and various others. Following this session a member of the DG connect team at the European Commission requested to join the UnBias stakeholder group.
Year(s) Of Engagement Activity 2017
URL https://eurodigwiki.org/wiki/Accountability_and_regulation_of_algorithms_-_Flash_02_2017
 
Description Algorithm Mediated Online Information Access (AMOIA) - user trust, transparency, control and responsibility. WebSci17, NY. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This activity was part of an ongoing series of stakeholder workshops we are running for UnBias to discuss fairness, and other ethics issues, in algorithmic decision making. This particular instance of the workshop series was a workshop help on the first day of the WebScience conference in Troy, New York, USA. Participants were other academic attendees of the Webscience conference. The event involved a lively discussion between participants, which was voice-recorded for future analysis (participants gave written consent) and provided an interest US perspective on the issues we had previously discusses with participants in the UK. Following the workshop a number of participants joined the UnBias stakeholder group to keep up to date on future activities of the project.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/event/amoia-workshop-at-acm-web-science-2017/
 
Description Algorithm Workshop, Held at the TIC, Strathclyde, February 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Lilian Edwards organised an Algorithm Workshop on 27th February at the Technology Innovation Centre (TIC) at Stathclyde for the benefit of Internet Law and Policy Masters students, and Internet law Honours students, as well as invited guests from law, technology and business and public attendees. The event was a sell out with 300 attending and created much interest on social media.
The workshop considered the legal, social and technical dimensions of algorithms and their role in governance. As our everyday lives are more and more determined by decisions made by automated algorithmic processes, the status of algorithms and how they can be regulated , queried and countermanded, becomes evermore important. To give just a few examples, algorithms now often determine how we are assessed as risks for policing and terrorism surveillance: how we get hired, fired and promoted; and what news and political opinion we are exposed to. Both personal and societal welfare and arguably, the future of democracy itself, thus depend on being able to regulate and make accountable the algorithm society. In particular a major current question is if a right to explanation of what an algorithm has decided exists in data protection law? Lilian spoke on this in her contribution: ""Slave to the Algorithm: War Stories and Legal Remedies".
We hope the event will be a "starter seed" for CILP and partners (including Edinburgh and Horizon DEC, Nottingham) to investigate this fascinating topic further and we will be seeking major grant funding. ax 120000 characters)
Year(s) Of Engagement Activity 2017
URL http://www.strath.ac.uk/humanities/lawschool/newsevents/algorithmworkshopfebruary2017/
 
Description Algorithmic Decision-Making. European Big Data Value Forum, Versailles. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Ansgar Koene presented an invited talk on the ongoing activities of the UnBias project, and the related work of the IEEE P7003 Standard for Algorithmic Bias Considerations working group he chairs. This presentation was part of the Data & Society panel session on the 2n day of the conference. The session was attended by about 200 people consisting of industry, academia, government and NGO attendeed of the European Big Data Values forum. Following the presentation there was a panel discussion. At the end of the session Ansgar was approached by a number of audience members to request future contact by a professor from Télécom Ecole de Management and a person from the New York based NGO NYSci [https://nysci.org/NYSci] regarding our work of engaging with young people on their experience and recommendations related to online algorithmic services.
Year(s) Of Engagement Activity 2017
URL http://www.european-big-data-value-forum.eu/program/data-society/#algorithmicdecisionmaking
 
Description Algorithmic awareness building for User Trust in online platforms. ISOC-UK England, London 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Interactive session aimed at exploring awareness building around the use of algorithms in online platforms, through the use of the UnBias Awareness Cards. Activities resulted in critical and civic thinking for exploring how decisions are made by algorithms, and the impact that these decisions may have on our lives and the lives of others. Participants engaged in interesting discussions and extra decks of cards were requested by some attendees.
Year(s) Of Engagement Activity 2018
URL https://unbias.wp.horizon.ac.uk/2018/11/23/workshop-on-algorithmic-awareness-building-for-user-trust...
 
Description Algorithmically Mediated Online Information Access (AMOIA) discussion workshop at Mozfest 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact This activity was a discussion dialogue, with participants of the Mozfest event in London, on the topic of fairness in Algorithmic decisions making related to Algorithmically Mediated Access to Online Content (e.g. search engines, social media recommendation feeds etc). Participants included civil-society NGO from Germany (Algorithm Watch), Liberians from US and Sweden, London based data activists and general audience. Activity mentioned by Mozfest organisers in the Medium blog.
Year(s) Of Engagement Activity 2017
URL https://medium.com/mozilla-festival/decentralisation-at-the-mozilla-festival-aad3e33e1443
 
Description Article in UK media: We asked young people what they want from the internet of the future - here is what they said 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Impacts: Reposted on the Independent website on April 1st 2017 and on the Digital Leaders blog and Medium page on November 28th 2017
Year(s) Of Engagement Activity 2017
URL https://uk.news.yahoo.com/asked-young-people-want-internet-112933237.html
 
Description BBC Click - 'It's Been Emotional' (about Digiplay workshop at Techtopia, Polka Theatre London) by Liz Dowthwaite 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Interview to UnBias researcher that helped to create and run a workshop at the Techtopia Festival. The aim was through play, teaching kids about data and how algorithms shape the world online.
Year(s) Of Engagement Activity 2018
URL https://www.bbc.co.uk/iplayer/episode/b0b4kg9d/click-its-been-emotional
 
Description BBC Nottingham Drive Time Radio interview on NSPCC proposal for algorithmic detection of online grooming 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact While visiting the BBC Nottingham studio for the TV interview regarding the proposal by the NSPCC that the government should mandate that Social Media companies use algorithms to detect if a child is being approached online as part of sexual grooming, Ansgar was asked to also provide expert commentary to contribute to the BBC Nottingham Drive Time Radio broadcast at 3:30pm on January 29th.
Year(s) Of Engagement Activity 2018
 
Description BBC Salford symposium 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Horizon and Databox presentation to BBC around privacy preserving personalised services
Year(s) Of Engagement Activity 2018
 
Description BBC1 News (East Midlands) - TV interview regarding NSPCC proposal for algorithmic detection of online grooming 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Following the proposal by the NSPCC that the government should mandate that Social Media companies use algorithms to detect if a child is being approached online as part of sexual grooming, the BBC East Midlands contacted Ansgar to ask for expert commentary regarding the technical feasibility of this proposal. The interview was broadcast as part of the 6:30pm and 10:30pm BBC1 regional news for East Midlands on January 29th.
Year(s) Of Engagement Activity 2018
URL https://www.bbc.co.uk/iplayer/episode/b09pr6zm/east-midlands-today-evening-news-29012018
 
Description CNBC Arabia TV News commentary on NHS and global Wannacry randsomeware incident 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services, and subsequent problems in other countries, due to a 'WannaCry' ransomware attack CNBC Arabia contacted Ansgar Koene to provide 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as a segment of the regular news show.
Year(s) Of Engagement Activity 2017
URL https://www.cnbcarabia.com/
 
Description CaSMa blog 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The CaSMa blog disseminates and publicize work and events designed to address the ethical challenges around social media.
To date, the blog has attracted more than 5,000 views and over 400 subscribers. During the last year, the CaSMa blog has posted more than 70 blogs, received many comments from followers (n>39) and several requests for guest posts (e.g. World Wide Web Foundation (webfoundation.org).
The blog is a valuable tool to publicize events, showcase current research projects and inform the public about current topics on social media research as well as provide a platform for the public to engage and communicate with the CaSMa team. For example, after the last public engagement event organised at Nottingham Contemporary, one of the attendees posted:

'Hello, I attended the most recent event. The event was organised masterfully and conducted with the utmost dignity and professionalism yet remained safe, supportive, engaging and thought provoking, it was "real".

At the end of the debate I posed the question, "is the emerging phenomenon of digital interaction a window into Jung's collective unconscious." This could be refined into a debate/exploration of virtual social groups and crowd consensus or dissension on the internet and perhaps their effects on the physical world.

please email me if you for further thoughts.'

Evidence that the CaSMa blog is reaching policy makers is evident from two occasions:
On December 7th 2015, following a blog post regarding the House of Lords inquiry into online platforms we were contacted:
Dear Dr Koene,
I just noticed your short blog on the Lords inquiry into online platforms, particularly commenting on the question relating to algorithms.
Would you care to respond to our inquiry, on that one question? You clearly have a lot of expertise in this area. A page or two would be sufficient and would certainly enrich the debate.
The only issue is that we will stop accepting submissions on the 10th of this month.
Nevertheless, given that you have already more or less written it
Best,
Kilian
Kilian Bourke
Policy Analyst
EU Internal Market Sub-Committee
Committee Office, House of Lords

On January 5th 2016, following blog posts on the draft Investigative Powers Bill we were contacted:
Dear Ansgar,
I work with the team leading on the Investigatory Powers Bill in the Home Office.
I hope you don't mind my approach, but we saw that you'd produced an analysis of the IP Bill on the CaSMa project blog site, and wondered if you might be interested in an informal discussion with officials working on the Bill. This could either be in London, or via phone if that were more convenient.
If you are interested in setting something up please do get in touch.
Best regards
Rebecca

Rebecca Underhill
National Security Directorate
Home Office
Year(s) Of Engagement Activity 2014,2015,2016
URL http://casma.wp.horizon.ac.uk/
 
Description Children's and Young People's Rights in the Digital Age: An IAMCR 2016 pre-conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Are children's rights being newly infringed or enhanced in the digital age? Such questions concern researchers, child rights' advocates, and internet governance experts. Yet children's needs and experiences in the digital age are often neglected in high-level debates about global internet provision and governance and children's rights are treated as a minority interest and seen as demanding exceptional treatment from adult society. Further, current debates frequently emphasise the risks children potentially face online and underline their right to protection, but much less attention is gven to children's provision and participation rights online.

The conference will foster an international debate on key issues related to children's and young people's rights in the digital age, including: child and youth participation rights; online opportunities and risks; inequalities and digital exclusion; policy and multi-stakeholder governance; the role of peers and peer culture; participatory research; e-learning, health promotion and creativity in the digital environment; cross-generational dynamics of online engagement.
The conference includes a plenary presentation from Global Kids Online. It will begin at midday on 26 July and close at midday on 27 July to enable delegates to make the journey to Leicester for the opening of IAMCR 2016 (approximately one-hour train journey).
Year(s) Of Engagement Activity 2016
URL http://www.lse.ac.uk/media@lse/events/CYPR-IAMCR-2016.aspx
 
Description Digital Democracy: critical perspectives in the age of big data. 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Blog summarising the European Communications Research and Education Association (ECREA) conference and UnBias participation in November 2017, Stockholm.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/2017/11/20/digital-democracy-critical-perspectives-in-the-age-if-big...
 
Description Digital Technology in Practice, NIHR MindTech symposium 2017. London. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact At this symposium Elvira Perez contributed to a round table to discuss if virtual therapist could bridge the current mental health service provision gap
Year(s) Of Engagement Activity 2017
URL http://www.mindtech.org.uk/mindtech-annual-conference.html
 
Description Disinformation and Discernment: New Skills to Protect Old Values. OEB MidSummit, Iceland. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Elvira to add
Year(s) Of Engagement Activity 2017
 
Description EGA School Fairness Tool Kit Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact This workshop was organised in order to allow young people who had co-created the unfairness toolkit- to have a chance to interact with the awareness cards (one of the three key components of the tool kit). We initially had a case study discussion to allow the young people to re-engage with the key issues and concerns regarding algorithmic fairness. We then conducted an interactive session where they undertook group work using the cards.
Year(s) Of Engagement Activity 2018
 
Description ESRC Annual Festival of Social Sciences, Nottingham 2018 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact "Do you trust internet platforms?" Participatory and hands-on activity to help internet users to explore their online experiences when interacting with algorithm driven platforms. We run two workshops for people aged 16-25 and 65 years old and over, where a total of 17 participants took part.
This activity constituted a pilot study, part of an interdisciplinary research project between the Universities of Nottingham, Oxford and Edinburgh called ReEnTrust, which explores new technological opportunities to enhance/re-build user's trust, and identify how this may be achieved in ways that are user-driven and responsible. Preliminary data collected from this study has been extremely valuable and has contributed to refine particular research topics within our current project (ReEnTrust). Also, participants from this activity expressed their will to contribute to follow-up interviews and also to be part of the ReEnTrust advisory group.
Year(s) Of Engagement Activity 2018
URL https://www.horizon.ac.uk/reentrust-call-for-participants/
 
Description Editorial Responsibility arising from personalisation algorithms. ETHICOMP conference, Turin. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This talk was part of the Ethicomp conference in Turin, Italy and was attended by an audience consisting of Ethicomp participants. Ethicomp is the main conference of the RRI in ICT community, with publications in the ORBIT Journal, launched by the Orbit project (https://www.orbit-rri.org). Following the presentation a number of audience members requested further information and some of them joined the UnBias stakeholders group.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/dissemination/presentations/
 
Description Editorial responsibility arising from personalization algorithms. The ethics of machine learning in professional practice. Cambridge, 28th Nov. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact During this workshop I presented the UnBias project which sparked questions and interests among an heterogeneous audience. It was and important engagement event afterwards two of the attendees become stakeholders and supporter of the UnBias project.
Year(s) Of Engagement Activity 2016
 
Description Ethical Hackathon (two day- long events- Oxford and Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact An 'ethical hackathon' is a novel event developed by the Human Centred Computing group at the University of Oxford. It takes a twist on the traditional hackathon format by challenging groups of participants to identify ways to embed ethical considerations into the processes of technical design and development. The UnBias team ethical hackathons in November 2018 and January 2019 involving postgraduate students at Horizon CDT University of Nottingham & the Cyber Security CDT University of Oxford. These took the form of a day long session. At the start of the session leaders Helena Webb and Menisha Patel introduced key project themes and invited students to discuss issues connected to algorithmic controversies and governance. During the Nottingham Ethical Hackathon discussion was also facilitated by Liz Dowthwaite, After initial themes had been introduced and activities completed, students were put into groups and set a design challenge to work on. At the end of the session the teams presented their designs in front a panel of judges from the UnBias team. The judges gave feedback on the presentations and prizes were awarded for the best designs.
Year(s) Of Engagement Activity 2018,2019
 
Description Ethicon at University of Nottingham 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact An 'ethicon' is a novel event developed by the Human Centred Computing group at the University of Oxford. It takes a twist on the traditional hackathon format by challenging groups of participants to identify ways to embed ethical considerations into the processes of technical design and development. The UnBias team ran an ethicon in January/February 2018 involving postgraduate students at Horizon CDT University of Nottingham. This took the form of a two part session. In the first, session leaders Helena Webb and Menisha Patel introduced key project themes and invited students to discuss issues connected to algorithmic controversies and governance. Discussion was also facilitated by Liz Dowthwaite and Helen Creswick, At the end of the session students were put into groups and set a design challenge to work on. A week later - after being given further time in the module sessions to work on the challenge - the second session took place. The teams presented their designs in front a panel of judges from the UnBias team. The judges gave feedback on the presentations and prizes were awarded for the best designs.
Year(s) Of Engagement Activity 2018
 
Description Ethics assessment of research and innovation. SATORI. London 24th Nov. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This is a working group organized with European funding. The connections that emerged from that meeting are extremely relevant specially after Brexit resolution because it allows us to keep connected with our European colleagues working on data ethics.
Year(s) Of Engagement Activity 2016
URL http://trilateralresearch.com/satori-mutual-learning-workshop-ethics-assessment-research-innovation/
 
Description European Researchers' Night: Curiosity Carnival 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Members of the Digital Wildfire project teamed up the EPSRC project UnBias to run an engagement stall at European Researchers' Night 2017 in Oxford. The Curiosity Carnival formed part of European Researchers' Night, celebrated in cities across Europe. Oxford ran a city wide programme of activities across its universities, libraries, gardens and woods to give members of the public a chance to find out about real research projects and meet the people who conduct them. The combined team set up information displays about the two projects and ran an activity that invited visitors to learn about common scenarios in which safety and fairness on the Internet are undermined and then vote to give their responses to them. Team members then engaged visitors in discussion about our research work and findings. Hundreds of participants - mostly families with children but also students - attended the event and took part in our engagement activities over the course of the evening.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/2017/10/02/unbias-takes-part-in-european-researchers-night/
 
Description Evaluation of the participation model 'Sharing the Future' : research project within Primary Parliaments, Nottingham City Council. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact We conducted a feasibility study designed to evaluate the efficacy of 'Sharing the Future' (StF), a new model for citizen participation routinely applied at Primary Parliament, an educational activity offered to primary schools in Nottingham City. Our study showed that the implementation of the model StF boosts children's confidence on their relation with other children and young people in regards to: 1) sharing their views and life experiences, 2) decision-making, as well as making decisions on their own and 3) being listened and respected by their peers. This feasibility study provided the elements and conditions required to conduct a larger future pilot study. From 232 children invited to participate in this study, a total of 102 pupils (aged 9-11) from 19 institutions took part. Data from this work lead to the preparation of a research manuscript to be soon submitted to an international citizen engagement peer-reviewed journal.
Year(s) Of Engagement Activity 2017
 
Description Experiential workshop at the National Trust building The Workhouse in Southwell as part of the book launch 'Voices from the Workhouse'. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Supporters
Results and Impact This invitation came from the National Trust and it is linked to the research project 'What is home?'. The aim of this experiential workshop is to reflect on the notions of home, the history of the The Workhouse and how to improve the visiting experience of future visitors. The workshop was also aimed to engage with an audience that rarely engages in embodied practices such as yoga or flamenco during a weekend retreat. The workshop was a success and many participants reported being interested in contributing or participating in future related events. This activity also links with previous work done by Horizon in this building aiming to improve the visitors experience by introducing interactive elements.
Year(s) Of Engagement Activity 2017
URL http://www.nationaltrust.org.uk/theworkhouse
 
Description Experiential workshop by the National Trust at The Workhouse 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Experiential workshop by the National Trust at The Workhouse to launch the book 'Voices from the Workhouse'. Southwell, 18th March, 2017. I have been invited again to provide a similar experiential workshop
Year(s) Of Engagement Activity 2017
 
Description Fairness toolkit sessions at schools and youth groups 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact The UnBias project involves the preparation of a 'fairness toolkit' that will help stakeholders of different kinds to understand controversies associated with online algorithms and reflect on the steps they could take to promote fairness online. To assist with the development of the toolkit we ran a series of workshops with young people to seek their experiences and views on these issues. These sessions were led by project collaborator Giles Lane with the assistance of Helena Webb, Menisha Patel and Liz Dowthwaite. They visited two schools and one youth group, running two 2-hour sessions at each location. Secondary school aged young people were invited to take part in a series of fun activities and debates.
Year(s) Of Engagement Activity 2017
 
Description Festival of Science and Curiosity (FOSAC), Nottingham City Library 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Drop-in sessions to introduce people to the UnBias Awareness Cards and to discuss issues of online fairness. This activity was part of a wider outreach event, and run as part of the Impact Exploration Grant Award. We engaged with approximately 50 people, mostly families. Three decks of cards were requested from people working who worked in the Education Sector.
Year(s) Of Engagement Activity 2019
URL https://www.horizon.ac.uk/13229-2/
 
Description First wave of UnBias Youth Juries 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact 144 student from secondary schools and/or 6th form colleges attended the workshops. 14 sessions were run at those institutions or at the UoN.
The UnBias Youth Juries are youth-lead focus groups with different scenarios to prompt discussions about some particular aspects on how the internet works (with focus on algorithm fairness when interacting with automated systems).
Sessions were very participative. Debate and audience change of opinion during the session was highly noticed.
Students and accompanying school teachers showed interest in taking part in related research activities.
Year(s) Of Engagement Activity 2017
 
Description Flamenco-Yoga as creative practice for mutual recovery. Experiential workshop presented at the 5th International Health Humanities Conference, Seville, 15-17 September [page 76] 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The workshop was run twice during the conference. No formal feedback was collected after or during the workshop but the first author captured anecdotal feedback and received numerous invitations to deliver the workshop again in different settings. To date, the first author has run the workshop several times among children and young people and is planing a systematic evaluation to understand the effects that creative practices as mutual recovery can have among s clinical and non-clinical populations.
Year(s) Of Engagement Activity 2016
URL http://www.ihhcsevilla2016.es/
 
Description Gem FM radio interview 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact I was interviewed by Gem FM about the work I did bringing yoga into children homes
Year(s) Of Engagement Activity 2016
 
Description Hello from Mozfest! 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Blog sumarising UnBias team engagement activities at Mozfest Festival October 2017, London.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/2017/10/30/hello-from-mozfest/
 
Description How do you take care of the internet? Mozfest festival, London 2017. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Drop-in session with interactive activities that sparked debate and reflection on issues such as: privacy, security and how to take care on the internet. Activities including scenarios related to fake news, hate speech, search results and personalised content were displayed and participants were encouraged to express their opinions by voting best possible outcome for each scenario. About 80 people from a diverse audience (from professional practitioners to the general public) engaged in this session. Relevant discussions and views provided our research team of new insights on people's online experiences and allowed to establish new contacts, for ongoing and future collaborations.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/2017/10/30/hello-from-mozfest/
 
Description Human Agency on Algorithmic Systems, AoIR conference, Estonia. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a presentation at the annual Association of Internet Researchers conference. The session was attended by about 60 audience consisting of other conference attendees, mostly from academia but also including some NGOs and industry interested in understanding the latest academic work on the impact of internet on society. The talk covered results from the UnBias Youth Juries, and stakeholder engagement workshops as well as some information regarding the IEEE P7003 Standard for Algorithmic Bias Considerations working group. At the end of the talk there was a good discussion and some of the participants approached to ask about joining the P7003 working group.
Year(s) Of Engagement Activity 2017
URL https://www.slideshare.net/AnsgarKoene/human-agency-on-algorithmic-systems
 
Description IEEE-SA webinar: The Human Standard - Why Ethical Considerations Should Drive Technological Design 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Online webinar organized by the IEEE Global Initiative for Ethics of Autonomous and Intelligent Systems with contributions from the chairs of the IEEE P70xx ethics related standards, including the P7003 Standard for Algorithmic Bias Considerations that is chaired by Ansgar Koene. The webinar was attended by IEEE members globally.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/the-human-standard-why-ethical-considerations-should-drive-tech...
 
Description IGF meeting, Geneva (UNOG). 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Presentation about (Self) regulation of algorithmic systems that control online information access.
Year(s) Of Engagement Activity 2017
URL https://igf2017.sched.com/event/DCQW/self-regulation-of-algorithmic-systems-that-control-online-info...
 
Description Impact Workshops working with the Fairness Toolkit to explore issues of Online Fairness 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact As part of the Impact Exploration Grant award, a total of eight workshops were run with members of the general public to gain feedback on the Awareness Cards, which are a part of the Fairness Toolkit and enable people to have discussions about issues of online fairness.

Two versions of workshops (eight workshops in total lasting two hours each) were carried out with people aged 13-17 years, 18-29 years, 30-50 years and 65+ years). A total of 48 people attended the workshops.

Some workshop participants reported taking the Awareness Cards away to try out with others, including in some University Seminars.
Year(s) Of Engagement Activity 2018,2019
 
Description Inerviewed fro article in WIRED 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Following revelations of abusive content on YouTube children channels Nicole Kobie interviewed Ansgar Koene for an article in WIRED. The article was published on 24 November 2017.
Year(s) Of Engagement Activity 2017
URL https://www.wired.co.uk/article/youtube-kids-moderation-google
 
Description Institute for Policy and Engagement launch- University of Nottingham. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact The aim of the event was to raise the profile of the Institute with colleagues, particularly academics. In particular, it was an opportunity for academics colleagues already engaged in policy and public engagement work to share their work with their peers.

Members of the UnBias team were invited to be one of the policy impact/public engagement stars of the event, and a slide summarising with our main policy impact/public engagement outputs was on display during the event. Our work was also highlighted by Professor Dame Jessica Corner during her presentation, being one of the 4 policy impact/public engagement stars out of 29 exhibited on the event.
Year(s) Of Engagement Activity 2019
URL http://blogs.nottingham.ac.uk/researchexchange/2019/02/12/institute-for-policy-and-engagement-launch...
 
Description Internet Reseaerch Ethics - interviewed for article in Nature 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact In September 2017 Ansgar was contacted by Elizabeth Gibney, a journalist working for Nature, for an interview to contribute to an article she was writing on "Ethics of Internet research trigger scrutiny: Concern over the use of public data spurs guideline update.". The article was published on October 3rd 2017
Year(s) Of Engagement Activity 2017
URL https://www.nature.com/news/ethics-of-internet-research-trigger-scrutiny-1.22746
 
Description Interview for BBC Scotland 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact I was interviewed by BBC Scotland for a discussion on the Digital Childhood Report
Year(s) Of Engagement Activity 2017
URL http://www.horizon.ac.uk/bbc-radio-scotland-interview-with-dr-elvira-perez-about-children-and-the-in...
 
Description Interview with Legal Publishing company online newsletter/blog 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Following mentoring a group of undergraduate students for a Legal Design Sprint (which they won) I was interviewed about terms and conditions online and whether they were fit for purpose.
Year(s) Of Engagement Activity 2018
URL https://www.justis.com/terms-and-conditions-fit-for-purpose/
 
Description Kooth online mental health representations and ethics 2/2 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This presentation presented a case study to illustrate the ethical challenges of online research. Kooth.com, and online platform that offer counseling services to children and young people was used as an example.
Year(s) Of Engagement Activity 2017
 
Description Legal Design Sprint mentor 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Undergraduate students
Results and Impact Mentor for team of undergraduates for 2 day legal design competition, in which they tackled the issue of terms and conditions being unfit for younger readers (and many adults)
Year(s) Of Engagement Activity 2018
URL https://www.justis.com/winning-idea-legal-design-sprint-2018/
 
Description Limited Resource Allocation Task Workshops- London, Edinburgh, Nottingham, Graz 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The limited resource allocation tasks were intended to bring together stakeholders in order to understand how they would respond to fairness in relation to the use of algorithms in a practical situation. Stakeholders were tasked with choosing an algorithm which they felt would produce the most appropriate outcome in particular contexts- and also, this allowed an exploration of how decisions varied with the "stakes" within a context were more or less consequential or serious.

There was so much interesting discussion in each of these sessions- we were able to integrate findings into publications. Further, we have had interest from some participants in using the task in their own teaching/interactions, so as to elaborate on issues of fairness in relation to the use of algorithms.
Year(s) Of Engagement Activity 2017,2018
 
Description Mental Health series at BBC Radio Nottingham 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact During this radio program was interviewed about the research I do to promote creative practices as mutual recovery.
Year(s) Of Engagement Activity 2017
 
Description Mindtech 2017 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presentation on how Databox can alleviate ethical and privacy challenges in mental health care.
Year(s) Of Engagement Activity 2017
URL http://www.mindtech.org.uk/mindtech-annual-conference.html
 
Description MozFest event drop in session 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact MozFest is an annual event run by the Mozilla Foundation to support and promote the open internet movement. At the 2017 event in London UnBias team members Helena Webb, Menisha Patel, Helen Creswick, Virginia Portillo, Elvira Perez and UnBias collaborator Giles Lane ran a drop in session for attendees called 'How do you take care on the internet'. The session combined elements of UnBias the ESRC project Digital Wildfire to prompt attendees to reflect on their responses to issues connected to safety and fairness on the internet - for instance in relation to excessive use of personalisation algorithms and the spread of fake news across social media. Over one hundred attendees joined the session over the course of half a day and they had the opportunity to learn more about the project by taking information leaflets and talking to team members.
Year(s) Of Engagement Activity 2017
 
Description Older people discuss how Smart City Nottingham could bring benefits to health and wellbeing 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Study participants or study members
Results and Impact During this event organised by Age-Friendly Nottingham and that coincided with 'Older peoples day' was the perfect venue to launch our report
Year(s) Of Engagement Activity 2017
 
Description Online mental health representations and ethics 1/2 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This was a presentation on online ethics part of the network 'Hungry for words'. The presentation focused on the challenges of securing online consent from participants
Year(s) Of Engagement Activity 2017
 
Description Open-space and Citizens Juries to explore older peoples views on optimising health and wellbeing benefits for a Smart City Nottingham 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This poster was presented at the MindTech Symposium
Year(s) Of Engagement Activity 2017
 
Description Poster presentation: "A multi-stakeholder perspective on the regulation and design of algorithm fairness" , TRILcon17 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Sparked questions and discussions about the novel results presented in the poster, part of the UnBias' stakeholder first workshop. Moreover, this poster received the 'Best Poster Award'.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/wp-content/uploads/2016/08/Unbias_TRILCon17_Poster.pdf
 
Description Poster presentation: "Children's rights in the digital world - What do children and young people want to enjoy a safe Internet?". Children, Rights and Childhood network, Birmingham. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact We provided research evidence which explored young people's views and concerns when interacting with internet services such as social media.
The event focused on children's rights and run within the "Child Rights Week". Our work generated lots of interest and discussion from researchers and participants working with young children. In particular, it was very inspiring to meet and discuss Children's Digital Rights with the key note speaker for UNICEF (Martin Russell), educators, and members of the public sector.
Year(s) Of Engagement Activity 2018
URL https://www.birmingham.ac.uk/schools/government-society/events/2018/children-rights-and-childhood.as...
 
Description Poster: Algorithm Fairness in Online Information Systems, WebSci conference, NY. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This poster sparked relevant discussions. It was also presented at "The growing ubiquity of algorithms in society: implications, impacts and innovations" - scientific meeting at the Royal Society, October 30-31, London, UK.
Year(s) Of Engagement Activity 2017
URL http://websci17.org/
 
Description Presentation at ECREA Symposium on Digital Democracy: critical perspectives in the age of new data, held at Södertön University, Stockholm, Nov. 2017 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Academic presentation of 'UnBias' research data which lead to relevant questions and discussion afterwards. It also allowed networking with colleagues in the filed for future research collaborations.
Year(s) Of Engagement Activity 2017
URL https://communicationanddemocracy.wordpress.com/2017/01/09/call-for-papers-ecrea-symposium-digital-d...
 
Description Presentation at Hungry for Words final workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was the final activity of the workshop which concluded on a round table that engaged a representative and inclusive group interested in male eating disorders
Year(s) Of Engagement Activity 2018
 
Description Presentation at Internet Society - European Chapters meeting 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact In February 2017 the European chapters of the Internet Society (ISOC) held their annual conference to discuss join activities and coordinate projects for the year. In 2017 Ansgar Koene represented the ISOC UK-England chapter with a presentation on "Fake News". Ansgar was invited to lead Uk based activities on User Trust, the ISCO thematic agenda of the year.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/internet-society-european-chapters-meeting/
 
Description RT UK - TV News and Social media - interview regarding NHS Wannacry ransomware 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services, and subsequent problems in other countries, due to a 'WannaCry' ransomware attack RT UK contacted Ansgar Koene to provice 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as a segment of the regular news show. Ansgar has subsequently be asked to provide comment as "Cyber expert" on numerous occasions.
Year(s) Of Engagement Activity 2017
URL https://www.rt.com/uk/
 
Description RT UK - TV News and Social media - interview regarding accusation by US Senate of spying by Kasperski software 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Following the breaking news that the cybersecurity software firm Kasperski was being accused by the US of using its anti-malware software to spy on the US Senate, and thus forbidding further Federal Government use of Kasperski products, RT UK contact Ansgar to provide commentary on the technical feasibility of using anti-malware software for spying. The brief TV interview was broadcast on 19 September 2017.
Year(s) Of Engagement Activity 2017
URL https://www.rt.com/uk/
 
Description RT UK - TV News and Social media content - Debate on UK parliament proposal to regulate Social Media like new media. Koene A. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact RT UK channel contacted Ansgar to invite him to participate in a short TV debate regarding the UK parliament proposal that government should regulate social media companies as traditional media companies. The TV debate was broadcast on TV and the RT UK social media channel on 13 December 2017.
Year(s) Of Engagement Activity 2017
URL https://youtu.be/3Yj6ImETQPQ
 
Description Report for Young People- "Youth Juries: What we learned from you" 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact Report that highlights the main findings from a total of 27 Youth Juries (focus groups) run by our research team between 2017-2018. Over 250 children and young people (mostly aged between 13-17 years of age) took part in the Youth Juries sessions. This report is written for the general public, in particular for young people, and includes recommendations for what actions should be taken to make the internet more child-friendly. It was launched in October 2018 and it's been available online since. It has been very welcomed within participants that took part in the Youth Juries, as well as teachers and Third Sector organisations such as the 5Rights Foundation.
Year(s) Of Engagement Activity 2017,2018
URL https://unbias.wp.horizon.ac.uk/wp-content/uploads/2018/10/Youth-Juries-what-we-learned-from-you.-Re...
 
Description Rinzing art exhibition 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact This is an photography exhibition launched at the Institute of Mental that explores mental health and wellbeing through street photography.The exhibition was launch at Eating Disorders week to bring awareness on male eating disorders.
Year(s) Of Engagement Activity 2018
 
Description STEM festival, Bluecoat Beechdale Academy, Nottingham 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact Activity designed for young children to help them to learn how the internet works and to reflect on issues of personal information and online filter bubbles, by creating their own "data gardens". While children enjoyed this activity, parents/guardians and teachers engaged with the UnBias research team on interesting discussions including how the nature of the content that they view online often determines what is shown to them. Adults expressed concerns about how to better manage their own and their children online experiences, and requested more information about online privacy and security issues. Our team provided information and a take away leaflet that gave tips with suggestions of tools and solutions to stop companies from tracking users.
Year(s) Of Engagement Activity 2018
URL https://unbias.wp.horizon.ac.uk/2018/06/18/how-to-create-your-own-data-garden/
 
Description School Visit (Bilborough college, Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Drop-in session at Bilborough college to promote and recruit participants for the next UnBias Youth Juries (focus groups to reflect, debate and share ideas), taking place at the UoN in March 2017. 35 student expressed their interest to participate.

Staff expressed interest for the students to participate in future events within our project and in related research areas.
Year(s) Of Engagement Activity 2017
 
Description School outreach activities at University of Oxford 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact UnBias team member Helena Webb regularly gives talks about the project as part of the University of Oxford's outreach programme. School students from across the country travel to the University to take part in taster sessions. During these sessions students learn about ongoing projects and have the opportunity to ask questions about them. In the case of presentations given by Dr Webb about UnBias, they are encouraged to debate issues around fairness on the internet and put forward their own views.
Year(s) Of Engagement Activity 2016,2017,2018
 
Description Science in the Park, British Science Association (Wollaton Park, Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Family event for all ages. One-to-one contact with parents/guardians, children of all ages, grandparents, teenagers and young adults. Participants expressed their views engaging in interesting discussions about online fairness/bias. In particular parents/guardians were very keen finding out more information about how the internet shapes their online experiences and what users can do about it.
Year(s) Of Engagement Activity 2018
URL https://unbias.wp.horizon.ac.uk/page/3/
 
Description Sky News TV interview for bulletin on NHS Wannacy Ransomware attack 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services due to a 'WannaCry' ransomware attack Sky News contacted Ansgar Koene to provice 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as segment of a rolling news coverage of the event. Ansgar was contacted again by Sky News on 9 September for comment regarding the Equifax hack.
Year(s) Of Engagement Activity 2017
 
Description Smart Because of You. FoSAC and NUCLEUS (RRI, Horizon 2020) conference, Nottingham. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Presentation about the UnBias Youth Juries (YJ): methodology and data. Also, a general overview of the UnBias project highlighted the wide range of participants that so far have engaged/participated in our project including: young people (mainly 13-17 yrs old), a multi-stakeholder panel including citizens from the public sector, academics, industry, media, policy makers, NGOs, etc. This activity generated interesting questions and discussion and helped to establish new contacts for further collaborations. General interest expressed by the audience and on online social network (twitter).
Year(s) Of Engagement Activity 2017
 
Description Stakeholders group organised by NCC 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Participation in the Nottingham Tech city steering group: a multi disciplinary team of about 15 people from the public and private sectors, academics, NGOs, etc., aiming to explore civic technology in Nottingham. Established new contacts for possible future collaborations
Year(s) Of Engagement Activity 2017
 
Description TRT Wrold News TV interview related to NHS and globa Wannacry randsomware attacks 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services, and subsequent problems in other countries, due to a 'WannaCry' ransomware attack TRT World contacted Ansgar Koene to provice 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as a segment of the regular news show.
Year(s) Of Engagement Activity 2017
URL https://www.trtworld.com/
 
Description Tectopia Festival - Digiplay workshop, London 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Five hour workshop and for 19 children aged 7-12 years. Interactive and fun workshop where children engaged learning about online algorithms.
Year(s) Of Engagement Activity 2018
 
Description The Conversation article We asked young people what they want from the internet of the future - here's what they said 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This article at The Conversation highlights that the Internet is not fit for children and online services have to be more child friendly. There is an amendment for the Data Protection bill that has been influenced by articles like this one.
Year(s) Of Engagement Activity 2017
URL https://theconversation.com/we-asked-young-people-what-they-want-from-the-internet-of-the-future-her...
 
Description The Human Bias in AI. Change Forum: Product and Data, London 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Interactive workshop mainly aimed to media industry stakeholders. The aim of the session was to build understanding and promote discussion around the use of algorithms in online platforms. Members of our team run activities using the UnBias Awareness Cards, designed to encourage critical and civic thinking for exploring how decisions are made by algorithms, and the impact that these decisions may have on our lives and the lives of others. The audience engaged in interesting discussions and the facilitators from our research team were invited to take part in future related activities (RCUK workshops).
Year(s) Of Engagement Activity 2019
URL https://www.changeforum.co/
 
Description The Internet on our own terms. Press release 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact This was the media press release for the launch of the report 'The Internet On Our Own Terms'.
Year(s) Of Engagement Activity 2017
URL http://www.nottingham.ac.uk/news/pressreleases/2017/february/young-people-call-on-government-for-gre...
 
Description Thresholds broadcast 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact BBC Click Fifty shades of Spray video coverage and interview with Mat Collishaw stimulated increased interest and raised awareness
Year(s) Of Engagement Activity 2017
URL https://www.bbc.co.uk/iplayer/episode/b08s72bm/click-fifty-shades-of-spray
 
Description Two-Day Ethical Hackathon Event Edinburgh 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact The two-day event in Edinburgh was held in order to bring together interdisciplinary teams to tackle design challenges. Importantly, as with the one-day events, this event was a twist on the traditional hackathon model (necessitating the integration of ethics). The event was structured through presentations in the morning, and then the challenge was set, students had the change to work through the night if they so wished, and on the following day they were tasked with presenting their work to a panel of judges. There were also mentors involved in the event who had different expertise, in order to help students understand the remit of the challenge, and in particularly guide them as to how to integrate ethics into their design process and outcome.

The purpose of the event was educational, in the sense of emphasising the importance of considering ethics in relation to algorithmic design. The attendees were very engaged. We were also able to conduct some interviews at the end of the event, and elicit feedback through questionnaires. The response on the whole was positive, with attendees feeling that they had acquired new knowledge through the day.
Year(s) Of Engagement Activity 2018
 
Description USACM panel on Algorithmic Transparency and Accountability. Washington DC. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The USACM panel on Algorithmic Transparency and Accountability was organized by the US policy SIG of the ACM to communicate the activities that the ACM is doing on Ethics of Algorithmic Decision making to congressional staff members. The even was held at the National Press Club in Washington DC. As part of the panel they invited Ansgar Koene to represent, and talk about, the activities of the IEEE Global Initiative for Ethics of Autonomous and Intelligence systems. The event was attended by about 60 people in person and also live streamed to a global audience. Member of the in-room audience included journalists from the Financial Times and Wired as well as junior staff members working in the offices of members of congress. Following the event Ansgar was interviewed, by e-mail, by a writer for the ACM's AI Matters blog (https://sigai.acm.org/aimatters/blog/2017/10/01/ieee-and-acm/). Following from this ACM/IEEE collaboration the two professional organizations set of an informal grou pto develop future joint activities to promote the work that both organizations are doing on Ethics is AI which Ansgar is a part of.
Year(s) Of Engagement Activity 2017
URL https://www.acm.org/public-policy/algorithmic-panel
 
Description UnBias Awareness Cards workshop at SOAS, University of London. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Undergraduate students
Results and Impact Workshop run by two members of our team and requested by a lecturer from SOAS. The aim was to use the UnBias Awareness Cards to bring awareness of online bias, in particular to reflect about freedom of speech online and how algorithms bias what we see. This activity stimulated lots of discussion and engagement within the audience. It also inspired a participant to write a reflective blog for the SOAS coding group website: "What's Fair in the Age of Big Data?" (https://www.soascodingclub.com/soas-coding-club-blog/2018/10/22/whats-fair-in-the-age-of-big-data-fm5w5).
Year(s) Of Engagement Activity 2018
URL https://www.soascodingclub.com/soas-coding-club-blog/2018/10/22/whats-fair-in-the-age-of-big-data-fm...
 
Description UnBias Final Project Event 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This event was the official final event of the UnBias project. It brought together a range of stakeholders (from a range of different areas, and some quite high profile) in order to showcase project outcomes through presentations and panel discussion. It was a very engaging event held at the Digital Catapult in London, that stimulated discussion about the project outcomes, and then algorithms more generally, amongst those who attended. We were also able to record key interviews and presentations- they are on the project website. Participants were very keen to hear more about ReEnTrust, and many have requested continued participation as stakeholders on this project. Our tangible record of the project of the website will we hope to reach those who were not able to attend the event.
Year(s) Of Engagement Activity 2018
 
Description UnBias Youth Advisory Group 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Note: This is a follow up of the UnBias Youth Advisory Group submitted in 2018.

In total, seven Advisory Group meetings took place between from November 2017-February 2019 with up to 4 participants. Meetings were held periodically throughout this time period to seek feedback and advice from young people aged 16-18 years of age. The young people have given feedback on project recruitment literature, materials and resources used in the wave 2 Youth Juries and feedback on materials included in the UnBias Fairness Toolkit. The Group also reviewed a report for Young People and gave feedback to make sure that the report was as accessible as possible to this age group.Their participation has been extremely valuable for our team as co-creation and delivering accessible material for young people are pillars in our research work.
Year(s) Of Engagement Activity 2017,2018,2019
 
Description UnBias Youth Juries (11 sessions- second wave) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact A total of 116 pupils aged between 13-17 years attended 11 interactive youth-led workshops. Sessions focused on issues of online fairness and algorithm bias in automated decision systems, in particular the impact of these on participants' online experiences.
These workshops sparked questions, debate, reflection and recommendations from participants on how issues of algorithm bias should be tackled. Young people's feedback was very positive as most of them expressed sessions were very interesting and educational and participants' learnt new things applicable in their online behaviours. Participants also felt inspired to learn more about the topics discussed in these sessions. One of the main outcomes was that it lead to the write up and launch of a report for young people "Youth Juries: What we learned from you".
Year(s) Of Engagement Activity 2018
URL https://unbias.wp.horizon.ac.uk/wp-content/uploads/2018/10/Youth-Juries-what-we-learned-from-you.-Re...
 
Description UnBias Youth Jury at the Explorers Fair (Festival of Science and Curiosity, Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact 30 young people attended the youth jury at the Broadway cinema, Nottingham. The juries are youth-lead focus groups designed to stimulate debate giving participants the chance to share their views and express their concerns about a particular topic. In this case the theme was algorithm fairness.

Some of the participants from this jury expressed their interest to take part in future Youth Juries and/or other related events.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/explorers-fair-expo/
 
Description UnBias Youth Jury at the National Video Game Arcade 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact 30 young people attended the youth jury at GameCity. The juries are designed to stimulate discussion and debate among jurors. Some of the participants from this jury were recontacted to attend the launch at the House of Lords 'The Internet on our own terms' and answer questions from the audience.
Year(s) Of Engagement Activity 2016
 
Description UnBias mentioned in the media -The Institute 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact UnBias project mentioned in The Institute, the IEEE news source blog which informs members about the latest news and trends in technology and engineering and shares opinions about what's going on in these areas.
Year(s) Of Engagement Activity 2017
URL http://theinstitute.ieee.org/ieee-roundup/blogs/blog/keeping-bias-from-creeping-into-code
 
Description UnBias youth advisory group 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Advisory group opened to young people to contribute to the co-creation of new scenarios for the UnBias Youth Juries. Three meetings took place between November 2017 - February 2018 and four students (16-18 years old) attended. They provided valuable feedback on their experiences when taking part of previous Youth Juries' session and we have used this feedback to make some modifications to the design of the second wave of Juries run in Feb-March 2018. Members of the advisory group have also given feedback on project recruitment literature, materials and resources in general.
Year(s) Of Engagement Activity 2017,2018
 
Description University of Oxford - Women in Computer Science day 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact The University of Oxford runs an annual Women in Computer Science Day. Young women from around the country aged 14+ attend with their schools or parents to learn about studying computer science and careers in the field. In the 2017 event Helena Webb and Menisha Patel gave a talk about the UnBias project and ran an stand in an exhibition where attendees could find our more information about UnBias and the ESRC Digital Wildfire project. The event was attended by around 200 young women. They had the opportunity to take information leaflets about the project and ask questions to Drs Webb and Patel.
Year(s) Of Engagement Activity 2017
 
Description V&A Digital Design Weekend, London 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Drop-in activities for all, including a range of case studies that related to fake news, hate speech, search results and personalised content. This sparked lively debate and discussion and participants were invited to vote on how some of these issues should be tackled.
A hands-on activity for children (3-13 year olds) was aimed to raise awareness and help children and parents/guardians to reflect on how personal information is used by websites and online systems and how this shapes their online experiences.
Year(s) Of Engagement Activity 2018
URL https://www.vam.ac.uk/event/6YVLW34q/digital-design-weekend-2018-ldf
 
Description WP3 Observational Studies 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact The observational activities formed a part of WP3- and investigating how users experience algorithms in their online browsing experience. We conducted a series of quasi-naturalistic experiments, mostly with post-graduate students within Oxford. We were also able to attend a youth jury in Nottingham, where we were able to conduct such an experiment with a group of young people.

In each case, pairs of participants were asked to undertake a task using a laptop- they were observed doing so, and audio-visual data was collected as well as screen capture recordings. We were then able to undertake some supplementary informal interviews to engage with their experiences. In each case users were very interested to discuss what they had experienced during the study- the young people in the youth jury were able to understand more about what algorithms are and use their participation in the task as a basis for discussion in the later parts of the jury.

We have been able to understand more about how users interact with algorithms through our analysis of the data collected; and we feel that young people and the students alike were able to understand and engage more with how they themselves experience algorithms.
Year(s) Of Engagement Activity 2017,2018
 
Description When AI goes to war 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact We presented a poster outlining the work done to interrogate young people about AI applied to military artifacts.
Year(s) Of Engagement Activity 2016
 
Description When AI goes to war 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact This was a youth jury to discuss the benefits and problems of having killer robots fully autonomous among young people
Year(s) Of Engagement Activity 2017
 
Description Widening Participation Family Discovery Day. University of Nottingham 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Hands-on activity designed for children aged 3-13 years to help them to learn how the internet works and to reflect on issues of personal information and online filter bubbles, by creating their own "data gardens".
While children enjoyed this activity, parents/guardians and teachers engaged with the UnBias research team on interesting discussions including how the nature of the content that they view online often determines what is shown to them. Adults expressed concerns about how to better manage their own and their children online experiences, and requested more information about online privacy and security issues. Our team provided information and a take away leaflet that gave tips with suggestions of tools and solutions to stop companies from tracking users.
Year(s) Of Engagement Activity 2018
URL https://unbias.wp.horizon.ac.uk/2018/06/18/how-to-create-your-own-data-garden/
 
Description Workshop at TRILcon17- Trust, information and the law 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Stakeholders workshop that aid reflexion and discussion about algorithm fairness throughout three case studies. This sparked pertinent discussion between academics, lawyers, y members from the public sector. Two groups of about 15 participants each attended this activity. Ansgar Koene's contribution in this conference was mentioned by Michael Cross in 'The Law Society Gazette': https://www.lawgazette.co.uk/news-focus/news-focus-algorithms-and-schrödingers-justice/5060964.article
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/trilcon-2017/
 
Description Workshop: Platform-to-business trading practices workshop (EC Digital Single Market) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Workshop organized by the European Commissions Directorate General for the Digital Single Market (DG connect) to explore the possible need for action by the European Commission against anticompetitive behaviour by online platform providers. The workshop invited companies that list their products or services on online platforms (e.g. hotels) and academics and NGOs who have done work related to online platforms, to discuss possible anticompetitive practices. Ansgar Koene was invited by members of the DG connect team to participate in this workshop following his EuroDIG flash session of Algorithm Regulation.
Year(s) Of Engagement Activity 2017
 
Description Workshops: UnBias Youth Juries (2 sessions), held in Nottingham as part of the Festival of Social Science (ESRC), Nov. 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Interactive youth-led workshops which sparked questions, debate, reflexion and recommendations from participants for an internet more user-centred. Participants' feedback was very positive as most of them expressed sessions were very interesting and educational and learnt new things applicable in their work/studies. Participants also felt inspired to learn more about the topics discussed in this activity. One of the main outcomes was that it lead to the creation of a youth advisory group with some of the participants that took part in these workshops.
Year(s) Of Engagement Activity 2017
URL http://www.esrc.ac.uk/public-engagement/festival-of-social-science/
 
Description Wp4 Stakeholder Engagement Workshops 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact As a core part of WP4 we undertook a series of stakeholder workshops in London. The purpose of these workshops was to provide a space in which stakeholders (from our multi-stakeholder panel) could discuss issues surrounding algorithmic fairness. Importantly, we also allowed stakeholders (drawn from areas such as policy, education, NGOs, etc) to also deliberate on what ideas they had for some of the solutions to mitigating problematic issues arising from the use of algorithms. We were able to reach a very large number of stakeholders, many of whom continue to be part of our stakeholder panel for the follow on ReEnTrust Project.
Year(s) Of Engagement Activity 2017,2018
 
Description Yoga in children homes 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Many yoga related sites cite this study.
Year(s) Of Engagement Activity 2016
URL http://www.nottingham.ac.uk/news/pressreleases/2016/december/yoga-can-have-social-benefits-for-child...
 
Description Young People's Policy Recommendations on Algorithm Fairness. WebSci conference, NY. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation was past of the WebScience confernece in Troy NY, USA which was attended by mostly academics but with some industry and NGO participants interested in the latest state of the art in academic thinking on information flows and user engagement with information on the world wide web. The Unbias talk on "Young People's Policy Recommendations on Algorithm Fairness" provided a strong contribution to the conference theme of Ethics in WebScience, with various members of the previous the Ethics Panel from the previous evening approaching after the talk for further information about our work.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/dissemination/presentations/
 
Description Youth Juries Open Educational Resource 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact We have created an Open Educational Resource for educators to deliver the youth juries in their own institutions
Year(s) Of Engagement Activity 2016
URL http://casma.wp.horizon.ac.uk/casma-projects/irights-youth-juries/oer/
 
Description Youth Jury, part of Festival of Science and Curiosity, Nottingham. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Eight participants (aged 13-17) attended this session held at Nottingham Central Library. It was a very interactive and fun youth led-discussion to reflect about algorithmic bias present on daily used online systems and platforms. Participants were very keen and engaged in very relevant discussions, shared their views and experiences, and provided recommendations for an ideal internet.
Year(s) Of Engagement Activity 2017
URL https://www.horizon.ac.uk/unbias-workshop-at-the-festival-of-science-and-curiosity-17-feb-2018/
 
Description Youth Panel competition: "Our Future Internet" 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact Competition opened to school pupils from years 7 to 13 to respond to our 'UnBias' animation Our Future Internet: http://bit.ly/OurFutureInternet. It offered participants a chance to win up to a £100 prize voucher.

The aim was to raise awareness within young people of some of the very serious issues that are prevalent in their use of the Internet. Participants (working in groups or individually) could choose the medium through which they respond: digital media including a short video, visual media or written media, to cover any relevant topic related to the animation.

We received ten submissions from 19 pupils. The quality of work was very high and entries were reviewed by a panel of judges that included Mark Highman - Director of Film Literacy Europe and adviser to the 5Rights Foundation, and two researchers from our team.

Feedback from teachers that supported this activity was very positive. We presented the prizes to the winners during a special event co-organised for this purpose at the relevant school.
Year(s) Of Engagement Activity 2018
URL https://www.horizon.ac.uk/unbias-youth-panel-video-competition-how-do-algorithms-affect-your-online-...