UnBias: Emancipating Users Against Algorithmic Biases for a Trusted Digital Economy

Lead Research Organisation: University of Nottingham
Department Name: School of Computer Science

Abstract

Contrary to public opinion, young people care about their personal data and want a digital world more transparent, a digital world they can trust. For example, little is known about how Amazon is able to tailor advertisements and recommend products that are actually interesting for potential online customers, or how Facebook decides which news Facebook users may be more inclined to read. All the mechanisms that support this filtering of information and products is obscure and internet users would like to know more about it, such as possible bias in their behaviour and, more importantly, have some control over these recommender systems.

This project aims to closely work with young people to further understand how aware 'digital natives' are about algorithm bias, their attitudes and main concerns and recommendations when interacting with such systems. This information will help us to better understand the way young people interact with such systems and identify youth-led solutions for teaching critical thinking toward digital information systems. We will apply different engagement tools and methodologies including focus groups, workshops and youth 'juries' to facilitate discussion, reflection and a deeper understanding of youth online behaviour and youth-lead software solutions.

Relevant for this project is the development of 'fairer' algorithms with young people or non-experts as well as with experts. To do that, we intend to run a series of hackathons or workshops in which expert programmers and young people will work together to produce and evaluate new fairer algorithms that will produce more transparent and less creepy outputs. We will also run an 'ethicon'; an innovative approach in which scientists and ethicists work together to produce ethically justifiable algorithm design. During this process the project will be able to identify a series of principles that will contribute to the development of a platform that will allow users to have more control over the existing online filtering systems. In other words, this project will provide citizens with the skills and tools to better judge when and how much to trust the information they are given, understand the digital identity that algorithms create from user's personal data as well as protecting the users' privacy and online security.

This project will provide policy recommendations, ethical guidelines and a 'fairness toolkit' co-produced with young people and other stakeholders that will include educational materials and resources co-designed to support youth understanding about online environments as well as raise awareness among online providers about the concerns and rights of young internet users. This project is relevant for young people as well as society as a whole to ensure trust and transparency are not missing from the internet.

The results will be widely disseminated to a variety of audiences ranging from academic peer-review journals to community groups of interest such as secondary schools and youth clubs.

Planned Impact

*General Public:*
The public is at the centre of this project from the initial co-design of scenarios/tasks, through the 'Youth Juries' workshops and focus group sessions that map public concerns, to co-design Hackathons and prototype evaluation sessions.

Educational materials produced as part of the project will be made available to educators, guardians and other stakeholders. These materials will help to empower citizens with skills and tools to reflect upon the behaviour of social media algorithms so that they will be better positioned to know which online services to trust, manage their online identity and privacy and be more secure from unwanted manipulation.

In addition workshop with young people, their guardians and educators, the project will also include dedicated public engagement and communications activities, such as presentations associated at:
- ESRC Research Methods Festival.
- ESRC Festival of Social Science.
- Nesta's Future Fest [futurefest.org], a weekend dedicated to "radical ideas, compelling talks and immersive experiences to inspire, excite and challenge perceptions of the future".
- MozFest in London, an annual hackathon organized by the Mozilla foundation.

*Policy-makers:*
Our findings regarding the cumulative impact of filtering/recommender algorithms on users will be communicated to the Information Commissioner's Office, to facilitate evidence based policy review related to the UK Data Protection Act's 'principle 6' on the "protection of individuals against having significant decisions made about them by wholly automated mean".
A report on teaching critical inquiry of algorithm mediated information will be prepared for presentation to the minister for internet safety and security for contributing towards evidence based policy making.
A report, summarizing our findings on subjective experiences of algorithm 'fairness' and related design guidelines for 'fair' information control algorithms will be produced for industry bodies, to support the development of improved industry guidelines on transparency and responsible innovation.

*Industry:*
There will be a series of workshops for software developers and service providers to encourage thinking about implicit and explicit biases that may affect information control algorithms. It is the hope that these workshops will stimulate innovations that will boost the reputation of the UK Digital Economy as leader in trustworthy, reliable systems.
The project will tap into an existing network of over 200 commercial partners at the Horizon Digital Economy Research institute to disseminate findings and encourage participation in relevant events. One route to engagement with SMEs will be through Continuing Professional Development workshops. Efforts will be particularly focused on sectors where understanding human behaviour and 'fair' unbiased information provision is business-critical, such as market analysis and product evaluation.
Beyond the immediate benefits to citizens, the outcomes will also contribute towards a fairer digital economy by helping to expose anticompetitive practices that might be embedded in algorithm behaviours and which harm SMEs especially.

*Third Sector:*
The educational materials produced by this project will be made available to support programmes by NGOs and Charities, like the Mozilla foundation, in teaching young people how to develop critically inquiring attitudes towards digital systems. Starting from the first year the project will engage with these organizations as an important part of the stakeholders workshops.
The 'Youth Juries' workshops will build on existing links between the Horizon Digital Economy Research institute and the iRights coalition which promotes the rights of young people online.

Publications

10 25 50
 
Title Roots 
Description This was an artistic exhibition organised at the Institute of Mental Health. The purpose of this exhibition was to share the artists' work and inspire others to try art as a means of helping them through difficult times by finding ways to express their emotions and be in the "here and now". 
Type Of Art Artistic/Creative Exhibition 
Year Produced 2017 
Impact Outcomes of "Roots" Exhibition. Artist statement: People have expressly stated how inspired they have been by the art and staff at IMH have stopped and thanked me stating that the light and life the artwork has brought into the building has been inspiring. Many people have stated that they have felt emotional connections to the artworks. Contributions to others and the community: Provided a talk with a group of MA students of Trauma and used the displayed artwork as a talking point for growth and resilience through trauma. Followed up with an individual student interview to assist with dissertation studies Held live discussion with BBC Radio Nottingham (Alan Clifford show) Developed links with the Nottingham Peace Project and planned provision of and gained council funding to lead "expression through art" workshops for young people in Basford (2018) Roots Exhibition Book - my story of Trauma, Resilience and Growth with accompanying paintings 1. Charitable financial benefits: Sales of paintings have raised £800 to provide a Remembrance Bench for Joel Cooke and £300 for Young Minds Trust. A total of £1,100 sales was made between the 10th October 2017 and 5th of January 2018. 2. New friendships and New opportunities: I have had a number of people ask me to show them how I paint different styles and I am starting small workshops at home on the 10th Jan 2018 I am contributing to Prof Stephen Regel's Stories and Narratives Project (2018) I am working with Su Ansell (De Montford University) on producing a short film about resilience, change and growth (2018) 3. Personal Growth, Empowerment, Health and Well-Being: The exhibition has encouraged me to get out and about, meet new people, socialise and converse. Exposure to the environment, particularly travelling on buses was my goal for my trauma treatment. I now have no fear of travelling on buses or passing through Nottingham. My confidence and communication skills are much improved. When I began planning g the exhibition with Elvira I had to take my daughter with me as I struggled with conversation skills. That is no longer the case. I am sure Elvira has noted the differences since we first met. My family and friends often comment on the progress I have made in overcoming my fear of public places and people. I intend to continue to raise funds for charity, raise awareness of how we can rebuild our resilience and growth through art expression. I will continue to inspire others by sharing my story and art. 
URL http://www.institutemh.org.uk/x-about-us-x/art-at-the-institute
 
Description The UnBias Youth Juries are an engaging methodology to promote digital citizenship.
Exploitation Route Youth Jury Open Educational Resources could be put to use by IT teachers and parents - requests are now arriving for reuse of resources from organizations worldwide
Responses to Parliamentary inquiries (three done already, more coming).
IEEE standards (Ansgar Koene chairing the relevant committee)
Sectors Digital/Communication/Information Technologies (including Software),Education,Government, Democracy and Justice,Security and Diplomacy

URL http://unbias.wp.horizon.ac.uk/
 
Description The project is still in early stages having only completed the first round of youth juries and other studies. However, ongoing work within the project has led to input to three UK government inquiries on topics related to UnBias and we are engaged in discussions around Baroness Kidron's amendments to the UK DPA around age appropriate design, while there has also been substantive international activity with IEEE on bias in algorithms standards. This is documented in items under "Influence on Policy..."
First Year Of Impact 2017
Sector Digital/Communication/Information Technologies (including Software),Education,Government, Democracy and Justice
Impact Types Societal,Policy & public services

 
Description Evidence to UK Parliament inquiry. Koene A.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/culture-media-and-s...
 
Description NSF future scoping workshop on Trustworthy Algorithmic Decision-Making
Geographic Reach North America 
Policy Influence Type Participation in a national consultation
URL http://trustworthy-algorithms.org/whitepapers/
 
Description Response to House of Commons inquiry. McAuley D., Koene A., Perez E-V., Jirotka M., Patel M. & Webb H.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/science-and-technol...
 
Description Response to House of Lords inquiry. Koene A.
Geographic Reach National 
Policy Influence Type Gave evidence to a government review
URL http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/artificial-intellig...
 
Description USACM Panel on Algorithmic Transparency and Accountability
Geographic Reach North America 
Policy Influence Type Membership of a guideline committee
URL https://www.acm.org/public-policy/algorithmic-panel
 
Description Biomedica Research Centre fuding
Amount £24,322 (GBP)
Organisation University of Leicester 
Department NIHR Biomedical Research Centre
Sector Hospitals
Country United Kingdom
Start 01/2018 
End 01/2019
 
Description Digital Rights
Amount £57,600 (GBP)
Funding ID TLEF 2017 001045 
Organisation The Legal Education Foundation 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2018 
End 04/2019
 
Description RPA Digital Futures About Algorithms and beyond
Amount £30,000 (GBP)
Organisation University of Nottingham 
Sector Academic/University
Country United Kingdom
Start 04/2017 
End 05/2018
 
Description RPA Rights and Justice Access to justice in a digital age: suspects' legal rights
Amount £15,000 (GBP)
Organisation University of Nottingham 
Sector Academic/University
Country United Kingdom
Start 04/2017 
End 09/2018
 
Description Smart City Project
Amount £8,000 (GBP)
Organisation University of Nottingham 
Sector Academic/University
Country United Kingdom
Start 05/2017 
End 05/2018
 
Description Chair of IEEE-SA P7003 Standard: Algorithmic Bias Considerations - Dr Ansgar Koene 
Organisation Institute of Electrical and Electronics Engineers (IEEE)
Country United States 
Sector Learned Society 
PI Contribution I proposed the P7003 standard as part of the IEEE Global Initiative for Ethics of Autonomous and Intelligent systems. I chair the IEEE working group for the development of the P7003 Standard for Algorithmic Bias Considerations. The work involves facilitating a monthly conference call, promoting the work to attract working group participants and providing the general outline for the standards documents. Liz Dowthwait from the UnBias project is the P7003 secretary, supporting my work by helping with the monthly agenda and conference minutes.
Collaborator Contribution The IEEE Standards Association (IEEE-SA provides the liaison officer to assist with coordination of the P7003 working group with the wider IEEE Standards activities. IEEE-SA also provides the web-conferencing facilities (WebEx) and online document hosting/collaboration space (iMeet). The IEEE Global Initiative has been facilitating media engagement and policy engagement activities (e.g. ACM/IEEE panel on Algorithmic Transparency and Accountability in Washington DC where I was a panel member)
Impact Dr Ansgar Koene was contacted by the ACM to participate in a panel discussion on Algorithmic Transparency and Accountability in Washington DC on 14th September 2017. https://www.acm.org/public-policy/algorithmic-panel. There was a write-up of the panel discussion, with follow-up interview with Ansgar "IEEE and ACM Collaborations on ATA", published in AI Matters: A Newsletter of ACM SIGAI, on 1 October 2017. Ansgar's role as chair and a summary of the P7003 Standard were mentioned in the article: "The Ethics of Artificial Intelligence for Business Leaders - Should Anyone Care?", in TechEmergence, on 9th December 2017. Ansgar was invited to publish a short paper on the IEEE P7003 activity in IEEE Technology and Society Magazine, "Algorithmic Bias: Addressing Growing Concerns", IEEE Technology and Society Magazine, Volume: 36, Issue: 2, June 2017. [DOI: 10.1109/MTS.2017.2697080]. An interview with Ansgar about P7003 was published in The Institute (The IEEE news source), on 12 September 2017, "Keeping Bias From Creeping Into Code".
Start Year 2017
 
Description Secretary of IEEE-SA P7003 Standard: Algorithmic Bias Considerations 
Organisation Institute of Electrical and Electronics Engineers (IEEE)
Country United States 
Sector Learned Society 
PI Contribution I support the work of the P7003 standard as part of the IEEE Global Initiative for Ethics of Autonomous and Intelligent systems by organising and minuting the monthly working group meetings. The group (EEE working group for the development of the P7003 Standard for Algorithmic Bias Considerations) is chaired by Ansgar Koene, also a member of the UnBias project.
Collaborator Contribution The IEEE Standards Association (IEEE-SA) provides the liaison officer to assist with coordination of the P7003 working group with the wider IEEE Standards activities. IEEE-SA also provides the web-conferencing facilities (WebEx/join.me) and online document hosting/collaboration space (iMeet). The IEEE Global Initiative has been facilitating media engagement and policy engagement activities.
Impact Minutes of all meetings are available at http://sites.ieee.org/sagroups-7003/
Start Year 2017
 
Description "Who is in charge? You or the algorithm?" A. Koene (Explorers Fair- Festival of Science and Curiosity, Nottingham) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact This was a general talk to reflect about how search engines, social networks, news recommender systems, etc., select which information is relevant for the user. The main purpose of this event was to raise awareness of how the internet works in a "language" for all ages. Being part of a Science Festival event for families, the audience was quite broad (from 9 year olds to teenagers, accompanied by their parents).

The audience participated answering and making questions during and at the end of the presentation.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/2017/02/19/unbias-public-engagement-at-the-explorers-fair/#more-368
 
Description Studium Generale presentation at TU Eindhoven. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Invited presentation to undergraduate and general audience, open to the public, at the University of Eindhoven. This talk was part of Holland Design Week at Eindhoven and also qualified for credit for undergraduate students at TU Eindhoven as part of their Technology Impact on Society foundations course. The event was attended by 350 people, student and staff a of TU Eindhoven and eternal people. The talks spakred a lively discussion. After the talk Ansgar was invited to participate in a one-week "Lorentz workshop" at the University of Leiden on "Intersectionality and Algorithmic Discrimination" that took place in December 2017
Year(s) Of Engagement Activity 2017
URL http://www.studiumgenerale-eindhoven.nl/nl/agenda/archief/the-age-of-the-algorithm/0/1109/
 
Description "Civic Tech 101": civic engagement collaboration with Nottingham City Council 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Policymakers/politicians
Results and Impact About 25 people attended a pre-session meeting followed by a live Skype and Q&A conference with Christopher Whitaker, the organiser of Chi Hack Night (Chicago's weekly event to build, share and learn about civic technology). The purpose of the event was to provide some insights into how civic technology could be used in Nottingham to produce online resources that will make complex and important information accessible to Nottingham citizens.

This event brought a wide range of stakeholders together (see "who were the audiences" section, above) aiming to create a multidisciplinary collaborative team. The members for the "Civic Tech 101" Steering Group will be decided on the next meeting (20th March 2017).
Year(s) Of Engagement Activity 2017
 
Description "Interacting with different web browsers & search engines - Do you care?" (Explorers Fair - Festival of Science and Curiosity, Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Seventy pupils attended this drop-in activity at the Explorers Fair Expo, as part of Nottingham Festival of Science and Curiosity (10th February).
Sessions involved hands-on exercises where students, working in pairs, compared results obtained when using different browsers and/or search engines. Participants engaged and discussed about their online preferences and/or concerns regarding: algorithm bias, filtering systems, fairness and privacy issues.

At the end of the sessions, networking with teachers led to establish links with schools to promote other current research activities within our research team (e.g., UnBias Youth Juries). Also, this activity contributed to develop strong links with the organisers of the Science and Curiosity Festival, which takes place annually in Nottingham, and to express our interest to take part in future events.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/explorers-fair-expo/
 
Description "Logan Paul's dead body video reinforces call for better child protection online", in the Conversation 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Elvira to add
Year(s) Of Engagement Activity 2017
URL https://theconversation.com/logan-pauls-dead-body-video-reinforces-call-for-better-child-protection-...
 
Description "Machine gaydar: AI is reinforcing stereotypes that liberal societies are trying to get rid of", in the Conversation 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Impact: Reposted on Digital Leaders blog, and Medium page on 29th November 2017.
Year(s) Of Engagement Activity 2017
URL https://theconversation.com/machine-gaydar-ai-is-reinforcing-stereotypes-that-liberal-societies-are-...
 
Description ALGORITHMIC DISCRIMINATION: ARE YOU IN OR OUT? 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Blog about algorithm bias and possible discrimination to the users, posted in UnBias website.
Year(s) Of Engagement Activity 2016
URL http://unbias.wp.horizon.ac.uk/2016/10/21/algorithmic-discrimination-are-you-in-or-out/
 
Description Accessible Fun Day- Festival of Science and Curiosity, Nottingham 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Hands-on activity for the general public but in particular for a SEND audience, aimed to bring awareness and to reflect on how personal data is used by online platforms. It was the first time UnBias took part of an activity SEND audience-friendly. Children from different ages and learning abilities, parents, grandparents and careers engaged with creative activities which sparked very interesting discussions and genuine interest from the public about our research topic. This activity received good feedback by online social networking (e.g., on twitter).
Year(s) Of Engagement Activity 2017
 
Description Accountability and regulation of algorithms. EuroDIG2017 conference, Estonia. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact As part of the EuroDIG (European Dialogue on Internet Governance) conference UnBias organized a 30minute 'flash session' on Accountability and Regulation of Algorithms. This session was held on the first day of the conference. EuroDig is a multi-stakeholder dialogue forum bringing together civil-society, government, academic and industry to discuss issued related to the future on the internet. In keeping with the spirit of this conference the UnBias led session consisted of a brief introduction of the issues of algorithmic bias followed by a lively discussion involving representatives from UNICEF, Google, Internet Society, European Commission and various others. Following this session a member of the DG connect team at the European Commission requested to join the UnBias stakeholder group.
Year(s) Of Engagement Activity 2017
URL https://eurodigwiki.org/wiki/Accountability_and_regulation_of_algorithms_-_Flash_02_2017
 
Description Algorithm Mediated Online Information Access (AMOIA) - user trust, transparency, control and responsibility. WebSci17, NY. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This activity was part of an ongoing series of stakeholder workshops we are running for UnBias to discuss fairness, and other ethics issues, in algorithmic decision making. This particular instance of the workshop series was a workshop help on the first day of the WebScience conference in Troy, New York, USA. Participants were other academic attendees of the Webscience conference. The event involved a lively discussion between participants, which was voice-recorded for future analysis (participants gave written consent) and provided an interest US perspective on the issues we had previously discusses with participants in the UK. Following the workshop a number of participants joined the UnBias stakeholder group to keep up to date on future activities of the project.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/event/amoia-workshop-at-acm-web-science-2017/
 
Description Algorithm Workshop, Held at the TIC, Strathclyde, February 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Lilian Edwards organised an Algorithm Workshop on 27th February at the Technology Innovation Centre (TIC) at Stathclyde for the benefit of Internet Law and Policy Masters students, and Internet law Honours students, as well as invited guests from law, technology and business and public attendees. The event was a sell out with 300 attending and created much interest on social media.
The workshop considered the legal, social and technical dimensions of algorithms and their role in governance. As our everyday lives are more and more determined by decisions made by automated algorithmic processes, the status of algorithms and how they can be regulated , queried and countermanded, becomes evermore important. To give just a few examples, algorithms now often determine how we are assessed as risks for policing and terrorism surveillance: how we get hired, fired and promoted; and what news and political opinion we are exposed to. Both personal and societal welfare and arguably, the future of democracy itself, thus depend on being able to regulate and make accountable the algorithm society. In particular a major current question is if a right to explanation of what an algorithm has decided exists in data protection law? Lilian spoke on this in her contribution: ""Slave to the Algorithm: War Stories and Legal Remedies".
We hope the event will be a "starter seed" for CILP and partners (including Edinburgh and Horizon DEC, Nottingham) to investigate this fascinating topic further and we will be seeking major grant funding. ax 120000 characters)
Year(s) Of Engagement Activity 2017
URL http://www.strath.ac.uk/humanities/lawschool/newsevents/algorithmworkshopfebruary2017/
 
Description Algorithmic Decision-Making. European Big Data Value Forum, Versailles. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Ansgar Koene presented an invited talk on the ongoing activities of the UnBias project, and the related work of the IEEE P7003 Standard for Algorithmic Bias Considerations working group he chairs. This presentation was part of the Data & Society panel session on the 2n day of the conference. The session was attended by about 200 people consisting of industry, academia, government and NGO attendeed of the European Big Data Values forum. Following the presentation there was a panel discussion. At the end of the session Ansgar was approached by a number of audience members to request future contact by a professor from Télécom Ecole de Management and a person from the New York based NGO NYSci [https://nysci.org/NYSci] regarding our work of engaging with young people on their experience and recommendations related to online algorithmic services.
Year(s) Of Engagement Activity 2017
URL http://www.european-big-data-value-forum.eu/program/data-society/#algorithmicdecisionmaking
 
Description Algorithmically Mediated Online Information Access (AMOIA) discussion workshop at Mozfest 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact This activity was a discussion dialogue, with participants of the Mozfest event in London, on the topic of fairness in Algorithmic decisions making related to Algorithmically Mediated Access to Online Content (e.g. search engines, social media recommendation feeds etc). Participants included civil-society NGO from Germany (Algorithm Watch), Liberians from US and Sweden, London based data activists and general audience. Activity mentioned by Mozfest organisers in the Medium blog.
Year(s) Of Engagement Activity 2017
URL https://medium.com/mozilla-festival/decentralisation-at-the-mozilla-festival-aad3e33e1443
 
Description Article in UK media: We asked young people what they want from the internet of the future - here is what they said 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Impacts: Reposted on the Independent website on April 1st 2017 and on the Digital Leaders blog and Medium page on November 28th 2017
Year(s) Of Engagement Activity 2017
URL https://uk.news.yahoo.com/asked-young-people-want-internet-112933237.html
 
Description BBC Nottingham Drive Time Radio interview on NSPCC proposal for algorithmic detection of online grooming 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact While visiting the BBC Nottingham studio for the TV interview regarding the proposal by the NSPCC that the government should mandate that Social Media companies use algorithms to detect if a child is being approached online as part of sexual grooming, Ansgar was asked to also provide expert commentary to contribute to the BBC Nottingham Drive Time Radio broadcast at 3:30pm on January 29th.
Year(s) Of Engagement Activity 2018
 
Description BBC Salford symposium 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Horizon and Databox presentation to BBC around privacy preserving personalised services
Year(s) Of Engagement Activity 2018
 
Description BBC1 News (East Midlands) - TV interview regarding NSPCC proposal for algorithmic detection of online grooming 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Following the proposal by the NSPCC that the government should mandate that Social Media companies use algorithms to detect if a child is being approached online as part of sexual grooming, the BBC East Midlands contacted Ansgar to ask for expert commentary regarding the technical feasibility of this proposal. The interview was broadcast as part of the 6:30pm and 10:30pm BBC1 regional news for East Midlands on January 29th.
Year(s) Of Engagement Activity 2018
URL https://www.bbc.co.uk/iplayer/episode/b09pr6zm/east-midlands-today-evening-news-29012018
 
Description CNBC Arabia TV News commentary on NHS and global Wannacry randsomeware incident 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services, and subsequent problems in other countries, due to a 'WannaCry' ransomware attack CNBC Arabia contacted Ansgar Koene to provide 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as a segment of the regular news show.
Year(s) Of Engagement Activity 2017
URL https://www.cnbcarabia.com/
 
Description CaSMa blog 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The CaSMa blog disseminates and publicize work and events designed to address the ethical challenges around social media.
To date, the blog has attracted more than 5,000 views and over 400 subscribers. During the last year, the CaSMa blog has posted more than 70 blogs, received many comments from followers (n>39) and several requests for guest posts (e.g. World Wide Web Foundation (webfoundation.org).
The blog is a valuable tool to publicize events, showcase current research projects and inform the public about current topics on social media research as well as provide a platform for the public to engage and communicate with the CaSMa team. For example, after the last public engagement event organised at Nottingham Contemporary, one of the attendees posted:

'Hello, I attended the most recent event. The event was organised masterfully and conducted with the utmost dignity and professionalism yet remained safe, supportive, engaging and thought provoking, it was "real".

At the end of the debate I posed the question, "is the emerging phenomenon of digital interaction a window into Jung's collective unconscious." This could be refined into a debate/exploration of virtual social groups and crowd consensus or dissension on the internet and perhaps their effects on the physical world.

please email me if you for further thoughts.'

Evidence that the CaSMa blog is reaching policy makers is evident from two occasions:
On December 7th 2015, following a blog post regarding the House of Lords inquiry into online platforms we were contacted:
Dear Dr Koene,
I just noticed your short blog on the Lords inquiry into online platforms, particularly commenting on the question relating to algorithms.
Would you care to respond to our inquiry, on that one question? You clearly have a lot of expertise in this area. A page or two would be sufficient and would certainly enrich the debate.
The only issue is that we will stop accepting submissions on the 10th of this month.
Nevertheless, given that you have already more or less written it
Best,
Kilian
Kilian Bourke
Policy Analyst
EU Internal Market Sub-Committee
Committee Office, House of Lords

On January 5th 2016, following blog posts on the draft Investigative Powers Bill we were contacted:
Dear Ansgar,
I work with the team leading on the Investigatory Powers Bill in the Home Office.
I hope you don't mind my approach, but we saw that you'd produced an analysis of the IP Bill on the CaSMa project blog site, and wondered if you might be interested in an informal discussion with officials working on the Bill. This could either be in London, or via phone if that were more convenient.
If you are interested in setting something up please do get in touch.
Best regards
Rebecca

Rebecca Underhill
National Security Directorate
Home Office
Year(s) Of Engagement Activity 2014,2015,2016
URL http://casma.wp.horizon.ac.uk/
 
Description Children's and Young People's Rights in the Digital Age: An IAMCR 2016 pre-conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Are children's rights being newly infringed or enhanced in the digital age? Such questions concern researchers, child rights' advocates, and internet governance experts. Yet children's needs and experiences in the digital age are often neglected in high-level debates about global internet provision and governance and children's rights are treated as a minority interest and seen as demanding exceptional treatment from adult society. Further, current debates frequently emphasise the risks children potentially face online and underline their right to protection, but much less attention is gven to children's provision and participation rights online.

The conference will foster an international debate on key issues related to children's and young people's rights in the digital age, including: child and youth participation rights; online opportunities and risks; inequalities and digital exclusion; policy and multi-stakeholder governance; the role of peers and peer culture; participatory research; e-learning, health promotion and creativity in the digital environment; cross-generational dynamics of online engagement.
The conference includes a plenary presentation from Global Kids Online. It will begin at midday on 26 July and close at midday on 27 July to enable delegates to make the journey to Leicester for the opening of IAMCR 2016 (approximately one-hour train journey).
Year(s) Of Engagement Activity 2016
URL http://www.lse.ac.uk/media@lse/events/CYPR-IAMCR-2016.aspx
 
Description Digital Democracy: critical perspectives in the age of big data. 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Blog summarising the European Communications Research and Education Association (ECREA) conference and UnBias participation in November 2017, Stockholm.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/2017/11/20/digital-democracy-critical-perspectives-in-the-age-if-big...
 
Description Digital Technology in Practice, NIHR MindTech symposium 2017. London. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact At this symposium Elvira Perez contributed to a round table to discuss if virtual therapist could bridge the current mental health service provision gap
Year(s) Of Engagement Activity 2017
URL http://www.mindtech.org.uk/mindtech-annual-conference.html
 
Description Disinformation and Discernment: New Skills to Protect Old Values. OEB MidSummit, Iceland. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Elvira to add
Year(s) Of Engagement Activity 2017
 
Description Editorial Responsibility arising from personalisation algorithms. ETHICOMP conference, Turin. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This talk was part of the Ethicomp conference in Turin, Italy and was attended by an audience consisting of Ethicomp participants. Ethicomp is the main conference of the RRI in ICT community, with publications in the ORBIT Journal, launched by the Orbit project (https://www.orbit-rri.org). Following the presentation a number of audience members requested further information and some of them joined the UnBias stakeholders group.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/dissemination/presentations/
 
Description Editorial responsibility arising from personalization algorithms. The ethics of machine learning in professional practice. Cambridge, 28th Nov. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact During this workshop I presented the UnBias project which sparked questions and interests among an heterogeneous audience. It was and important engagement event afterwards two of the attendees become stakeholders and supporter of the UnBias project.
Year(s) Of Engagement Activity 2016
 
Description Ethics assessment of research and innovation. SATORI. London 24th Nov. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This is a working group organized with European funding. The connections that emerged from that meeting are extremely relevant specially after Brexit resolution because it allows us to keep connected with our European colleagues working on data ethics.
Year(s) Of Engagement Activity 2016
URL http://trilateralresearch.com/satori-mutual-learning-workshop-ethics-assessment-research-innovation/
 
Description Evaluation of the participation model 'Sharing the Future' : research project within Primary Parliaments, Nottingham City Council. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact We conducted a feasibility study designed to evaluate the efficacy of 'Sharing the Future' (StF), a new model for citizen participation routinely applied at Primary Parliament, an educational activity offered to primary schools in Nottingham City. Our study showed that the implementation of the model StF boosts children's confidence on their relation with other children and young people in regards to: 1) sharing their views and life experiences, 2) decision-making, as well as making decisions on their own and 3) being listened and respected by their peers. This feasibility study provided the elements and conditions required to conduct a larger future pilot study. From 232 children invited to participate in this study, a total of 102 pupils (aged 9-11) from 19 institutions took part. Data from this work lead to the preparation of a research manuscript to be soon submitted to an international citizen engagement peer-reviewed journal.
Year(s) Of Engagement Activity 2017
 
Description Experiential workshop at the National Trust building The Workhouse in Southwell as part of the book launch 'Voices from the Workhouse'. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Supporters
Results and Impact This invitation came from the National Trust and it is linked to the research project 'What is home?'. The aim of this experiential workshop is to reflect on the notions of home, the history of the The Workhouse and how to improve the visiting experience of future visitors. The workshop was also aimed to engage with an audience that rarely engages in embodied practices such as yoga or flamenco during a weekend retreat. The workshop was a success and many participants reported being interested in contributing or participating in future related events. This activity also links with previous work done by Horizon in this building aiming to improve the visitors experience by introducing interactive elements.
Year(s) Of Engagement Activity 2017
URL http://www.nationaltrust.org.uk/theworkhouse
 
Description Experiential workshop by the National Trust at The Workhouse 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Experiential workshop by the National Trust at The Workhouse to launch the book 'Voices from the Workhouse'. Southwell, 18th March, 2017. I have been invited again to provide a similar experiential workshop
Year(s) Of Engagement Activity 2017
 
Description Flamenco-Yoga as creative practice for mutual recovery. Experiential workshop presented at the 5th International Health Humanities Conference, Seville, 15-17 September [page 76] 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The workshop was run twice during the conference. No formal feedback was collected after or during the workshop but the first author captured anecdotal feedback and received numerous invitations to deliver the workshop again in different settings. To date, the first author has run the workshop several times among children and young people and is planing a systematic evaluation to understand the effects that creative practices as mutual recovery can have among s clinical and non-clinical populations.
Year(s) Of Engagement Activity 2016
URL http://www.ihhcsevilla2016.es/
 
Description Gem FM radio interview 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact I was interviewed by Gem FM about the work I did bringing yoga into children homes
Year(s) Of Engagement Activity 2016
 
Description Hello from Mozfest! 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Blog sumarising UnBias team engagement activities at Mozfest Festival October 2017, London.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/2017/10/30/hello-from-mozfest/
 
Description How do you take care of the internet? Mozfest festival, London 2017. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Drop-in session with interactive activities that sparked debate and reflection on issues such as: privacy, security and how to take care on the internet. Activities including scenarios related to fake news, hate speech, search results and personalised content were displayed and participants were encouraged to express their opinions by voting best possible outcome for each scenario. About 80 people from a diverse audience (from professional practitioners to the general public) engaged in this session. Relevant discussions and views provided our research team of new insights on people's online experiences and allowed to establish new contacts, for ongoing and future collaborations.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/2017/10/30/hello-from-mozfest/
 
Description Human Agency on Algorithmic Systems, AoIR conference, Estonia. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a presentation at the annual Association of Internet Researchers conference. The session was attended by about 60 audience consisting of other conference attendees, mostly from academia but also including some NGOs and industry interested in understanding the latest academic work on the impact of internet on society. The talk covered results from the UnBias Youth Juries, and stakeholder engagement workshops as well as some information regarding the IEEE P7003 Standard for Algorithmic Bias Considerations working group. At the end of the talk there was a good discussion and some of the participants approached to ask about joining the P7003 working group.
Year(s) Of Engagement Activity 2017
URL https://www.slideshare.net/AnsgarKoene/human-agency-on-algorithmic-systems
 
Description IEEE-SA webinar: The Human Standard - Why Ethical Considerations Should Drive Technological Design 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Online webinar organized by the IEEE Global Initiative for Ethics of Autonomous and Intelligent Systems with contributions from the chairs of the IEEE P70xx ethics related standards, including the P7003 Standard for Algorithmic Bias Considerations that is chaired by Ansgar Koene. The webinar was attended by IEEE members globally.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/the-human-standard-why-ethical-considerations-should-drive-tech...
 
Description IGF meeting, Geneva (UNOG). 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Presentation about (Self) regulation of algorithmic systems that control online information access.
Year(s) Of Engagement Activity 2017
URL https://igf2017.sched.com/event/DCQW/self-regulation-of-algorithmic-systems-that-control-online-info...
 
Description Inerviewed fro article in WIRED 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Following revelations of abusive content on YouTube children channels Nicole Kobie interviewed Ansgar Koene for an article in WIRED. The article was published on 24 November 2017.
Year(s) Of Engagement Activity 2017
URL https://www.wired.co.uk/article/youtube-kids-moderation-google
 
Description Internet Reseaerch Ethics - interviewed for article in Nature 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact In September 2017 Ansgar was contacted by Elizabeth Gibney, a journalist working for Nature, for an interview to contribute to an article she was writing on "Ethics of Internet research trigger scrutiny: Concern over the use of public data spurs guideline update.". The article was published on October 3rd 2017
Year(s) Of Engagement Activity 2017
URL https://www.nature.com/news/ethics-of-internet-research-trigger-scrutiny-1.22746
 
Description Interview for BBC Scotland 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact I was interviewed by BBC Scotland for a discussion on the Digital Childhood Report
Year(s) Of Engagement Activity 2017
URL http://www.horizon.ac.uk/bbc-radio-scotland-interview-with-dr-elvira-perez-about-children-and-the-in...
 
Description Kooth online mental health representations and ethics 2/2 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This presentation presented a case study to illustrate the ethical challenges of online research. Kooth.com, and online platform that offer counseling services to children and young people was used as an example.
Year(s) Of Engagement Activity 2017
 
Description Mental Health series at BBC Radio Nottingham 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact During this radio program was interviewed about the research I do to promote creative practices as mutual recovery.
Year(s) Of Engagement Activity 2017
 
Description Mindtech 2017 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presentation on how Databox can alleviate ethical and privacy challenges in mental health care.
Year(s) Of Engagement Activity 2017
URL http://www.mindtech.org.uk/mindtech-annual-conference.html
 
Description Older people discuss how Smart City Nottingham could bring benefits to health and wellbeing 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Study participants or study members
Results and Impact During this event organised by Age-Friendly Nottingham and that coincided with 'Older peoples day' was the perfect venue to launch our report
Year(s) Of Engagement Activity 2017
 
Description Online mental health representations and ethics 1/2 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This was a presentation on online ethics part of the network 'Hungry for words'. The presentation focused on the challenges of securing online consent from participants
Year(s) Of Engagement Activity 2017
 
Description Open-space and Citizens Juries to explore older peoples views on optimising health and wellbeing benefits for a Smart City Nottingham 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This poster was presented at the MindTech Symposium
Year(s) Of Engagement Activity 2017
 
Description Poster presentation: "A multi-stakeholder perspective on the regulation and design of algorithm fairness" , TRILcon17 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Sparked questions and discussions about the novel results presented in the poster, part of the UnBias' stakeholder first workshop. Moreover, this poster received the 'Best Poster Award'.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/wp-content/uploads/2016/08/Unbias_TRILCon17_Poster.pdf
 
Description Poster: Algorithm Fairness in Online Information Systems, WebSci conference, NY. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This poster sparked relevant discussions. It was also presented at "The growing ubiquity of algorithms in society: implications, impacts and innovations" - scientific meeting at the Royal Society, October 30-31, London, UK.
Year(s) Of Engagement Activity 2017
URL http://websci17.org/
 
Description Presentation at ECREA Symposium on Digital Democracy: critical perspectives in the age of new data, held at Södertön University, Stockholm, Nov. 2017 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Academic presentation of 'UnBias' research data which lead to relevant questions and discussion afterwards. It also allowed networking with colleagues in the filed for future research collaborations.
Year(s) Of Engagement Activity 2017
URL https://communicationanddemocracy.wordpress.com/2017/01/09/call-for-papers-ecrea-symposium-digital-d...
 
Description Presentation at Hungry for Words final workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was the final activity of the workshop which concluded on a round table that engaged a representative and inclusive group interested in male eating disorders
Year(s) Of Engagement Activity 2018
 
Description Presentation at Internet Society - European Chapters meeting 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact In February 2017 the European chapters of the Internet Society (ISOC) held their annual conference to discuss join activities and coordinate projects for the year. In 2017 Ansgar Koene represented the ISOC UK-England chapter with a presentation on "Fake News". Ansgar was invited to lead Uk based activities on User Trust, the ISCO thematic agenda of the year.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/internet-society-european-chapters-meeting/
 
Description RT UK - TV News and Social media - interview regarding NHS Wannacry ransomware 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services, and subsequent problems in other countries, due to a 'WannaCry' ransomware attack RT UK contacted Ansgar Koene to provice 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as a segment of the regular news show. Ansgar has subsequently be asked to provide comment as "Cyber expert" on numerous occasions.
Year(s) Of Engagement Activity 2017
URL https://www.rt.com/uk/
 
Description RT UK - TV News and Social media - interview regarding accusation by US Senate of spying by Kasperski software 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Following the breaking news that the cybersecurity software firm Kasperski was being accused by the US of using its anti-malware software to spy on the US Senate, and thus forbidding further Federal Government use of Kasperski products, RT UK contact Ansgar to provide commentary on the technical feasibility of using anti-malware software for spying. The brief TV interview was broadcast on 19 September 2017.
Year(s) Of Engagement Activity 2017
URL https://www.rt.com/uk/
 
Description RT UK - TV News and Social media content - Debate on UK parliament proposal to regulate Social Media like new media. Koene A. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact RT UK channel contacted Ansgar to invite him to participate in a short TV debate regarding the UK parliament proposal that government should regulate social media companies as traditional media companies. The TV debate was broadcast on TV and the RT UK social media channel on 13 December 2017.
Year(s) Of Engagement Activity 2017
URL https://youtu.be/3Yj6ImETQPQ
 
Description Rinzing art exhibition 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact This is an photography exhibition launched at the Institute of Mental that explores mental health and wellbeing through street photography.The exhibition was launch at Eating Disorders week to bring awareness on male eating disorders.
Year(s) Of Engagement Activity 2018
 
Description School Visit (Bilborough college, Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Drop-in session at Bilborough college to promote and recruit participants for the next UnBias Youth Juries (focus groups to reflect, debate and share ideas), taking place at the UoN in March 2017. 35 student expressed their interest to participate.

Staff expressed interest for the students to participate in future events within our project and in related research areas.
Year(s) Of Engagement Activity 2017
 
Description Second Wave of UnBias Youth Juries 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact 103 student from secondary schools and/or 6th form colleges attended the workshops. 9 sessions were run at those institutions or at the UoN.
The UnBias Youth Juries are youth-lead focus groups with different scenarios to prompt discussions about some particular aspects on how the internet works (with focus on algorithm fairness when interacting with automated systems).
Sessions were very participative. Debate and audience change of opinion during the session was highly noticed.
Students and accompanying school teachers showed interest in taking part in related research activities.
Year(s) Of Engagement Activity 2017
 
Description Sky News TV interview for bulletin on NHS Wannacy Ransomware attack 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services due to a 'WannaCry' ransomware attack Sky News contacted Ansgar Koene to provice 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as segment of a rolling news coverage of the event. Ansgar was contacted again by Sky News on 9 September for comment regarding the Equifax hack.
Year(s) Of Engagement Activity 2017
 
Description Smart Because of You. FoSAC and NUCLEUS (RRI, Horizon 2020) conference, Nottingham. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Presentation about the UnBias Youth Juries (YJ): methodology and data. Also, a general overview of the UnBias project highlighted the wide range of participants that so far have engaged/participated in our project including: young people (mainly 13-17 yrs old), a multi-stakeholder panel including citizens from the public sector, academics, industry, media, policy makers, NGOs, etc. This activity generated interesting questions and discussion and helped to establish new contacts for further collaborations. General interest expressed by the audience and on online social network (twitter).
Year(s) Of Engagement Activity 2017
 
Description Stakeholders group organised by NCC 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Participation in the Nottingham Tech city steering group: a multi disciplinary team of about 15 people from the public and private sectors, academics, NGOs, etc., aiming to explore civic technology in Nottingham. Established new contacts for possible future collaborations
Year(s) Of Engagement Activity 2017
 
Description TRT Wrold News TV interview related to NHS and globa Wannacry randsomware attacks 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Following the nationwide disruption of NHS services, and subsequent problems in other countries, due to a 'WannaCry' ransomware attack TRT World contacted Ansgar Koene to provice 'expert commentary' on the possible origins, impacts and technical safeguards that should be put in place. The interview was broadcast on 12 May 2017 as a segment of the regular news show.
Year(s) Of Engagement Activity 2017
URL https://www.trtworld.com/
 
Description The Conversation article We asked young people what they want from the internet of the future - here's what they said 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This article at The Conversation highlights that the Internet is not fit for children and online services have to be more child friendly. There is an amendment for the Data Protection bill that has been influenced by articles like this one.
Year(s) Of Engagement Activity 2017
URL https://theconversation.com/we-asked-young-people-what-they-want-from-the-internet-of-the-future-her...
 
Description The Internet on our own terms. Press release 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact This was the media press release for the launch of the report 'The Internet On Our Own Terms'.
Year(s) Of Engagement Activity 2017
URL http://www.nottingham.ac.uk/news/pressreleases/2017/february/young-people-call-on-government-for-gre...
 
Description Thresholds broadcast 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact BBC Click Fifty shades of Spray video coverage and interview with Mat Collishaw stimulated increased interest and raised awareness
Year(s) Of Engagement Activity 2017
URL https://www.bbc.co.uk/iplayer/episode/b08s72bm/click-fifty-shades-of-spray
 
Description USACM panel on Algorithmic Transparency and Accountability. Washington DC. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The USACM panel on Algorithmic Transparency and Accountability was organized by the US policy SIG of the ACM to communicate the activities that the ACM is doing on Ethics of Algorithmic Decision making to congressional staff members. The even was held at the National Press Club in Washington DC. As part of the panel they invited Ansgar Koene to represent, and talk about, the activities of the IEEE Global Initiative for Ethics of Autonomous and Intelligence systems. The event was attended by about 60 people in person and also live streamed to a global audience. Member of the in-room audience included journalists from the Financial Times and Wired as well as junior staff members working in the offices of members of congress. Following the event Ansgar was interviewed, by e-mail, by a writer for the ACM's AI Matters blog (https://sigai.acm.org/aimatters/blog/2017/10/01/ieee-and-acm/). Following from this ACM/IEEE collaboration the two professional organizations set of an informal grou pto develop future joint activities to promote the work that both organizations are doing on Ethics is AI which Ansgar is a part of.
Year(s) Of Engagement Activity 2017
URL https://www.acm.org/public-policy/algorithmic-panel
 
Description UnBias Youth Jury at the Explorers Fair (Festival of Science and Curiosity, Nottingham) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact 30 young people attended the youth jury at the Broadway cinema, Nottingham. The juries are youth-lead focus groups designed to stimulate debate giving participants the chance to share their views and express their concerns about a particular topic. In this case the theme was algorithm fairness.

Some of the participants from this jury expressed their interest to take part in future Youth Juries and/or other related events.
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/explorers-fair-expo/
 
Description UnBias Youth Jury at the National Video Game Arcade 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact 30 young people attended the youth jury at GameCity. The juries are designed to stimulate discussion and debate among jurors. Some of the participants from this jury were recontacted to attend the launch at the House of Lords 'The Internet on our own terms' and answer questions from the audience.
Year(s) Of Engagement Activity 2016
 
Description UnBias mentioned in the media -The Institute 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact UnBias project mentioned in The Institute, the IEEE news source blog which informs members about the latest news and trends in technology and engineering and shares opinions about what's going on in these areas.
Year(s) Of Engagement Activity 2017
URL http://theinstitute.ieee.org/ieee-roundup/blogs/blog/keeping-bias-from-creeping-into-code
 
Description UnBias youth advisory group 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Advisory group opened to young people to contribute to the co-creation of new scenarios for the UnBias Youth Juries. Three meetings took place between Nov 2017 - Jan 2018 and four students (15-16 yrs old) attended. They provided valuable feedback on their experiences when taking part of previous Youth Juries' session and we have used this feedback to make some modifications to the design the last wave of Juries that will be run in Feb-March 2018.
Year(s) Of Engagement Activity 2017,2018
 
Description When AI goes to war 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact We presented a poster outlining the work done to interrogate young people about AI applied to military artifacts.
Year(s) Of Engagement Activity 2016
 
Description When AI goes to war 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact This was a youth jury to discuss the benefits and problems of having killer robots fully autonomous among young people
Year(s) Of Engagement Activity 2017
 
Description Workshop at TRILcon17- Trust, information and the law 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Stakeholders workshop that aid reflexion and discussion about algorithm fairness throughout three case studies. This sparked pertinent discussion between academics, lawyers, y members from the public sector. Two groups of about 15 participants each attended this activity. Ansgar Koene's contribution in this conference was mentioned by Michael Cross in 'The Law Society Gazette': https://www.lawgazette.co.uk/news-focus/news-focus-algorithms-and-schrödingers-justice/5060964.article
Year(s) Of Engagement Activity 2017
URL http://unbias.wp.horizon.ac.uk/event/trilcon-2017/
 
Description Workshop: Platform-to-business trading practices workshop (EC Digital Single Market) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Workshop organized by the European Commissions Directorate General for the Digital Single Market (DG connect) to explore the possible need for action by the European Commission against anticompetitive behaviour by online platform providers. The workshop invited companies that list their products or services on online platforms (e.g. hotels) and academics and NGOs who have done work related to online platforms, to discuss possible anticompetitive practices. Ansgar Koene was invited by members of the DG connect team to participate in this workshop following his EuroDIG flash session of Algorithm Regulation.
Year(s) Of Engagement Activity 2017
 
Description Workshops: UnBias Youth Juries (2 sessions), held in Nottingham as part of the Festival of Social Science (ESRC), Nov. 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Interactive youth-led workshops which sparked questions, debate, reflexion and recommendations from participants for an internet more user-centred. Participants' feedback was very positive as most of them expressed sessions were very interesting and educational and learnt new things applicable in their work/studies. Participants also felt inspired to learn more about the topics discussed in this activity. One of the main outcomes was that it lead to the creation of a youth advisory group with some of the participants that took part in these workshops.
Year(s) Of Engagement Activity 2017
URL http://www.esrc.ac.uk/public-engagement/festival-of-social-science/
 
Description Yoga in children homes 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Many yoga related sites cite this study.
Year(s) Of Engagement Activity 2016
URL http://www.nottingham.ac.uk/news/pressreleases/2016/december/yoga-can-have-social-benefits-for-child...
 
Description Young People's Policy Recommendations on Algorithm Fairness. WebSci conference, NY. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The presentation was past of the WebScience confernece in Troy NY, USA which was attended by mostly academics but with some industry and NGO participants interested in the latest state of the art in academic thinking on information flows and user engagement with information on the world wide web. The Unbias talk on "Young People's Policy Recommendations on Algorithm Fairness" provided a strong contribution to the conference theme of Ethics in WebScience, with various members of the previous the Ethics Panel from the previous evening approaching after the talk for further information about our work.
Year(s) Of Engagement Activity 2017
URL https://unbias.wp.horizon.ac.uk/dissemination/presentations/
 
Description Youth Juries Open Educational Resource 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact We have created an Open Educational Resource for educators to deliver the youth juries in their own institutions
Year(s) Of Engagement Activity 2016
URL http://casma.wp.horizon.ac.uk/casma-projects/irights-youth-juries/oer/
 
Description Youth Jury, part of Festival of Science and Curiosity, Nottingham. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Eight participants (aged 13-17) attended this session held at Nottingham Central Library. It was a very interactive and fun youth led-discussion to reflect about algorithmic bias present on daily used online systems and platforms. Participants were very keen and engaged in very relevant discussions, shared their views and experiences, and provided recommendations for an ideal internet.
Year(s) Of Engagement Activity 2017
URL https://www.horizon.ac.uk/unbias-workshop-at-the-festival-of-science-and-curiosity-17-feb-2018/