Patterns in Practice: cultures of data mining in science, education and the arts

Lead Research Organisation: University of Sheffield
Department Name: Information School

Abstract

Patterns in Practice will explore how practitioners' beliefs, values and feelings interact to shape how they engage with and in data mining and machine learning - forms of 'narrow AI'.

Data and algorithms are becoming increasingly important resources for decision makers in organisations across sectors. Data mining and machine learning techniques allow analysts to find hidden patterns in the vast troves of data that organisations hold, producing predictive insights that can be actioned by others within the organisation or further afield. As applications of such techniques have become more common place, they have also become more controversial. The recent case of Cambridge Analytica mining Facebook data for political campaigning purposes is a recent example. Across sectors practitioners are asking what good data practices look like and how they can be fostered, and the UK government has recently launched the Centre for Data Ethics and Innovation to examine such issues.
While many data scientists are excited by these techniques and their potential to overcome perceived limitations of human judgement, for other groups of practitioners they can be perceived as an intrusive threat to privacy, an unwelcome challenge to professional insight, or dismissed as overhyped methods that produce poor quality information. Beliefs, values and feelings such as these, influenced by the cultures that practitioners are embedded within, are crucial factors that shape how the adoption and application of this type of AI unfolds in different contexts of practice. They also shape how different groups of practitioners come to relate to one another and the subjects of their data. Ultimately, practitioners' beliefs, values and feelings shape how they come to understand what is desirable and ethical with regard to the application of such techniques in different contexts.
In Patterns in Practice, we will use a combination of interviews, focus groups and observations to explore how the beliefs, values and feelings of different groups of practitioners shape how they engage with data mining and machine learning, and influence the evolution of cultures of data practice. We will examine the beliefs, values and feelings both of those developing and implementing applications that use data mining and machine learning techniques, and those being asked to use the outputs of such applications to inform their decision making. Since factors such as the novelty of application, individual and social implications, and the involvement of commercial interests can impact on people's beliefs and feelings about the application of such technologies, we have decided to explore practitioners' perceptions within three contrasting sectors in science, education and the arts: (1) mining chemical data to inform drug discovery in the pharmaceutical industry, (2) predictive learning analytics in UK universities, and (3) novel applications of data mining in the arts. Through exploring a diverse range of practitioners' perspectives, we aim to build a rich picture about what they believe and how they feel about the application of data mining in different contexts.
Building upon this empirical foundation, we aim to engage different groups of practitioners across the sectors to enhance their understanding of the ways in which their own and others' beliefs, values and feelings can impact upon how they engage with data mining and machine learning applications and how this shapes how such applications become embedded, or not, into different organisational contexts. Drawing on this deeper understanding, we aim to empower practitioners in the sectors we work with and relevant stakeholders (i.e. members of the public, policy makers) to foster the development of critical and reflective "data cultures" (Bates, 2017) that are able to exploit the possibilities of data mining and machine learning, while being critically responsive to their societal implications and epistemological limitations.

Planned Impact

Who?
Through our research into how affective and ideational factors shape data cultures, we aim to develop an empirically grounded foundation for engaging differently situated groups of practitioners in critical and reflective dialogue, specifically in the domains of science (drug discovery), education (learning analytics) and the arts (arts practice). Through doing so we aim to foster the development of "data cultures" that allow organisations to exploit the possibilities of DM/ML techniques while simultaneously being responsive to their societal implications and epistemological limitations. Our partner organisations (GlaxcoSmithKline [GSK], JISC and Sheffield Doc/Fest) will work with us to achieve our objectives in their own organisations and sectors.
-Pharmaceutical sector. Our partners GSK will benefit through becoming better informed about how affective-ideational dynamics influence how DM/ML outputs are embedded in - and inform decision-making across - the drug discovery pipeline. Beyond GSK, these insights will be transferable to other organisations within the pharmaceutical sector.
-Higher education. Our partners JISC will benefit from enhanced understanding about how predictive learning analytics is being received by different practitioners within the context of the UK's Higher Education sector. This will enhance JISC's capacity to develop best practice guidelines for ethical practice, and HE institutions' ability to make effective and ethical decisions about the adoption and use of learning analytics.
-Cultural sector. Our artists-in-residence and cultural partners will benefit through developing their DM/ML practice, and opportunities to engage audiences with these practices. The Sheffield Doc/Fest, and other collaborating digital arts organisations, will gain insights which can inform their curation practices, and expand their art-science practice.

How?
In order to foster the development of more critical and reflective cultures of engagement with DM/ML practices in the above sectors, we will:
1. Involve practitioners in partner organisations and our artist in residence in the research throughout, and disseminate findings within these organisations
2. Engage research participants in a series of dialogue events that aim to foster critical cross-sector and cross-profession discussion among differently situated practitioners
3. Disseminate findings to practitioners via blogs and articles in practitioner publications, and at relevant festivals, conferences and events.

A further objective is to raise awareness of DM/ML and the affective-ideational context for DM/ML practice among members of the public. We will:
1. Host an artist in residence who will produce a DM/ML art work to be exhibited at Sheffield Doc/Fest Alternate Realities in the final year of the project
2. Run a work in progress public event as part of the residency, and public dialogue events that engage the public, practitioners and policy makers in constructive discussion about DM/ML
3. Disseminate findings on popular blogs and social media, at digital festivals and events.

A final objective is to develop skills and capacity among the members of the research team and our collaborators. We will:
1. Provide basic DM/ML training for all researchers on the project
2. Have a training budget of £1000 for each RA allocated based on a Training Needs Analysis
3. Support our artists in residence to apply for Arts Council funding in order to tour the exhibit nationally.
 
Description Festival of the Mind - Patterns in Practice
Amount £7,000 (GBP)
Organisation University of Sheffield 
Sector Academic/University
Country United Kingdom
Start 03/2022 
End 09/2022
 
Description GSK 
Organisation GlaxoSmithKline (GSK)
Country Global 
Sector Private 
PI Contribution We are conducting research at GSK as part of one of the project case studies.
Collaborator Contribution Sharing literature, recruiting participants, allowing access to facilities for fieldwork, engagement in dialogue events, invitations to deliver talks on findings .
Impact n/a
Start Year 2021
 
Description JISC 
Organisation Jisc
Country United Kingdom 
Sector Public 
PI Contribution We will be beginning data collection at JISC and in HE institutes over summer 2022. We will share findings with JISC.
Collaborator Contribution Assisting in recruitment of participants, access to networks, opportunities to share findings to relevant stakeholders, engagement with dialogue events
Impact n/a
Start Year 2021
 
Description Watershed & Pervasive Media Lab 
Organisation Watershed Media Centre
Country United Kingdom 
Sector Private 
PI Contribution We will work in partnership with Watershed to host an artist in residence & exhibit their work. Watershed will in addition receive £29,000 (inclusive of VAT) to: • Pay the artist-in-residence £8000 (Artist fee) • Host and deliver the artist residency £6000 (Watershed fee) • Support the public showcase of final work and all related fees and materials £15,000 (including creative and technical fees, installation, materials, refreshments and equipment)
Collaborator Contribution work in partnership with the Patterns In Practice team to co-produce an Artist Commission through our creative technology hub, the Pervasive Media Studio. The Pervasive Media Studio houses a community of creative technology practitioners who work across the cultural and commercial sectors to support inventive ideas. Ideas cut across film, music, theatre, design, visual art, games, literature and the creative and technology sectors. The commissioned Patterns In Practice artist would be embedded within this community. We are excited by the scope of this programme in the context of current societal concern around algorithmic practices. Watershed's values it's in-kind contribution at £6000 which includes: • Desk space plus meeting and events space for the commissioned artist within the collaborative environment of the Pervasive Media Studio • Staff time to: o Promote the final work to public audiences o Ensure financial processes are well managed
Impact forthcoming
Start Year 2023
 
Description A brief history of AI in arts practice blog on project website 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This is the third entry in our series on the use of AI techniques in the three contexts explored in Patterns in Practice
Year(s) Of Engagement Activity 2023
URL https://lifeofdata.org/site/patterns-in-practice/ai-in-art/
 
Description AI in Education blog on project website 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This is the second post on our series dedicated to the use of AI techniques in the three contexts explored in Patterns in Practice, this time we focus on the education sector.
Year(s) Of Engagement Activity 2022
URL https://lifeofdata.org/site/patterns-in-practice/ai-in-education/
 
Description AI in drug discovery - PIP blog post 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Blog post emerging from the literature work on the pharmaceuticals case. Published on our project blog & shared on Twitter.
Year(s) Of Engagement Activity 2021
URL https://lifeofdata.org/site/patterns-in-practice/patterns-in-practice-highlights/
 
Description Arts and Humanities Shaping AI Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Presented a 10 minute talk on Patterns in Pratcice, and joined in workshop activities for the following event organised by Scott Delahunta (Coventry) and Matt Studley (UWE). There are increasing calls for the Arts and Humanities to be more involved in the development of Artificial Intelligence. The assumption is that arts and humanities can bring perspectives that will help make this development more just, trustworthy and responsible. This implies that developer communities (data scientists and AI researchers) are in need of these perspectives. But is there any evidence of this involvement delivering on such promises? There is talk of a less academic, more applied approach, with scholars working alongside artists and scientists, but what are the examples and how might we learn from them? That is the key question we would like to address in organising a one-day workshop with a small number of individuals to openly share and discuss examples of how the arts and humanities can shape our AI future. We are particularly interested in methods and approaches involving practice researchers using participatory, performance and creative processes to engage the public and action researchers/ social scientists using ethnographic engagement with communities of practice, e.g. developers and data scientists.
Year(s) Of Engagement Activity 2023
 
Description Data/opium talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact We hosted a talk in the Fetsival of the Mind Spiegeltent, Sheffield City Centre.
Otis Mensah, musician/writer and the first Poet Laureate of Sheffield will be joined by filmmaker Hugh Mann Adamson and researcher Dr Itzelle Medina-Perea, Sheffield Information School. They will discuss their collaboration on Patterns in Practice, a video installation presenting a storytelling performance by Otis Mensah about how data scientists' beliefs, values and feelings interact to shape how they engage with Artificial Intelligence techniques.
Year(s) Of Engagement Activity 2022
URL https://festivalofthemind.sheffield.ac.uk/2022/spiegeltent/patterns-in-practice
 
Description Data/opium video 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact A video was produced in collaboration with Otis Mensah, musician/writer and the first Poet Laureate of Sheffield, and ENON Films to produce a short storytelling performance exploring how data scientists' beliefs, values and feelings interact to shape how they engage with AI techniques to inform drug discovery in the pharmaceutical industry. The video was exhibited at Festival of the Mind Sheffield (https://player.sheffield.ac.uk/events/patterns-practice), online (https://player.sheffield.ac.uk/events/patterns-practice) and is on continuous display in the Information School lobby.
Year(s) Of Engagement Activity 2022
URL https://player.sheffield.ac.uk/events/patterns-practice
 
Description Experimentalism and the Fourth Industrial Revolution ODI workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact The latest roundtable in our new project Experimentalism and the Fourth Industrial Revolution will take place online on Zoom and is convened by the Open Data Institute (ODI), in partnership with the Center for Responsible AI, NYU and the Leverhulme Centre for the Future of Intelligence.
Year(s) Of Engagement Activity 2021
 
Description FutureFantastic Dialog: Behind AI Systems 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Online Dialogue with AI arts practitioners from UK and India. In this conversation, we are exploring how and by whom AI systems are constructed and designed, who benefits and who is disadvantaged, how they impact society and what the ethical implications are. The event series, art commissions and festival is supported by the British Council as part of the India/UK Together Season of Culture
Year(s) Of Engagement Activity 2022
URL https://uwe-repository.worktribe.com/output/10482043
 
Description Project update blog - pip website 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Blog post giving an upddate opn first few months of the project. Shared on project website & social media.
Year(s) Of Engagement Activity 2022
URL https://lifeofdata.org/site/patterns-in-practice/project-update-2/
 
Description Stewarding the AI Commons 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact AEOLIAN Workshop 2. The theme for Workshop 2 is 'Reimagining Industry / Academic / Cultural Heritage Partnerships in AI,' something that we're taking very broadly to include not only industry per se, but also issues in public policy, political economy, ethics, fairness, and other not-strictly-industry topics. The overarching aims of AEOLIAN are:
- To make digitised and born-digital collections more accessible.
- To analyse these collections using innovative research methods.
- To identify synergies and collaborative avenues between US and UK cultural organisations.
This workshop is focused on the broader applications of what these innovative AI research methods and collaborations between industry, academia and cultural institutions might look like. We want critique but also, perhaps, visions of what and how these relations could grow with equity and social justice interweaved from the design process upwards, hence the 'reimagining.' The topic of your talk would be up to you; we are leaving the theme as loose as possible, with issues of public policy, ethics, and fairness among other possible emphases.
Year(s) Of Engagement Activity 2021
 
Description Understanding why machine learning matters to society - ischool blog 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Blog post on the Information School blog - in conversation with PDRAs' Itzelle Medina Perea and Monika Fratczak about the project.
Year(s) Of Engagement Activity 2023
URL https://information-studies.blogspot.com/2023/02/understanding-why-machine-learning.html