Zones of Data Translation: Understanding how social and cultural data are transformed into value

Lead Research Organisation: King's College London
Department Name: Digital Humanities

Abstract

Zones of Data Translation aims at further extending technological bridges of understanding between the university, community groups and members of the public via the workshop as method. This follow-on proposal builds directly on our previous AHRC grant, Our Data Ourselves (AH/L007770/1), wherein we examined ways of understanding and reclaiming the data that young people produce on smartphone devices. More specifically, we explored the growing usage and centrality of mobiles in the lives of young people between the ages of 14 and 18 years old, questioning what data-making possibilities exist if users can either uncover and/or capture what data controllers such as Facebook monetize and share about themselves with third-parties. These initial interventions into the enclosed processes of datafication were meant as a preliminary investigation into the possibilities that arise when young people are given back the data which they are normally structurally precluded from accessing.

The challenges inherent in these uneven processes of datafication are shared both by researchers and the general public, particularly given the lack of democratic control or public awareness around the material processes that enable the capture and privatised use of our data. Because of this problematic, we see great potential in collaborating with and learning from the civically minded technology and data advocacy NGO, Tactical Tech Collective. Their mandate is to work with a broad range of publics to raise awareness about personal data, privacy and digital security. Together, we will extend our interdisciplinary methodological approach by sharing existing tools in order to co-design two new workshops.

Sharing the MobileMiner Application and original infrastructure from the Our Data Ourselves grant will further enable us to engage new publics. To accomplish this goal we have five core activities animating our objectives:
1) First, upon completion of our participation in the Glass Room in London, we will further collaborate with Tactical Tech and make available the MobileMiner application for both the future and long term impact of this original tool from the Our Data Ourselves grant.
2) Second, we will collaborate with Tactical Tech to produce two unique workshops, which will be trialled at two separate events-one with the Open Rights Group and the other at King's College London.
3) Third, to launch the workshop at King's College London, we will hold a symposium, bringing together academics and community practitioners who are practicing and theorising interdisciplinary methodological approaches to Big Data.
4) Fourth, Tactical Tech will profile one of our co-designed workshops at their 2018/19 Glass Room Event.
5) Fifth,we will produce an Impact Report that will address a general audience of NGOs in the field, drawing from the aforementioned activities and best practices.

In working with the Tactical Tech Collective, we will ask the following questions as we develop our impact:
- How is Tactical Tech already mobilising the workshop as an interdisciplinary tool to study the material environment of social big data? How can this then be harnessed by humanities researchers for greater impact and engagement?
- How can we leverage the results of 'Our Data Ourselves' to engage new audiences beyond the classroom and the academic workshop?
- How can the techno-cultural method inform the development of new collaborative spaces to facilitate innovative humanities research that can engage the general public, augmenting knowledge exchanges between experts and non-experts?

Planned Impact

All components of our work will deliver direct impact, as detailed in the Case for Support. Noteworthy, however, is the impact that will come from working with the Tactical Tech Collective, a non-profit organization that have been working worldwide to demystify and promote technology in the context of pedagogical activism. Specifically, their work lies at the intersection of technology, activism and politics and reaches more than three million people worldwide annually through events, training, online resources and exhibitions.Their mandate is to work with a broad range of publics to raise awareness about personal data, privacy and digital security.

Through Tactical Tech and other collaborations in the project with the Open Rights Group we will engage with a range of other stakeholders who are focused on public outreach for critical capacity building around data and technology. Moreover, this will provide a unique opportunity to extend the pathways to impact that were initially engaged in the original grant by sharing the MobileMiner application with Tactical Tech. Specifically, this tool will be made available and reworked so that it may prominently feature in the two new co-designed workshops we will create.

Our collaboration with Tactical Tech will allow us to explicitly target a relatively new community for arts and humanities research to demonstrate how the workshop as method can be used to uncover processes of datafication with both academic and non-academic audiences. To gauge the potential and long term impact of these workshops they will be trialled at two separate events with different stakeholder groups. By so doing, we can better understand the feasibility of the technocultural method by testing its potential application and presenting these findings in both academic and non-academic publications. In addition, the workshop will be profiled in Tactical Tech's, Mozilla sponsored, Glass Room in a Box event, scheduled to take place in 2018/19. It is worth noting that the first iteration of this event in New York City attracted more than 10,000 community participants and and the next event scheduled in London during October 2017 is expected to be even greater.

The primary impact of the project is to provide knowledge exchange, practical experience and critical thinking about the processes of datafication via the workshop as method in relation to different audiences. We would expect all participants to end the project with:
- Cultural transformations where academic, cultural and non profit organisations are challenged to connect with new forms of knowledge in new environments. These organisations need to consider the new power structures in these environment as well as new audiences, which include spectators but also a range of diverse communities that actively transform these environments.
- A wider understanding of what a capacity to understand and negotiate the material infrastructure of the mobile environment.
- Be able to mobilise the workshop as an interdisciplinary tool to study the material environment of social big data.
- A method and digital assets from involving Tactical Tech who will contribute their knowledge and expertise in the co-creation of new workshops to build capacity among wider and more diversified audiences.
- A culture, in which arts and humanities research can engage the general public, augmenting knowledge exchanges between experts and non-experts.

Publications

10 25 50

publication icon
Pybus J (2021) Did you give permission? Datafication in the mobile ecosystem in Information, Communication & Society

 
Description This work has a had a wide impact on community by taking existing tools and then opening them up further into an accessible platform that facilitated greater visibility and understanding of the different actors that comprise the mobile environment. In so doing, the 'manifest destiny platform' comprising of over 6000 applications enabled users without any technical background to have a better understanding of i) what makes the mobile environment and apps unique and different from browsers; ii) how to assess which apps are 'leakier' and hence gather more (sensitive) user data; iii) who the main third parties are that gather personal data in conjunction with app developers; iv) how data governance infrastructures work in apps to determine the personal data being gathered via their mobile devices; v) a new understanding of social media platforms, namely Google and Facebook, which unexpectedly appeared in over 70 percent of the apps we looked at.

We have therefore achieved new insight into the infrastructure of how platforms gather personal data on mobile devices; created a platform that will serve as an important starting point for future research; and a model for cross disciplinary research that opens up technical objects in order to make them accessible, understandable and interpretable for non-expert communities. From an impact perspective, our platform has been integrated into Tactical Tech's infrastructure and will now be used for their global data literacy workshops and has been incorporated into the SoBigData infrastructure so that it can be used and accessed by other researchers.
Exploitation Route Our tools, platform and workshop will be made available to the general public. We anticipate diverse uptake following the completion of our grant:
1) Tactical Tech will integrate the workshops into their infrastructure
2) Manifest Destiny platform will be incorporated into the larger infrastructure of SoBigData: a European Research Infrastructure for Big Data and Social Mining. From data to knowledge, investigating stories ethically, paying attention to citizens privacy run by CNR (Italian National Research Centre). This is a consortium, which consists of 12 research institutions from 7 countries (Italy, UK, Germany, Estonia, Finland, The Netherlands, and Switzerland) will enable the widest dissemination for further academic research.
3) Personaldata.io--A small Geneva nonprofit focused on data protection, aimed at empowering an agile civil society to respond to threats associated with personal data--have agreed to link to the Manifest Destiny platform, so that it will function as a public tool.
Sectors Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Education

 
Description This findings have led to a number of public facing workshop and appearance on Al Jeezera.
First Year Of Impact 2020
Sector Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software)
Impact Types Cultural,Societal

 
Title Manifest Destiny: A tool that will easily allow participants to examine the permissions on over 7000 Android applications 
Description The Manifest Destiny builds on the Android Destruction Kit that was developed for the Our Data Ourselves AHRC grant. It makes use of the tools that were already embedded that aim to unpack and make visible Android permissions. By so doing, we now have a database of over 7000 applications which includes: a definitions, ratings, and blackboxes. Tactical tech is now working with us on the front end of this tool, which will eventually be embedded on their own website to maximise its global impact. The tool features prominently in our workshops. At present, it only has permissions, however, we are adding application trackers so participants can easily decipher the permissions that allow for their data to flow and the trackers which take it from them. 
Type Of Material Improvements to research infrastructure 
Year Produced 2019 
Provided To Others? No  
Impact At present there a few notable impacts resulting from this tool: 1) When this tool goes live on Tactical Tech's website, it will be available to the 1.7million users who currently visit their site annually. 2) Paul-Olivier Dehaye from Personaldata.io will include it on his platform, which services the wider public who are interested in know how their data gets used by large platform. He has produced a series of tools to help users file requests for information via GDPR. 3) We are in discussion with the 'SoBigData'--a European Research Infrastructure for Big Data and Social Mining. From data to knowledge, investigating stories ethically, paying attention to citizens privacy. They have agreed to incorporate our platform and datasets into their infrastructure for wider, open-access dissemination amongst the public and academics interested in mobile permission and tracker research. 4) The platform is now being used as a teaching devise at King's College London in the MA Big Data, Culture and Society. 
URL https://manifestdestiny.reveb.la
 
Description SoBigData Research infrastructure 
Organisation National Research Council
Department Institute of Information Science and Technology
Country Italy 
Sector Academic/University 
PI Contribution The SoBigData Research infrastructure grant that is run out of CNR have agreed to integrate our Manifest Destiny platform into their existing infrastructure for wider dissemination and impact.
Collaborator Contribution The SoBigData Research team have agreed to grant us server space and to help with a script that will see the data on the platform continue to update and remain relevant for the next few years.
Impact The main output of this collaboration will be the integration of the platform to amplify its wider research impact.
Start Year 2020
 
Description CGTN The Agenda: Online adverts have completely changed modern life 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact I was interviewed by the Agenda, the flagship show for the Chinese network CGTN. This is a very high profile programme, synonymous with BBC's News Night in China. It would have been viewed by a very large audience. Here I discussed some of the context surround the outputs of our AHRC award.

The producer was very pleased with the interviewer as asked if I would be put on a list of experts that they can call on when the need arises.
Year(s) Of Engagement Activity 2019
URL https://newseu.cgtn.com/news/2019-11-24/-Online-adverts-have-completely-changed-modern-life--LPUJhIC...
 
Description Data Power Conference (Bremen): Manifest Destiny-Critically Engaging Mobile Data Permissions 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Over 35 people attended our panel, entitled: Data activism, citizen engagement, indigenous data sovereignty and open data. Participants were from a range of different backgrounds from universities in Europe, North American and Australia. The paper I presented drew on our research and the production of the Manifest Destiny platform by addressing how we can better understand the technological objects that enable the capture of our personal data via the applications we routinely download on our mobile devices. In so doing, I opened up discussion on how datafication transpires on mobile devices by discussion the technical components - from hidden permissions to user-friendly interfaces - that allow our personal data to flow from the applications that we use. The main question of the talk was: Can we facilitate a more agentic and engaged citizen who is able to evaluate her apps in a different way?

The talk was very popular and garnered excellent discussion and requests for further information. In addition, I was one of nine papers selected by organising committee, following the conferences conclusion, to contribute towards an open access book chapter with Palgrave Press.
Year(s) Of Engagement Activity 2019
URL https://data-power.smart-abstract.com/sessionplanner/#/list
 
Description Demonstration of the draft workshops with students from the MA in Big Data and Culture at King's College London 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact After working closely with Tactical Tech, we have created two draft workshops for their Glass Room Exhibit in San Francisco. We wanted to demo these before they are fully integrated on the Tactical Tech Website.

We worked with over 35 MA students at King's College, taught them how to use the tools we have developed to open up the Android Manifests on their mobile devices to examine both permissions and trackers.

Students were very interested and there was an excellent discussion that followed. Many reported that this gave them a unique perspective about the apps they use and had never considered previously that data is shared unevenly. We also identified areas that need further work, in part by asking students for feedback. Overall, this was both productive for us and for them.
Year(s) Of Engagement Activity 2019
 
Description Invited Talk at the University of Glasgow: Politics of Personalisation on our Mobile Devices 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact I was invited to be a part of an expert panel on to discuss 'surveillance capitalism' at the University of Glasgow, based on the growing popularity of our work on mobile phones. The talk was attended by the Glasgow University community, and included some interested members of the public. The panel was recorded and has since been disseminated in the form of a podcast, which includes the presenter slides for wider public impact.

The talk drew on our research and the production of the Manifest Destiny platform by addressing how we can better understand the technological objects that enable the capture of our personal data via the applications we routinely download on our mobile devices. In so doing, I opened up discussion on how datafication transpires on mobile devices by discussion the technical components - from hidden permissions to user-friendly interfaces - that allow our personal data to flow from the applications that we use. The main question of the talk was: Can we facilitate a more agentic and engaged citizen who is able to evaluate her apps in a different way?

The panel garnered a lively discussion and following the conversation, I was asked to be be a part of an ESRC expert panel for a new grant on data agency and young people.
Year(s) Of Engagement Activity 2019
URL https://medium.com/@justine.gangneux/living-in-the-age-of-surveillance-capitalism-4957cfd38b44
 
Description Keynote speaker at the Social Life of Methods, conference, University of Helsinki Finland 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The intended purpose of this talk was discuss the elements of the workshop we are developing with Tactical Tech to a wider, primarily postgraduate audience. The aim was to fine tune the theoretical direction that that is being built into the two workshops we are creating and that will be integrated into Tactical Tech's Glass room exhibit in San Francisco in September 2019.

Key elements discussed included: android permissions, trackers and their relationship with application manifests found in the Google Play Store.

Over 70 Participants attended, which sparked a wide range of questions and a rich discussion, mainly because many audience members were exited about the unique perspective on application infrastructure that was being put forward. The organiser, Minna Ruckenstein, has invited me to come back once the workshops are complete so that students may experience the tools we are developing first hand.
Year(s) Of Engagement Activity 2018
URL https://blogs.helsinki.fi/psrc-ss-conference/
 
Description Media Lab talk at Science Po 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Gave a presentation on our findings to over 100 people at the Science Po Media Lab.
Year(s) Of Engagement Activity 2020
 
Description Organised Event at King's College London: Did You Give Permission?: Touching the Technical Objects of Personal Data in the Mobile Ecosystem 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact This was roundtable event that I organised with the Centre for Digital Culture at King's College London. I invited Dr. Reuben Binns from the University of Oxford and currently working at the ICO, to present his extensive research on mobile tracking. Together, we aimed to present both our innovative research which opens up the generative technical objects of datafication for critical investigation. The event was well attended and led to excellent discussion, that carried on into the reception afterwards.

Following from this event, I received both a PhD request and invitiation to participate with Annalect, a marketing consulting firm. One of their 2020 objectives to help their clients 1) better understand the current landscape of app-related user permission/consent and the ethics surrounding it and 2) the outlook on the consequences of transmitting users' mobile data onward to third parties. They have thereby submitted a request to know if we would collaborate with them to explore areas of potential private-public sector knowledge exchange and collaboration.
Year(s) Of Engagement Activity 2019
URL https://www.kcl.ac.uk/events/did-you-give-permission-touching-the-technical-objects-of-personal-data...
 
Description Tactical Tech Workshop (San Francisco): The Data OCEAN: Persuasion by Personality in Elections 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact This workshop ran daily at Tactical Tech's, San Francisco Glass Room Exhibition between October 16 and November 3, 2020. This very popular event, sponsored by Mozilla has been seen globally by over 30,000 people and includes art installations, host talks, screenings and workshops all aimed at garnering literacy and discussion around our data surveillance society and the tech industry.

The workshop that we contributed towards used the tracking data provided by the Manifest Destiny platform to demonstrate to participants how data profiling occurs. This was then brought together with Tactical Tech's work on the OCEANs personality testing, following the Cambridge Analytical scandal during the US presidential election in 2016. The workshop was run by Tactical Tech staff and reached several hundred participants who come to the Glass Room, demonstrate a wide public impact and engagement with the material.
Year(s) Of Engagement Activity 2019
URL https://program.tacticaltech.org/glassroom-san-francisco-2019/event/the-data-ocean
 
Description Workshop at La Sapienza University (Rome): 'Opening Up the Mobile Technical Objects of Data Capitalism' 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact We were invited to La Sapienza University in Rome Gaia Casagrande, based on the profile of we were building around Manifest Destiny. Here we did two workshops data literacy workshops that unpack the mobile application environment. Our aim was to provided A) context around what android permissions are and how they contribute to datafication and B) provide access to the manifests of different applications they might use (found in the 'Manifest Destiny' database we have created, which now holds over 7000 different manifest permissions). In short, asking students if android manifests and permissions can bring about another way to critically evaluate the movement of data within our apps and thereby more agency and possibility for critical data engagement?

The workshops broadly covered:
1) Conceptual overview of the relationship between datafication/(political) advertising and personalisation
2) Material environment of our mobile devices which facilitates the capture of our data (permissions)
3) Our data's social lives--thinking about trackers, that rely on permissions
4) Application imaginaries - a practical hands on way of rethinking our relationship with leaky applications that facilitate the flow of personalised content.
Year(s) Of Engagement Activity 2019
URL https://iris.uniroma1.it/handle/11573/1305030
 
Description Workshop at the University of Milan: The social life of digital data: Critically unpacking the mobile ecosystem 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact I was invited to give a workshop for MA and PhD students at the University of Milan, based on the successful profile I was building about the Manifest Destiny platform. There were 35 students who attended this session.

The aim of the session was to A) provide context around what android permissions are and how they contribute to datafication and B) provide access to the manifests of different applications they might use (found in the 'Manifest Destiny' database we have created, which now holds over 7000 different manifest permissions). In so doing, asking studewnts to consider if android manifests and permissions bring about another way to critically evaluate the movement of data within our apps and thereby more agency and possibility for critical data engagement?

The 3 hours can be broken down in the following way:
1) Conceptual overview of the relationship between datafication/(political) advertising and personalisation
2) Material environment of our mobile devices which facilitates the capture of our data (permissions)
3) Our data's social lives--thinking about trackers, that rely on permissions
4) Application imaginaries - a practical hands on way of rethinking our relationship with leaky applications that facilitate the flow of personalised content.

This discussion sparked a strong discussion throughout with excellent participation. Following this session, I received a request from a student to come to King's via the Erasmus programme to work with me.
Year(s) Of Engagement Activity 2019
URL https://www.nasp.eu/training/phd-programmes/somet/somet-seminar-series-2019-understanding-digital-so...
 
Description Workshop for Social Media and Society Conference (Toronto): Did you give permission? Critically Engaging the Mobile Data Ecosystem 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This workshop was presented at the Social Media and Society conference at Ryerson University, in Toronto, Canada on July 19, 2019. It was attended by around 50 students, academics, alongside some interested members of the public including. The aim of the workshop was to present the tools and methods that we designed to bring greater transparency and user agency to data ecosystems on mobile devices. In so doing we deployed our platform which enables access to and analysis of the coded permission of thousands of mobile apps. Our participatory approach was aimed at cultivating a new more critical understandings around the essential building blocks of datafication found on the social media mobile applications in order to open up discussions of privacy beyond terms and conditions.

The workshop was broken into two sections and upon leaving we were asked for our slides to be disseminated as most participants reported an increased interest in this area or research. One participants has since reported using our platform in is classroom in the United States.
Year(s) Of Engagement Activity 2019
URL https://easychair.org/smart-program/SMSociety19/2019-07-19.html
 
Description Workshop with Tactical Tech at OrgCon 2019 (London): The secret life of your data 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact This was the main output of our grant, culminating in a three part workshop which was run with Tactical Tech in the 'Action Space' during OrgCon (The largest Digital Human Rights Conference in Europe). The workshops were collectively titled: "The secret life of your data." The aim was to take participants on a journey that followed their personal data on their devices, through their apps and out into the world of 'big data' where it gets sold, processed and stored by some of the world's leading digital companies. The workshops were entitled: i) An introduction to your mobile phone extraction device, which provided a broad context and overview of how data collection works and is related to the user experience; ii) Permissions and manifests--How does my data leave my phone? where we opened up the tool Manifest Destiny platform to participants to demonstrate the building blocks that facilitate personal data flows; and finally iii) Trackers: Howe does data move beyond my phone into the world of big data? Here, after learning about how we give permission for data to leave our phone, we introduced participants to the world of tracking and broadened this discussion within the wider context of how their data is starting to shape their information landscape.

Each workshop had around 35 people (capacity) and feedback from the organisers indicated that we were the most popular event of the conference, thereby receiving a lot of positive feedback. Furthermore, more than 65 percent of participants agreed to be interviewed for further research.
Year(s) Of Engagement Activity 2019
URL https://orgcon.openrightsgroup.org/2019/programme.html