The wonders of the Zooniverse: Modelling and optimising volunteer participation in online citizen science

Lead Research Organisation: University of Portsmouth
Department Name: Economics

Abstract

The growth in the digital economy has dramatically affected the way in which people interact with each other and engage with a number of activities. Although the commercial and social aspects of this transition have previously been explored in some depth, third-sector and volunteering activity has not been subjected to the same degree of analysis from the economic and management sciences. This proposal will fill a significant gap in the understanding and modelling of volunteering practices in the digital economy.

The particular focus of this research project is the group of websites known as the Zooniverse, a highly successful grouping of online citizen science and crowdsourcing projects such as Galaxy Zoo and Cell Slider. Volunteers to these sites donate their time to classifying data of scientific interest, ranging from images of distant galaxies to weather patterns and cancer cells.

This project will re-evaluate existing economic models of volunteering in light of data obtained directly from Zooniverse volunteers, including attitudes, behaviours and responses to incentives. The research will allow for the development of new economic models of volunteering and crowdsourcing that will offer more effective explanations for participation and engagement with online volunteering and citizen science initiatives. The project will also investigate ways in which volunteering levels can be increased and sustained through the optimisation a specific and tailored series of direct interactions with participants. The results will be used to refine develop new models for the management and organisation of citizen science initiatives in order to enhance the creation of scientific progress and social value.

Planned Impact

Studying the Zooniverse from the perspective of the economic and management sciences will be important for understanding the motivations of online citizen scientists and their overall capacity for volunteering. Such work would be of great interest to the voluntary sector and is related to the desire of the present government to inspire the 'Big Society' i.e., increasing civic responsibilities and contributing to societal projects.

Citizen-science volunteering is already being used in new and exciting ways beyond academia. For example, 'DIYgenomics' recruits volunteers to use a mobile phone application to look for variations in the MTHFR gene and their link to vitamin-B deficiency. Although this endeavour is non-profit, the output of the research may have significant implications for commercial activity. Understanding such behaviour is at the heart of this proposal and represents a major untapped resource in the digital economy.

The Zooniverse is committed to enabling and encouraging educational use of their projects. A dedicated Zooniverse education group exists and the Education Director holds a position on the Executive Board of the Zooniverse, demonstrating the importance this role is held in within the organization. A website was recently launched (www.zooteach.org) to collect and distribute ideas for the use of Zooniverse projects in the classroom, and online tools (e.g. Galaxy Zoo Interactive) are being developed to deepen the learning enabled by some of the Zooniverse sites. By helping the Zooniverse to improve user's capacity for volunteering, this research will impact on these educational endeavours.

Furthermore, by exploring the intricacies of voluntary activities in the Zooniverse, the project will be able to construct models relating to educational practice and therefore engagement. The detail revealed will be useful for similar web communities, citizen science and volunteering initiatives, as well as potential commercial applications that make use of crowdsourcing.

Publications

10 25 50
 
Title Project Outcome Video - Citizen Science Gaming as a Motivator 
Description One of a series of short videos communicating the main findings of the project, this one focusing on gaming as a motivator, with particular emphasis on 'gamisation'. 
Type Of Art Film/Video/Animation 
Year Produced 2016 
Impact The video was shared widely with external organisations, including the British Science Association. 
URL https://youtu.be/xTKElhJHBg4
 
Title Project Outcome Video - Citizen Science Leveraging the Power of the Crowd 
Description One of a series of short videos communicating the main findings of the project, this one focusing on leveraging the power of the crowd by investigating the structure and operations of the Zooniverse organisation. 
Type Of Art Film/Video/Animation 
Year Produced 2016 
Impact The video was shared widely with external organisations, including the British Science Association. 
URL https://youtu.be/I8Oi9rrThM4
 
Title Project Outcome Video - Citizen Science Motivation and Learning 
Description One of a series of short videos communicating the main findings of the project, this one focusing on the motivations to volunteer for online citizen science and crowdsourcing projects, as well as the importance of learning. 
Type Of Art Film/Video/Animation 
Year Produced 2016 
Impact The video was shared widely with external organisations, including the British Science Association. 
URL https://youtu.be/dUZfF62T2OI
 
Description Citizen science is a way of carrying out research with input from members of the public. Online citizen science platforms use this approach to help professional scientists with the analysis of large data sets, which is particularly valuable when it is difficult or impossible for computers to interpret such data automatically. As part of this research project, we have investigated the motivations of people who contribute their time to online citizen science projects such as those hosted by Zooniverse.org.

Our first major finding was that volunteers most often choose to participate in order to gain new knowledge, skills and abilities. In addition, we have shown that users expressing an interest in learning new things are more likely to analyse larger quantities of data and stay part of the community over a longer period. Our second and related major finding was based around conducting a series of quizzes with participants, testing their overall knowledge of science, as well as in specific fields linked to their favourite Zooniverse project, such as astronomy or ecology. We found that, while more active participants don't seem to know any more about general science compared with other users, higher levels of participation tend to result in a better performance in subject-specific science quizzes. We believe this is evidence that participants are learning about particular areas of science when they contribute to these projects.

Our third major finding is that many people want to contribute to citizen science projects not only for the love of science, but also to be able to socialize, have fun and play games. Users sometimes do this by 'gamising' aspects of their activities. Some of the ways in which the Zooniverse team have encouraged gamisation is by making links to aspects of popular culture, for example by sharing LOLcats and other project-themed memes with their users. We suggest this helps to make projects appear more familiar and light-hearted, demystifying aspects of science that might otherwise turn people away. We conclude that these sorts of activities are vitally important for encouraging social interaction and building the online communities that are vital in order for these projects to operate effectively.

Our fourth major finding relates to the organisational aspects of the Zooniverse and involved extensive interviews with the many scientists and developers working as part of that organisation. We have concluded that the Zooniverse has been able to successfully manage both technology and the crowd by building a unique organisational climate that is rapidly-changing, flexible and informal. Members of the team are given freedom and autonomy to experiment with the introduction of innovative new technologies and processes, such as a project builder with tools to allow anyone to design and run a citizen science project. Working practices such as these help motivate members of the team by providing opportunities for learning, which makes them more likely to stay with the organisation rather than joining other tech-based companies. This finding has important implication for the orgainsational strategies adopted by online citizen science and crowdsourcing projects.
Exploitation Route Based on our findings, we specify a number of outcomes that might be taken forward in non-academic contexts. First, given that citizen science seems to be a good way for people to learn, we encourage its increased use as a learning tool and more widespread coverage of citizen science in school and college curricula. By doing so, it might be possible to significantly improve society's engagement with science. Second, our findings suggest that encouraging gamisation and the freedom to play could be used more widely as a motivation to participate in group tasks, especially by organisations that aren't able to compensate participants with cash or prizes such as charities and third-sector organisations. Third, we suggest that the organisational models and strategies adopted by the Zooniverse might be adopted more widely among commercial and non-commercial bodies organising mass-collaboration and crowdsourcing projects, particularly those which run wholly or predominantly online.
Sectors Communities and Social Services/Policy,Creative Economy,Digital/Communication/Information Technologies (including Software),Education,Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections

URL https://volcrowe.org/
 
Description This project has engaged in significant public outreach and engagement with a number of culture, heritage, museums and collections, most notably the Manchester Museum and the British Science Association. Although details of events and workshops can be accessed separately under the respective output headings, overall we have been successful in our efforts to influence public opinion and participation in citizen science, with significant proportions of attendees at our events reporting changes in opinion and behaviour as a result of our research.
First Year Of Impact 2016
Sector Culture, Heritage, Museums and Collections
Impact Types Cultural,Societal

 
Description Data exploration - Creating new insight and value
Amount £77,216 (GBP)
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 09/2014 
End 02/2016
 
Description ESRC Festival of Social Science
Amount £1,500 (GBP)
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 11/2015 
End 11/2015
 
Title Volunteer and Crowdsourcing Economics Survey Data Analysis Tool 
Description This is a publicly accessible, interactive resource containing all of the (anonymised) data gathered from our research into the users of online citizen science platforms, mainly consisting of survey results combined with actual usage data. The link below allows users to graphically represent elements of the dataset in creative and customisable ways, as well as downloading any elements they wish in CSV format. 
Type Of Material Database/Collection of data 
Year Produced 2016 
Provided To Others? Yes  
Impact The data tool has been widely shared and well received by external organisations, including the British Science Association. 
URL https://volcrowe.herokuapp.com
 
Description Academic partnerhip with the Crowd Data Center 
Organisation The Crowd Data Center
Country Global 
Sector Private 
PI Contribution Data analysis and insights.
Collaborator Contribution Supply of data relating to crowdfunding activity around the world.
Impact The partnership is akin to a KS agreement between academic researchers and an SME. Ths SME in this case specialises in market intelligence and data collection. No formal outputs have yet been produced.
Start Year 2014
 
Description Lendwithcare Research Collaboration 
Organisation Care UK
Department Lendwithcare
Country United Kingdom 
Sector Hospitals 
PI Contribution The PI has used insights on digital volunteering and altruism from the funded project to initiate a relationship with Lendwithcare, a pro-social crowdfunding platform which makes small loans to entrepreneurs in developing countries. The input from the PI and the research team relates to using data analysis to investifgate issue relating to lender behaviour and activity, as well as providing expertise on country risk factors (informing strategic plans for growth and expansion), as well as assessing the impact of loans made to existing clients.
Collaborator Contribution Partners provide their expertise in understanding and interpreting the nature of their data, supply access to raw data itself and provide resources necessary for collaborators to visit microfinance institutions in partner countries.
Impact The collaboration is multi-disciplinary, involving collaborators from Economics, Law, Operations and Marketing. The collaboration has resulted in journal articles and policy briefing documents, with the findings haveing a real impact on policy and decision making within the Lendwithcare organisation.
Start Year 2014
 
Description 2016 International Conference on Social Media & Society (London) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Project co-investigator Dr Anita Greenhill, along with Dr Jamie Woodcock, recently presented the findings of a research paper entitled 'Disentangling value in a co-creating organisation: exploring the tensions between paid professionals and users, scientists and citizen scientists' at the 2016 International Conference on Social Media & Society in London. The conference aims to bring together researchers to identify best practices for studying the implications of social media on society, involving researchers from a range of disciplines including management, information science, education and sociology.
Year(s) Of Engagement Activity 2016
URL https://smsociety16.sched.com/
 
Description 29th International Astronomical Union (IAU) General Assembly (Honolulu, Hawaii) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The IAU General Assembly is a highly prestigious meeting of leading minds in astronomical research from around the world. Dr Masters' participation in the event during August 2015 has played a key role in communicating the findings of the VOLCROWE project to a wider audience with an interest in science education and communication.
Year(s) Of Engagement Activity 2015
 
Description ASE online chat on 'Citizen Science in Schools' (Twitter) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact Lively online debate and discussion about citizen science in schools. Informed serveral teachers about new Zooniverse projects and Zooteach materials.

Several teachers indicated that they would integrate some of the newer Zooniverse projects that I alerted them to (e.g. Snapshot Serengeti and Penquin Watch) into their lesson plans.
Year(s) Of Engagement Activity 2014
 
Description British Academy of Management Annual Meeting 2016 (Newcastle) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Project researcher Roy Meriton presented work from the project at BAM2016 - the prestigious annual meeting of the British Academy of Management, hosted by Newcastle University between 6th - 8th September 2016.
Year(s) Of Engagement Activity 2016
URL https://www.bam.ac.uk/civicrm/event/info?id=3013
 
Description Communicating Astronomy to the Public 2016 (Columbia) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact On May 16th, the recently published VOLCROWE research on 'science learning via participation in online citizen science projects' was presented to the Communicating Astronomy to the Public 2016 conference in Columbia, organised by the International Astronomical Union.
Year(s) Of Engagement Activity 2016
URL http://www.planetariomedellin.org/cap2016/english-version/cap-2016/about-cap-2016/
 
Description Computational Social Science Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk promted many questions and a lively discussion.

Discussions with computational social scientists about future research directions and possible collaboration.
Year(s) Of Engagement Activity 2014
URL http://compsocsci.eu/
 
Description Crowdsourcing Week (October 2015) 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The VOLCROWE project recently featured as part of Crowdsourcing Week event. The event was established in 2012 and has resulted in a series of global conferences and summits which bring together thought leaders from around the world to engage and discuss how crowdsourcing can lead to meaningful change. As part of our team's involvement in the event, we contributed a Crowdsourcing Week blog explaining the objectives of the project and our findings to date. We also produced an infographic sheet summarising our main findings in a visually engaging way.
Year(s) Of Engagement Activity 2015
 
Description ESRC Festival of Social Science (Manchester) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The event organised as part of the ESRC Festival of Social Science held at the Manchester Museum engaged with a total of 190 members of the public throughout the day. Of those who provided feedback, 100% agreed with the statements 'I am more aware of the social science and the benefits to society' and 'I will pass the information from the event to others'. Additionally, 95% of attendees agreed with the statement 'I have a better understanding of the topic of the event', while 92% agreed 'I will find out more about the topic of the event'. On a scale of 1-4, our attendees also awarded an average rating of 3.82 in terms of the educational value of the event.
Year(s) Of Engagement Activity 2015
 
Description GAMEON'2014 (Lincoln) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Talk promted questions and discussion. A very positive response from this community.

Sharing of ideas, requests for follow-up information, possible further collaboration.
Year(s) Of Engagement Activity 2014
URL http://www.eurosis.org/cms/?q=node/2821
 
Description Leveraging Technological Change: The Role of Business Models and Ecosystems 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact 20 minute talk about the project followed by a series of questions and short discussion.

After my talk, there were several requests from the audience for collaboration, which has led to the preparation of a jointly authoured paper.
Year(s) Of Engagement Activity 2014
URL http://innovation-regulation2.telecom-paristech.fr/wp-content/uploads/2014/03/Workshoppresentation-2...
 
Description London School of Economics Seminar (London) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Led a research seminar at London School of Economics and Political Science, where findings from the team's 'Doing good online' paper were presented to an audience of faculty staff and students.
Year(s) Of Engagement Activity 2016
 
Description Presentation at 12th International Conference of the International Society for Third-Sector Research (Stockholm) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact Project researcher Dr EY Oh presented the findings from our paper 'Doing good online: An investigation into the characteristics and motivations of digital volunteers' at the 12th International Conference of the International Society for Third-Sector Research in Stockholm, Sweden. The conference ran between June 28th and July 1st 2016. According to their website "Founded in 1992, the International Society for Third-Sector Research (ISTR) is a major international association promoting research and education in the fields of civil society, philanthropy, and the nonprofit sector. ISTR is an organization committed to building a global community of scholars and interested others dedicated to the creation, discussion, and advancement of knowledge pertaining to the Third Sector and its impact on human and planetary well-being and development internationally. As an organization, ISTR is recognized and respected for its global vision, its commitment to excellence, its collaborative approach, and the values of diversity and pluralism with which it pursues its mission".
Year(s) Of Engagement Activity 2016
URL http://www.istr.org/?StockholmConference
 
Description Professional Development Workshop at the Academy of Management Annual Meeting (California) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Members of the research team organised and delivered a Professional Development Workshop at the recent Academy of Management Annual Meeting, running between August 5th-9th in Anaheim, California. The workshop, entitled 'Organising Work Online with Crowds', aimed to establish the key differences and similarities between the management of crowdsourcing in commercial and non-profit sectors, as well as the aspects of successful models that could usefully be employed in other contexts.

The Professional Development Workshop was listed among the Academy Programme Highlights as an event of particular interest to the Organizational Communication and Information Systems (OCIS) interest group. The workshop was attended by over fifty delegates, with very positive feedback was given by those in attendance. For example, in response to being asked whether the session had enhanced their awareness and understanding of the topic, the workshop was given a score of 4.13/5. In response to a question relating to whether the session had affected their behaviour or thinking, respondents awarded the workshop a score of 3.56/5. When asked whether they would pass information from the session on to others, respondents awarded a score of 4.13/5. Specific written feedback included 'Deeper insights into open innovation communities, didn't know about citizen science before', 'Enjoyed the interaction' and 'Connections: met some very interesting people'.
Year(s) Of Engagement Activity 2016
URL http://aom.org/Meetings/annualmeeting/2016/AOM-2016-Theme--Making-Organizations-Meaningful.aspx
 
Description Workshop on Volunteering and Altruism in the Digital Economy (Exeter) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact A workshop was organised for postgraduate and MBA students (many of whom were part-time and also in industrialo or business roles) at the University of Exeter looking at volunteering and altruism in the digital economy.
Year(s) Of Engagement Activity 2014
 
Description Workshop on Volunteering and Altruism in the Digital Economy (Oxford) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The VOLCROWE team hosted an event on 22nd April, 2015 at the University of Oxford bringing together academic and practitioners working in the area of volunteering and altruism in the digital economy. A varied and interesting range of contributions were made by organisations such as NESTA, Cancer Research UK, Just Giving and the Zooniverse. Academic research teams also contributed information about their activities, with contributions from the VOLCROWE project, the CENTRIM newtork at the University of Brighton, the Communities and Culture Network + and other streams of research funded by the NEMODE network.

Asked to comment on their experiences of the workshop, attendees provided the following feedback:

"Excellent event, full of insights on volunteerism and how the Digital Economy has transformed what is possible" - Roger Maull, University of Surrey and Head of NEMODE

"I got some real insights into perceptions of the digital economy not only from an academic perspective but from hands on operators leading on social innovation - I've not stopped talking about it with Allia colleagues since." - Tim Jones, Allia

"The VOLCROWE event was a very useful opportunity to hear from both academics and people working with organizations which use crowdsourcing. It was helpful to get a sense of the broad spectrum covered by crowdsourcing and crowdfunding, and to see that by sharing information with each other, we may be able to help our organizations to operate more effectively". Helen Thomas (Postgraduate Student), University of Loughborough
Year(s) Of Engagement Activity 2015
 
Description Zoocon (Portsmouth) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Study participants or study members
Results and Impact As well as interviewing participants, a group of volunteers reviewed coverage of citizen science on Wikipedia and made changes.

Attendees indicated that attending the event had changed the way they look at citizen science and how it is represented online. Attendees also claimed that the event will change their patterns of online behaviour and make them more proactive in making sure citizen science coverage is accurate and up-to-date.
Year(s) Of Engagement Activity 2014
URL http://www.icg.port.ac.uk/events/event/zoocon-portsmouth/