Developing evaluation knowledge, capacity and resources for the arts and health sector

Lead Research Organisation: University of the West of England
Department Name: Faculty of Health and Applied Sciences

Abstract

This project stems from a long-standing collaboration between Willis Newson (WN), the leading UK arts and health consultants, and Professor Daykin, a leading international scholar and the first Professor of Arts in Health. Developing evaluation methodologies is a critical priority for the emergent arts and health sector. There is a burgeoning interest in the role of arts and culture in improving health and wellbeing, and a growing evidence base has identified a wide range of health and wellbeing outcomes. However, there is a lack of consensus about the best way of evidencing the value and impact of arts on health and wellbeing. Most evaluation takes place outside of academia and practitioners can find it difficult to keep up to date with developments in methodology. There is a need to support practitioners in their evaluation practice, which extends across a range of approaches, including creative methodologies.

The overall project aim is to strengthen practice led evaluation for the arts and health field, locally, nationally and internationally. The project also seeks to make health professionals, commissioners, researchers and funding bodies aware of the contribution of arts based approaches.

The project objectives include working with leading experts to develop knowledge and resources for arts and health evaluation. The project will seek to support practitioners by providing learning and CPD opportunities including workshops, seminars and online resources. The project will also develop a dedicated website to support dissemination, networking and ongoing development of arts and health evaluation knowledge and resources.

A peer learning process is proposed, organised around key questions, including:
1. What underlying models, methodologies and frameworks, including ethical frameworks and practices, are currently applied in arts and health evaluation?
2. How can these frameworks and methodologies realistically be improved?
3. What are the key components of an overarching framework that can support best practice in arts and health evaluation?
4. What models, tools and resources are needed to support outcomes, impact and process evaluation in arts and health contexts?
5. How can practitioners be supported in developing creative approaches to evaluation?

The learning cycle will be divided into four main phases. Phase 1 will identify existing resources for arts and health evaluation, synthesising current evidence. Phase 2 will involve piloting and testing of emergent evaluation models across a range of arts and health settings and activities. Fieldwork will explore the experiences of evaluators across a range of methodologies including quantitative assessment, economic evaluation, qualitative research and creative methodologies. During phase 3 we will work with practitioners to develop frameworks, tools and resources for arts and health evaluation. In phase 4, a website will be developed containing the resources developed through the project. These will be made available free to practitioners and will include literature, project research findings, video lectures, guidance and tools. The website will be launched at a dissemination event, co-hosted with the SRG, which will draw in a wide range of practitioners and professionals from the arts and health field.

The project will be guided by a Stakeholder Reference Group (SRG), comprised of leading experts in the evaluation field, arts and health commissioners, arts practitioners and health professionals.

Planned Impact

The project will benefit practitioners, evaluators, researchers and policy makers at local, national and international levels.

Arts and health is an emergent, multidisciplinary field that includes artists, practitioners, programme managers, health professionals and policy makers. Within the UK, the research team have strong links with several networking organisations including the National Alliance for Arts and Health and Wellbeing, which has, since 2010, drawn together representatives from nine regional organisations to provide a national voice. They have established a Charter for arts, health and wellbeing and actively promote evaluation and evidence based practice. Beneficiaries include the regional organisations, such as Arts and Health SouthWest, which has over 800 members who regularly undertake CPD and, in a recent survey, voted evaluation the second highest priority in terms of development.

Practitioners will benefit in the shorter term by gaining access to high quality, focused CPD activity, information and resources. In the medium and longer term, access will be maintained through the website resources. These will strengthen programme evaluation, leading to programme improvements and increased awareness of the role of arts.

Programme managers and policy makers will benefit from the research. In the short term, representatives from these constituencies will be included in the Stakeholder Reference Group. In the longer term, the project will stimulate evidence production as well as understanding of best practice and effective delivery of arts and health projects and programmes. This will strengthen delivery and support development of new programmes in a wide range of settings, including hospitals, primary care, social care, public health and community settings. It will strengthen understanding of the role and impact of arts across a wide range of health conditions and communities including mental wellbeing, older people and chronic conditions. In the longer term the project will strengthen the wider evidence base for arts and health, leading to enhanced understanding of the role of research, evaluation and advocacy.

Evaluators and researchers will benefit from the project. They include members of academic networks and groupings, such as the ESRC funded Arts and Health Academic Research Network led by Theo Stickley at Nottingham University, as well as academic researchers based in a growing number of centres for arts and health research. These include the Sydney de Haan Research Centre for Arts and Health at Canterbury Christ Church University, the Centre for Medical Humanities at Durham University, the University of the West of England, the University of Central Lancashire and Manchester Metropolitan University.

The project will benefit arts and health advocacy organisations across a range of art forms and disciplines. These include arts based groupings and health based groupings, such as the Royal Society for Public Health which has a strong track record of advocacy in this field. They will benefit directly, through membership of the Stakeholder Reference Group, from networking, exploring and sharing knowledge and experience. They will benefit from the opportunity to develop strong links across the arts and health sector and disseminate their work.

In the short term, members of these groupings will be directly involved in the programme as members of the Stakeholder Reference Group. They will benefit from networking, exploring and sharing knowledge and experience. In the medium term they will benefit from the opportunity to develop links and disseminate their work to audiences beyond academia. In the longer term international researchers and evaluators will benefit from knowledge produced by the project and disseminated in international peer review journals.

Publications

10 25 50
 
Description This knowledge exchange project draws on the views of a wide range of stakeholders linked with evaluation of arts for health and wellbeing. A total of 36 participants including artists, health professionals, evaluators, researchers, project managers, funders, commissioners and policy makers were engaged over a one year period (September 2013-August 2014) to explore evaluation issues and develop evaluation resources.

The project revealed the diversity of creative arts activity, including music and performance, visual arts and literary art forms, currently being used to support people of all ages, including people with specific heath conditions. It revealed the wide range of evaluation methodologies in use, including quantitative and experimental methods. The use of arts based evaluation methods and approaches is relatively rare. When used, these methods enrich evaluation by encouraging reflection, empowering participants, widening the audience for which evaluation is accessible and enlivening dissemination.

Four overarching themes emerged across the various data sets. First, the project highlighted current opportunities for the development of arts for health and wellbeing. Second, it explored several challenges, including issues surrounding the quality of evidence, including problematic notions of hierarchies of evidence. It demonstrated that there is a need for development of evaluation practice and that artists need to be supported if they are to effectively engage in coproduction with a wide range of stakeholders.

The findings have been used to inform the development of the Creative and Credible website, which seeks to support evaluation practice and address the needs identified through the knowledge exchange process. The website includes information, guidance, tools and resources that are free to download at: www.creativeandcredible.co.uk
Exploitation Route The website is available to all and contains a range of materials including guidance, case studies, tools and resources that can be directly used to improve evaluation practice. The project findings are being taken forward to inform national policy and practice development. For example, the PI has been invited by Public Health England to write a standard evaluation framework for commissioning arts for health and wellbeing. She has also been invited to present keynote addresses at a number of professional conferences. The findings are also being taken forward to inform professional development. For example, the PI and project partner have been invited to deliver a workshop at a major arts and health network event organised by Arts and Health SouthWest in November 2015. In the longer term, the project findings can be taken froward by an international community of practitioners and service delivery organisations through publication of peer review journal papers.
Sectors Communities and Social Services/Policy,Creative Economy,Education,Healthcare,Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections

URL http://www.creativeandcredible.co.uk
 
Description The findings have been used to inform the development of evaluation resources for the sector, including those commissioned by Public Health England. The findings have also been used to develop a CPD programme for arts professionals and commissioners that is currently delivered regularly at the University of Winchester. This is now delivered in partnership with the Royal Society of Public Health and Willis Newson arts consultants.
First Year Of Impact 2016
Sector Communities and Social Services/Policy,Creative Economy,Education,Healthcare,Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections
Impact Types Cultural,Societal,Economic

 
Description Advisory Group to All Party Parliamentary Committee on Arts, Health and Wellbeing
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Public Health England Evaluation Framework
Geographic Reach National 
Policy Influence Type Implementation circular/rapid advice/letter to e.g. Ministry of Health
Impact Public Health England published 'Arts for Health and Wellbeing: An evaluation Framework' on 5th February 2016. The arts, including music, dance, theatre, visual arts and writing, are increasingly recognised as having the potential to support health and wellbeing. However, in order for arts to be included in commissioning of health and social care services, there needs to be robust evidence of their effectiveness, impacts and costs. This document suggests a standard framework for reporting of project activities that will strengthen understanding of what works in specific contexts and enable realistic assessment and appropriate comparisons to be made between programmes. The document is intended for: health commissioners, third sector organisations, trainers, funders, practitioners, managers, arts organisations, researchers, others with an interest in the development and evaluation of arts for health and wellbeing programmes.
URL http://www.gov.uk/government/publications/arts-for-health-and-wellbeing-an-evaluation-framework
 
Description What Works for Wellbeing, Culture and Sport
Amount £626,046 (GBP)
Funding ID ES/N003721/1 
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 06/2015 
End 05/2018
 
Title Creative and Credible 
Description A resource for arts and health practitioners, commissioners and evaluators which provides a knowledge base and resources to support a wide range of evaluation methodologies. 
Type Of Material Improvements to research infrastructure 
Year Produced 2015 
Provided To Others? Yes  
Impact The website has been used in training and CPD with consortia of healthcare commissioners, funders, practitioners and service users. 
URL http://www.creativeandcredible.co.uk
 
Title Creative and Credible 
Description The Creative and Credible toolkit adapts data analysis techniques used in research for project evaluation purposes. The tool is freely available to download. 
Type Of Material Data analysis technique 
Provided To Others? No  
Impact Practitioners have reported using the toolkit and as a result a CPD programme has been developed at the University of Winchester to encourage its further use. The pilot workshop recruited 20+ participants who evaluated the workshop and tools positively. 
URL http://www.creativeandcredible.co.uk
 
Description Collaboration for the purposes of delivering CPD 
Organisation Royal Society for Public Health
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Collaboration for the purpose of delivering an annual CPD programme.
Collaborator Contribution Jointly hosted, programme is advertised to RSPH members through mailing list, RSPH provides administrative support.
Impact Jointly delivered training programme
Start Year 2018
 
Description Public Health England 
Organisation Arts Enterprise with a Social Purpose
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Following publication of the research, I was commissioned by Public Health England with Aesop to write guidance in the form of the Arts, Health and Wellbeing Evaluation Framework.
Collaborator Contribution Aesop coproduced the guidance.
Impact Public Health England Arts for Health and Wellbeing Evaluation Framework (2016). https://www.gov.uk/government/publications/arts-for-health-and-wellbeing-an-evaluation-framework
Start Year 2015
 
Description Keynote Address (BAMT) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Creative and Credible: the challenge of coproduction in evidencing and developing music and arts for health and wellbeing. Keynote Presentation. British Association of Music Therapy Annual Conference, Glasgow, 7-9th April 2016.
This keynote presentation was well received by delegates who reported that the talk had encouraged them to think in new ways about evaluation and impact of their work.
Year(s) Of Engagement Activity 2016
 
Description Keynote Address (Creative Hertfordshire) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Arts for Health and Wellbeing: An Evaluation Framework. Creative Hertfordshire's Art of Wellbeing Conference. Hatfield, Thursday 23rd June 2016. This one day conference brought together practitioners, policy makers and commissioners to explore the role of arts in health and wellbeing. Participants reported that the presentation had increased their understanding of the importance of evaluation and of how to evaluate their practice.
Year(s) Of Engagement Activity 2016
 
Description Keynote Address (Norfolk Arts Forum) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact National Developments in Arts, Health and Wellbeing. Exploring the Contribution of Arts and Culture to Education and Wellbeing in Norfolk. Thursday 19th May 2016, Norwich Castle Museum & Art Gallery.
This one day conference brought together practitioners, policy makers and commissioners to explore the use of arts in health and social care. Participants reported that the presentation had increased their understanding of the importance of evaluation and how to evaluate practice.
Year(s) Of Engagement Activity 2016
 
Description Keynote Address (TanDem Arts and Dementia Conference) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Creative and Credible Evaluation for arts, health and wellbeing. TanDem Arts and Dementia Conference: Research into Practice, University of Nottingham. 6th October 2016. This keynote address brought together researchers, practitioners and policy makers to examine the research on arts and dementia. Participants reported that the presentation increased their understanding of the importance of evaluation and of how to evaluate arts practice in dementia contexts.
Year(s) Of Engagement Activity 2016