The design and use of local metrics to evaluate performance: a comparative analysis of social care organisations

Lead Research Organisation: University of Manchester
Department Name: Medical and Human Sciences

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.
 
Description Performance measures in the English public sector are employed primarily on a national basis, often to assist government regulation. However, little is known about their use locally, particularly where local issues assume prominence, such as in local authority social services. The relationships between national performance ratings and the ways local authorities manage their own performance are not fully known. This study explored these links through investigating social care services for older people (a costly, relatively unexamined service in this context). National questionnaire surveys gathered information from all local authority social care organisations in England and all health and social services trusts in Northern Ireland. The surveys included information on the range of measures used locally, the organisational context and the manner in which performance is measured. Interviews with managers in selected sites supplemented these data. These findings were compared with data and written material from Japan, where measures at a local level are more generally available.

Performance measurement practices across the three countries showed distinct differences, reflecting the different ways performance reporting is conceptualised in each. In England practices drew largely on nationally available measures, although local bespoke measures are increasingly available; in Northern Ireland a more local approach was employed; while in Japan a system conceptualised as 'intelligence', gathers data at the individual level. In England, it appears that management practices, principally strategies stressing flexibility and innovation, influence both local performance processes and centralised composite performance ratings, the latter, to a larger extent than external factors, such as resources.
Exploitation Route Improved performance measurement for policy and practice
Sectors Communities and Social Services/Policy,Healthcare
URL http://research.bmh.manchester.ac.uk/pssru/research/Assessment1/localmetricsinsocialcare/
 
Description Some of findings have been commented upon by managers in social care organisations in relation to the shortcomings of simple performance measurement approaches. Northern Ireland managers have employed the material in new policy development for performance review. Enhanced networks between academic group and local authority performance managers
First Year Of Impact 2010
Sector Communities and Social Services/Policy,Healthcare,Leisure Activities, including Sports, Recreation and Tourism
Impact Types Policy & public services
 
Description ESRC Performance Project Outline 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact A number of requests for information about the study and discussions with individual local authorities. In particular engagement with North West Performance Leads Group.

Impact has primarily been in the way the study's findings have benefitted organisations responsible for monitoring and delivering social care in the UK. Findings have been communicated to the English Department of Health and the Association of Directors of Adults Social Services (ADASS) Research Group and, through them, to all English Directors of Social Services. Findings have also been included in reporting to the Information Centre for Health and Social Care's consultation process, in terms of streamlining data requirements for performance management of English local authorities. In addition, the team have collaborated with the Department of Health lead on developing proposals for a new National Indicator Set in social care as part of an on-line forum for performance officers and local authority representatives. The project has also been used to foster and develop a network of local authority performance officers in England - the North West Performance Leads Group in social services, where the research team have participated in regular meetings to disseminate findings and contribute to evidence-based practice and policy development in this area.

In Northern Ireland, findings were disseminated to officers with responsibility for policy development and the planning, managing and provision of services for older people including DHSSPS, Social Services Inspectorate and Health and Social Care Trusts. Copies of newssheets, reports and academic papers were distributed to relevant academics in Queen's University and University of Ulster.
Year(s) Of Engagement Activity 2006
URL http://www.nursing.manchester.ac.uk/pssru/research/assessment/esrcprojectoutline.pdf
 
Description Research and Policy Update 11 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact MAterial summariss key findings of a comparison of England, Northern Ireland and Japan

Interest in the study findings from the University of Nagoya and
Year(s) Of Engagement Activity 2010
URL http://www.nursing.manchester.ac.uk/pssru/research/assessment1/localmetricsinsocialcare/rpupdateissu...
 
Description Research and Policy Update 11 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact MAterial summariss key findings of a comparison of England, Northern Ireland and Japan

Interest in the study findings from the University of Nagoya and
Year(s) Of Engagement Activity 2010
URL http://www.nursing.manchester.ac.uk/pssru/research/assessment1/localmetricsinsocialcare/rpupdateissu...
 
Description Research and Policy Update 11 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact MAterial summariss key findings of a comparison of England, Northern Ireland and Japan

Interest in the study findings from the University of Nagoya and
Year(s) Of Engagement Activity 2010
URL http://www.nursing.manchester.ac.uk/pssru/research/assessment1/localmetricsinsocialcare/rpupdateissu...
 
Description Research and Policy Update Issue 1 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Research and Policy Update to local authority representatives and policymakers

Local Authority Managers requested additional information and copies of publications. Also academics in Nagoya, Japan
Year(s) Of Engagement Activity 2008
URL http://www.publicservices.ac.uk/wp-content/uploads/pssru-rp-update-1-december.pdf
 
Description Research and policy update issue 2 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Update to local authority representatives and policymakers.

Managers requested further nformation
Year(s) Of Engagement Activity 2009
URL http://www.pssru.ac.uk/researchsummaries.php