Evaluating public-private partnerships at the Nexus

Lead Research Organisation: University of Surrey
Department Name: Sociology

Abstract

This fellowship will provide important tools and knowledge to deliver the Government's ambitious Industrial Strategy. Specifically, it will develop, test, apply, and promote innovative appraisal and evaluation approaches for understanding public-private-partnerships (PPP) in food-energy-water-environment Nexus domains, with a particular focus on infrastructure. PPP in these areas might be for energy plants, waste management infrastructure, reservoirs, or water treatment plants. Partnerships of these types, for infrastructure and other purposes, are a key delivery mechanism for many of the Industrial Strategy's goals. The Strategy repeatedly makes clear the importance of PPP in delivering innovation, growth, and infrastructure.

The fellow will develop frameworks for both appraising (i.e. assessment before a PPP has started) and evaluating (i.e. understanding if and why a PPP has been a success or not) PPP in food-energy-water-environment Nexus domains. These frameworks will set out the important questions to address when studying PPP, the appropriate methods to use to answer them, and the data which will be needed. These frameworks will be published freely and actively shared with appraisal and evaluation communities in the UK and beyond, and experts in PPP, infrastructure, and other relevant areas. The fellow will also deliver a critical review of the types of PPP used currently and in the past.

The development of the frameworks will also be supported by regular interaction with those who will use them, to ensure their needs are accounted for. A key part of this will be a project within the fellowship with Anglian Water and the South Lincolnshire Water Partnership (the SLWP is a group of public, private and third sector organisations collaborating to plan the management and use of water resources in the South Lincolnshire Fens and adjacent areas). This project will explore old and new models of PPP that the partnership could adopt. It will help the group explore options to better share risk and reward across the partnership, improve project delivery, and maximise benefits. The project will also explore options for updating water abstraction licensing strategies as part of Defra's 'Water Abstraction Plan' initiative (the partnership is a pilot catchment in this initiative). The project will serve to underpin the development of the frameworks through the understanding it will generate of user needs, and the space it will allow for testing the approach to be used.

The fellowship also has ambitious plans for delivering unique career development and training to the fellow via: (i) a distinctive and comprehensive mentoring programme (including mentors from industry, government, and academia); (ii) a shadowing and short-term placement plan at industry partners such as Anglian Water; and (iii) an intensive professional development and training programme including training provided by the University of Surrey, but also industry and government partners.

All of this work will be underpinned by the novel methodological approach of the fellow's host, the Centre for the Evaluation of Complexity Across the Nexus, which combines the tools and thinking provided by Complexity Science and the food-energy-water-environment Nexus approach, with social research methods and effective policy evaluation approaches.

The fellowship will deliver a range of outputs, the most important of which will be both an academic journal paper and a freely available report on each of the following topics: (i) reviewing types of PPP; (ii) appraising PPP; and (iii) evaluating PPP. The appraisal and evaluation reports will each go through two iterations of development, to allow the time for meaningful input from users between iterations.

Planned Impact

Non-academic beneficiaries of the fellowship include:

Private sector:

Businesses that are considering joining a PPP, or are already part of one, will have interest in the deeper understanding, and tools for appraising and evaluating PPP, generated by this fellowship. They may make or change decisions, or become aware of new opportunities based on the work of the fellowship. Those businesses operating at the food-energy-water-environment Nexus will find particular value, for example water companies (including project partner Anglian Water), energy companies, waste management companies, and food businesses (such as large retailers, wholesalers and markets).

Other companies will also find value in the fellowship's effort and outputs where they need frameworks and tools to aid their work in facilitating, implementing, appraising and evaluating PPP. For example: companies which deliver and facilitate such as CH2M and Plus Value; project management and finance companies such as CB&S; infrastructure investment funds such as MIRA and Meridian Infrastructure; appraisal and evaluation companies such as Berkeley Research Group, and Risk Solutions; and large accountancy and engineering firms, such as KPMG (e.g. Corporate Finance Infrastructure division) and Atkins, which deliver services related to PPP and engage in them themselves.

Third sector:

Third sector organisations may also be part of, or be considering joining PPP; again, they will find value in the understanding and tools developed in the fellowship. Other NGOs which analyse PPP will also find value, for example the Institute for Government which has considered PPP under its remit of making government more effective. Some appraisal and evaluation organisations are also technically third sector where they are not-for-profit, for example the Tavistock Institute.

Public sector:

Government departments and agencies that observe or are part of PPP regularly in their areas of responsibility will have strong interest in the knowledge and tools developed in the fellowship. Their analysts will be able to use the appraisal and evaluation outputs directly in their work, and policy teams will be able to get a broader sense of PPP from the critical review. The departments and agencies most likely to find the work of value are those CECAN already works with, BEIS, Defra, FSA, EA, however the Departments of Health and Education are also likely to be interested given the prevalence of PPP in their areas.

Agencies with remits related to infrastructure (such as the Infrastructure and Projects Authority, and National Infrastructure Committee), and auditing (such as the National Audit Office) will also find value in the fellow's work.

Foreign government and intergovernmental organisations which conduct work which could make use of the fellowship's efforts and outputs include: the European Court of Auditors (conducts audits, but also a proactive programme on evidence and reviews); the European Environment Agency (which carries out and commissions appraisal and evaluation); the UNECE Committee on Innovation, Competitiveness and Public Private Partnerships (which advises governments on PPP); and the World Bank (which also advises on PPP).

Developing relationships:

The relationship with Anglian Water and the SLWP is already established. Other relationships will be built and maintained through an iterative and snowballing approach, which will include regular reach-outs to new potential users at key points in output delivery, and maintenance of existing relationships. There will also be specific 'big pushes' on reaching out to users at the beginning and end of the fellowship. These efforts will involve bespoke bilateral meetings with the possibility of direct input into or exploitation of the fellow's work where interest is high. CECAN already has many relationships with relevant organisations in the public, private and third sectors, and these will be a key entry point.

Publications

10 25 50
 
Description The UK is at a crossroads with public-private partnerships. For some, they are loathsome symbols of privatisation and financialisation, for others they are beacons of hope for reforming public services. In reality, they are something in between, and indeed, not all one and the same.

As part of a re-imagining of what public-private partnerships are and can be, the fellowship's first report reviews innovative partnerships working in the UK on food-energy-water-environment 'nexus' domains. Innovative partnerships are partnerships which are not based on contractual, bilateral, zero-sum, low trust, transactional relationships, but those which are built on shared goals, addressing problems, and trust.

The report finds a vibrant community of interconnected partnerships, with the most activity and interaction in water and environment domains, and at local scales. Organisations from all sectors play important roles, though public sector organisations tend to fill a significant bridging role between partnerships. More results are presented in the report, along with an infographic that gives an overview of the partnerships. High resolution versions of this infographic, and a network diagram, and a full list of partnerships and partners analysed can be found at www.innovativeppp.org/review-of-ppp.

These findings are already being put to use by the partnerships I am working with, supporting their efforts to manage, appraise and evaluate their work. Other public-private partnerships and cross-sector collaborations may find the outcomes of this project useful when designing, managing, and analysing their activities.
Exploitation Route The findings are already being put to use by the partnerships I am working with, supporting their efforts to manage, appraise and evaluate their work.

Other public-private partnerships and cross-sector collaborations may find the outcomes of this project useful when designing, managing, and analysing their activities.
Sectors Agriculture, Food and Drink,Communities and Social Services/Policy,Energy,Environment,Leisure Activities, including Sports, Recreation and Tourism,Government, Democracy and Justice,Culture, Heritage, Museums and Collections

URL http://www.innovativeppp.org/review-of-ppp
 
Description Two years since the end of this three year fellowship, most of the directly attributable non-academic impacts are realised, while others are still regularly emerging from the wider programme of work I am conducting on systems mapping. Some impacts were hampered by Covid-19 and the reduction in meetings in person. While I have now finished the fellowship, and taken up a lectureship at Oxford, impact activities related to my research activity continue through my connection to CECAN and the regular work we do as research or on as consultancy basis. I have also expanded my impact work using systems mapping through the BEIS and CIFF funded 'EEIST' project. This project applies complexity and systems thinking methods in policy analysis, and I have been using systems mapping with the Chinese government within it. We are currently developing an invited proposal for a much larger, but similar programme, which would involved using systems mapping in policy design, appraisal, and evaluation with governments in China, India, Brazil, Indonesia, and South Africa. Past impacts include: 1) South Lincolnshire Water Partnership (SLWP): my work with the SLWP explored governance models for partnerships such as theirs. Impacts have related to informing their thinking around what governance models might work for them in the coming years as they ramp up activity. 2) Renewable Heat Incentive evaluation and large Biogas and Biomethane consortium applications: I worked with the consultancy company delivering the large evaluation of the this flagship government energy policy. In particular, exploring how large applications - typically consortia of public and private partners - to the scheme might be evaluated. This has informed the design and delivery of this large evaluation for government. 3) Fellowship reports: I have published a fellowship report, and have disseminated this to a wide range of relevant stakeholders. 4) IUCN UK Peatland Programme: I supported the UKPP (a PPP) in their 10-year evaluation efforts. This directly informed their evaluation, and there are stlll plans for me to contribute to a write-up of this work 5) Systems mapping: I have been able to deliver systems mapping (and more broadly complexity and evaluation) training across a number of events and sessions, impacting the practice of evaluators and analysts in government, business, and the third sector. 6) Defra water policy: I played a key role in a recent project funded by Defra and delivered in partnership with Mott Macdonald. This has had a strong impact on the direction of Defra's research in water policy, helping to embed and operationalise their interest in systems approaches. 7) I recently conducted an evidence review on systems thinking for Natural England, and regularly advise BEIS, the FCDO, and other organisations informally on using systems mapping.
First Year Of Impact 2018
Sector Agriculture, Food and Drink,Energy,Environment,Leisure Activities, including Sports, Recreation and Tourism,Government, Democracy and Justice,Other
Impact Types Economic,Policy & public services

 
Description Complexity sciences for env policy elective
Geographic Reach National 
Policy Influence Type Influenced training of practitioners or researchers
 
Description PSM MSc module
Geographic Reach Local/Municipal/Regional 
Policy Influence Type Influenced training of practitioners or researchers
Impact Impacted the practice of government analysts attending MSc module (course can be attended by externals).
 
Description Defra Systems analysis for water resources
Amount £100,000 (GBP)
Organisation Department For Environment, Food And Rural Affairs (DEFRA) 
Sector Public
Country United Kingdom
Start 11/2019 
End 07/2020
 
Description ESRC University of Surrey Impact Acceleration Account award - Implementing innovative legal and organisational structures for a just transition: a catchment management beacon project
Amount £20,000 (GBP)
Organisation University of Surrey 
Sector Academic/University
Country United Kingdom
Start 06/2020 
End 09/2020
 
Description InSPIRE: Innovating UK clean air policies to prevent cognitive disorders across the lifespan, particularly for vulnerable urban populations
Amount £50,000 (GBP)
Organisation Medical Research Council (MRC) 
Sector Public
Country United Kingdom
Start 02/2020 
End 03/2021
 
Description Natural England Systems Thinking Evidence Review
Amount £25,000 (GBP)
Organisation Natural England 
Sector Charity/Non Profit
Country United Kingdom
Start 11/2021 
End 03/2022
 
Description Participatory Systems Mapping for sustainable development and connectivity
Amount £30,000 (GBP)
Organisation Facebook 
Sector Private
Country United States
Start 11/2019 
End 03/2020
 
Description Training for evaluation in complex settings
Amount £10,000 (GBP)
Organisation Public Health England 
Sector Public
Country United Kingdom
Start 12/2019 
End 03/2020
 
Title UK Nexus PPPs 
Description Data on 50+ public-private partnerships working in Nexus policy domains. 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? Yes  
Impact None yet. 
URL https://www.innovativeppp.org/review-of-ppp
 
Description Centre for the Evaluation of Complexity Across the Nexus (CECAN) 
Organisation Centre for the Evaluation of Complexity Across the Nexus
Country United Kingdom 
Sector Academic/University 
PI Contribution I am fully embedded in the CECAN team, and collaborate (bringing my topic and methods knowledge) on a range of CECAN activities relevant to my fellowship, including co-production evaluation methods in practice case studies with research users (i.e. government and industry partners), standalone methods development, and academic writing.
Collaborator Contribution Colleagues in CECAN collaborate on these methods case studies, methods development, and writing projects - all of direct relevance to the fellowship. They bring a broad range of expertise on substantive topics, methods, and research use by government and industry.
Impact Almost all the paper listed under publications. Various reports and briefing notes at cecan.ac.uk Consultancy reports for Defra and Natural England
Start Year 2018
 
Description ABM CPD course 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Delivered a one-day course on agent-based modelling for policy analysis to business, government, and academics.
Year(s) Of Engagement Activity 2018
 
Description Apolitical talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Talk on systems mapping to Apolitcal - a company that provide training for civil servants, globally.
Year(s) Of Engagement Activity 2023
 
Description BEIS evaluation workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Policymakers/politicians
Results and Impact Presented at a CECAN event delivered for BEIS on evaluation methods and complexity
Year(s) Of Engagement Activity 2019
 
Description BEIS net zero systems 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Discussion with BEIS systems team on use of systems mapping.
Year(s) Of Engagement Activity 2021
 
Description Book launch talks 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Series of talks hosted by different groups as part of our book launch.
Year(s) Of Engagement Activity 2023
 
Description British Science Week 2018 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Organised and presented at a session at the 2018 British Science Week - https://www.britishscienceweek.org/
Year(s) Of Engagement Activity 2018
URL http://www.britishscienceweek.org
 
Description CECAN COMPLEX-IT webinar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact CECAN webinar presenting COMPLEX-IT work
Year(s) Of Engagement Activity 2021
 
Description CECAN PSM Webinar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Webinar presenting my PSM work and future plans. Attended by over a 100 people live, with recording up on CECAN website. Spun out multiple meetings and connections with people interested in using PSM.
Year(s) Of Engagement Activity 2021
 
Description CECAN Steering and Evaluation Complex Adaptive Systems Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Attended and shared research with workshop - highly participative workshop designed to foster new collaborations.
Year(s) Of Engagement Activity 2019
URL https://www.cecan.ac.uk/events/cecan-workshop-new-approaches-to-participatory-steering-and-evaluatio...
 
Description CECAN annual event 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Organised a session and presented at the CECAN annual event 2018.
Year(s) Of Engagement Activity 2018
URL https://www.cecan.ac.uk/events/policy-evaluation-for-a-complex-world-11th-july-2018/
 
Description China carbon pricing systems mapping 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Long term engagement with ERI and BNU in China on modelling carbon pricing, including systems mapping.
Year(s) Of Engagement Activity 2022,2023
 
Description Defra systems mapping workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Helped facilitate a large systems mapping workshop at Defra. Aim was to explore impact of gov policy on agriculture and rural economy/
Year(s) Of Engagement Activity 2018
 
Description Defra water systems project 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Range of meetings, presentations, and workshops as part of project with Defra and Mottmacdonald
Year(s) Of Engagement Activity 2020,2021
 
Description Dept for Education bespoke training course 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Co-delivered a requested/bespoke course to the Department of Education on complexity and evaluation.
Year(s) Of Engagement Activity 2018
 
Description DfE training courses 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Ran two courses for staff at Department for Education on policy evaluation in complex settings.
Year(s) Of Engagement Activity 2019
 
Description Energy Trilemma BEIS presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Presentation made at BEIS to BEIS staff on a energy trilemma systems mapping project. Aim was to share the work and encourage others to consider similar projects.
Year(s) Of Engagement Activity 2018
 
Description FASS Festival of Research 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Attended a stand presenting CECAN and my fellowship at a day-long showcase of research at Surrey.
Year(s) Of Engagement Activity 2019
URL https://www.surrey.ac.uk/news/fass-festival-research-2018
 
Description Frontier Economics presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Gave an invited talk to approx 30 staff at 'Frontier Economics' London office on complexity science methods for social science.
Year(s) Of Engagement Activity 2019
 
Description IUCN evaluation workshops 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Ran several workshops for the IUCN UK Peatland Programme on systems mapping to support their evaluation efforts.
Year(s) Of Engagement Activity 2019
 
Description MaaS mini-project 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Organised and ran multiple workshops in partnership with Department of Transport, on systems mapping the 'Mobility as a Service' UK system.
Year(s) Of Engagement Activity 2020
 
Description Mint Magazine article 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Wrote an article on stakeholder participation for the Mint Magazine
Year(s) Of Engagement Activity 2018
URL http://www.themintmagazine.com/putting-stakeholders-at-the-centre/
 
Description Mott McDonald Water team meeting 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Met with Water team at Mott McDonald to present on fellowship.
Year(s) Of Engagement Activity 2018
 
Description OECD event 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Gave talk at OECD event 'Forecasting for policy making' on PSM ongoing work. Created involvement in a handbook chapter.
Year(s) Of Engagement Activity 2021
 
Description Present at Surrey Evidence-based policy research afternoon 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other audiences
Results and Impact Presented at workshop on evidence-based policy organised by the university and attended by 40-50 researchers and policy makers/analysts.
Year(s) Of Engagement Activity 2019
 
Description Renewable Heat Systems Mapping Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Held a workshop at BEIS, attended by participants from government and industry interested in renewable heat sources and biogas in particular. Purpose was to develop a systems map of the renewable heat and biogas sectors in the UK, and explore impact of government policy (RHI) on the sector.
Year(s) Of Engagement Activity 2018
 
Description SIPHER training 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Ran a training session on systems mapping for the SIPHER UKPRP consortium hosted in Sheffield.
Year(s) Of Engagement Activity 2019
 
Description Sage video 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Recorded an interview with Sage publishers discussing systems mapping. Video to be a resource on website for students and researchers.
Year(s) Of Engagement Activity 2018
 
Description That's Surrey TV interview 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Gave an interview to That's Surrey TV channel
Year(s) Of Engagement Activity 2019
 
Description UK Evaluation Society Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Organised a session and presented at the 2018 UK Evaluation Society conference - a conference for evaluation practitioners.
Year(s) Of Engagement Activity 2018
URL http://www.profbriefings.co.uk/ukes2018
 
Description UK Evaluation Society London Branch Seminar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Gave a seminar to the London branch of the UK Evaluation Seminar on systems mapping.
Year(s) Of Engagement Activity 2018
 
Description UNDP talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Talk to UNDP on modelling approaches, including systems mapping
Year(s) Of Engagement Activity 2022
 
Description Warwick Natural England workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Attended a workshop co-organised by Natural England and CECAN to discuss use of complexity-appropriate methods in their analysis work.
Year(s) Of Engagement Activity 2018