Qualitative impact assessment protocol for social impact investment (QUIPSII)

Lead Research Organisation: University of Bath
Department Name: Social and Policy Sciences

Abstract

Under the ESRC-DFID funded 'ART' project (Assessing Rural Transformations) a robust methodology and protocol for qualitative impact evaluation (known as the 'QUIP') was designed and piloted for use primarily by NGOs promoting household level food security and poverty reduction through rural livelihood interventiions. This should help to strengthen learning and accountability feedback loops for their development interventions.

The QUIP incorporates many best practice characteristics of other qualitative impact evaluation methods, including contribution analysis and process tracing. It also emphasises complementarity with quantitative performance monitoring. In addition, it broke new ground in addressing problems of pro-project or confirmation bias, and in promoting transparency (hence auditability) in the analysis of text data. This follow-on proposal is to help us broaden and deepen adoption of these innovations, following positive feedback on the QUIP from both practitioners and evaluation specialists.

While believing that the QUIP has potential to be adapted for use by a wide range of organisations, the proposal is to promote its adoption particularly among impact investors in the field of socially responsible financial inclusion and enterprise development. Impact investment is a rapidly growing field, and its performance also hinges on being able to make credible and cost-effective assessment of impact at the household level in complex contexts that are often subject to rapid change. Financial inclusion and enterprise development are leading areas of impact investment. They are subject to ongoing debate about the potential for market-led development strategies for which better evidence of household level impact is needed. This is also a field in which the Principal Investigator has substantial expertise and an established international reputation.

The following steps are required to promote the QUIP in this field:
(1) Close engagement with existing networks and leading organisations promoting financial inclusion and enterprise development (e.g. CGAP, ACTION International, DCED, GIIN, SEEP, SoCAP, UNCDF), including analysis of current impact evaluation approaches and relevant publications. (2) Adaptation of the QUIP to meet the needs of organisations working in this sector, including further development of the open access QUIP analysis software.
(3) Preparation and web dissemination of QUIP materials specifically tailored to potential users in this sector - e.g. to accommodate different impact domains.
(4) Development and testing of tools for training and supporting those interested in (a) commissioning QUIP studies, (b) being employed as researchers to carry them out.
(5) Translation and testing of key materials into Spanish, French and Hindi. Further web based dissemination activities in these languages.
(6) Identification of - and collaboration with - organisations willing to commit to QUIP studies at their own expense.

To spearhead promotion of the QUIP we are also exploring setting up a specialist consultancy organisation dedicated to this task as a research spin-off company. We believe that doing so will enable us to scale-up dissemination and use of the QUIP more rapidly, effectively and sustainably. Separate funds have already been obtained in the form of an 'ICURe' grant to support this business development aspect of promotion of the QUIP from the SETsquared Partnership. Backed by Innovate UK and HEFCE, this is the leading enterprise collaboration between the universities of Bath, Bristol, Exeter, Southampton and Surrey. The purpose of the ICURe grant is restricted to helping a named early career researchera through a narrowly specified set of market validation and business planning activities. These are complementary to the impact and engagement activities requested in this proposal.

Planned Impact

Who will benefit and how?

The immediate beneficiaries of the project will be public and private social impact investors who face the problem of how to address the attribution challenge in assessing the social impact of their work. Improved feedback on the contribution of activities to positive and negative social impact can support (a) short feedback loops via internal learning and operational adjustments (b) long feedback through improved wider accountability and resource allocation. The QUIP will be useful to any social impact investor serious about the need for strong social impact reality checks in evaluating their efforts to reduce problems of economic insecurity, poverty, injustice and social exclusion through improved access to financial services, employment and self-employment.

Benefits will be achieved directly by seeking out organisations willing to take up and use the QUIP. We will do this by building up and supporting networks of (a) skilled commissioners willing and able to finance QUIP studies themselves, and (b) professional researchers skilled in carrying out such studies. Our longer term goal is to set up an independent non-profit company to drive this work forward on a sustainable footing. Initial interest in the QUIP has come from organisations ranging from Diageo to IIED and the Stromm Foundation in Norway.

Second, benefits will be achieved indirectly by broadening the range and accessibility of material available about the QUIP (and hence the ideas underpinning it) in order to influence social impact evaluation methods and practices. We will do this by engaging in practitioner and academic debates over how to add to the evidence base for socially responsible impact investment in ways that are methodologically robust.
 
Description This project funded additional impact and engagement work, building on a recently completed prior DFID-ESRC joint research grant (ES/J018090/1) referred to as the ART Project. The ART project designed and tested a new Qualitative Impact Assessment Protocol (QuIP) for NGO interventions in climate change and rural livelihood development projects. This project explored how far the QuIP tool could be adapted for use by public and private sector social impact investors - hence the name QuIPSII.

The project achieved its main goal of consulting with a broad range of social impact investors on (a) their current thinking and practice in relation to the need to assess the social impact of their investments (b) their response to the QuIP as one way of addressing this need. It also contributed to building interest in making use of the QuIP. In response we set up a non-profit start-up company called Bath Social and Development Research (BSDR Ltd) as a vehicle for underting commissined QuIP studies and associated consultancy with impact investors and microfinance organisations. See BSDR under Collaborations for more information on these.

Two key findings were: (a) current thinking and practice remains very fragmented, with respect to terminology as well as methodology; (b) there is potential demand for use of the QuIP alongside other social performance assessment mechanisms, but while heavily committed to monitoring change in outcome variables few impact investors are as yet willing to invest in impact studies that credibly test assumptions about their contribution to observed changes. These and other findings are set out in more detail in the CDS Briefing paper - social impact investment and the attribution challenge. See the link below.
Exploitation Route A new website was set up (http://bathsdr.org) containing guidelines for the QuIP. These have been updated in the light of feedback, and translated into French and Spanish. A social enterprise - Bath Social and Development Ltd - has been set up to support organisations interested in using it. See information provided under Collaborations.
Sectors Agriculture, Food and Drink,Digital/Communication/Information Technologies (including Software),Education,Financial Services, and Management Consultancy,Government, Democracy and Justice,Manufacturing, including Industrial Biotechology

URL http://www.bathsdr.org
 
Description The QuIP stimulated interest among a variety of organisations that attended the stakeholder workshop organised in April 2016. These included Acumen and the Aga Khan Foundation. Attendance at impact investment conferences in the USA also elicited commissioned studies from the C&A Foundation and Habitat for Humanity in 2017. These were delivered through BSDR - the start-up company formed as a result of the original research. More information on these activities are supplied in the Collaboration Section. Findings from these and other QuIP studies were also published in a book - Attributing Development Impact (see publications). Since 2017, use of the QuiP to evaluate social investments have expanded gradually with the support and encouragement of Bath SDR Ltd. Recent clients include the MasterCard Foundation, Agdevco and Opportunity International UK.
First Year Of Impact 2016
Sector Agriculture, Food and Drink,Communities and Social Services/Policy,Financial Services, and Management Consultancy,Manufacturing, including Industrial Biotechology
Impact Types Economic

 
Description Invited membership of the Intellectual Leadership Team of DFID's new Centre for Excellence in Development Impact and Learning (CEDIL)
Geographic Reach National 
Policy Influence Type Membership of a guideline committee
 
Description Participation in Wilton Park meeting on new frontiers in evaluation
Geographic Reach Multiple continents/international 
Policy Influence Type Influenced training of practitioners or researchers
Impact Invited participant at an international workshop on "new frontiers for evaluation in an era of market-oriented development" Wilton Park, 20-22 July.
 
Description ICURe
Amount £35,000 (GBP)
Funding ID QUIP 514603306 
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 08/2015 
End 04/2016
 
Title Qualitative impact Protocol (QuIP) 
Description The QuIP is primarily an evaluation method, which might also be classified as a form of applied social science research incorporating aspects of process tracing and contribution analysis in particular. However, as both an exploratory and confirmatory evaluation method it does incorporate some innovative features that are relevant to purer or academic social science research methods (e.g. in relation to methods to reduce confirmation bias and improve data coding). In addition to pursuing opportunities for commercialising the QuIP in development practice and among impact investors, we have also presented it to more academic audiences, and are planning applications to more academic work (e.g. through Maconachie's new project for Humanity United) on assessing wellbeing along informal mining value chains in West Africa). 
Type Of Material Improvements to research infrastructure 
Year Produced 2015 
Provided To Others? Yes  
Impact The QuIP has attracted a lot of interest among other researchers, and been presented at several conferences (including in Bordeaux, London, Manchester, Pretoria, Stockholm) and through invited seminars (including for DFID, Save the Children, Oxfam UK, OPM Ltd, the National Audit Office and the Aga Khan Development Network). Other research bodies have incorporated it into research proposals, including teams at the Overseas Development Institute, OPM, the International Institute for Environment and Development. A non-profit company Bath Social and Development Research Ltd, has been set up specifically to promote QuIP and has used it to conduct commissioned impact evaluation studies for Self Help Africa (in Kenya), Oxfam GB (in Ethiopia) and Diageo (in Ethiopia). More are planned 
URL http://qualitysocialimpact.org/
 
Description ACUMEN 
Organisation Acumen
Country United States 
Sector Charity/Non Profit 
PI Contribution Staff responsible for social impact assessment in Acumen attended the CDS research workshop. This led to follow up discussions about how they could develop a lean version of the QuIP to suit their own purposes. Follow-up has been delegated to BSDR Ltd. A first pilot of the lean QuIP was conducted in India in late 2016 and a second one in 2017.
Collaborator Contribution They commissioned BSDR to assist them with the two reports.
Impact So far outputs have been internal to Acumen.
Start Year 2016
 
Description Aga Khan Development Network 
Organisation Aga Khan Foundation
Country Switzerland 
Sector Charity/Non Profit 
PI Contribution BSDR has committed to providing training and consultancy services to AGDN to enable it to use and/or adapt the QuIP for internal purposes. A collaborative QuIP based study was conducted of midwifery graduates from the Aga Khan University in Uganda. More joint studies are planned for 2019.
Collaborator Contribution AGDN financed a public lecture on the QuIP by James Copestake in Ottawa. They have also supported QuIP training undertaken by BSDR. The Uganda study led to a joint publication, submitted to the Journal of Midwifery.
Impact Webcase of a public lecture: Cautionary tales of complex causation: Qualitative and mixed method impact assessment of climate change and livelihood transformations in Africa.
Start Year 2016
 
Description Bath SDR Ltd 
Organisation Bath Social & Development Research Ltd
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution BSDR was set up in 2016 as an independent non-profit company to promote further development and use of the QuIP methodology. A legal agreement was signed between BSDR and the University of Bath in 2016 under which Bath SDR has rights to promote the QuIP under licence. During 2016 Bath SDR commissioned QuIP studies in Ethiopia, India, Kenya, Mexico and Uganda. Since then additional studies were conducted in a further six countries, and again . Actual and pipeline clients include Acumen, Aga Khan Development Network, Bristol City Council, the C&A foundation, Diageo Ltd, Gorta Self Help Africa, Habitat for Humanity, Oxfam GB, Save the Children Fund, Tearfund, Tree Aid. As of early 2021 the company employs two staff full-time and a growing network of part-timers, both in the UK and abroad. I am a member of the Board of Directors, and am also contracted to BSDR by the University to advise and support its activities. Bath SDR pays a licence fee to the University of Bath of 1% of its revenue for permission to utilise the intellectual property developed during the ART project.
Collaborator Contribution In addition to mainstreaming use of the QuIP BSDR is building up an archive of experience with use of the QuIP to conduct qualitative impact evaluation of development projects that will inform further research under CDS. These form the core of the recently published book - Copestake et al. (2019).
Impact BSDR has asssisted in producing various internal reports for other collaborators listed.
Start Year 2016
 
Description C and A Foundation 
Organisation C and A Foundation
Country Switzerland 
Sector Private 
PI Contribution C&A commissioned BSDR Ltd to conduct a QuIP study of a programme to improve labour standards in factories supplying C&A with ready made garments in Mexico. The final report was published on the web in 2017 - see http://www.candafoundation.org/impact/results-learning/evaluation-c-foundation-yo-quiero-yo-puedo-cuidarm/
Collaborator Contribution Commissioned QuIP study through BSDR. This is the basis of a case study in Chapter 4 of Copestake et al. (2019)
Impact BSDR QuIP report https://d2bkwed3dzgijf.cloudfront.net/live/media/filer_public/4b/9e/4b9e20d0-5d41-4b7b-b567-a2df9d2a09f8/final_report_impact_evaluation_yqyp_programme_mexico_120617-vf_web_version.pdf
Start Year 2015
 
Description Diageo Ltd (Ethiopia) 
Organisation Diageo
Country United Kingdom 
Sector Private 
PI Contribution The research led to the Head of Corporate Social Responsibiity of Diageo commissioning QuIP studies of their smallholder malt barley procurement in Ethiopia from BSDR. This was completed in 2016, and a publication based on the findings (commissioned independently by Diageo) was published in 2017. Diageo saw the QuiP as a pilot "deep dive" to explore possible positive and negative effects of their smallholder barley procurement in Ethiopia at the household level and below. We found evidence of positive impact on household incomes and education. We also found some rising inequality, due to rising land rents and more seriously negative shocks to some farmers arising from credit being advanced against poor seed. This has prompted follow-up discussion about risk sharing mechanisms that Diageo might develop with their partners. Diageo commissioned a second QuIP study in Uganda in 2018, a third in Cameroon, and a fourth is planned (in Kenya).
Collaborator Contribution The study will add to the database of QuIP applications from which we can learn. It is also a pioneering commission for BSDR - the spin-off social enterprise from the research. Diageo have contributed to funding a publication based on the report. This Ethiopia QuIP study also features as a case study chapter in Copestake et al, (2019).
Impact Internal report submitted to Diageo by BSDR Ltd in 2016. Publication to follow. The study will also provide material for future CDS work on qualitative impact evaluation.
Start Year 2016
 
Description F1F9 
Organisation F1F9 India Private Limited
Country India 
Sector Private 
PI Contribution We have worked with F1F9 consultants to design the outline of the spreadsheet required for analysis, based on the need for simple, open access software that any small NGO or consultant can use to analyse qualitative data. This has involved regular meetings, testing and feedback on each new design.
Collaborator Contribution F1F9 have done all the coding and creation of the spreadsheet which we are now sharing with potential users, through BSDR Ltd. These include Acumen, Aga Khan Development Network, Tearfund and several self-employed consultants who have attended training. Much of the initial work undertaken by F1F9 was pro bono.
Impact The main output is the QUIP spreadsheet, still undergoing further development so it is not publicly available yet. However, its development is charted int he blog post in the URL above.
Start Year 2013
 
Description Habitat for Humanity International 
Organisation Habitat for Humanity
Country United States 
Sector Charity/Non Profit 
PI Contribution BSDR conducted a QuIP study for H4H relating to wholesale financing of microfinance for low cost housing improvement in South India. They also supported a further study incorporating QuIP in Peru in 2018.
Collaborator Contribution They have funded two QuIP studies. The India study also features as a case study chapter in Copestake et al. (2019).
Impact The India study contributed to HFHIs internal reflection on their mission and strategy both in India and more widely. This is documented in Chapter 5 of Copestake et al (2019).
Start Year 2016
 
Description SetSquared Partnership 
Organisation SETsquared Partnership
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Selected for an ICURe (Innovation to Commercialisation of University Research) grant
Collaborator Contribution Financial, plus participation in training workshop
Impact Post I-Cure we prepared a business plan for launch of a spin-off company to promote the QuIP and other applied social and development consultancy and applied research activities generated by the Centre for Development Studies. This was pitched unsuccessfully to Innovate UK early in 2016 for a start-up grant of £300k. However, feedback was useful and informed the subsequent launch of Bath Social and Development Research Ltd.
Start Year 2015
 
Company Name Bath Social and Development Research (Bath SDR Ltd) 
Description Bath SDR is a company limited by guarantee, and was set up to promote the QuIP and other products of research conducted though the Centre for Development Studies through consultancy and applied research activities. 
Year Established 2016 
Impact Shortlisted for start-up grant of cerca £300,000 from Innovate UK in January 2016 (unsuccessfully). During 2016 commissions were received for QuIP studies from Gorta Self Help Africa (Kenya), Oxfam GB (Ethiopia), Diageo Ltd (Ethiopia), C&A Foundation (Mexico), Habitat for Humanity (India), Acumen (India), Tearfund (Uganda). In 2017 commissions were received for QuIP studies from Tree Aid (Uganda) and Save the Children (Tanzania). Training was also commissioned by the Aga Khan Development Network.
Website http://www.qualitysocialimpact.org/
 
Description "Attributing Development Impact: scope for improving qualitative evaluations" University of Malawi, Zomba, Malawi 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Talk at the Centre for Socio-economic Research, plus two day training of field researchers
Year(s) Of Engagement Activity 2018
 
Description "Attributing Development Impact: the QuIP quest for better impact evaluation" Lusaka, Zambia 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Public Lecture in the School of Public Health of the University of Zambia (UNZA).
Year(s) Of Engagement Activity 2018
 
Description "Attributing development impact: scope for improving qualitative evaluation." IDS Sussex, Brighton, UK 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact QuIP presentation
Year(s) Of Engagement Activity 2018
 
Description (European Evaluation Society). Impact evaluation using the QuIP Thessaloniki, Greece 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact to add
Year(s) Of Engagement Activity 2018
 
Description A Talk about the QuIP - South West Qualitative Research Symposium 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2017
 
Description COnference presentation on QuIP - Decvelopment Studies Association - Milton Keynes 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Conference presentation on the QuIP = UK Evaluation Society - London - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Conference presentation. Development impact assessed inclusively? The qualitative impact protocol case book Manchester, UK 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact to add
Year(s) Of Engagement Activity 2018
 
Description Conference presentation: attributing development impact using the QuIP: collaborative innovation in eliciting credible grassroots feedback - 8th Annual ASA Sociology of Development Conference: Development in Dialogue: engaging practitioners and across disciplines 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Conference presentation given concerning attributing development impact using the QuIP: collaborative innovation in eliciting credible grassroots feedback
Year(s) Of Engagement Activity 2019
 
Description DFID: seminar for evaluation specialists (London) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Invited talk on the QuIP methodology to DFID evaluation staff in London, live transmitted to staff in DFID offices worldwide and recorded for video dissemination. DFID Head Office in Whitehall, 9 December.
Year(s) Of Engagement Activity 2015
 
Description Doctoral training workshop: causal attribution using the QuIP. Kroc School of Peace Studies, Notre Dame University 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Talk given at a doctoral training workshop entitled: Causal attribution using the QuIP. Kroc School of Peace Studies, Notre Dame University
Year(s) Of Engagement Activity 2019
 
Description European Evaluation Society Sep 2016 - Maastricht 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Part of a panel presentation on innovation in impact assessment.
Year(s) Of Engagement Activity 2016
 
Description Guest lecture: Impact evaluation in complex contexts: action research using the QuIP - at Dept of Social Policy & Intervention, University of Oxford 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Guest lecture to impart research outcomes of using the QuIP for action research in complex contexts
Year(s) Of Engagement Activity 2019
 
Description Impact investment workshop (Bath) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a meeting over three days of international experts, mostly from the private sector, concerned with how impact investors assess the social impact of their programmes. It aimed to generalise from the experience of social performance assessment of microfinance for the impact investment field more widely. It also sought to build on the work developing QuIP to reflect more widely on methodological issues and options associated with impact assessment using qualitative methods and how to promote better practice in this field. In addition to the UK participants came from Cameroon, India, Kenya, Luxemburg, Poland, Switzerland and the USA. See page 3 of the workshop briefing at the URL below.
Year(s) Of Engagement Activity 2016
URL http://qualitysocialimpact.org/wp-content/uploads/2016/05/QUIP-SII-Briefing-Paper-May-2016.pdf
 
Description Innovations in Impact Evaluation: the case of the QuIP - DfID talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Talk at the Department of International Development (Residential for Evaluation and Statistics Teams)
Year(s) Of Engagement Activity 2018
 
Description Intensive QuIP Briefing - British Red Cross (M&E) Dept - Oxford - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Intensive QuIP Briefing - Trinity College Dublin, Impact Evaluation Summer School - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description International webinar to Evaluation specialists in the Aga Khan Development Network (9 November 2016) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This Webinar brought together evaluation specialists acros the global Aga Khan Development Network, for discussion of the QuIP following my Ottawa lecture a few weeks before
Year(s) Of Engagement Activity 2016
 
Description Invited Seminar for the Church of England on Qualitative Impact Evaluation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Seminar given at the Church of England headquarters
Year(s) Of Engagement Activity 2020
 
Description Invited briefing on QuIP - Save the Children UK (M&E Staff) - London - 2018 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact To add
Year(s) Of Engagement Activity 2018
 
Description Invited lecture on the Qualitative Impact Protocol (QuIP) Degree of recognition: National - Poverty Research Methods Doctoral Worshop 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Invited lecture on the Qualitative Impact Protocol (QuIP) Degree of recognition: National - Poverty Research Methods Doctoral Worshop
Year(s) Of Engagement Activity 2019
 
Description Invited lecture organised by the Aga Khan Development Foundation Canada (20 October 2016) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I was invited to give the fifth of a programme of invited lectures on the topic of "measuring development impact" organised by the Aga Khan Development Fundation in Ottawa, Canada. The title was "Cautionary tales of complex causation: qualitative and mixed method impact assessment of climate change and livelihood transformations in Africa"
Year(s) Of Engagement Activity 2016
URL http://www.akfc.ca/en/events/item/278-complex-causation
 
Description Invited presentation (UK Department for International Development, Annual Professional Development Conference for Statistics and Evaluation specialists) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Invited to make a plenary presention on the Qualitative Impact Protocol (QuIP) and then engage in more detailed discussion through break-out groups.
Year(s) Of Engagement Activity 2018
 
Description Invited presentation on QuIP - ERC 'Knowledge for Use' research group - Newcastle - 2018 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2018
 
Description Mokoro Seminar on "The story behind the numbers: making, analysing and using qualitative evidence" in Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Mokoro Ltd is an Oxford based international development consultancy. It runs an annual public seminar, to which I was invited as a speaker to talk about experience in mainstreaming use of the QuIP
Year(s) Of Engagement Activity 2019
 
Description Plenary QuIP book launch - UK Evaluation Society - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Professional Training (BSDR LtD) QuIP Lead Evaluator Course Bath,UK 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact to add
Year(s) Of Engagement Activity 2019
 
Description Professional Training (BSDR Ltd) QuIP Lead Evaluator Course Bath, UK 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Two day formal training in QuIP for lead evaluators, organised jointly with BSDR Ltd
Year(s) Of Engagement Activity 2018
 
Description Professional Training (BSDR Ltd) QuIP Lead Evaluator Course Bath, UK 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact to add
Year(s) Of Engagement Activity 2018
 
Description Professional briefing on QuIP - CDC (Heads of M&E and Impact) - Bath - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Professional briefing on QuIP - Concern Worldwide - Dublin - 2018 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact To add
Year(s) Of Engagement Activity 2018
 
Description Professional briefing on QuIP - DfID (Evaluation Unit) - London - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Professional briefing on QuIP - Stellenbosch Business School - Stellenbosch - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Professional briefing on QuIP - Trinity College Dublin, Impact Evaluation Summer School 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact To add
Year(s) Of Engagement Activity 2018
 
Description Professional briefing on QuIP- Institute for Economic and Social Policy - Cape Town - 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2019
 
Description Professional workshop (BBC Media Action): Impact Evaluation using the QuIP 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Introductory talk about the QuIP following collaboration between BBC Media Action and BSDR in evaluating a radio programme in Myanmar
Year(s) Of Engagement Activity 2018
 
Description Professional workshop (WYG Engineering, Research Dept in London): Impact evaluation using the QuIP 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Introductory training in impact evaluation, drawing upon QuIP experience.
Year(s) Of Engagement Activity 2018
 
Description QuIP presentation at ESRC-DFID sponsored conference (Pretoria) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I gave a presentation at a session on "Innovation in Research Methods" at the ESRC-DFID Joint Fund for Poverty Alleviation Research sponsored conference in Pretoria from 16-18 March entitled "Lessons from a decade of research innovation, engagement and impact."
Year(s) Of Engagement Activity 2016
URL http://www.theimpactinitiative.net/files/lessons-decades-research-poverty-innovations-engagement-and...
 
Description QuIP talk to Aga Khan Development Network Technical Working Group (Geneva) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Formal presentation at the annual workshop of the AKDN Quality of Life Technical Working Group, attended by M&E and related specialists from Geneva, US, Kenya, France, Afghanistan, Tajikistan, Pakistan, Canada and India.
Year(s) Of Engagement Activity 2016
 
Description QuIP talk to the National Audit Office (London) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Formal presentation to the qualitative research technical group of the National Audit Office in London, also relayed by weblink to regional offices elsewhere in the UK.
Year(s) Of Engagement Activity 2016
 
Description QuIP training for the Aga Khan Foundation (7 April 2017) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact QuIP training for staff of the Aga Khan Development Network from UK, Switzerland, Canada and Kenya
Year(s) Of Engagement Activity 2017
URL http://www.bathsdr.org
 
Description QuIP: lead evaluator training course 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact to add
Year(s) Of Engagement Activity 2018
 
Description Seminar presentation on QuIP - DSA Business and Development Study Group - London - 2017 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact To add
Year(s) Of Engagement Activity 2017
 
Description Seminar: Impact evaluation in complex contexts: action research using the QuIP - Government Outcomes Lab, Blavatnik School of Government, University of Oxford 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Seminar held to discuss using the QuIP in action research in complex contexts
Year(s) Of Engagement Activity 2019
 
Description Talk to Tearfund Supporters about the QuIP (City of London) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact To add
Year(s) Of Engagement Activity 2017