Designing and evaluating provider results-based financing for tuberculosis care in Georgia: understanding costs, mechanisms of effect and impact

Lead Research Organisation: Curatio International Foundation
Department Name: Research

Abstract

Tuberculosis remains one of the world's biggest killers, and Georgia is among the countries where the TB burden is high. Georgia has low TB treatment success rates, indicating that people are not completing treatment, thus posing a risk to their health and to their families and communities. Untreated TB cases lead to the development of drug resistance, which is a huge challenge for the country, for the region and the world. The GoG recognises the importance of this public health problem. Significant achievements in TB control were made during the last decade, including improvements to TB case detection and treatment. Nevertheless, challenges related to timely initiation of treatment, patients' poor adherence to treatment and lower than targeted treatment success rates remain.
A number of factors could potentially explain the poor control of TB cases in Georgia, including health system (provider) related factors, such as demotivation of health care providers and delayed TB detection, and patient related factors, such as failure to seek treatment, and poor adherence to treatment. In an attempt to address these barriers, Georgia has provided patient adherence support to all TB patients since 2007, with the support of the Global Fund (GF). This includes monetary incentives to encourage continuous treatment and to cover transportation costs.
Notwithstanding the introduction of incentives for patients, treatment adherence remains low and the attention has shifted to the incentives available for service providers. In Georgia, primary care facilities are predominantly privately owned and paid by capitation, without tying incentives to their performance (e.g. for case detection and referral). These providers must provide TB treatment in their mandate, but this mandate will shortly expire. Although the GoG is paying referral specialists salaries for the provision of TB services through its vertical programme, it has limited capacity for monitoring and leverage over the performance of these providers, and salaries are low compared to other specialists.
The GoG is therefore planning to introduce a provider RBF intervention in pilot areas in 2017. The pilots intend to explore the potential of a provider intervention, in addition to the already existing patient incentives, to increase the motivation of both public and private providers in improving patient adherence and treatment outcomes. From a research perspective, the introduction of this scheme provides an opportunity for embedded development and research, working closely with the national programme and policy makers, and leveraging Global Fund support and influence.
The main goal of the research is to participate in problem analysis during the design phase and provide evidence on the implementation and effects of the new supply side RBF scheme on adherence and treatment success rates, on the cost of the intervention, and how it works in different contexts in Georgia (including wider health system effects, intended or not).
To achieve this goal, we will engage with policymakers and programme managers during the process of designing and developing the intervention. By doing so we will ensure that the design is theory-led, engage policy makers from an early stage and develop and document the iterative and participative learning process between policy makers and researchers.
As well as informing policy in Georgia, the results are expected to enrich global policy debates on RBF and TB programming, including through public-private partnerships, as well as feeding into academic debate on how to combine realist evaluation techniques with trials and cost-effectiveness analysis.

Technical Summary

The study will first inform how the problem is conceptualised and the intervention is designed in collaboration with the policy makers at national level. Once piloting is started, the research will seek to answer the following research questions:
(1) What is the impact of provider-focused Results Based Financing (RBF) on patients' adherence to tuberculosis treatment and treatment outcomes of both Drug-Susceptible (DS) and MDR patients in Georgia?
The impact of RBF will be evaluated using a quasi-experimental trial design. Eligible facilities will be randomly selected in 20 districts, then randomly allocated to intervention and control groups. The study population will include nurses and physicians involved in TB primary care and TB patients (DS & MDR-TB cases), who provide TB treatment to approximately 500 patients, which represents 12% of the expected total newly registered TB patients. The intervention will be RBF with provider incentives, complementing the existing patients' incentives. The comparison will be of intervention (RBF) and control groups (existing funding model), considering the variety of the contexts (e.g. semi-urban/urban, and public/private facilities). The outcome measures will be adherence to TB treatment and treatment success rate.
(2) Is the RBF intervention cost-effective?
Cost-effectiveness analysis will generate evidence on the costs of the intervention by comparing the existing model with the added supply side RBF intervention.
(3) How does it work, for whom and in which conditions? and (4) How should RBF be modified to optimise national roll-out for this and possibly other health services?
To identify the mechanisms of change and the context factors that enhance or undermine the effectiveness of the RBF intervention, we will carry out realist case studies in a sub-set of sites. This theory-informed trial design will allow us to assess how and why the RBF scheme leads to the observed results, for whom and in which conditions.

Planned Impact

The beneficiaries of this research will be TB patients, nurses and physicians involved in TB care, health facility managers, policy-makers, community members and the scientific community, in Georgia, the region and globally.
The aim of the proposed research is to support the design and to evaluate the impact, cost-effectiveness and mechanisms of change of a provider Results Based Financing (RBF) scheme focused on strengthening Tuberculosis (TB) outpatient care services (which complements already existing demand-side incentives for TB patients), delivered through public and private providers in Georgia, a lower-middle-income country (LMIC). To do so, we will develop and implement an innovative theory-informed trial design.
Underlying the RBF scheme is the hypothesis of policymakers that it will provide increased motivation to healthcare providers in both public and private facilities at primary and secondary care level and will also help to persuade the private providers to retain TB services in future. Because of the resulting behaviour change of providers, TB patients will receive health services that are of better quality and more responsive to their needs, which in turn will lead to better adherence to treatment and treatment success.
Our research will contribute to the RBF scheme in two ways, (i) by supporting the design of an appropriate intervention, including elaboration of the underlying problems and expected pathways of change, and (ii) assessing its impact and cost-effectiveness and identifying the factors that support or undermine its effectiveness in different settings, as well as documenting intended or unintended system effects and why they come about.
The research is envisaged to contribute to narrowing the knowledge gap existing around RBF interventions, such as their application in public/private settings and their cost-effectiveness, and to provide a clearer understanding of the underlying mechanisms of change, the conditions of success and the wider (negative and positive) consequences of RBF schemes. The research will also produce methodological innovation regarding the use of realist evaluation alongside cost-effectiveness analysis and in general theory-informed trial designs, which will primarily be shared with research communities operating in the areas of health systems research, health financing and economics, communicable disease control, and programme evaluation.
The evidence produced through this research will be used by national policy-makers to reform the financing of primary health schemes in a way that improves efficiency, quality and sustainability of services. Through a participatory learning process, the policy-makers will improve their understanding of the RBF model application in a changing context. This will provide important evidence to inform the national rollout and possible expansion of RBF to other services, such as the maternal and child health services and management of chronic diseases, based on the findings concerning impact, cost-effectiveness and conditions of success.
Additionally, findings will be beneficial for other LMICs, particularly for those with a similar vertical organization of TB services (most of the former Socialist countries of Eastern and Central Europe and Central Asia) and for countries where private providers play an important role in the provision of TB services. Using the communication strategies outlined above, we will inform the development of RBF for TB and related service delivery in other contexts - highlighting positive and negative findings, as well as contextual barriers and enablers, and the wider systems effects and resource implications (which are crucial to scalability and sustainability). The implications for the provider/patient interaction will be a key focus area, as will be focusing on vulnerable patient groups and the MDR patients.

Publications

10 25 50
 
Description The study investigated the effectivness of the provider side Results Based Financing (RBF) intervention, on the loss to follow up in Tuberculosis (TB) treatment for Drug-Susceptible (DS) and Multi Drug Resistant (MDR) patients, as a primary outcome and treatment adherence and treatment success as secondary outcomes. The study found that a) the intervention  has minimal to no effect on loss to follow-up on drug susceptible and drug resistant patents, b) the intervention may have had a slight favourable, but not statistically significant effect an adherence to treatment and c) the intervention had slightly positive but non-statistically significant effect on treatment success. The Realist Evaluation component of the study revealed explanatory factors of the result such as policy level factors, intervention design, implementation challenges and external factors. Although, no significant improvements in treatment outcomes the study revealed improved provider motivation and satisfaction. The costing component of the study estimated the providers, patients and intervention costs. As a result, no difference in provider costs and patient costs between intervention and control sites were found. Catastrophic costs for DS and DR patients account for 30% and 50% respectively. 
The five year duration of research project contributed to the local (Georgia based) early career researchers capacity building. The young researchers gained new knowledge and skills, with active mentorship from partner institutions and through active participation in dissemination activities such as scientific paper development and presenting study results on different local and international forums.
Exploitation Route The outcomes of the study informs different audiences. At the National Level Health Policy Makers can consider the result while planning similar interventions. The study outcomes contributes to the scientific knowledge generation for the international research community.
The research team is currently working on number of scientific papers for the wider dissemination.
Sectors Healthcare

 
Description The study outcomes were considered by national level policy makers during the design of the national TB program for 2023. Specifically the study showed no improvement in the treatment outcomes for DS and DR TB patients and accordingly the intervention was not scaled up countrywide. The factors explaining the outcomes such as policy, intervention design, implantation challenges and external factors were translated into the recommendations for consideration in the ongoing Primary Health Care (PHC) reform process in Georgia. The reform envisages integration of TB outpatient care into the PHC, which amplifies the importance of the research findings.
First Year Of Impact 2022
Sector Healthcare
Impact Types Policy & public services

 
Description Better estimates of the costs of TB control
Amount $300,034 (USD)
Funding ID OPP1158747 
Organisation Bill and Melinda Gates Foundation 
Sector Charity/Non Profit
Country United States
Start 08/2016 
End 10/2019
 
Title Data Collection Forms for the Trial component of the study 
Description Several Data Collection Tools for the Trial component has been created: 1. Socio-Economic Status form - (SES) 2. Patient Trial form - (PT) 3. Facility Trial form - (FT) 
Type Of Material Physiological assessment or outcome measure 
Year Produced 2018 
Provided To Others? No  
Impact Data Collection Forms for the Trial component has been tested in 4 pre test facilities 2 intervention and 2 control arm facilities and after slide modification has been evaluated as appropriate for trial component data collection 
 
Title Data Collection Tools for Health Economic Evaluation 
Description Several data collection tools for Health Economic Evaluation component of the study has been created: 1. Patient Costing Instrument - P3. Enrollment form and locator 2. Patient Costing Data Collection Form - PF3 (Patient Face to Face questionnaire) 3. Patient Costing Data Collection Form - PP3 (Patient Phone questionnaire) 4. Facility Personnel Salary & Time for TB services (form FP2) 5. Personnel workload and time allocation to TB activities 6. Personnel workload and time allocation between TB activities 7. Service Data Collection form SD1 8. Patient Record Data Collection form PR1 9. Drugs and Laboratory Data Collection form DL2 10. Transportation Data Collection form - Tr2 11. Capital and Other Costs data collection form - CO2 12. Facility Building Costs 13. Vehicle costs for TB services 14. Laboratory Equipment 15. Other costs 
Type Of Material Physiological assessment or outcome measure 
Year Produced 2018 
Provided To Others? No  
Impact The data collection tools for Health Economic Evaluation component of the study have been tested during the pilot stage of the study in 5 facilities and after some corrections have been updated and evaluated appropriate for data collection. 
 
Title Data Collection Tools for the Realist Evaluation 
Description Several data collection tools for the Realist Evaluation method has been created: 1. Interview guide for TB service providers - (IDI-Pr) 2. Interview guide for facility managers / supervisors (IDI-Facility Man) 3. Interview guide for national-level key informants (IDI-Nat inform) 4. Interview guide for patient interviews - (IDI-Pt) 5. Observation checklist - (ObsCheck) 6. Local context mapping tool for facilities - (LocContMap) 7. National Context mapping tool for facilities - (NatContMap) 
Type Of Material Physiological assessment or outcome measure 
Year Produced 2018 
Provided To Others? No  
Impact Data collection tools for the Realist Evaluation component of the study has not been used yet. 
 
Title Incremental costs data collection and data entry tool 
Description The excel based data collection and data entry tool has been developed in order to collect information about costs related to the development and introduction of the pilot intervention. The collection has been implemented using serval techniques: in-depth interviews with stakeholders, providers and research staff who were involved in the development of the pilot, the second approach was to collect the information from available secondary from service providers and research staff extracting information from the timesheets. The collected information has been entered in the excel based data entry tool for final calculation of the incremental costs. 
Type Of Material Improvements to research infrastructure 
Year Produced 2021 
Provided To Others? No  
Impact The process of final calculation of incremental cost is part of the economic evaluation, the data analysis is currently under the progress and final impact will be available after the data analysis finalization. 
 
Title Database for Health Economics Evaluation 
Description Database for Health Economics Evaluation has been created and used to entry all data collected in this component of the study. 
Type Of Material Database/Collection of data 
Year Produced 2018 
Provided To Others? No  
Impact No analysis have been conducted yet in this database 
 
Title Trial data collection database in the Oped Data Kit (ODK) software 
Description The data collection form and database in ODK software have been designed and developed for this particular study design. The database collects data on the trial component of the study. The data will be exported to excel and STATA statistical software for data analysis purposes. 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? No  
Impact NA 
 
Description Better estimates of the costs of TB control-Costing the delivery of tuberculosis services in Georgia from a health systems' perspective (VALUE-TB Georgia) 
Organisation London School of Hygiene and Tropical Medicine (LSHTM)
Country United Kingdom 
Sector Academic/University 
PI Contribution The partnership resulted from this award is between two research institutions CIF and LSHTM. Our organization (CIF) developed a proposal requested by LSHTM to become part of this multi-country research project called VALUE TB. The study in Georgia is part of a multi-country study called VALUE TB (the targeted countries include Ethiopia, The Philippines, Kenya, and India). This study provides cost data that could be used by Georgian health authorities and others in the region to improve country investment in TB programmes. The study makes the cost data available in a disaggregated form so that it will also be useful to those, such as the Global Health Costing Consortium (www.ghccosting.org) wishing to extrapolate costs to other settings, or over the time. Although the lack of TB cost data is widely recognized, methods to collect the necessary cost data to inform planning at the country levels are currently cumbersome and expensive, particularly as cost estimates need to be regularly updated. The collection of original cost data often requires substantial time and travel, and current levels of investment for costing exercises at the country level are often insufficient. Hence, the collaboration will address these knowledge and data gaps.
Collaborator Contribution This new collaboration has been initiated by Prof. Anna Vassall, the health economist at the LSHTM, co-investigator in this award (Designing and evaluating provider results-based financing for tuberculosis care in Georgia: understanding costs, mechanisms of effect and impact). As our award also had the costing component concurrent with the aims of Value TB study and the new collaboration provided the possibility to have an additional data point at a country level and to contribute to the cost-effectiveness of both studies. The VALUE TB globally has the following objectives: Objective 1 - To estimate the unit costs of a comprehensive set of TB services globally from a health providers' perspective Objective 2 - To develop a sustainable cost data collection framework in each country The over-arching project will aim to produce both a mechanism and the elements required to sustain costing activities going forward. The planned outcomes of Value TB for Georgia will include: • The establishment of an international stakeholder group of both users and producers of TB cost data (linked to the Global Health Costing Consortium (GHCC) and TB modelling Consortium (TB MAC) stakeholder groups) to define priority costing needs and methods gaps • In collaboration with GHCC, robust piloted standards, guidelines and tools to collect TB cost data, and efficient data collection processes adapted and designed in Georgia which are relevant to the costing purpose and unique setting • A set of training and capacity building tools to accompany these tools for researchers and economic modelers conducting cost studies within the country • Recommendations on the appropriate levels of budgeting for provider costing studies to be performed periodically • Recommendations on maximizing linkages with other efforts (clinical trials, national patient cost surveys) • Recommendations to further improve both the speed and efficiency of TB cost estimation going forward. Objective 3 - To facilitate the estimation of technical efficiency The cost estimates will be used to conduct and analyze the technical efficiency of TB services. We will collect information to facilitate the estimation of combined cost functions for the five countries, looking at the scale and other cost drivers. By better understanding, the drivers of both costs and efficiency, planners in a wide range of settings can select the costs most relevant to their context.
Impact The primary outcome of this study is collected and analyzed data from 28 health facilities around the country. The most significant outcome of the Value TB study results was the change in the National TB Program financing approach in the country.
Start Year 2019
 
Title Results4TB- Integrated Care and Results-Based Financing intervention to improve adherence among patients with drug-susceptible and drug-resistant TB in Georgia 
Description The provision Tuberculosis (TB) services in Georgia, as part of the general health care services, is based on a public-private mix. The government supports universal free access to TB care. At the outpatient level, TB services are provided at TB units staffed by TB doctors and TB nurses. Semi-urban units were recently integrated into the district and regional level health centres (which also offer general outpatient services), most of which are private. Only a few TB units remain as separate public institutions, mainly in the capital and large cities. The proposed intervention to be tested by the Resuts4TB research project will take a Patient-Centered Care (PCC) approach with which TB patients will receive an integrated, multidisciplinary treatment at the outpatient level. Two intervention packages are proposed considering the current set-up of TB services at the outpatient level: 1) Intervention package designed for TB units integrated with primary health care centres in semi-urban areas Under the intervention, patients with TB will receive an integrated, multidisciplinary treatment at the primary health care level. An integrated team composed by a TB doctor, a TB nurse (or rural nurse for rural patients), and a Family Doctor will be established. The package includes: • defining new roles and responsibilities of health care providers involved in TB case management (incl., a TB doctor, a family doctor, a DOT nurse, a rural nurse) within the scope of their professional competencies to ensure the integrated patient centred approach • introducing new tools such as o facility managers guidelines on implementing the intervention o a case management plan for a patient o instruments for monitoring of the integrated team performance o instruments for verification of the incentive scheme for providers training o on principles of patient-centred care for all members of a TB team o on principles of integrated care, for all members of a TB team o on managing side effects of TB treatment, for family doctors and TB doctors • paying bonuses (incentive payments) to a team based on performance indicator - TB patient retained on the TB treatment. 2) Intervention package tailored to specialized TB services in urban areas Under the current model, the team is composed of a TB doctor and a TB nurse. The intervention package involves: • introduction of new tools such as a case management plan (a patient's card), instruments for monitoring, a facility managers' guideline on implementing the intervention • training for TB doctors to manage side effects • paying bonuses (incentive payments) to a team based on performance indicator - pulmonary DS-TB and DR-TB patients adherence rate to treatment. In both models, the facility manager has a role in the intervention package. The manager is responsible for enabling the work of the team (such as contracting, creating job descriptions, supervision on the bonus distribution within the team etc.) and ensuring a supportive environment for providing patient-centred care. The total bonus payment for the facility includes the manager's and the institution's share. Performance-based payments are distributed to health care personnel in a way to build up motivation, ensure fairness, and avoid negative incentives. The volume of a financial incentive is determined based on the following: • The number of DS-TB and DR-TB patients on outpatient treatment in a facility • The monthly income of a facility generated through voucher financing (average of vouchers of DS-TB and DR-TB patients) topped up by about 40% • All players (facility, manager, TB doctor, DOT nurse / rural nurse, family doctor / rural nurse) contribution • Similar bonus payments in large cities and district centers • Higher bonus payment for a rural doctor compared to a family doctor in an urban area (considering a low number of patients in rural areas) • Higher bonus payment for a facility and a facility manager in an integrated TB unit compared to a specialised TB unit (considering a higher volume of work and a lower number of patients) • The facility share intended to cover small additional costs to implement the intervention (e.g. meetings, communication, travel costs etc.). Performance payments are based on the fulfilment of pre-agreed indicator(pulmonary DS-TB and DR-TB patients adherence rate to treatment): for > 85% indicator fulfilment - payment is 100% of financial incentive, for 71-84% indicator fulfilment - payment is 50%, for < 70% indicator fulfilment - payment is 0%. The indicator is measured monthly, reporting, and payments are implemented quarterly. The amount of the bonus are to be distributed among the personnel, facility and manager in line with the indicated rates. Randomization, conducted in 2018, was constrained and stratified according to the facility operation type (i.e. integrated vs. specialized care management). The Results4TB intervention is to be tested in eight randomly selected TB facilitates countrywide during the 24-months period. Additional eight randomly selected TB facilities serve as control units allowing to measure the impact of the intervention on adherence to TB treatment and TB success rates as well as its cost-effectiveness and other contextual factors influencing intervention implementation. The intervention was described in detail in the respective guidelines. Other Intervention tools such as a patient card, a poster visualizing personnel task distribution, a reporting form and training materials were developed. Trainings were provided for the intervention facilities outpatient services managers, tuberculosis doctors, nurses, and family doctors. Before the intervention start, the intervention was pretested in two facilities (out of the study sample) for six months period in 2018. This allowed fine-tuning reporting and supervision forms and procedures. The intervention (bonus payments) is funded through the Global Fund Tuberculosis Grant to Georgia. The Results4TB intervention was included as a pilot component of the TB state program in 2019. The public purchaser - Social Service Agency - contracted eight intervention facilities and the intervention officially started from July 1st 2019. The Results4TB intervention continued in 2020. Similarly to the previous year, a pilot component was included in the 2020 TB state programme and the Social Service Agency contracted respective intervention facilities for implementation of the intervention in 2020. The intervention continues in 2021, The National Health Agency (former Social Service Agency) has contracted the facilities for the intervention implementation in 2021. Patients were enrolled in the trail by end of March 2021. The research team initiated the data collection for the Trial, the Economic Evaluation and the Realist Evaluation in 2019 according to the data collection plan and the tools. The tools were prior tested and fine-tuned. Ethics approvals were obtained and updated from the national IRB, as well as from the QMU, the ITM and the LSHTM ethics review boards for the respective research components. In addition, mobility restrictions due to COVID-19 epidemic in Georgia in April-May 2020 and from November 2020 onwards significantly decreased patients' visit to facilities including for DOT. This affected providers bonus payment formation (the key component of the intervention under research) which is directly linked to DOT accomplishment. On the other hand, COVID-19 epidemic resulted in reduced new TB cases leading to prolongation of patient enrollment in the study. At this stage it is preliminary to report on the full effect of COVID-19 on outcome of the research. In addition changes have been made in the treatment approach for DS TB patients, Video Observation Treatment (VOT) has been encouraged, before the Covid-19 epidemic the VOT was available only for MDR TB patients. As mentioned above the Results4TB intervention (bonus payments) is funded through the Global Fund Tuberculosis Grant to Georgia as part of a pilot component of the TB state program. The MoH made decision to continue the intervention under the same funding in 2022. The TB state program for 2022 includes the pilot component on bonus payments and the single purchaser (National Health Agency) has contracted the same intervention facilities for intervention implementation. 
Type Health and Social Care Services
Current Stage Of Development Initial development
Year Development Stage Completed 2019
Development Status Under active development/distribution
Impact The intervention development stimulated discussion among key stakeholders about possible introduction of results based financing scheme in primary health care of Georgia. In addition recent national level meeting with relevant stakeholders related to changes in the payment and service provision due to Covid-19 epidemic, resulted in an encouragement of Video Observation Treatment scale up for DS TB patients. MoH intends to transform TB outpatient care towards integrated care model including revision of the payment mechanism in 2022, so that the revised model is implemented from 2023. The Results4TB study results will inform the policy modification process. 
 
Description Discussion on the intervention scale up at the National Level 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact The aim of the policy discussion was to inform further decision on the continuation and scale up of the pilot intervention. The Ministry of Health was looking for the research evidence to base it's decision on further actions. As a result of Covid-19 epidemic the delivery of study outcomes (data collection, analysis and synthesis) has been postponed. The government in collaboration with the donor (The Global Fund to fight AIDS, TB and Malaria) decided to continue the pilot stage of the intervention until the evidence generated as a result of the study will become available
Year(s) Of Engagement Activity 2022
 
Description Doing embedded development and research - reflections on the start of the Results4TB programme 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Sophie Witter, Professor of International Health Financing and Health Systems at Queen Margaret University, shared her reflections on the gains and pains of the first 18 months of the Results4TB programme in Georgia the blog has been published in January 2019 on the Results4TB webpage and through social media. The blog describes key issues on the way of doing embedded research and intervention development at the same time.
Year(s) Of Engagement Activity 2019
URL http://results4tb.curatiofoundation.org/index.php/2019/01/18/reflections-on-the-start-of-the-results...
 
Description GEORGIA ON THEIR MIND Bruno Marchal and Ariadna Nebot Giralt contribute to better TB care in Georgia 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Blog for general audience has been created by Prof Bruno Marchal and Ariadna Nebot Giralt in order to provide more information on new model designed by the Results4TB project. It has been published on the web site of the project and also disseminated through social media.
Year(s) Of Engagement Activity 2018
URL http://results4tb.curatiofoundation.org/index.php/2018/04/20/georgia-on-their-mind-bruno-marchal-and...
 
Description Global health researchers work to eradicate tuberculosis 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Professor Sophie Witter about Results4TB project: Global health researchers work to eradicate tuberculosis. Blog has been created for researchers, policy makers and general audience and it has been published on the web site of the project and also disseminated through social media. Blog has been published in August 2018.
Year(s) Of Engagement Activity 2018
URL http://results4tb.curatiofoundation.org/index.php/2018/08/14/professor-sophie-witter-about-results4t...
 
Description Oral presentation on 6th Global Symposium on Health Systems Research- The intersection of randomized trials, realist and economic evaluations 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The oral presentation has been conducted on the Global Symposium on Health Systems Research during the phase 1 conducted in November 2020. The methodological abstract has been presented to the conference participants.
Year(s) Of Engagement Activity 2020
 
Description Oral presentation on Realist 2021 virtual conference- A prospective realist evaluation of a Tuberculosis policy in Georgia: engaging policymakers and practitioners 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The oral presentation on study interim outcomes has been presented on virtual conference. The conference entitled 2021 International Conference for Realist Research, Evaluation and Synthesis took place in February 2021. The realist evaluation interim outcomes has been presented to the participants.
Year(s) Of Engagement Activity 2021
 
Description Poster presentation- 6th Global Symposium on Health Systems Research on Designing complex health interventions using embedded, participatory multi-disciplinary approaches: reflections from a researcher/practitioner partnership in Georgia 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Poster presentation has been disseminated on 6th Global Symposium on Health Systems Research. The abstract title is Designing complex health interventions using embedded, participatory multi-disciplinary approaches: reflections from a researcher/practitioner partnership in Georgia
Year(s) Of Engagement Activity 2020
 
Description Present the intervention at the worksop dedicated to TB management at general outpatient care 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The workshop participants discussed integration of TB care model within general primary care. The workshop was organized within Global Fund supported TB-REP Georgia project. The Provider results based financing model that also includes elements of TB integration into primary care was presented to the audience. The audience expressed interest in the topic, the presentation was followed by questions and answers.
Year(s) Of Engagement Activity 2018
 
Description Presentation about Results4TB intervening on the Inter-regional workshop in preparation for transitioning towards domestic financing in TB, HIV and Malaria programmes organized by WHO Regional Office for Europe 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Supporters
Results and Impact Presentation made by the project manager about Results4TB intervening on the Inter-regional workshop in preparation for transitioning towards domestic financing in TB, HIV and Malaria programmes organized by WHO Regional Office for Europe. The main donors in TB field were attending the presentation such as the Global Fund, WHO regional Office for Europe and so on. The audience supported initiation and has been engaged in active discussion with presenter.
Year(s) Of Engagement Activity 2018
 
Description Results4TB - Research Project Introduction 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact In March 2017, the research team presented the project to the Country Coordination Mechanism (CCM) members. CCM is coordinating body established by the Government of Georgia and chaired by the Minister of Labor, Health and Social affairs of Georgia and responsible to govern and ensure intrasectoral coordination of HIV and TB national programs. The project aim, objectives and plan were presented at the meeting. Participant agreed that the overall objective of the project is aligned with National TB Strategy.
Year(s) Of Engagement Activity 2017
 
Description Results4TB- Program Theory First Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact The Results4TB research project includes a policy formulation process and further adopts a controlled trial design, integrating cost-effectiveness and realist evaluation components, for estimation of impact and value for money. This allows evaluating policy effectiveness in terms of adherence and treatment success rates and estimation of policy cost per desired outcomes.
In order to understand a complex policy process and assess policy effectiveness the project combines the realist research approach with a trial design. The Realist research approach applies participatory and interactive techniques to elicit the programme theory (PT).
The programme theory (PT) is the set of assumptions of programme designers (or other actors involved) that explain how they expect the intervention to reach its objective(s). The whole research team including co-investigators from The Queen Margaret University, London School of Hygiene and Tropical Medicine and Antwerp Institute Of Tropical Medicine, visited Georgia for the preparation to the first PT workshop and participated in it.
In May 16-17, 2017 the first workshop was conducted in order to undergo a concept mapping exercise with TB stakeholders to formulate the programme theory. The 2-day workshop was held in Kakheti region, where participated diverse range of key TB stakeholders. The workshop participants represented policy-makers, TB program managers, health care facility managers, service providers (TB doctors and nurses) and researchers.
The workshop has 3 main goals:
• Identifying the key elements of the problem, the long-term outcome and the policy options
• Thinking about the pathway of change or the causal pathway behind the policy option(s)
• Synthesis - a structured (set of) pathways that summarize the programme theory of the participants
Participants were divided into three groups and were asked to identify any type of bottlenecks across the TB treatment cascade from demand and supply sides that impede TB care in Georgia; the next step was to identify possible solutions. In the final stage of the workshop, findings were summed up and presented to the participants.
As a result of the 1st PT workshop the participative situation and solution analysis led to formulating the initial programme theory. The detailed hypothesis informed the formulation of the policy and the design of the pilot intervention, and the design of the eventual policy via a cluster randomized trial, realist evaluation and cost-effectiveness studies.
Year(s) Of Engagement Activity 2017
URL https://twitter.com/Curatio_CIF/status/864803370909011968
 
Description Results4TB- Program Theory Second Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Following the first PT workshop the research team drafted the intervention concept and held several meetings with the main stakeholders from the National Center for Disease Control (NCDC) and the Ministry of Labour, Health and Social Affairs (MoLHSA) of Georgia to introduce the concept and discuss certain critical issues with them. The meetings were helpful to proceed with further elaboration of the intervention concept, however, there were pending issues that required discussion with the wider audience of the stakeholders.
The 2nd workshop was conducted in Tbilisi, Georgia on 9th of August to discuss the programme theory, specifically to get feedback from stakeholders on the intervention concept and fine-tune it. The initial program theory that was developed by the research team based on the first workshop findings and independent discussions with NCDC and MoLHSA representatives.
The audience represented policy-makers, TB program managers, health care facility managers, service providers (TB doctors and nurses) and researchers. In addition, representative from the state purchaser Social Service Agency participated in the workshop and family doctors and managers from Primary Care Facilities were also invited as the intervention design implies active role.
The second workshop was divided into 2 parts:
Part 1. The first part of group work required individual work from each participant. They were asked to provide their thought about expected effects or results (positive and negative, short-term and long-term) of the intervention
Part 2. Second part of the group work implied team work. Participants were discussing about processes and mechanisms that would help the intervention to reach the final goal and defining essential conditions and contextual constraints for the policy successful implementation.
Based on the second workshop findings the research team was able to finalize the programme theory of the project.
Year(s) Of Engagement Activity 2017
URL https://twitter.com/Curatio_CIF/status/895182620572745728
 
Description Satellite Session at HSR2022- Development and evaluation of integrated Tuberculosis care with Pay for Performance in Georgia - what lessons for the region and beyond? 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The satellite session at HSR2022 has been organised by grant holder organization - Curatio International Foundation (CIF) in partnership with Queen Margaret University (QMU), London School of Hygiene and Tropical Medicines (LSHTM), Institute of Tropical Medicines Antwerp (ITM).
Pay for Performance (P4P) is a relatively new strategy aiming at improving the performance of the health care providers through incentivizing and motivating behavior change for the desired output. Many high and an increasing number of low- and middle-income countries (LMIC) health systems adopted P4P in their reimbursement schemes. There is a growing body of literature on P4P with mixed effects on outcome of interest due to heterogeneity in the types of schemes and evaluations conducted.
This session aimed at discussing the results of five-year research investigating the impact, mechanisms of effect and costs of the provider incentive payment scheme for Tuberculosis care in Georgia. Georgia presents a case with highly privatized health care system. The P4P intervention package includes the integration of Tuberculosis outpatient care with Primary Health Care services as one of its core elements. It has been implemented as a pilot intervention with the national roll-out perspective. The study employed a theory-informed trial design and investigated how and why the P4P intervention led to the observed results. Realist evaluation through multiple realist case studies identified the mechanisms of change and the contextual factors that influenced the implementation of the intervention and ultimately led to the results. The intervention was also evaluated from the economic perspective, costs of P4P intervention from a provider and patient side and its incremental costs were estimated.
Triangulation of trial, realist and economic evaluation data have been presented. This is a novel approach and presents an opportunity to apprise intervention from multiple perspectives.
The session discussed the following questions:
• What is the impact of the provider-focused P4P scheme on patients' adherence to tuberculosis treatment and treatment outcomes of both Drug-Susceptible (DS) and Drug Resistant (DR) patients in Georgia?
• How was the intervention adopted and implemented, for whom and in which conditions does it work?
• What is the cost of the P4P intervention? Is it cost-effective?
• What are the challenges of integration of care challenges?
• How should P4P be modified to optimize national roll-out for this and possibly other health services?
• What are the challenges and opportunities of the innovative research methodology?
The session was hybrid and all participants were actively engaged in Q&A sessions and reported that the outcomes are very useful for the research community as well as for the policy makers
Year(s) Of Engagement Activity 2022
URL https://healthsystemsresearch.org/hsr2022/wp-content/uploads/2022/11/HSR-2022-Final-program-Nov.pdf
 
Description Study Interim Outcomes Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact The aim of the workshop was to inform policy decision about continuation of the pilot intervention under the currents state program 2021 revised in late March 2021. The secondary objective was to inform stakeholders about the adjustment of the intevention in the context of the Covid-19 epidemic. The research team presented trial mid-term results to the policy makers and other stakeholders. As a result decision was made to continue the financing of the bonus payments under the intervention, as the study was undergoing and final results were expected by February 2022. (the expected time-line for the production of the final results of the study was further extended until November 2022).
Year(s) Of Engagement Activity 2021
 
Description TB MAC meeting focusing on different aspects of country-level modelling and modelling the interplay between primary care/universal health coverage and TB 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The meeting was focusing on different aspects of country-level modelling and modelling the interplay between primary care/universal health coverage and TB. Sessions on country-level modelling included efforts to improve quality and transparency, data linking intervention activities to their epidemiological impact, economic modelling to support decision-making, the Global Funds key performance indicator around efficiency, and approaches to subnational TB burden estimation. This was our 10th TB MAC meeting and third joint TB MAC/WHO Task Force Annual Meeting, held on October 3-4, in Istanbul, Turkey. It brought together funders, modellers, economists and other members of the TB community for some productive discussions and interesting talks.
Presentation of co-investigator Ivdity Chikovani on challenges of TB financing in Georgia in the context of UHC. The presentation mentions ongoing study Results4TB to provide answers to some of the policy questions in TB financing
Year(s) Of Engagement Activity 2019
URL http://tb-mac.org/tb-mac-news/tb-mac-co-hosts-agm-on-modelling-the-epidemiology-and-or-economics-of-...
 
Description Third Steering Committee Meeting- Results4TB 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Third Steering Committee Meeting on the study interim outcomes has been conducted in January 2021. The meeting has covered intervention implementation challenges as well as those related to barriers due to Covid-19 epidemic. The meeting has been attended by study team members, policy maker- deputy minister of IDPs, Labour, Health and Social Affairs of Georgia, representatives of academia from local and international institutions, representative of community based organization and finally representative from the MRC/UKRI. The meeting outcome were recommendations on further steps and modification of activities planned
Year(s) Of Engagement Activity 2021
 
Description Training of healthcare providers in the intervention and control sites of the study 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Trainings for healthcare providers in 8 intervention and 8 control sites was conducted. The aim of training in the intervention sites was to establish a new model of provider results based payments and integrated care of Tuberculosis in the primary healthcare at the outpatient level. Two-day training was provided for the intervention facilities with participation from 15 to 20 participants per facility. Attendees were TB doctors, TB nurses, facility managers, family doctors, rural family doctors and rural nurses. In addition the TB doctors were trained on patient enrollment and basic data collection for the study.
Half day training for control facilities aimed to train TB doctors in patient enrollment and basic data collection for the study, in total 15 TB doctors were trained.
Year(s) Of Engagement Activity 2018,2019
 
Description Trial Data Monitoring Committee Meeting 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The Trial Data Monitoring Committee (DMC) has been composed of local experts in the field of public health and health systems research. Five external committee members and study team members (PI- Dr. Akaki Zoidze, Co-I- Dr. Ivdity Chikovani, Researchers - Ms. Karin Diaconu and Ms. Lela Sulaberidze and Project manager- Mrs. Maia Uchaneishvili) who are responsible for the trial component of the research attended the meeting. The role and responsibilities of the DMC have been defined as follows, to provide: Recommendations for pre/intermediate data analysis; Additional recommendations for data security; Request for a right to continue/suspend the research, taking into account the rights of the participants and the requirements of the security and Provide information to the Research Committee and Donor (MRC) if additional funding is needed. Committee discussed all above mentioned points and very preliminary outcomes of the study and no further recommendations have provided.
Year(s) Of Engagement Activity 2019