A mathematical modeling framework for tuberculosis burden estimation and economic evaluation of pharmaceutical interventions
Lead Research Organisation:
University of Sheffield
Department Name: Health and Related Research
Abstract
Tuberculosis (TB) is a major cause of disease and death globally. In 2015, WHO estimated there were 9.6 million TB cases and 1.5 TB deaths. Nearly 500,000 of these cases were resistant to two or more of the main drugs used to treat TB. New drugs, and combinations of drugs, are being developed to treat tuberculosis, as are new vaccines that may protect against disease in adults.
Quantifying the burden of TB is fundamental to understanding its global epidemiology and for making appropriate resource allocation decisions. Most estimates of new TB case numbers each year rely strongly on the number of cases reported by countries in that year to WHO. Unfortunately, one in three TB cases are thought to go either undetected or unreported, so the number of cases reported underestimates the number of new cases. While one can correct for this, it is hard to know exactly how much to adjust the reported numbers. Some countries have good systems for recording causes of deaths, which can be used to estimate the number of deaths caused by TB. Increasingly, large and expensive prevalence surveys are being used to estimate the number of people with active disease in a population. These estimates are less subject to bias, but measure a different quantity. Little work has explored the best way of combining these three data sources.
A major goal of this work is to use mathematical transmission models for burden estimation and provide a unified framework for all data. These models yield the number of new cases, deaths, and also the prevalence of disease. They explicitly represent disease transmission and so introduce a dependence between the number of new cases in different years. These models involve parameters evidenced from previous epidemiological work, but must be calibrated to learn from data on TB reports, deaths and prevalence. Calibration means adjusting imperfectly known model parameters in order to match observed model outputs to the data. This process provides a model that may be used to make predictions about burden, but may also teach us something about the underlying processes. Many of the parameters concerning the epidemiology and disease course of TB are quite uncertain, and this uncertainty is rarely represented fully in models needing calibration, but will be done in this project using statistical techniques that also allow comparison of different models' performance.
TB burden estimation and calibration of transmission models are almost always carried out on a country-by-country basis. Many parameters describing disease progression are likely to be similar in different countries, even if their exact values differ for unknown reasons. Hierarchical modelling techniques allow such parameters to be correlated between countries. This can improve precision, particularly for countries with little data, as estimates can be informed by data from neighbouring countries. I will explore these techniques for the transmission model, and also in statistical modelling aiming to account for the observed patterns of drug-resistance. The transmission model will ultimately be extended to include different types of drug resistance.
As new treatments and vaccines emerge, those with responsibility for public health will want to understand the potential impact these new technologies can have in terms of gains in health, and changes in spending. Producing cost-effectiveness and budget impact evidence requires a model that includes transmission, in order to account for indirect benefits accrued by avoiding secondary cases. We will use our model to provide guidance to decision-makers seeking to maximise health gain with limited resources. We will also analyse sources of uncertainty in the model to identify future research that would have most value in increasing the precision of burden estimates and in reducing decision uncertainty around the introduction of new interventions.
Quantifying the burden of TB is fundamental to understanding its global epidemiology and for making appropriate resource allocation decisions. Most estimates of new TB case numbers each year rely strongly on the number of cases reported by countries in that year to WHO. Unfortunately, one in three TB cases are thought to go either undetected or unreported, so the number of cases reported underestimates the number of new cases. While one can correct for this, it is hard to know exactly how much to adjust the reported numbers. Some countries have good systems for recording causes of deaths, which can be used to estimate the number of deaths caused by TB. Increasingly, large and expensive prevalence surveys are being used to estimate the number of people with active disease in a population. These estimates are less subject to bias, but measure a different quantity. Little work has explored the best way of combining these three data sources.
A major goal of this work is to use mathematical transmission models for burden estimation and provide a unified framework for all data. These models yield the number of new cases, deaths, and also the prevalence of disease. They explicitly represent disease transmission and so introduce a dependence between the number of new cases in different years. These models involve parameters evidenced from previous epidemiological work, but must be calibrated to learn from data on TB reports, deaths and prevalence. Calibration means adjusting imperfectly known model parameters in order to match observed model outputs to the data. This process provides a model that may be used to make predictions about burden, but may also teach us something about the underlying processes. Many of the parameters concerning the epidemiology and disease course of TB are quite uncertain, and this uncertainty is rarely represented fully in models needing calibration, but will be done in this project using statistical techniques that also allow comparison of different models' performance.
TB burden estimation and calibration of transmission models are almost always carried out on a country-by-country basis. Many parameters describing disease progression are likely to be similar in different countries, even if their exact values differ for unknown reasons. Hierarchical modelling techniques allow such parameters to be correlated between countries. This can improve precision, particularly for countries with little data, as estimates can be informed by data from neighbouring countries. I will explore these techniques for the transmission model, and also in statistical modelling aiming to account for the observed patterns of drug-resistance. The transmission model will ultimately be extended to include different types of drug resistance.
As new treatments and vaccines emerge, those with responsibility for public health will want to understand the potential impact these new technologies can have in terms of gains in health, and changes in spending. Producing cost-effectiveness and budget impact evidence requires a model that includes transmission, in order to account for indirect benefits accrued by avoiding secondary cases. We will use our model to provide guidance to decision-makers seeking to maximise health gain with limited resources. We will also analyse sources of uncertainty in the model to identify future research that would have most value in increasing the precision of burden estimates and in reducing decision uncertainty around the introduction of new interventions.
Technical Summary
The aim of this study is to develop methods to better understand the global burden of tuberculosis (TB), patterns of drug-resistance to TB, and the cost-effectiveness of new pharmaceutical interventions. I will build on my age- and gender-structured model of TB transmission, including HIV/ART, coded in fortran and R, and publicly available as a package. I will use a fully Bayesian inference framework, to calibrate the model to data including notification and vital registration data, and prevalence survey data, integrating over uncertainty in poorly identified parameters. Alternative models, including regression and time-series models of the temporal autocorrelation in incidence will be considered under the same model assumptions relating incidence to measured data. Bayesian model comparison techniques will be used to formally compare the fit of alternative models, and the potential benefit of model averaging in terms of improved out-of-sample predictive accuracy assessed. The model will be fitted in a hierarchical framework and any gains in performance assessed. The relative contribution of different data sources to estimates will be analysed and value-of-information analysis undertaken to identify data types and locations that would most reduce (decision) uncertainty. I will develop Bayesian hierarchical ecological multinomial regression models of the patterns and trends in all types of drug-resistance, having compiled a database of relevant country-level variables. I will incorporate drug-resistance in our transmission model, exploring emulation techniques and pragma-based use of accelerators to make this tractable. I will apply hierarchical regression techniques to cost data and extend our model to calculate disability adjusted life years and costs. I will perform cost-effectiveness, budget impact and health impact analyses of emerging pharmaceutical interventions for TB.
Planned Impact
Outputs on the burden of TB are likely to be of interest to a wide range of stakeholders. Methodology and results are likely to be directly useful to organizations involved in similar areas, namely WHO, Avenir Health and the Institute for Health Metrics and Evaluation. Burden results will be of interest to major donors in prioritising investment decisions, and to the countries themselves in identifying any reporting or performance gaps, in preparing concept notes for donors such as the Global Fund, and, potentially, for presenting additional evidence against results. Burden results will be of potential interest to advocates for TB or advocates for particular subgroups identified as receiving less attention. Work prioritising data collection for TB burden estimation will be of interest to those involved in coordinating such efforts at an international level. Understanding patterns of TB drug-resistance, their trends and determinants, will be of interest to epidemiologists, TB programme managers, as well as the manufacturers of anti-TB drugs and diagnostics capable of drug-sensitivity testing.
Results from cost-effectiveness analyses will be of interest to major donors, and national tuberculosis programme managers and Ministries of Health, but also to pharmaceutical companies developing such interventions, and advocates concerned with promoting research and development and market access for such products. Results from cost-effectiveness analyses in specific settings should inform decision-making, and have the potential for impact on the health and productivity of wider society through improved healthcare resource allocation.
The scientific advisory board for this project will include representation from bodies including the WHO and TB Alliance, ensuring that key stakeholders are aware of results arising from the study. Where possible, output data from the study will be made publicly available, and software implementing methods and the model will be made publicly available.
As a result of this project, I will further my skills in the epidemiology of TB and drug-resistant TB in particular, and model implementation and calibration. Through a mixture of formal training and learning-by-doing, I will also develop skills in hierarchical modelling, systematic review, and health economic evaluation, giving me a unique combination of skills for undertaking modelling and analysis to inform TB policy. I will also have developed a platform that can be updated and applied to the economic evaluation of interventions emerging from the pipeline, and further adapted to address additional questions. Interacting with and organising the scientific advisory board will enhance my professional and academic networks, and develop inter-personal and organizational skills. Planning and implementing a complex and long-term piece of work will strengthen my strategic thinking and project management skills, as will specific training courses planned in this area. I intend to develop PhD studentships, potentially in collaboration with the Wellcome Trust Doctoral Training Centre in ScHARR.
Results from cost-effectiveness analyses will be of interest to major donors, and national tuberculosis programme managers and Ministries of Health, but also to pharmaceutical companies developing such interventions, and advocates concerned with promoting research and development and market access for such products. Results from cost-effectiveness analyses in specific settings should inform decision-making, and have the potential for impact on the health and productivity of wider society through improved healthcare resource allocation.
The scientific advisory board for this project will include representation from bodies including the WHO and TB Alliance, ensuring that key stakeholders are aware of results arising from the study. Where possible, output data from the study will be made publicly available, and software implementing methods and the model will be made publicly available.
As a result of this project, I will further my skills in the epidemiology of TB and drug-resistant TB in particular, and model implementation and calibration. Through a mixture of formal training and learning-by-doing, I will also develop skills in hierarchical modelling, systematic review, and health economic evaluation, giving me a unique combination of skills for undertaking modelling and analysis to inform TB policy. I will also have developed a platform that can be updated and applied to the economic evaluation of interventions emerging from the pipeline, and further adapted to address additional questions. Interacting with and organising the scientific advisory board will enhance my professional and academic networks, and develop inter-personal and organizational skills. Planning and implementing a complex and long-term piece of work will strengthen my strategic thinking and project management skills, as will specific training courses planned in this area. I intend to develop PhD studentships, potentially in collaboration with the Wellcome Trust Doctoral Training Centre in ScHARR.
Publications
Alba S
(2022)
TB Hackathon: Development and Comparison of Five Models to Predict Subnational Tuberculosis Prevalence in Pakistan.
in Tropical medicine and infectious disease
Bond V
(2019)
Value and Limitations of Broad Brush Surveys Used in Community-Randomized Trials in Southern Africa.
in Qualitative health research
Burke RM
(2023)
Impact of Community-Wide Tuberculosis Active Case Finding and Human Immunodeficiency Virus Testing on Tuberculosis Trends in Malawi.
in Clinical infectious diseases : an official publication of the Infectious Diseases Society of America
Cardoso Pinto AM
(2022)
Disruptions to routine childhood vaccinations in low- and middle-income countries during the COVID-19 pandemic: A systematic review.
in Frontiers in pediatrics
Dale KD
(2020)
Estimating Long-term Tuberculosis Reactivation Rates in Australian Migrants.
in Clinical infectious diseases : an official publication of the Infectious Diseases Society of America
Dale KD
(2018)
Estimating the prevalence of latent tuberculosis in a low-incidence setting: Australia.
in The European respiratory journal
Dodd P
(2019)
HIV and Tuberculosis - A Formidable Alliance
| Description | GDG ACF presentation |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Description | Meeting of subgroup to discuss methods for estimating TB disease burden, Geneva, Switzerland, 11-12 May 2022 |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Contribution to new or improved professional practice |
| URL | https://www.who.int/groups/global-task-force-on-tb-impact-measurement/meetings/2022-05 |
| Description | Participant in WHO regional consultation on the management of tuberculosis in children and adolescents for high burden and priority countries in the African Region |
| Geographic Reach | Africa |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Description | Participation in Regional Workshop on Child and Adolescent Tuberculosis in the WHO European Region |
| Geographic Reach | Europe |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://www.euro.who.int/__data/assets/pdf_file/0006/444687/Child-and-adolescent-tuberculosis-eng.pd... |
| Description | Participation in WHO Consultation on the Classification of Intrathoracic Tuberculosis disease in Children aged 0-9 years |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Participation in a guidance/advisory committee |
| URL | https://www.who.int/publications/i/item/9789240046764 |
| Description | Participation in WHO guideline development group |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Participation in a guidance/advisory committee |
| URL | https://www.who.int/publications/i/item/9789240046764 |
| Description | Drug-resistant TB burden estimation |
| Amount | $43,725 (USD) |
| Organisation | The Global Alliance for TB Drug Development |
| Sector | Private |
| Country | Global |
| Start | 01/2018 |
| End | 11/2018 |
| Description | EDCTP |
| Amount | € 5,300,000 (EUR) |
| Organisation | University of Bordeaux |
| Sector | Academic/University |
| Country | France |
| Start | 03/2023 |
| End | 03/2027 |
| Description | European and Developing Countries Trials Partnership (EDCTP) |
| Amount | € 12,902,402 (EUR) |
| Funding ID | RIA2016S-1632 |
| Organisation | Sixth Framework Programme (FP6) |
| Department | European and Developing Countries Clinical Trials Partnership |
| Sector | Public |
| Country | Netherlands |
| Start | 03/2018 |
| End | 09/2021 |
| Description | INTEGRATING GENOMIC AND SPATIAL APPROACHES FOR TARGETED CONTROL OF HIV-ASSOCIATED TUBERCULOSIS EPIDEMICS |
| Amount | $870,052 (USD) |
| Funding ID | R01AI147854 |
| Organisation | National Institutes of Health (NIH) |
| Department | National Institute of Allergy and Infectious Diseases (NIAID) |
| Sector | Public |
| Country | United States |
| Start | 07/2020 |
| End | 07/2024 |
| Description | MRC Transition Support: A mathematical modelling framework for tuberculosis burden estimation and economic evaluation of pharmaceutical interventions. |
| Amount | £135,005 (GBP) |
| Funding ID | MR/W029227/1 |
| Organisation | Medical Research Council (MRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 08/2022 |
| End | 08/2023 |
| Description | ScHARRl research stimulation fund |
| Amount | £1,925 (GBP) |
| Organisation | University of Sheffield |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 03/2019 |
| End | 07/2019 |
| Description | UNITAID |
| Amount | $81,236,597 (USD) |
| Organisation | World Health Organization (WHO) |
| Department | UNITAID |
| Sector | Public |
| Country | Switzerland |
| Start | 03/2018 |
| End | 09/2021 |
| Title | Additional file 2 of Durations of asymptomatic, symptomatic, and care-seeking phases of tuberculosis disease with a Bayesian analysis of prevalence survey and notification data |
| Description | Additional file 2. TB prevalence survey characteristics |
| Type Of Material | Database/Collection of data |
| Year Produced | 2021 |
| Provided To Others? | Yes |
| Impact | Published at https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-021-02128-9 |
| URL | https://springernature.figshare.com/articles/dataset/Additional_file_2_of_Durations_of_asymptomatic_... |
| Title | Additional file 3 of Durations of asymptomatic, symptomatic, and care-seeking phases of tuberculosis disease with a Bayesian analysis of prevalence survey and notification data |
| Description | Additional file 3. Extracted data, 11 included settings |
| Type Of Material | Database/Collection of data |
| Year Produced | 2021 |
| Provided To Others? | Yes |
| Impact | Published at https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-021-02128-9 |
| URL | https://springernature.figshare.com/articles/dataset/Additional_file_3_of_Durations_of_asymptomatic_... |
| Title | Additional file 4 of Durations of asymptomatic, symptomatic, and care-seeking phases of tuberculosis disease with a Bayesian analysis of prevalence survey and notification data |
| Description | Additional file 4. Extracted data, Blantyre Malawi |
| Type Of Material | Database/Collection of data |
| Year Produced | 2021 |
| Provided To Others? | Yes |
| Impact | Published at https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-021-02128-9 |
| URL | https://springernature.figshare.com/articles/dataset/Additional_file_4_of_Durations_of_asymptomatic_... |
| Title | Additional file 5 of Durations of asymptomatic, symptomatic, and care-seeking phases of tuberculosis disease with a Bayesian analysis of prevalence survey and notification data |
| Description | Additional file 5. Extracted data, Kenya. TB prevalence data were from Enos et al. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2021 |
| Provided To Others? | Yes |
| Impact | Published at https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-021-02128-9 |
| URL | https://springernature.figshare.com/articles/dataset/Additional_file_5_of_Durations_of_asymptomatic_... |
| Title | Input data for post-TB analysis |
| Description | Input data for a post-TB analysis. See https://github.com/petedodd/post |
| Type Of Material | Database/Collection of data |
| Year Produced | 2020 |
| Provided To Others? | Yes |
| Impact | This analysis was published here https://www.thelancet.com/journals/laninf/article/PIIS1473-3099(20)30919-1/abstract |
| URL | https://zenodo.org/record/3989261 |
| Title | Multi-ancestry meta-analysis of host genetic susceptibility to tuberculosis identifies shared genetic architecture |
| Description | The heritability of susceptibility to tuberculosis disease (TB) has been well recognized. Over one-hundred genes have been studied as candidates for TB susceptibility, and several variants were identified by genome-wide association studies (GWAS), but few replicates. We established the International Tuberculosis Host Genetics Consortium (ITHGC) to perform a multi-ancestry meta-analysis of GWAS including 14,153 cases and 19,536 controls of African, Asian, and European ancestry. Our analyses demonstrate a substantial degree of heritability (pooled polygenic h2=26.3% 95% CI 23.7-29.0%) for susceptibility to TB that is shared across ancestries, highlighting an important host genetic influence on disease. We identified one global host genetic correlate for TB at genome-wide significance (p < 5x10-8) in the human leukocyte antigen (HLA)-II region (rs28383206, p-value = 5.2x10-9). These data demonstrate the complex shared genetic architecture of susceptibility to TB and the importance of large-scale GWAS analysis across multiple ancestries experiencing different levels of infection pressures. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2022 |
| Provided To Others? | Yes |
| Impact | Associated with this paper: https://elifesciences.org/articles/84394 Summary statistics are stored as compressed .zip files. Unzipped files can be opened with any text editor, Excel, or read into R programming environment (or equivalent data analysis software)' note the files are space-separated and have a header row. Each row in the files contains information for a single SNP. As well as the genomic data, this includede TB infection estimates from my work https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1002152 |
| URL | https://datadryad.org/dataset/doi:10.5061/dryad.6wwpzgn2s |
| Title | HEdtree |
| Description | An R package for developing, visualising and analysing decision tree models for health economics. |
| Type Of Technology | Software |
| Year Produced | 2017 |
| Open Source License? | Yes |
| Impact | Used in a paper that is currently in draft form. |
| URL | https://github.com/petedodd/HEdtree |
| Title | R package for paediatric TB modelling |
| Description | An R package for modelling paediatric TB progression and outcomes. |
| Type Of Technology | Software |
| Year Produced | 2019 |
| Open Source License? | Yes |
| Impact | NA |
| URL | https://github.com/petedodd/ptbcore |
| Title | mvregerr |
| Description | R package for Bayesian multivariate regression including known measurement error. |
| Type Of Technology | Software |
| Year Produced | 2017 |
| Open Source License? | Yes |
| Impact | In use in a manuscript currently in preparation. |
| URL | https://github.com/petedodd/mvregerr |
