Heterogeneity in treatment effects: Can modelling techniques provide personalized prediction of treatment response and uncover groups of respondents?
Lead Research Organisation:
Lancaster University
Department Name: Mathematics and Statistics
Abstract
Randomized trials of novel drugs, health technologies and non-drug interventions are usually designed to test average treatment effects. In the analysis of these trials it is therefore typically assumed that treatment effects are constant across individuals. This strong assumption is often not supported by empirical evidence or the theories under-girding the intervention. While heterogeneity in intervention effects is often expected, the assessment of differential treatment effects is limited by available statistical methods.
This proposal aims to develop and compare two different statistical methods to investigate how these differential effect can best be identified and examines the ability of these approaches to predict an individual's response to treatment. The work will utilize three recently finished studies in three important medical areas: Stroke, epilepsy and physical activity which enables methodological work, simulations, and applied analyses to be carried out simultaneously creating a feedback loop in which methodological problems that arise in applied analyses are identified and then can be addressed through statistical and simulation work, improving each. The multidisciplinary research team includes experienced substantive experts for each study as well as methodologists with experience in statistical methods for randomized studies.
This proposal aims to develop and compare two different statistical methods to investigate how these differential effect can best be identified and examines the ability of these approaches to predict an individual's response to treatment. The work will utilize three recently finished studies in three important medical areas: Stroke, epilepsy and physical activity which enables methodological work, simulations, and applied analyses to be carried out simultaneously creating a feedback loop in which methodological problems that arise in applied analyses are identified and then can be addressed through statistical and simulation work, improving each. The multidisciplinary research team includes experienced substantive experts for each study as well as methodologists with experience in statistical methods for randomized studies.
Technical Summary
The proposed research aims to develop and examine two alternative approaches, each from a different methodological area, for assessing differential effects of treatments in individually randomized and group-randomized studies. The first approach for testing differential effects is inspired by ideas in causal modelling and involves the use of missing data techniques to create a predicted individual treatment effect (PITE) for each respondent. Particular focus will be given to the parametrization of the prediction model and incorporating uncertainty into predicted values. The second approach, regression mixture models, identifies latent classes of individuals who respond differently to a predictor (e.g. treatment), and then add covariates to understand why differential effects occur.
This proposal develops both methods for individually randomized studies and compares/contrasts the two approaches. Additionally, both approaches will be extended for use with group randomized trials (GRTs). Specific aims are to:
1. fully develop the PITE approach for individually randomized studies;
2. evaluate and contrast the efficacy of the different approaches for finding differential treatment effects in individually randomized studies;
3. extend and evaluate each of these approaches to allow for estimation of differential treatment effects in group-randomized trials;
4. develop open-source software and associated training tailored to applied statisticians working on randomized studies.
This proposal develops both methods for individually randomized studies and compares/contrasts the two approaches. Additionally, both approaches will be extended for use with group randomized trials (GRTs). Specific aims are to:
1. fully develop the PITE approach for individually randomized studies;
2. evaluate and contrast the efficacy of the different approaches for finding differential treatment effects in individually randomized studies;
3. extend and evaluate each of these approaches to allow for estimation of differential treatment effects in group-randomized trials;
4. develop open-source software and associated training tailored to applied statisticians working on randomized studies.
Planned Impact
In addition to academic beneficiaries, the work proposed in this grant will have great impact on others. By developing methodology for the identification of differential effects, we will allow methodology to catch up with the, often theoretically well understood, heterogeneity in treatment response and consequently create an empirical basis for these theories in substantive fields. This will also be of interest to scientists developing new interventions as the evidence for presence of differential effects is paramount to either develop a treatment further for a specific sub-group or alter the intervention to widen then pool of beneficiaries.
Undertaking a structured comparison for methods for identifying differential effects is highly relevant at the design stage as well as analysis stage of a study. At the design stage it allows the researcher to adapt the study design to the particular strength (and needs) of the method of choice. At the analysis stage an informed choice of method can either lead to increased power or more appropriate evaluation of the hypothesis under investigation.
Understanding the relevant drivers for differential effects will enhance the understanding of treatment mechanisms and is therefore particularly important for developing an existing intervention further or to develop a new, but related, intervention. Moreover, such understanding allows treatments to be designated to particular patient groups enabling more targeted therapy.
The ability to predict individual patient's response to treatment will be highly relevant for general practitioners as it empowers them to make an informed judgement about optimal treatment strategy on a patient level. This will subsequently lead to long-term patient benefit through evidence based personalized treatments.
Undertaking a structured comparison for methods for identifying differential effects is highly relevant at the design stage as well as analysis stage of a study. At the design stage it allows the researcher to adapt the study design to the particular strength (and needs) of the method of choice. At the analysis stage an informed choice of method can either lead to increased power or more appropriate evaluation of the hypothesis under investigation.
Understanding the relevant drivers for differential effects will enhance the understanding of treatment mechanisms and is therefore particularly important for developing an existing intervention further or to develop a new, but related, intervention. Moreover, such understanding allows treatments to be designated to particular patient groups enabling more targeted therapy.
The ability to predict individual patient's response to treatment will be highly relevant for general practitioners as it empowers them to make an informed judgement about optimal treatment strategy on a patient level. This will subsequently lead to long-term patient benefit through evidence based personalized treatments.
Publications
Ballarini NM
(2018)
Subgroup identification in clinical trials via the predicted individual treatment effect.
in PloS one
Chang C
(2021)
A permutation test for assessing the presence of individual differences in treatment effects.
in Statistical methods in medical research
Jaki T
(2019)
The Effects of Sample Size on the Estimation of Regression Mixture Models.
in Educational and psychological measurement
Lamont A
(2018)
Identification of predicted individual treatment effects in randomized clinical trials.
in Statistical methods in medical research
Description | NIHR Senior Research Fellowship |
Amount | £653,526 (GBP) |
Funding ID | SRF-2015-08-001 |
Organisation | National Institute for Health Research |
Sector | Public |
Country | United Kingdom |
Start | 01/2016 |
End | 12/2020 |
Description | Jeroen Vermunt |
Organisation | University of Tilburg |
Department | Department of Methodology and Statistics |
Country | Netherlands |
Sector | Academic/University |
PI Contribution | Joint research into differential treatment effects |
Collaborator Contribution | Input in general discussions around direction of work and specific comments on publications. |
Impact | Joint publications currently under review. |
Start Year | 2016 |
Description | Lee New Mexico |
Organisation | University of New Mexico |
Country | United States |
Sector | Academic/University |
PI Contribution | Joint research |
Collaborator Contribution | Novel methods for PITE |
Impact | Publications |
Start Year | 2014 |
Description | NWHTMR |
Organisation | University of Liverpool |
Department | Department of Biostatistics |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | Joint research and support in implementation of methods |
Collaborator Contribution | Joint research and implementation of methods |
Impact | Joint papers, funding applications |
Start Year | 2009 |
Description | Lee UNM workshop |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Workshop at University of New Mexico "Methods for assessing individual differences." |
Year(s) Of Engagement Activity | 2018 |
Description | Seminar Meduni Vienna |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Seminar Presentation at Medical University of Vienna |
Year(s) Of Engagement Activity | 2015 |
Description | Talk 1 at Modern Modeling Methods conference, Storrs, CT, USA |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Presentation"An imputation-based approach for predicting individual treatment effects." at Modern Modeling Methods conference, Storrs, CT, USA. |
Year(s) Of Engagement Activity | 2015 |
Description | Talk 2 at Modern Modeling Methods conference, Storrs, CT USA |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Presentation "A random forest approach to predicting individual treatment effects." at Modern Modeling Methods conference, Storrs, CT. |
Year(s) Of Engagement Activity | 2015 |
Description | Talk 3 at Modern Modeling Methods conference, Storrs, CT USA |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Presentation "Sample size requirements for imputation-based PITE" at Modern Modeling Methods conference, Storrs, CT USA |
Year(s) Of Engagement Activity | 2015 |
Description | Talk at UNM |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Professional Practitioners |
Results and Impact | Talk to Div. of Translational Informatics, Dept. of Internal Medicine, University of New Mexico |
Year(s) Of Engagement Activity | 2016 |