Heterogeneity in treatment effects: Can modelling techniques provide personalized prediction of treatment response and uncover groups of respondents?

Lead Research Organisation: Lancaster University
Department Name: Mathematics and Statistics

Abstract

Randomized trials of novel drugs, health technologies and non-drug interventions are usually designed to test average treatment effects. In the analysis of these trials it is therefore typically assumed that treatment effects are constant across individuals. This strong assumption is often not supported by empirical evidence or the theories under-girding the intervention. While heterogeneity in intervention effects is often expected, the assessment of differential treatment effects is limited by available statistical methods.

This proposal aims to develop and compare two different statistical methods to investigate how these differential effect can best be identified and examines the ability of these approaches to predict an individual's response to treatment. The work will utilize three recently finished studies in three important medical areas: Stroke, epilepsy and physical activity which enables methodological work, simulations, and applied analyses to be carried out simultaneously creating a feedback loop in which methodological problems that arise in applied analyses are identified and then can be addressed through statistical and simulation work, improving each. The multidisciplinary research team includes experienced substantive experts for each study as well as methodologists with experience in statistical methods for randomized studies.

Technical Summary

The proposed research aims to develop and examine two alternative approaches, each from a different methodological area, for assessing differential effects of treatments in individually randomized and group-randomized studies. The first approach for testing differential effects is inspired by ideas in causal modelling and involves the use of missing data techniques to create a predicted individual treatment effect (PITE) for each respondent. Particular focus will be given to the parametrization of the prediction model and incorporating uncertainty into predicted values. The second approach, regression mixture models, identifies latent classes of individuals who respond differently to a predictor (e.g. treatment), and then add covariates to understand why differential effects occur.

This proposal develops both methods for individually randomized studies and compares/contrasts the two approaches. Additionally, both approaches will be extended for use with group randomized trials (GRTs). Specific aims are to:

1. fully develop the PITE approach for individually randomized studies;
2. evaluate and contrast the efficacy of the different approaches for finding differential treatment effects in individually randomized studies;
3. extend and evaluate each of these approaches to allow for estimation of differential treatment effects in group-randomized trials;
4. develop open-source software and associated training tailored to applied statisticians working on randomized studies.

Planned Impact

In addition to academic beneficiaries, the work proposed in this grant will have great impact on others. By developing methodology for the identification of differential effects, we will allow methodology to catch up with the, often theoretically well understood, heterogeneity in treatment response and consequently create an empirical basis for these theories in substantive fields. This will also be of interest to scientists developing new interventions as the evidence for presence of differential effects is paramount to either develop a treatment further for a specific sub-group or alter the intervention to widen then pool of beneficiaries.

Undertaking a structured comparison for methods for identifying differential effects is highly relevant at the design stage as well as analysis stage of a study. At the design stage it allows the researcher to adapt the study design to the particular strength (and needs) of the method of choice. At the analysis stage an informed choice of method can either lead to increased power or more appropriate evaluation of the hypothesis under investigation.

Understanding the relevant drivers for differential effects will enhance the understanding of treatment mechanisms and is therefore particularly important for developing an existing intervention further or to develop a new, but related, intervention. Moreover, such understanding allows treatments to be designated to particular patient groups enabling more targeted therapy.
The ability to predict individual patient's response to treatment will be highly relevant for general practitioners as it empowers them to make an informed judgement about optimal treatment strategy on a patient level. This will subsequently lead to long-term patient benefit through evidence based personalized treatments.

Publications

10 25 50
 
Description NIHR Senior Research Fellowship
Amount £653,526 (GBP)
Funding ID SRF-2015-08-001 
Organisation National Institute for Health Research 
Sector Public
Country United Kingdom
Start 01/2016 
End 12/2020
 
Description Jeroen Vermunt 
Organisation University of Tilburg
Department Department of Methodology and Statistics
Country Netherlands 
Sector Academic/University 
PI Contribution Joint research into differential treatment effects
Collaborator Contribution Input in general discussions around direction of work and specific comments on publications.
Impact Joint publications currently under review.
Start Year 2016
 
Description Lee New Mexico 
Organisation University of New Mexico
Country United States 
Sector Academic/University 
PI Contribution Joint research
Collaborator Contribution Novel methods for PITE
Impact Publications
Start Year 2014
 
Description NWHTMR 
Organisation University of Liverpool
Department Department of Biostatistics
Country United Kingdom 
Sector Academic/University 
PI Contribution Joint research and support in implementation of methods
Collaborator Contribution Joint research and implementation of methods
Impact Joint papers, funding applications
Start Year 2009
 
Description Lee UNM workshop 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Workshop at University of New Mexico "Methods for assessing individual differences."
Year(s) Of Engagement Activity 2018
 
Description Seminar Meduni Vienna 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Seminar Presentation at Medical University of Vienna
Year(s) Of Engagement Activity 2015
 
Description Talk 1 at Modern Modeling Methods conference, Storrs, CT, USA 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentation"An imputation-based approach for predicting individual treatment effects." at Modern Modeling Methods conference, Storrs, CT, USA.
Year(s) Of Engagement Activity 2015
 
Description Talk 2 at Modern Modeling Methods conference, Storrs, CT USA 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentation "A random forest approach to predicting individual treatment effects." at Modern Modeling Methods conference, Storrs, CT.
Year(s) Of Engagement Activity 2015
 
Description Talk 3 at Modern Modeling Methods conference, Storrs, CT USA 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentation "Sample size requirements for imputation-based PITE" at Modern Modeling Methods conference, Storrs, CT USA
Year(s) Of Engagement Activity 2015
 
Description Talk at UNM 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Talk to Div. of Translational Informatics, Dept. of Internal Medicine, University of New Mexico
Year(s) Of Engagement Activity 2016