Evaluating effects of complex treatments in chronic disease using large observational datasets

Lead Research Organisation: London School of Hygiene & Tropical Medicine
Department Name: Epidemiology and Population Health

Abstract

Patients with chronic conditions and their carers face difficult questions about the effects of treatments: What are the long-term effects of multiple treatments used in combination? What are the expected health outcomes for a given patient under different treatment choices? Randomized controlled trials are the gold standard for estimating treatment effects, but their ability to answer complex questions is limited. They are typically restricted to a subset of the eventual treatment population, have short follow-up, usually do not consider several treatments in combination, and can be unethical. Large longitudinal observational datasets from disease registries and electronic health records provide the means to gain understanding of treatment effects that would not be feasible in a trial. However, to do this we have to successfully overcome the fundamental difficulty that those who received a given treatment were prescribed it for a reason, and hence the groups who do and do not receive treatment are not directly comparable. How to handle this is a highly active area of research.

This fellowship will develop and evaluate statistical methods needed to address key questions about the effects of treatments on health outcomes using large observational datasets. It will also tackle crucial questions about the effects of treatments on health outcomes for patients with cystic fibrosis (CF) using data from the UK CF Registry. CF is an inherited, chronic, progressive, and life-shortening condition affecting about 10,000 in the UK. People with CF need intensive treatment and support from health services and families. The UK CF Registry captures data on nearly all UK CF approximately annually and the data contain demographic information, information on treatments used, clinical measurements, and dates of birth, diagnosis and death.

Key statistical advancements will include methods enabling estimation of the effects of multiple treatments used in combination on health outcomes; methods for answering questions about the impact of a one-time major intervention (e.g. lung transplantation) on survival in a way that is most relevant to patients and clinicians; and methods for providing personalised information to patients about their expected outcomes under different treatment choices.

Patients with CF take many treatments daily, which is time consuming and unpleasant. Questions addressed in this fellowship will focus on those that could help reduce treatment burden and help patients and clinicians in making treatment decisions. We will investigate the impact of three commonly used treatments on lung function, and whether existing treatments are redundant in patients receiving Ivacaftor, which is a major new treatment in CF since 2012 and effective for patients with a certain genotype. Another key question will be about the impact of lung transplantation on survival in CF. This research will provide personalised information for patients about what their expected survival would be should they choose to be listed for lung transplant or not.

In the second part of the fellowship, I will study the impact of treatments on health outcomes in other chronic disease areas of major public health importance, including type 2 diabetes, using the Clinical Practice Research Database (CPRD). CPRD is a database of over 11 million patients in the UK, obtained from General Practitioner records. It will be important to react to new questions arising in CF and in other chronic diseases. Further statistical developments will be an ongoing focus.

This research will be led by the Future Leaders Fellow with assistance from a postdoctoral researcher. The host institution is the London School of Hygiene and Tropical Medicine. The Cystic Fibrosis Trust, a UK-wide charity, is a Project Partner. Several collaborators will provide expert input: they include statisticians, clinicians, and patient representatives.

Planned Impact

This fellowship will develop novel statistical methodology for estimation of treatment effects from routinely collected observational data, enabling effective exploitation of the wealth of computerised clinical data that is increasingly available. It will provide answers to key questions about treatment effects in cystic fibrosis (CF) by making use of longitudinal observational data from the UK CF Registry.

Immediate beneficiaries will be statisticians, epidemiologists and data scientists working with observational data and those working on statistical methodology for causal inference. The proposed methodology will be developed with practical applicability in mind and publications will be aimed at both statistical and applied audiences. Computer code, using the open source R software, will be made freely available, facilitating uptake. Findings will be communicated via presentations at international conferences and smaller focused workshops. Invited conference sessions will be proposed in years 3 and beyond and a high profile symposium is planned for the end of year 3. A wide audience will be reached via the networks of the LSHTM Centre for Statistical Methodology and the International Biometric Society. Dissemination via local networks at the host institution and collaborators will be used to encourage uptake of the methods during the lifetime of the project.

The applied results from this fellowship will be of direct benefit to patients with chronic diseases and their doctors. The first beneficiaries will be in the CF community. Results will include new information about combined treatment effects and information for the first time about the impact of withdrawing existing treatments for patients who are using a new disease-modifying drug. This has the potential to reduce treatment burden and to impact on health care policy and spending. This project will result for the first time in answers to key questions about the impact of lung transplantation on survival for CF patients in the UK, with a focus on providing information in the most relevant way for patents and clinicians. Collaborators include CF clinicians who are best placed to influence putting findings into clinical practice. Input from patient advisors will ensure that results are communicated appropriately. The wider UK and international clinical audience will be reached via publications and presentations at the UK, European and US CF Conferences. The CF Trust, which is a Project Partner, is in an ideal position to communicate findings to a wide audience, via its website and social media, and international influence. In the longer term, our personalised information about treatment effects could be incorporated into clinical practice. In a current project in collaboration with the CF Trust I am investigating approaches to how personalised information on predicted survival can be presented to doctors and patients. Experiences from that will inform this project.

This project will positively impact the UK CF Registry and the UK Transplant Registry, by placing them at the forefront of research into learning about treatment effects from registry data. Our results will motivate continued support for the registries from patients and health carers and encourage use of the registries for further research. Uptake of the methods in other national CF registries is anticipated within the lifetime of the project. Linked data will create a future resource for new studies about transplant in CF.

Research outputs will also include novel findings about treatment effects in other chronic diseases, including type 2 diabetes, using the Clinical Practice Research Database. The results will be communicated through traditional routes of publications and conference presentations. Discoveries with the potential for major public health impacts can influence public trust in their data being used for research.

Publications

10 25 50

publication icon
Granger E (2022) Treatment patterns in people with cystic fibrosis: have they changed since the introduction of ivacaftor? in Journal of cystic fibrosis : official journal of the European Cystic Fibrosis Society

 
Description This award has resulted in new statistical methods in causal inference and in novel findings in the field of cystic fibrosis (CF).

I have developed statistical methodology for using simulated data to evaluate the performance of different statistical methods for estimating the effects of treatments using observational data. I have developed open access code for implementing these methods which is available in a github repository. The corresponding paper has been published in the Biometrical Journal (2021). I have also worked extensively on statistical methods for estimating effects of treatment using longitudinal observational data using a particular approach called the "sequential trials approach", which makes efficient use of patient data collected longitudinally. I have shown how this method relates to alternative methods and how, under certain assumptions, it can provide more precise estimates of treatment effects. The paper relating to this work is under review and R code for implementing the methods has been provided in a github repository. The work has also been presented at several invited seminars. Thirdly, I have developed methodology for estimating the impact of organ transplant on survival, and this work has been presented at several conferences and invited seminars. These methods will be applied to the motivating question of the impact of lung transplant on survival for people with cystic fibrosis. To facilitate this investigation I am working towards linkage of two national datasets - the Cystic Fibrosis Registry and the NHS Blood & Transplant Cardiothoracic Transplant Registry. NHS approval for this project has been achieved and I await the linkage to be performed by NHS Digital. In 2019 I formed the Cystic Fibrosis Transplant Research Group, which brings together clinicians, data experts, researchers, and policy makers to study issues relating to the use of data and modern analytical methods to study the impact of lung transplant in cystic fibrosis.

I and my team have worked extensively on research using data from the UK Cystic Fibrosis Registry, with a focus on treatment burden and impacts of new disease modifying treatments called CFTR modulators. This has included a study in which we have shown that use of commonly used treatments in CF had declined following the introduction of CFTR modulators (published in Journal of Cystic Fibrosis 2021). We have also shown how observational data can be used to robustly estimate effects of newly introduced treatments when all individuals meeting certain criteria (e.g. defined by genotype) receive the new treatment, and applied these methods to provide evidence that CFTR modulators improve key health outcomes for people with CF (published in American Journal of Epidemiology 2022). The newest CFTR modulator treatment, for which a large proportional of the UK CF population is eligible, was introduced in the UK in late 2020. We used statistical modelling to project the potential long term impact of this treatment on reduced requirement for intravenous antibiotics for people with CF (published in Thorax 2021). This work has also demonstrated how information from randomized trials and patient registries can be used in combination. The research in CF conducted through this award has been presented widely to clinical, patient, and academic audiences at conferences, workshops, and an international masterclass.
Exploitation Route Code has been developed to help researchers to robustly and fairly evaluate the performance of different statistical methods for estimating the effects of treatments using observational data. I have developed open access code for implementing these methods which is available in a github repository (https://github.com/ruthkeogh/causal_sim). This can be used by others to evaluate new and existing methods, and to assess performance of methods under different scenarios.

Code developed for implementing and evaluating the performance of the sequential trials approach for estimating treatment effects on survival using observational data is available in a github repository (https://github.com/ruthkeogh/sequential_trials). This has wide ranging applications, and I have initiated collaborations with researchers using electronic health records to apply these methods elsewhere.

The work conducted on treatment burden in people with CF who have initiated a CFTR modulator treatment is leading to further work to study the benefits of use of existing treatments in these patients.

The QCovid risk tool has been used by UK policy makers to identify people at high risk of severe outcomes from Covid-19, and to inform an expanded shielding list. The tool can also be used by members of the public to assess their risk of severe outcomes from Covid-19 (https://qcovid.org/).

The outcomes from the Cystic Fibrosis Transplant Research Group in the remainder of the award will be used to provide patients and health care teams with information that helps them to make important clinical and life decisions. It could also be used to inform policy on organ allocation.
Sectors Digital/Communication/Information Technologies (including Software),Healthcare

URL https://github.com/ruthkeogh/causal_sim,https://qcovid.org/,https://digital.nhs.uk/coronavirus/risk-assessment
 
Description The QCovid risk tool has been used by UK policy makers to identify people at high risk of severe outcomes from Covid-19, and to inform an expanded shielding list. The tool can also be used by members of the public to assess their risk of severe outcomes from Covid-19. Our results concerning the association of the new Covid variant with increased mortality risk has informed government policy.
First Year Of Impact 2020
Sector Healthcare
Impact Types Societal

 
Description QCOVID research group
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
Impact The QCOVID model is an evidence-based risk prediction model that estimates a person's combined risk of catching coronavirus and being admitted to hospital catching coronavirus and dying. An online tool was created (https://qcovid.org/). The model is being used at a national level to identify people at high risk and has been made available publicly through an NHS app (https://digital.nhs.uk/coronavirus/risk-assessment). The QCOVID algorithm has been used to identify an updated Covid-19 shielding list, resulting in many more people being recommended to shield in early 2021. Updates have also been published, which extend to the risk prediction model to the UK vaccinated population.
URL https://digital.nhs.uk/coronavirus/risk-assessment
 
Description SPI-M: evidence on new variant
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
Impact I provided senior statistical input to an investigation of he impact of the new Covid variant B1.1.7 detected in the UK in late 2020 on mortality. This work was led my Nick Davies, LSHTM, in collaboration with the Centre for Mathematical Modelling. The investigation made use of large-scale data on Covid-19 testing from Public Health England. We were the first to report the potential increased risk of mortality with the new variant at a meeting of the SPI-M committee in January 2021. The finding was then further investigated using additional data, and also further investigated and confirmed by other groups. The results were announced by the Prime Minister in a press conference and widely reported in the media. A preprint of this work is available on Medrxiv. Davies et al. 2021 "Increased hazard of death in community-tested cases of SARS-CoV-2 Variant of Concern 202012/01" https://www.medrxiv.org/content/10.1101/2021.02.01.21250959v1.
URL https://www.gov.uk/government/publications/nervtag-paper-on-covid-19-variant-of-concern-b117
 
Description Looking beyond the mean: what within-person variability can tell us about dementia, cardiovascular disease and cystic fibrosis
Amount £486,957 (GBP)
Funding ID MR/V020595/1 
Organisation Medical Research Council (MRC) 
Sector Public
Country United Kingdom
Start 09/2021 
End 03/2024
 
Description NIHR Doctoral Fellowship
Amount £1 (GBP)
Funding ID NIHR302287 
Organisation National Institute for Health Research 
Sector Public
Country United Kingdom
Start 04/2022 
End 03/2025
 
Description NIHR Pre-doctoral Fellowship
Amount £1 (GBP)
Funding ID NIHR302010 
Organisation National Institute for Health Research 
Sector Public
Country United Kingdom
Start 09/2021 
End 08/2023
 
Title QCovid 
Description QCovid is an evidence-based model that uses a range of factors such as age, sex, ethnicity and existing medical conditions to predict risk of death or hospitalisation from COVID-19. It provides nuanced information on people's risk of serious illness due to COVID-19 and has the potential to help patients and doctors reach a shared understanding of risk. It is a 'living' risk prediction model which will be updated regularly as our understanding of COVID-19 increases and more data become available. The model is available as an online tool at: https://qcovid.org/. 
Type Of Material Computer model/algorithm 
Year Produced 2020 
Provided To Others? Yes  
Impact In collaboration with the University of Oxford and several other UK institutions, I was part of the research group that developed the QCOVID risk prediction algorithm, which was commissioned by the Department of Health. The group was lead by Julia Hippisley-Cox (Oxford). The QCOVID model is an evidence-based risk prediction model that estimates a person's combined risk of catching coronavirus and being admitted to hospital catching coronavirus and dying. An online tool was created (https://qcovid.org/). The model is being used at a national level to identify people at high risk. The QCOVID algorithm has been used to identify an updated Covid-19 shielding list, resulting in many more people being recommended to shield in early 2021. The prediction model was published (see publications): Clift, Coupland, Keogh et al 2020. "Living risk prediction algorithm (QCOVID) for risk of hospital admission and mortality from coronavirus 19 in adults: national derivation and validation cohort study". https://www.bmj.com/content/371/bmj.m3731. My role was to provide statistical input to the development of the model. 
URL https://qcovid.org/
 
Description CF Transplant research group 
Organisation Cystic Fibrosis Trust
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution I formed a working group of researchers, clinicians and data providers to facilitate research into lung transplantation in cystic fibrosis.
Collaborator Contribution Partners contributed expertise in data linkage; clinical knowledge and statistical knowledge.
Impact This collaboration is multidisciplinary and includes clinicians and statisticians from several institutions, and data providers.
Start Year 2019
 
Description CF Transplant research group 
Organisation NHS Blood and Transplant (NHSBT)
Country United Kingdom 
Sector Public 
PI Contribution I formed a working group of researchers, clinicians and data providers to facilitate research into lung transplantation in cystic fibrosis.
Collaborator Contribution Partners contributed expertise in data linkage; clinical knowledge and statistical knowledge.
Impact This collaboration is multidisciplinary and includes clinicians and statisticians from several institutions, and data providers.
Start Year 2019
 
Description CF Trial Emulation Network 
Organisation University College London
Department Great Ormond Street Institute of Child Health
Country United Kingdom 
Sector Public 
PI Contribution In early 2023 I established the CF Trial Emulation Network in collaboration with Dr Gwyneth Davies (UCL Great Ormond Street Institute of Child Health), who is a clinician and also a UKRI Future Leaders Fellow. Dr Davies and I co-lead this international collaborative group.
Collaborator Contribution Dr Gwyneth Davies (UCL Great Ormond Street Institute of Child Health) co-leads this group with me. The group includes members from several other institutions including: UK Cystic Fibrosis Trust, US Cystic Fibrosis Foundation, University of Cincinnati, Seattle Children's.
Impact The aim of the CF Trial Emulation Network is to investigate the feasibility and validity of the trial emulation approach and other causal inference methods in cystic fibrosis to gain understanding of treatment effects using observational data from international patient registries. The group is multidisciplinary and currently has 13 members from the UK and US, including clinicians, statisticians, epidemiologists and data experts. The group meets approximately monthly. There no published outputs from the group yet. Current projects include: (1) a position paper from the group, (2) undertaking a trial emulation for an existing randomized controlled trial, (3) proposing a session for an international conference.
Start Year 2023
 
Description Collaboration with Department of Biostatistics, Cincinnati Children's Hospital. 
Organisation Cincinnati Children's Hospital Medical Center
Country United States 
Sector Hospitals 
PI Contribution I am involved in a collaboration with Dr Rhonda Szczesniak, Associate Professor at the above Institution. We are working together on several research projects currently in preparation for publication. I have contributed statistical expertise and knowledge and experience of data sets to this collaboration.
Collaborator Contribution Dr Rhonda Szczesniak contributes statistical expertise and knowledge and experience of data sets to this collaboration.
Impact Several papers are in preparation. Dr Szczesniak and I have proposed an invited conference session.
Start Year 2016
 
Description STRATOS Initiative member 
Organisation STRengthening Analytical Thinking for Observational Studies (STRATOS) Initiative
Country Global 
Sector Public 
PI Contribution The STRATOS Initiative is a large collaboration of experts in many different areas of biostatistical research. The objective of STRATOS is to provide accessible and accurate guidance in the design and analysis of observational studies. I am an expert member of the 'measurement error and misclassification' topic group. I participate in regular telephone meetings of the group. I have contributed as an author to three tutorial/review papers - one has been pblished (Shaw et al 2018), and two are under review. I have contributed to an international workshop and a conference symposium organised by the STRATOS Initiative. In 2018 I was appointed to the executive committee of STRATOS as a co-chair.
Collaborator Contribution The STRATOS Initiative organised a week-long workshop at the Banff International Research Station, Canada (July 2016) - I attended this free of charge. The Initative provides links with international experts on a range of topics in statistics and epidemiology.
Impact Workshop presentation at the STRATOS Initiative 1st group meeting (Banff, July 2016). Symposium presentation at the ISCB Conference, 2016. Invited session presentation at the Royal Statistical Society Conference, 2018.
Start Year 2015
 
Title R code for implementation of the sequential trials approach 
Description R code for implementation of the simulation study described in the paper: "Causal inference in survival analysis using longitudinal observational data: Sequential trials and marginal structural models" 
Type Of Technology Software 
Year Produced 2021 
Open Source License? Yes  
Impact This software has recently been released. 
URL https://arxiv.org/abs/2110.03117
 
Title R code: Simulating longitudinal data from marginal structural models 
Description R files for implementation of the simulation methods described in the preprint paper: Keogh RH, Seaman SR, Gran JM, Vansteelandt S. Simulating longitudinal data from marginal structural models using the additive hazards model. 2020. https://arxiv.org/abs/2002.03678 The code is provided on github: https://github.com/ruthkeogh/causal_sim This is also discoverable through the LSHTM Data Compass: https://datacompass.lshtm.ac.uk/1566/ 
Type Of Technology Software 
Year Produced 2020 
Open Source License? Yes  
Impact This software has just been released. 
URL https://arxiv.org/abs/2002.03678
 
Description Biometric Society Workshop Oct 2019 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Organiser of a half-day workshop on the topic: "New perspectives on studying the effects of treatment on a time to event outcome". Hosted by the Biometric Society and Centre for Statistical Methodology, London School of Hygiene & Tropical Medicine.

I also gave a talk at this event on the topic of "Using sequential trials to estimate treatment effects in longitudinal observational data, with an application in cystic fibrosis".
Year(s) Of Engagement Activity 2019
URL https://biometricsociety.org.uk/events/new-perspectives
 
Description CMS Statistics 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I gave an invited talk at the International Conference on Computational and Methodological Statistics 2021 in a session on the theme of statistical methods in Covid research. The topic of my talk was "Estimating length of stay in a multi-state model conditional on the pathway, with application to patients with Covid-19". The session included questions and discussion.
Year(s) Of Engagement Activity 2021
URL http://www.cmstatistics.org/CMStatistics2021/
 
Description CSM seminar 2020 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Centre for Statistical Methodology seminar on the topic of "Routes taken and length of stay after hospital admission with COVID 19: Results and statistical challenges.".This was a joint talk with my collaborator Karla Diaz-Ordaz (LSHTM). The talk was followed by discussion and questions. The talk was an opportunity to present results form analyses of national data on individuals hospitalised due to Covid-19, in addition to work on development of new methodology.
Year(s) Of Engagement Activity 2020
URL https://www.lshtm.ac.uk/newsevents/events/routes-taken-and-length-stay-after-hospital-admission-covi...
 
Description Cardiff University 2021 Target Trials 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact I gave a talk for the Cardiff University, Division of population Medicine seminar series. The topic was "Emulating a target trial: estimating causal effects using observational data". The talk was a tutorial on the topic of target trials aimed at researchers and clinicians in the hosting institution. The event was attended by 50 people and was followed by questions and discussion. I was contacted to share slides after the event.
Year(s) Of Engagement Activity 2021
 
Description Cystic Fibrosis Medical Association 2021 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Patients, carers and/or patient groups
Results and Impact I gave an invited talk at the Annual Meeting of the UK Cystic Fibrosis Medical Association on the topic of "Using registry data to study the impact of CFTR modulators on clinical outcomes and treatment use.". The audience of 75 was primarily CF clinicians.
Year(s) Of Engagement Activity 2021
 
Description Dutch Biometric Society symposium 2020 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact This was an event of the Dutch Biometric Society ("Biostatistics Kaleidoscope") to celebrate the Hans Van Houwelingen Award - I was the chair of the jury for this award. My talk was entitled "Using sequential target trials to estimate causal effects of treatments from longitudinal observational data." and the event included two other speakers.
Year(s) Of Engagement Activity 2020
URL https://www.vvsor.nl/biometrics/events/biostatistics-kaleidoscope/
 
Description ECFS 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Poster presentation at the virtual European Cystic Fibrosis Conference in 2021. The poster was titled "Estimating the long-term effects of insulin use on health outcomes in cystic fibrosis-related diabetes".
Year(s) Of Engagement Activity 2021
 
Description ECFS 2021 - Presentation 2 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact European Cystic Fibrosis Conference 2021. I gave a talk titled "Treatment patterns in people with cystic fibrosis: have they changed since the introduction of ivacaftor?" in a session on the topic "Clinical and treatment outcomes: data from Registry". This talk was followed by questions and discussion.
Year(s) Of Engagement Activity 2021
 
Description ECFS 2021 - talk 1 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact European Cystic Fibrosis Conference 2021. I gave a talk titled "An investigation of the effect of ivacaftor on survival using UK cystic fibrosis registry data" in a session on the topic "Clinical and treatment outcomes: data from Registry studies". This was a virtual conference and y talk was attended by 260 participants. The talk was followed by several questions and discussion. As a result I received two invitations to give talks at other events: (1) at the German CF Patient and Caregiver Organization conference; (2) for a Nordic Cystic Fibrosis Masterclass.
Year(s) Of Engagement Activity 2021
URL https://www.ecfs.eu/digital2021
 
Description ECFS 2021 - talk 2 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact European Cystic Fibrosis Conference 2021. I gave a talk titled "Impact of triple therapy on IV antibiotic requirements in cystic fibrosis: combing evidence from a patient registry and randomised trials". This was a virtual conference and my talk was attended by 260 participants. The talk was followed by questions and discussion. Questions arose about the inplications of the findings presented and impact that Covid may have on the use of the results in the future.
Year(s) Of Engagement Activity 2021
URL https://www.ecfs.eu/digital2021
 
Description ECFS 2022 invited session 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact This was an invited talk given at the European Cystic Fibrosis Society Conference, held in Rotterdam (Netherlands) in June 2022. The talk was in a session on the topic of "Ageing with Cystic Fibrosis". The session comprised four talks, and I presented a talk on the topic "The evolving age profile of people with cystic fibrosis: a view to the future.". The session was attended by a large audience, primarily made up of clinicians and researchers in cystic fibrosis. The talk was followed by questions from the audience, and there was subsequent discussion, including about applying the methodology presented to other data sources. This annual conference is attended by over 2000 international delegates.
Year(s) Of Engagement Activity 2022
URL https://www.ecfs.eu/rotterdam2022
 
Description ECFS2022 - Oral presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a talk given at the European Cystic Fibrosis Society Conference, held in Rotterdam (Netherlands) in June 2022. The talk was in a session on the topic of "Factors influencing lung function and survival". I presented a talk on the topic ""Investigating the effects of dornase alfa and hypertonic saline used in combination on lung function in people with cystic fibrosis". The session was attended by clinicians and researchers in cystic fibrosis and the talk was followed by questions from the audience, particularly regarding the use of registry data to answer questions about the effectiveness of treatments in cystic fibrosis.
Year(s) Of Engagement Activity 2022
URL https://www.ecfs.eu/rotterdam2022
 
Description EUROCIM 2020 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact European Causal Inference Meeting 2020 (virtual). Contributed conference talk entitled: "of a target trial to investigate causal effects of organ transplantation on survival."
Year(s) Of Engagement Activity 2020
 
Description EUROCIM 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I gave a talk on the topic "Estimating treatment effects on survival in an entirely treated cohort" for the European Causal Inference Meeting 2021. This was a virtual meeting and my talk was attended by 150 participants. The talk was followed by questions and discussion, and I received follow-up questions by email from two participants.
Year(s) Of Engagement Activity 2021
 
Description EuroCIM 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact European Causal Inference Meeting 2021. I gave a talk titled "Estimating the effects of multi-level exposures on outcomes using longitudinal data: a simulation study" in a session on longitudinal analyses. This presentation sparked questions and discussion afterwards.
Year(s) Of Engagement Activity 2021
 
Description German CF Patient and Caregiver Organization 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact I gave an invited talk at the German Cystic Fibrosis Patient and Caregiver Organization conference 2021 on the topic "Estimating survival in CF using national registry data: how it works and some challenges". This was a tutorial about the use of patient registry data in studies aiming to estimate life expectancy of people with cystic fibrosis. The audience was primarily clinicians, scientists, and patient representative organisations.
Year(s) Of Engagement Activity 2021
 
Description IBC 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a contributed talk at the International Biometric Conference (IBC), which took place in Riga, Latvia, in June 2022. I gave a talk on the topic "Validation of counterfactual risk prediction models". The session was very well attended and was followed by questions and discussion.
Year(s) Of Engagement Activity 2022
URL https://www.ibc2022.org/home
 
Description ISCB 2020: invited talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact International Society of Clinical Biostatistics conference 2020 (virtual). I gave an invited talk in a session on the topic of "Efficient Designs & cutting-edge analyses". My talk was entitled: "Using negative controls to estimate causal effects of treatment in an entirely treated cohort.". The session was organised by Mitchell H. Gail, NIH/NCI, US & Sven Ove Samuelsen, Oslo, Norway.
Year(s) Of Engagement Activity 2020
URL https://iscb2020.info/invited-sessions
 
Description ISCB 2020: organised session 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact International Society of Clinical Biostatistics Conference 2020 (virtual). I co-organised an invited session on the topic of "Tackling the challenges of imperfections in longitudinal and survival data: missingness, measurement error and irregular sampling". My co-organiser was Laurence Freedman (Israel) and there were talks from 3 speakers followed by questions and discussion.
Year(s) Of Engagement Activity 2020
URL https://iscb2020.info/invited-sessions
 
Description ISCB 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I gave a contributed talk to the International Conference on Clinical Biostatistics 2021 on the topic "Estimating treatment effects on survival in an entirely treated cohort". This was a virtual conference. The talk was followed by questions and discussion.
Year(s) Of Engagement Activity 2021
URL http://www.iscb2021.info/en
 
Description ISCB 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a contributed talk at the Annual Conference of the International Society for Clinical Biostatistics (ISCB), which took place in Newcastle, UK, in August 2022. I gave a talk on the topic "Estimation and calibration of counterfactual risk predictions, with application to liver transplant". My collaborator, Dr Nan Van Geloven (Leiden University Medical Center, Leiden, Netherlands) gave a talk in the same session. We both spoke about a joint project and presented different aspects, which was an effective way of presenting and promoting our joint work. The session was very well attended and was followed by questions and discussion.
Year(s) Of Engagement Activity 2022
URL https://www.iscb2022.info/
 
Description ISCB July 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact International Society of Clinical Biostatistics Conference (Belgium). Talk title: "Using sequential trials to estimate treatment effects in longitudinal observational data: Insights and application". I contributed this talk in a session on the topic of causal inference. The session attracted a large audience and there was a number of questions both directly after the talk, and from members of the audience afterwards. One audience member asked for further information on applying the methods I described to his research at the Thrombosis Research Institute (UK), and we are since then investigating opportunities to collaborate.
Year(s) Of Engagement Activity 2019
URL https://kuleuvencongres.be/iscb40/program
 
Description ISCB short course 2020 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact International Society of Clinical Biostatistics conference 2020. Invited 1-day short course (virtual). Topic: "Understanding and tackling measurement error: A whistle stop tour of modern practical methods." I delivered the course in collaboration with Dr Pam Shaw (Penn State University).

The course included lectures, computer practicals using example data sets and corresponding course notes.

This course is based on two tutorial papers (see publications list) written as part of the STRATOS Initiative.

Around 20 researchers attended.
Year(s) Of Engagement Activity 2020
URL https://iscb2020.info/conference-courses
 
Description ISCB2022 - Oral presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a contributed talk at the Annual Conference of the International Society for Clinical Biostatistics (ISCB), which took place in Newcastle, UK, in August 2022. I gave a talk on the topic "Estimating the effects of multiple treatments in combination on outcomes using longitudinal data". The session was well attended and the talk was followed by questions and discussion. A member of the audience approached me afterwards and this led to an invitation to present on a similar topic at their own institution.
Year(s) Of Engagement Activity 2022
URL https://www.iscb2022.info/
 
Description Invited talk ERCIM conference: Dec 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact International Conference of the ERCIM WG on Computational and Methodological Statistics. Invited speaker in a session on "Causal inference using observational longitudinal data". Talk title: "Using sequential trials to estimate treatment effects in longitudinal observational data."
Year(s) Of Engagement Activity 2019
URL http://cmstatistics.org/CMStatistics2019/organized.php
 
Description Invited talk: Armitage Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Invited speaker at MRC Biostatistics Unit 17th Armitage Lecture and Workshop, University of Cambridge.

Talk title: "Emulation of a target trial to investigate the impact of lung transplant on survival in cystic fibrosis"
Year(s) Of Engagement Activity 2019
URL https://www.mrc-bsu.cam.ac.uk/news-and-events/armitage-lectureships-and-workshops/17th-armitage-lect...
 
Description JSM 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I gave an invited talk in a session at the Joint Statistical Meeting 2021, which was a virtual meeting hosted in Seattle and is one of the world's largest statistical events. The title of my talk was "Causal inference for organ transplantation: challenges in studying a finite resource and an application in lung transplantation". My talk was one of four on a related theme, and a discussant gave a discussion of the contributions.
Year(s) Of Engagement Activity 2021
URL https://ww2.amstat.org/meetings/jsm/2021/
 
Description Karolinska Institute Epidemiology Methods Seminar 2020 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Karolinska Institute Epidemiology Methods Seminar. I was invited to give the inaugural seminar for this new series. My talk was entitled "Using negative controls to
estimate causal effects of treatment in an entirely treated cohort.". The talk was followed by discussion with the audience.
Year(s) Of Engagement Activity 2020
URL https://news.ki.se/epidemiology-methods-series-imm
 
Description Karolinska Institute invited seminar Sept 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Karolinska Institute, Stockholm, SEptember 2019.
Biostatistics seminar series: invited speaker. Talk title "Using sequential trials to estimate treatment effects on survival using longitudinal observational data"
Year(s) Of Engagement Activity 2019
 
Description LSHTM Internal Talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Invited presentation at an Early Careers Statistician event at LSHTM. I gave a talk titled: "Investigating the effects of multiple treatments used in combination on health outcomes in people with cystic fibrosis".
Year(s) Of Engagement Activity 2021
 
Description LSHTM MSc 50th Anniversary symposium 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact April 2019. MSc in Medical Statistics 50th Anniversary Symposium, LSHTM. I gave an invited talk on the topic: "Creating a trial within a longitudinal cohort: Some statistical insights and an application in cystic fibrosis.". The talk generated a number of questions and discussion, and requests for further discussion about how to apply the methods described to different areas of application.
Year(s) Of Engagement Activity 2019
URL https://www.lshtm.ac.uk/newsevents/events/symposium-celebrate-50-years-msc-medical-statistics
 
Description LiDs conference June 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Conference on Lifetime Data Science, Pittsburgh, US. Invited session speaker. Talk title: "Using a sequence of emulated trials to estimate treatment effects in longitudinal observational data."
Year(s) Of Engagement Activity 2019
URL http://lids2019.pitt.edu/index.html
 
Description Lorentz Boerhaave Museum Public Lecture 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact I co-organised a Lorentz Workshop on the topic of "Counterfactual prediction for personalized healthcare" (5-9 December 2022, Leiden, Netherlands). The workshop is described ion a separate item. As part of the workshop my co-organisers and I delivered a public lecture at the Boerhaave museum, Leiden, Netherlands. The lecture was on the topic: "Can predicting the future help us to make better decisions about our health?". It was aimed at the general public and was attended by an audience of around 20. The lecture was followed by questions and discussion and a reception which included further discussion.
Year(s) Of Engagement Activity 2022
URL https://rijksmuseumboerhaave.nl/te-zien-te-doen/lorentzlezing-predicting-future/
 
Description Lorentz Workshop 2022 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I was a co-organiser of a Lorentz Center Workshop with my collaborators Dr Nan van Geloven (Leiden University Medical Center, Netherlands) and Dr Daniala Weir (Utrecht University, Netherlands). This 5-day workshop was on the topic of "Counterfactual prediction for personalized healthcare" and took place 5-9 December 2022 in Leiden, Netherlands. As co-organisers we planned the workshop and secured funding and support from the Lorentz Center. The workshop brought together around 25 international participants, including researchers from academia and industry, PhD students, and clinical collaborators. The aim was to share knowledge about estimation and validation of counterfactual prediction models in healthcare using observational data, from the perspectives of both causal inference and AI. The workshop consisted of a combination of talks, round-table discussions, and practical data analysis activities.

The workshop led to several follow up projects/papers that newly formed collaborative subgroups of participants will work on after the workshop.

The workshop included a public lecture given to visitors of the Boerhaave museum, Leiden, Netherlands. This lecture was deliver by the three co-organisers.
Year(s) Of Engagement Activity 2022
URL https://www.lorentzcenter.nl/counterfactual-prediction-for-personalized-healthcare.html
 
Description McGill seminar 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact I was invited to give a talk to the McGill University Biostatistics seminar series on the topic "Emulating target trials to study the effect of lung transplantation on survival in cystic fibrosis". The talk was followed by questions and discussion, and audience members follow-up with me afterwards with further questions and comments.
Year(s) Of Engagement Activity 2021
 
Description NHSBT seminar: Oct 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact NHS Blood and Transplant invited seminar on the topic of : "What is the impact of lung transplant on survival in cystic fibrosis? Statistical challenges and solutions"
Year(s) Of Engagement Activity 2019
 
Description Nordic CF Masterclass 2021 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Patients, carers and/or patient groups
Results and Impact I was invited to deliver the annual Nordic Cystic Fibrosis Masterclass 2021. This involved giving a seminar and participating in surrounding discussions. My talk was titled "Using registry data to study the long term impacts of CFTR modulators on health outcomes and treatment use". It was attended by 50 individuals, primarily clinicians, from across the Nordic region.
Year(s) Of Engagement Activity 2021
 
Description Norwegian Epidemiological Association Conference; Keynote speaker 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I was a keynote speaker at the Norwegian Epidemiological Association Conference, Oslo, November 2019. I gave a talk on the topic "Emulation of a target trial to investigate the impact of lung transplant on survival in cystic fibrosis".
:
Year(s) Of Engagement Activity 2019
URL http://nofe.no/kurs-og-konferanser-nofe-2019/
 
Description Ornulf Borgan symposium 2022 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I gave a talk for a 2-day symposium to celebrate the work of Prof Ornulf Borgan, which took place in Oslo, Norway, in June 2022. My talk was on the topic "Estimation and validation of counterfactual risk predictions". There were over 100 attendees, and the main audience was other biostatisticians.
Year(s) Of Engagement Activity 2022
URL https://www.mn.uio.no/math/english/research/groups/statistics-data-science/events/conferences/borgan...
 
Description Oxford Causal Inference seminar April 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact University of Oxford Causal Inference in Epidemiology Seminar (Nuffield Department of Population Health). Talk title: "Creating a 'target trial' within a longitudinal cohort: application to estimate treatment effects in cystic fibrosis". The seminar sparked questions and discussion and requests for further information about how to use the techniques I described in different application areas.
Year(s) Of Engagement Activity 2019
URL https://www.ndph.ox.ac.uk/events/causal-inference-in-epidemiology-seminar-creating-a-target-trial-wi...
 
Description RSS 2020: invited talk 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Royal Statistical Society Conference 2020 (virtual). I gave an invited talk in a session on the topic of "Target Trial Emulation" (organisers Nicola Fiz-Simon, Galway, Wendy Harrison, Leeds). The title of my talk was "Emulation of a target trial to investigate the impact of lung transplant on survival in cystic fibrosis". The session included discussion and questions.
Year(s) Of Engagement Activity 2020
 
Description St Georges Seminar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact I was invited to present my work at a departmental seminar held at St Georges, University of London. I gave a talk titled: "Emulating target trials to estimate treatment effects in cystic fibrosis using registry data". This was well attended and the talk was followed by many questions and engagement from the audience. In particular, there was discussion on the methodology used and potential uses/impact of emulating trials using registry data. This was a good way to promote my work and previous publications to a relevant audience, including clinicians who specialise in cystic fibrosis.
Year(s) Of Engagement Activity 2023
 
Description Talk - CMStatistics 2020 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact This was a talk given at "Computational and Methodological Statistics Conference" in 2020. My talk was titled "Estimating the effect of insulin use on health outcomes in people with cystic fibrosis-related diabetes using causal prediction" in a session on the topic "Challenges in analysing and predicting different types of outcomes in clinical studies". The talk was followed by questions and discussion.
Year(s) Of Engagement Activity 2020
 
Description Talk to CFStorm Group 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Gave a talk to a group of clinicians and CF experts titled "Treatment patterns in the ivacaftor treated population". This sparked questions and discussion about the ongoing project with a potential for collaboration in the future.
Year(s) Of Engagement Activity 2021
 
Description VicBiostat 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was an invited talk for the Victorian Centre for Biostatistics (ViCBiostat), Australia. ViCBiostat is a virtual centre comprising a collaboration between the Murdoch Children's Research Institute, Monash University and The University of Melbourne. It aims to build the Australian biostatistical workforce and future leaders through a program of methodological research embedded in significant collaborative health and medical research. There were around 30 participants for my virtual talk on the topic of "Estimation and validation of counterfactual risk prediction models". The seminar was followed by questions and discussion.
Year(s) Of Engagement Activity 2023
URL https://www.vicbiostat.org.au/seminars