From models to insight: Effective use of models to inform decisions

Lead Research Organisation: London School of Economics and Political Science
Department Name: Methodology

Abstract

Decision-makers are often keen to "follow the science" in highly-charged contexts such as climate policy, pandemic response, economic policy and humanitarian crisis response. In situations like these, where decisions are informed by complex modelling or simulation and there is inevitable disagreement and uncertainty, it is unclear what "following the science" really means.

Some existing paradigms of model use and interpretation are beginning to reveal themselves as unfit for purpose in the present age. We can see this in the roots of the financial crisis in 2008 (over-confidence in models), public discourse on the developing climate crisis (no one quite knows how to interpret different model results), and the present pandemic crisis (where various models appear to be driving policy in conflicting directions). These are not coincidental: as computers become more powerful, and models become more complex, the role of the model within the scientific process has become larger and larger and so has the power of the model to influence decision-making. Limitations and biases of the scientific approach in decision-making contexts have been studied extensively, but the specific role of mathematical models is becoming more and more important.

The overall aim of this project is to understand both mathematical and social aspects of the role of models in decision-making, and to connect these with real-world examples and case studies. The project crosses disciplinary boundaries, and also has a strong emphasis on impact and engagement with government, business and the third sector. This will help to ensure as wide as possible a dissemination of my recommendations about good practice for modelling and the interpretation and use of model outputs.

The four case studies speak to the key societal challenges that are addressed by this work: mitigation of and adaptation to climate change, managing epidemic/pandemic response strategies, economic stability and management of the energy transition, and the need to respond to potentially-predictable humanitarian crises. I will work closely on one case study with partners at the Start Network, a consortium of humanitarian agencies aiming to take forecast-based action in anticipation of humanitarian crises.

Mathematically, I will develop a new, coherent framework for modelling methods and the quantification of uncertainty. But models and mathematics do not exist in a vacuum. I will also investigate the social and political context of model-making and model use, and the consequences of that context for the applicability of methods and robustness of model-based results, in particular for their use in decision support.

The results and outcomes of this project will be directly relevant to UK decision-makers in government, business and the third sector, with potential to be transformative for the use of models as decision support tools. The programme of outreach and engagement is therefore very important to this project, including a book, website, blog, Twitter and engaging with subject-specific conferences. I will also invite/ encourage a diverse range of participants at the annual workshops, conferences, and the Advanced Training Course which will build the skills of UK-based early career researchers.

Publications

10 25 50
 
Description Start Network Anticipation work 21-22 (Madagascar cyclone) 
Organisation Start Network
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Providing cyclone forecasting expertise; guidance in the use of cyclone forecasting tool to activate financial mechanisms based on forecast of cyclone in Madagascar; ad hoc assistance with queries; supports for local network members implementing the new tool
Collaborator Contribution Expertise in forecast-based financing; access to local and national stakeholders in Madagascar including local meteorological service; practical and logistical considerations.
Impact Use of a cyclone forecasting tool to activate humanitarian action in advance of Cyclone Batsirai (Feb 2022); Use of a cyclone forecasting tool to activate humanitarian action in advance of Cyclone Emnati (Feb 2022); Supported Start Network collaboration with Madagascar Meteorological service; Improved national response to humanitarian crises.
Start Year 2021
 
Description Invited reflection: The Potential for Anticipatory Action and Disaster Risk Financing, Start Network Assembly, London, Oct 2022 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Invited reflection: The Potential for Anticipatory Action and Disaster Risk Financing, Start Network Assembly, London, Oct 2022
Year(s) Of Engagement Activity 2022
 
Description Invited talk: All models are normative, Royal Statistical Society event on Responsible Modelling, London, Jan 2023 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Invited talk: All models are normative, Royal Statistical Society event on Responsible Modelling, London, Jan 2023
Year(s) Of Engagement Activity 2022
 
Description Invited talk: Becoming a good mathematician: practical ethics for the mathematical sciences, LSE Women In Maths seminar, London, March 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Invited talk: Becoming a good mathematician: practical ethics for the mathematical sciences, LSE Women In Maths seminar, London, March 2023
Year(s) Of Engagement Activity 2023
 
Description Invited talk: Escape From Model Land: The Dangers Of Over-Confidence In Mathematical Models And How To Avoid It. Z/Yen FS Club, Oct 2021 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Invited talk: Escape From Model Land: The Dangers Of Over-Confidence In Mathematical Models And How To Avoid It. Z/Yen FS Club, Oct 2021
Year(s) Of Engagement Activity 2021
URL https://www.zyen.com/events/all-events/escape-model-land-dangers-over-confidence-mathematical-models...
 
Description Invited talk: Escape from Model Land, UK Government Economic Service (internal webinar), London, March 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Invited talk: Escape from Model Land, UK Government Economic Service (internal webinar), London, March 2023
Year(s) Of Engagement Activity 2023
 
Description Invited talk: Escape from Model Land. Scottish actuarial webinar series, Oct 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Invited talk: Escape from Model Land. Scottish actuarial webinar series, Oct 2021
Year(s) Of Engagement Activity 2021
URL https://www.actuaries.org.uk/learn-develop/attend-event/scottish-actuarial-webinar-series-2021
 
Description Invited talk: Escaping from Model Land, Swiss National Bank (internal webinar), Zurich, Feb 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Invited talk: Escaping from Model Land, Swiss National Bank (internal webinar), Zurich, Feb 2023
Year(s) Of Engagement Activity 2023
 
Description Invited talk: Models, mathematics, and data science: how to make sure we're answering the right questions, CIVICA Social Data Science Seminar, March 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Invited talk: Models, mathematics, and data science: how to make sure we're answering the right questions, CIVICA Social Data Science Seminar, March 2023
Year(s) Of Engagement Activity 2023
 
Description Invited talk: Understanding the limitations of mathematical modelling for sustainable transitions and risk management.NNIP Summer Course in Sustainable Investing, London/online, Oct 2022 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Invited talk: Understanding the limitations of mathematical modelling for sustainable transitions and risk management.NNIP Summer Course in Sustainable Investing, London/online, Oct 2022
Year(s) Of Engagement Activity 2022
URL https://www.nnip.com/en-INT/professional/insights/articles/sustainable-investing-summer-course-2022
 
Description Panellist: Data Science, AI and sustainability, DSI x Ekimetrics, Dec 2022 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact Panellist: Data Science, AI and sustainability, DSI x Ekimetrics, Dec 2022
Year(s) Of Engagement Activity 2022
URL https://www.lse.ac.uk/DSI/Events/Using-data-science-for-sustainable-business/DSI-x-Ekimetrics
 
Description Panellist: Follow the Science? Data, models and decisions in the 21st century, LSE Public Event, Jan 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Panellist: Follow the Science? Data, models and decisions in the 21st century, LSE Public Event, Jan 2023
Year(s) Of Engagement Activity 2023
URL https://www.lse.ac.uk/Events/2023/01/202301241830/models