JDec: Joint decision models for citizens, crops, and environment

Lead Research Organisation: University of Warwick
Department Name: Statistics

Abstract

This project will adapt decision-theoretic tools to agri-environmental management, a domain that has been underserved by mathematical methodology. The process of decision-making within an agricultural context is complex, because it spans multiple interdependent stages, and involves many risks along the way. Decisions - when to apply pesticides, how much to apply, when to prune, when to water, even when to harvest - can affect crucially the produce quantity and quality, and hence the short-term success of the enterprise. The decisions will also determine the extent of environmental harm, which have been challenging to define, as is the value of "services" provided by the ecosystem. To facilitate their inclusion in decision-making we develop models that are more flexible and more holistic than common frameworks in operational research.

First, outcomes need to be valued by utility functions that reflect costs and benefits comprehensively. Among other things, they need to be evaluated along decision trajectories, including appropriate levels of memory and foresight, and interdependencies along the way. For example, a herbicide treatment may look effective only as long as its indirect effect is ignored on the wild pollinators that had visited the weeds, and whose loss will need to be compensated with new costs.

Second, in an agricultural-environmental context, decisions are not taken by humans alone. A modelling approach looking at decisions being taken jointly by all three --- the farmer, the crop and the environment --- opens the flexibility needed to deal with interactions. We further allow for a higher level of uncertainty, in that the influence each of these agents has may itself depend on random events.

Third, our models acknowledge the temporal dimension and potential resource allocation constraints. In a large, interconnected, multi-stage system of land and resource management, past actions influence future decisions. Adding rapidly changing environment, with extreme weather events increasing in frequency, shifting pest and pollinator ranges, and resource depletion, we need to take account of the need for robust approximate solutions in model development. In other words, the challenges of having to make decisions in the "real world in real time" requires a paradigm for "good enough" decision-making, and a conceptualisation of the gap it has to optimal solutions.
Our major objective is to build the mathematical and statistical framework for decision modelling that covers these three aspects. Our work extends existing approaches by building in more flexible mechanisms for uncertainty and interdependencies. Key ideas from behavioural sciences will move us beyond a narrow rationality framework. Subject to data availability, our resulting theory will be applicable to both small and large landscape scales.

We will explore these ideas in two case studies. The first is a system of wild pollinators in apple orchards, a particularly suitable testing ground for understanding indirect effects at the frontier between managed land and its surrounding landscape. The second case study explores the use of decision modelling in a large farm scale experiment with 4 crops and multiple intervention methods. It provides a rich data set for comparing decision strategies.

Our work can directly benefit many citizens: not only crop scientists and land managers, but also ecologists, conservationists, local authorities, charities and policy-makers. The tools we are designing will open up to the field sciences an approach that has been used with great success in a variety of other disciplines. With better tools, such as the ones we are proposing, environmentally-conscious actions taken to feed a growing population in a changing climate can be dynamic, adaptable, and sustainable.

Planned Impact

The proposed work aims primarily to expand decision-theoretic concepts and make them applicable to an agri-environmental context. This, we believe, will be of benefit to both academic and non-academic audiences. The non-academic category includes the many different types of stakeholders involved in decision-making about resources and management (e.g. allocation, landscape use and crop management decisions) within an existing legal framework. These stakeholders include land managers, land owners, local authorities, and charities. It also includes those who make recommendations or decisions about policies itself, such as politicians at regional, national and European level.

A popular framework used by policy makers for assessing and comparing the impact of alternative policies is multi-criteria decision analysis (MCA). It gives priority to assessing all three dimensions, economic, social, and environmental and arriving at solutions through negotiation processes. Another such framework is multi-level perspective (MLP), which is frequently applied to scenarios involving technological transitions. Neither frameworks is a priori quantitative, but both draw on other frameworks to conduct that part of the analysis and integrate them into a bigger picture afterwards. This role could also be taken up by our proposed models and the tools built from them, enhancing MCA and MLP with a more flexible and holistic decision-making approach.

A primary output of the work will be the design of tools (both as mathematical models and as software) for the application of our theoretical developments. These can be applied by crop scientists, ecologists, or conservationists to agri-environmental datasets, or datasets that have a similar structure. We intend to present these findings in audience-appropriate scientific publications, with the associated code publicly available. Furthermore, we intend to have worked examples distributed with the code, in order to ensure that users can confidently apply our procedures. Within the research community, our work can be used as the basis for a range of further developments, from crop development to projects for restoration of old agricultural land.

As a by-product of our work, we will be putting together standardised protocols for data quality assessment of agri-environmental datasets, and primary exploratory and data-handling procedures. Since transparency and repeatability are core values of our research, we will make all of these protocols available, and we will associate with them tutorials that can guide learners through the fundamentals in an accessible manner. To further promote training we intend to create learning units from our tutorials, that can be used as teaching resources for life scientists.

While it is tempting to design decision support tools to help land managers do their jobs, such tools have found low uptake in the past. Similar observations have been made in the clinical context, where there have also been very few successful examples. Hence, the first step for building a successful tool is to elicit user needs through dialogue. Both outputs described above can function as vehicles to create such a dialogue with a potential user community and create trust that they can deliver useful advice.
Rather than providing closed or even proprietary software tools, we will provide an accessible theoretical and conceptual framework upon which future researchers and users can build. Realistic quantification of the differences between outcomes of alternative decision strategies and priorities can serve as guidance toward better intuitive agri-environmental decision-making, and may find its way into discussion and future developments of the decision process.

Publications

10 25 50
 
Title Data-driven decision models for agri-environment temporal multivariate data 
Description This project was carried out by data science student Matt Persin under supervision of Dr Julia Brettschneider. The objective of this project was to visualise agri-environmental temporal multivariate data and to use this for building decision models incorporating land managers, crop and environment. The data used in this project comes from the maize crop section of the well establish Farm Scale Experiment in the UK (Perry et al, J Appl Ecology, 2003). Analysis of the data was carried in domain context increasing credibility and impact starting with variable organising, data quality assessment, identified the deficiencies in this data set (e.g. lack of yield measures, lack of interpretability of the pesticide information, individualised protocols by farmers) as well as strength (e.g. temporal development, trained assessors of ecological counts) and challenges (e.g. highly individualised protocols by land managers). The next stage of the project was the development of a visualisation format of the temporal multivariate land manager specific time lines showing drilling data, pesticide usage, weed cover, and crop cover. The last phase of the project was the development of trade-offs between economics and ecological considerations using expected utility theory with a variety of utility functions. Cluster analysis was used to build the decision trees in a data driven way. 
Type Of Material Data analysis technique 
Year Produced 2020 
Provided To Others? No  
Impact This project highlighted the importance of extensive data quality assessment, which led to a follow-up project focussing on just that. It further demonstrated the need for larger data sets shall data-driven decision making be reliable, efficient and effective. 
 
Title Decision analysis in orchard management considering wild pollinators 
Description This project was carried out by Stephen Brownsey under supervision by Dr Julia Brettschneider at the Department of Statistics at the University of Warwick. The objective of this project was to visualise agri-environmental temporal multivariate data and to use this for building decision models incorporating land managers, crop and environment. The data used in this project comes from in a study on wild pollinators in apple orchards in NY (Park et al, 2015). The project is interdisciplinary encompassing the need to learn and use expertise from several domains (botany, ecology, data science, statistics) and pioneering the use of data-driven decision theory models for apple orchard management. Initial analysis of the data was carried in domain context increasing credibility and impact starting with variable organising, data quality assessment, identified the deficiencies in this data set (e.g. lack of yield measures, vague information on measurement dates, individualised protocols by farmers) as well as strength (e.g. biodiversity scores, trained assessors of ecological counts). The second stage of the project was to establish a pipeline for building decision models and trees from this type of data applicable, which the student mastered by comparing many different types of clustering algorithms for this small real-world data sets. The last phase of the project was the development of trade-offs between economics and ecological considerations using expected utility theory with a variety of utility functions. Cluster analysis was used to build the decision trees in a data driven way. 
Type Of Material Data analysis technique 
Year Produced 2020 
Provided To Others? No  
Impact The project highlighted the need for a deep understanding of experimental planning and the interpretation of variables for data-driven decision making to be successful. Due to insufficient data quality only half of the data set was useable for statistical analysis making the application of clustering techniques challenging. There are clear lessons for future developments in this interdisciplinary field. However, this project provides a template for similar such studies in the future. 
 
Title Growth models for agricultural crops 
Description Based on the winter and spring oilseed data set from the UK Farm Scale Experiments, mathematical growth models were fitted, evaluated and compared. This was preceded by data quality control and initial data analysis. Inference for crop height is based on normality assumption and t-tests. An economic evaluation was performed using expected utility theory. 
Type Of Material Data analysis technique 
Year Produced 2020 
Provided To Others? No  
Impact The work was performed by Master level student Berke Goker under supervision by Dr Julia Brettschneider and led to the discovery of numerous deficiencies in the quality of the data. This gave rise to a follow-up project shedding light on this issue. 
 
Title Quality assessment of farm scale evaluation oilseed data 
Description Detailed exploratory analysis of data quality of the UK farm scale evaluation spring and winter oilseed data with a focus on the analysis of patterns of missingness of measurements. It showed that some of the variables were missing not a random. 
Type Of Material Data analysis technique 
Year Produced 2020 
Provided To Others? No  
Impact This work was done as part of an MSc summer project 2020 (6/2020-9/2020) by Yang Hu under supervision of Dr Julia Brettschneider at the Department of Statistics at the University of Warwick. It revealed deficiencies in the quality of parts of the data sets. This implies that caution is needed when this data set is analysed to avoid bias and incorrect conclusions. The deficiencies would only effect certain types of objectives, so that would have to be checked. 
 
Title Visualise agri-environmental temporal multivariate data 
Description This work was carried out by data science student Elizabeth Potter under supervision by Dr Julia Brettschneider at the Department of Statistics at the University of Warwick. The objective of this project was to visualise agri-environmental temporal multivariate data and to use this for building decision models incorporating land managers, crop and environment. The data used in this project comes from the well establish Farm Scale Experiment in the UK (Perry et al, J Appl Ecology, 2003). Analysis of the data was carried in domain context increasing credibility and impact starting with variable organising, data quality assessment, identified the deficiencies in this data set (e.g. lack of yield measures, lack of interpretability of the pesticide information, individualised protocols by farmers) as well as strength (e.g. temporal development, trained assessors of ecological counts) and challenges (e.g. highly individualised protocols by land managers). The heart of the project was the design of a sophisticated visualisation format of the temporal multivariate land manager specific time lines showing drilling data, pesticide usage, weed cover, and crop cover. The implementation is not restricted to the farm scale data, but could show other temporal developments provided a suitable data set. 
Type Of Material Data analysis technique 
Year Produced 2020 
Provided To Others? No  
Impact The project highlighted the importance of viewing agri-environmental processes on a spatio-temporal scale. The lead to a collaboration with an engineer at Warwick Manufacturing Group, Professor Naomi Brookes, to study data-driven projects management. 
 
Description Working group about scales as part of the Landscape Decision Programme 
Organisation University of Leicester
Country United Kingdom 
Sector Academic/University 
PI Contribution I contributed to discussions at regular meetings, including suggestions to bring in natural sciences and mathematical sciences perspective. In particular, the regarding measurement quality and multiple agent or multi-criteria decision making.
Collaborator Contribution In regular meetings we have been working towards a paper and have now a well developed draft titled "Scales, stitches and silos: transdisciplinary case studies in understanding landscape planning".
Impact Manuscript. Currently, final touches are made. Journal options have been discussed.
Start Year 2021
 
Description Working group about values as part of the Landscape Decision programme 
Organisation University of Leicester
Country United Kingdom 
Sector Academic/University 
PI Contribution Contribution to discussions, which took place frequently, at times weekly, but then paused, but will restart again next month.
Collaborator Contribution Discussion around theory and cases studies by a team of NERC funded colleagues led by Martin Phillips.
Impact Manuscript has been drafted. Currently all group member contribute further bits.
Start Year 2021
 
Title Beet Experiment Visualisation Prototype 
Description Interactive web app offering a battery of data visualisations from the Farm Scale Experiments used in Case Study 1 of JDec. User can select variables to be included from the following list: Drill date, Herbicide applied, Weed cover, Crop cover, Pollinators. They will be shown as coloured dots of size proportional to amount. Data is built into the app. Also, the app had built in weather data originally obtain from the Met Office. Plots can be underlaid with colours corresponding to weather conditions. User can choose from the the following list: Rain, Sunshine, Temperature, Frost. Joint work by Julia Brettschneider and Elisabeth Potter. 
Type Of Technology Webtool/Application 
Year Produced 2020 
Impact Web app prototype was completed by 28.2., which is less than a week ago. We expect to demonstrate it end of this week to students and academics in the Department of Computer Sciences. 
URL https://github.com/ebethpotter/fse_app
 
Title Building decision tree for agri-environmental scenarios 
Description Allows the comparison of different decision trees and rules for the farms scale experiment maize data. Built by Matt Persin under supervision by Julia Brettschneider. 
Type Of Technology Webtool/Application 
Year Produced 2020 
Impact Has inspired further work on decision models for agri-environmental settings. 
URL https://github.com/MPersin19/CornProject
 
Title Wild Pollinators Application Prototype 
Description Shows results of clustering and exploratory data analysis for pollinators data from Case study 2 of JDec. Users can select different levels of Fungicides, Insecticides, Thinner in both Protocols. Joint work between PI Julia Brettschneider and Stephen Brownsey. 
Type Of Technology Webtool/Application 
Year Produced 2020 
Impact Will be launched at a seminar talk end of this week (6.3.2020) 
 
Description Decision models and real world applications 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Talk on mathematical extensions to decision models that accommodate multiple perspectives and multiple decisions makers. This is largely motivated by developing decision models that a sophisticated enough to enable the integration of both economical and ecological perspectives. The main application are agri-environmental settings.
Year(s) Of Engagement Activity 2020
URL https://warwick.ac.uk/fac/sci/statistics/currentstudents/modules/st9/st912