ISCF WAVE 1 AGRI TECH Agronomic Big Data Analytics for improved crop management

Lead Research Organisation: British Geological Survey
Department Name: Environmental Modelling

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.

Technical Summary

Large data sets on crop yield and soil properties (as opposed to experimental data) rarely yield simple answers to conventional statistical analysis. It is unusual, for example, to find a strong relationship between crop yield and a soil property that can be expressed by a regression model . Similarly, the spatial variations of yield in a single field over successive seasons can be markedly different with small correlations between yield in any two seasons. This means that one cannot, in general, use yield maps to segment fields into zones with consistent yield performance. For this reason we propose that, to be agronomically informative, the analysis of big data sets requires hypothesis driven models. We will propose and test two such models, and then work with our commercial partner to integrate them into a data interpretation service.

First, we shall use boundary line analysis as a method to model limiting effects of environmental factors on crop yield. This was first proposed by Webb (1972), who suggested that the limiting response of a biological system, such as yield, (y) to an environmental variable, such as a nutrient concentration (x) is seen in the upper boundary of a scatter plot of y against x. A statistical formulation of this model, which can be fitted and tested by rigorous methods, has only recently become available through research by the PI and colleagues. It will be applied in the current project to examine potentially limiting effects on yield of a range of physical and chemical soil properties.

We shall address the problem of the complex spatio-temporal variation of crop yield using k-means cluster analysis of yield map sequences. The method identifies subregions of a field within which crop yields, over seasons, are more internally uniform than within the field/farm as a whole. We shall test the hypotheses that such subregions express underlying soil variation at farm scale in a way consistent with boundary line models.

Planned Impact

This project will demonstrate the potential for focussed statistical analysis of Big Data sets from the agricultural sector using analytical models which embody clear agronomic concepts, and which will allow the identification of limiting factors on crop production at within-field to regional scales. This has the potential to improve the management of farm land, whether by identifying regional trends in limiting factors, reflecting climatic and geological constraints, or factors that apply to just part of a single field (e.g. where a potentially high-yielding subregion has developed a nutrient deficiency due to sustained high offtake-rates for nutrients in crop products and residues). As such, the methodology has the potential to support the implementation of regional strategies for advisors and agribusinesses at one spatial scale, and the use of precision farming technology for improved profitability and reduced environmental impact at another.

In order to have this impact the methodology must be applicable to a substantial volume of data representing a significant proportion of agricultural land, integrated with existing workflows for data collection and advice and support to growers. This must be achieved in a sustainable commercial framework. Because this is a catalyst project there is enormous potential to achieve this through the enhanced opportunity for the commercial partner AgSpace to offer big-data based services to its customers. There is an existing commercial relationship between AgSpace and large agri-business like BASF, Syngenta, Farmcare, IPF and Agrii. This means that the project will have an immediate reach, via these land managers, advisors and commercial organizations that directly manage or influence the management of a significant proportion of agricultural land in the UK and further afield.

These immediate impacts would be seen in land management. In addition, there is also considerable potential value of these big data approaches to agricultural research. The agricultural research market that this project wishes to access is very large in terms of financial value. There are 2 key sectors we wish to explore; firstly, the commercial sector is increasing R & D budgets annually to stay ahead of competition. For example, Syngenta invested over $1.4 billion in 2014, BASF crop production invest £215 million annually and Agrii invest over £1m annually into agricultural research and development (R&D), these are a few examples of existing AgSpace customers that offer a clear route to market. Second, there is considerable potential value of these methods to publically-funded agricultural research. One particular opportunity in the public sector is the imminent revision of Defra's RB209 recommendations on soil nutrient and pH management.

Publications

10 25 50

publication icon
Lawley R (2020) New Horizons for Soil Research in Direct Driller

 
Description The project has developed algorithms to take measurements of crop yield from a particular agricultural field over multiple years and use them to delineate 'management zones' within which there is a common pattern of temporal variation of crop yields. It is hypothesised that a common factor (e.g. water availability or soil nutrient deficit) is limiting crop yields throughout a zone and thus the entire zone should be managed in the same manner. Management here refers to the types and rate of fertiliser or pesticide application. Such limiting factors have been identified for particular zones within particular UK fields and in the majority of cases in has been possible to use other sources of data to identify a likely yield-limiting factor. Software has been developed to pre-process data gathered from UK farms, use it to form management zones and then to calculate statistical metrics relating to the likelihood of a particular factor limiting yield. Comparison of these statistical metrics suggest that the effectiveness of the management zones derived from clustering of yield data is similar to those derived from agronomical surveys.
Exploitation Route The algorithms developed in the project have been passed to the industrial partner AgSpace and they are exploring the options to include these techniques when making fertiliser and pesticide recommendations to farmers. Similar clustering techniques could be used to design efficient on-farm experiments regarding different crop management strategies. The experiments could be confined to zones where, in the absence of variable management, yield or sustainability metrics are expected to be relatively constant. BGS have discussed this prospect with commercial agricultural enterprises and it has been included in a proposal to Innovate UK which would lead to innovations into on-farm experimentation.

BGS continue to explore the effectiveness of soil management zones derived by statistical clustering (particularly with reference to water availability) in the NERC funded Achieving Sustainable Agricultural Systems long-term National Capability programme. In this work BGS are exploring both the potential to use the zones to better inform on-farm management and to improve predictions of the impact of different climate scenarios on farm productivity and sustainability.
Sectors Agriculture, Food and Drink

 
Description The project is concerned with strategies for efficient and cost effective management of agricultural crops in the UK. One aspect was to compare the cost effectiveness of different approaches to delineating management zones in UK agricultural fields. These are zones which receive common management inputs (e.g. fertiliser, pesticides). It was found that zones based upon agronomical surveys led as profitable crop management as those based on maps of past yield or remote sensing data of crop inputs. This information was provided to project partners AgSpace who have included it within their protocols for advising farmers on management decisions.
First Year Of Impact 2019
Sector Agriculture, Food and Drink
Impact Types Economic

 
Description Farming Innovation Pathways
Amount £491,000 (GBP)
Funding ID 10004348 
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 10/2021 
End 10/2023
 
Description Seeding Catalyst Award: Transforming Food Production Seeding Award
Amount £100,000 (GBP)
Funding ID ISCF-TFP-SA-BGS 
Organisation Biotechnology and Biological Sciences Research Council (BBSRC) 
Sector Public
Country United Kingdom
Start 10/2018 
End 02/2019
 
Title Plant-available magnesium layer in UK soil observatory 
Description UK soil observatory data-layer mapping plant-available Magnesium across England and Wales and probability of deficient quantities of this nutrient for arable farming 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact Dataset is one of a suite of soil layers within the UK Soil Observatory used by farming industry and land managers to assess suitability of land for agriculture. 
URL http://mapapps2.bgs.ac.uk/ukso/home.html?layers=MAGNETAvailableMg,MAGNETProbabilityMg&extent=-138008...
 
Title Seeding Catalyst Award ISCF-TFP-SA-BGS: 1-2m Terrain classification Proof of concept 
Description Using the freely available 2 m EA 2016 digital surface model a number of terrain derivatives have been calculated using R to demonstrate the agricultural application of LiDAR data. The purpose of this dataset was to show how a national elevation dataset (the full coverage of England and Wales is expected by 2020) can be quickly processed into a series of terrain classifications with further derivative use. The examples developed related to: • Trafficability • Wind exposure • Solar power generation • Topographic wetness 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? Yes  
Impact It is currently too early to determine if the proof of concept has any notable impact. On demonstrating the data to precision agriculture practitioners they expressed an interest in seeing the national coverage becoming part of a 'toolkit' of data applicable to a range of farming techniques. 
URL http://www.ukso.org/agri-pocs.html
 
Title Seeding Catalyst Award ISCF-TFP-SA-BGS: Cation Exchange Capacity model proof of concept 
Description The proof of concept was designed to demonstrate how current regional and national data can be processed to deliver a very simple national model of Cation exchange Capacity (CEC), with an effective spacial scale of c. 1:50,000. The CEC of a soil is a measure of the cations that a soil can retain on its negatively charged surfaces, which are found on clay particles and on soil organic matter. As CEC in soils increase they can hold more nutrients such as K+, NH4+, Mg2+, Ca2+, Zn2+, particularly if pH is maintained around pH 7. Thus clay soils generally have higher CEC values due to their clay content and generally holding more organic matter, whereas sandy soils generally have lower CEC values, where greater leaching of nutrients is expected. Soils with high CEC values may also hold more water and will require more lime to correct to a given pH. The CEC values were estimated from the organic matter determined as % LOI from the BGS G-BASE survey (soil-geochemistry), and converted to % C using the recognised conversion factor of 0.58 and the mean % clay from classes of soil texture from the BGS Soil Parent Material Model. Estimates were calculated using the mean values for CEC produced from 3 different pedo-transfer functions used to predict CEC. The median values estimated as Cmolc kg-1 (Centimole of charge per Kg) from the G-BASE sample points associated with each soil parent material were calculated and assigned to one of three classes (low, medium, high). 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? No  
Impact Too early to report any notable impacts from this model. There have been technical difficulties in hosting the model online by the 28th February deadline. These will be resolved before April 1st 2019. 
 
Title Seeding Catalyst Award ISCF-TFP-SA-BGS: Soil Moisture Forecast Proof of concept 
Description BGS is building on their understanding of soil water processes to provide near real-time soil moisture values to 10 test sites and to predict how this may change over the next few days. BGS has developed a national recharge model used to make climate change predictions and we are using this experience to develop short-term (a few days' ahead) forecasts. Using observed and forecast rainfall and temperature, soil moisture can be calculated up to the present day and for two days ahead. For each test site users are presented with graphs of rainfall (yellow), evaporation (orange) and soil moisture (grey) as a time series (hourly data). The rainfall and evaporation are either measured or forecast and the soil moisture is produced by a recharge model (see http://qjegh.lyellcollection.org/content/51/2/247.abstract) using the rainfall and evaporation in combination with soil and crop properties. 
Type Of Material Computer model/algorithm 
Year Produced 2019 
Provided To Others? Yes  
Impact It is too early to identify any notable impacts at this stage. At the moment we are focused on delivering a live-feed service in a stable manner. The development team have already begun looking at how to integrate the outputs in different ways within the UKSO portal and how to establish 'coverages' of soil moisture forecast - rather than point-location outputs. 
URL http://www.ukso.org/agri-pocs.html
 
Title Seeding Catalyst Award ISCF-TFP-SA-BGS: Soil erosion perils proof of concept 
Description This dataset provides an overview of the risk of water and wind erosion to bare soils caused by rainfall running off soil in a sloping terrain, or by wind lifting dry granular material from the soil surface. The data sets are derived from the soil-texture data in BGS Parent Material V6 combined with a calculation of slope from the Ordnance Survey Terrain 50 dataset. The categorisation follows teh very simple DEFRA guideline previously published for farmers to meet cross compliance requirements. The resistance of soil to erosion is largely determined by soil texture. Soils with a high sand or silt content are the most vulnerable to wind and water erosion. Soils with a higher clay content have more stable soil aggregates. Soil organic matter also influences aggregate stability by binding soil particles together. Rainfall that runs off across bare soils on slopes can detach and transport soil particles and begin to scour the soil surface. This water scouring results in shallow channels, or 'rills', developing down the slope. They very often form in tramlines or wheelings, where soil infiltration rates are reduced by compaction. Wind erosion causes a wider -scale loss of surface materials and can be a significant factor in atmospheric pollution. The categories used in this data reflect those previously published in DEFRA guidance on managing soil erosion risk. 
Type Of Material Database/Collection of data 
Year Produced 2019 
Provided To Others? Yes  
Impact It is too early to determine if this simplistic model of erosion will have an impact. It is hoped that users will note the simple categorisation and take appropriate action. BGS will be monitoring uptake of the data over the next two years as part of its ongoing support for the UKSO. 
URL http://mapapps2.bgs.ac.uk/ukso/home.html?layers=SPMSoilErosion,SPMWindErosion&basemap=topo
 
Title UK Soil Observatory layer of slope 
Description UK Soil Observatory layer of slope greater than 12 degrees for England and Wales. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact Data-layer is used by land managers to assess risk of soil erosion. 
URL http://ukso.org/static-maps/ordnance-survey-terrain-50.html
 
Title Update of National Soil Inventory Data Layers within UK Soil Observatory 
Description All data layers mapping soil properties across England and Wales from National Soil Inventory data have been updated to be consistent with British Geological Survey data holdings. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact Data are used by academics and land-managers to assess the suitability of land for various purposes and as underpinning data for all aspects of environmental modelling. 
URL http://ukso.org/static-maps/advanced-soil-geochemical-atlas-of-england-and-wales.html
 
Description Jointly founding a Agricultural Statistics Network with Rothamsted Research, UK CEH and BIOSS, and participating in the first network meeting (Feb 2020) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 45 statisticians from agricultural institutes and businesses attended the initial network meeting, where innovations in agricultural research techniques were shared. The participants agreed upon the objectives of the network which included cross-institutional support and training to statisticians.
Year(s) Of Engagement Activity 2020
 
Description Seeding Catalyst Award ISCF-TFP-SA-BGS: Knowledge dissemination event at the CropTech 2018 agricultural show 27/28 November 2018 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Third sector organisations
Results and Impact BGS hosted a stand at the Croptech 2018 Show in order to engage with developers and practitioners of agri-technology systems (specifically those using field scale mapping of soil characteristics). The aim of attending the event was to:
• raise awareness of high resolution soil data (from the UKSO.org platform),
• gather suggestions and feedback from attendees about current and future datasets they feel would be beneficial (via a questionaire),
• engage directly with professional practitioners of agritechnologies to discuss how they can access and add value to the datasets on UKSO,
• develop skills within the project team for working closely with stakeholders from across the agri-sector and to
• demonstrate the current web-based technology and digital datasets available to anyone wanting to know more about soils and landscape.
It was not possible to count the total number of visitors to the stand, but nearly 40 visitors assisted by completing a questionnaire about the type of farming/land management they were involved in, whether they used digital data and what kinds of future soil informatics may be relevant to them. Several visitors expressed an interest in attending a possible workshop at BGS offices to explore the data further and discuss how they would like to see it evolve (a plan for workshop was developed from these requests - see later entries). Very few visitors were aware of the UKSO portal, but several were aware of the companion mySOIL app. There was wholly positive support for making the map datasets easier to use and for better promotion of the website. A small number of visitors to the stand enquired about how the data could be added to their current farm-management software (which for at least two platforms we could provide a positive answer). UKSO and the aims of the project featured in several feeds on social media, with followup requests for further details from several farms, agritech companies and journalists. A brief article was published in Farmers Guide (http://www.farmersguide.co.uk/).
Year(s) Of Engagement Activity 2018
URL http://www.ukso.org
 
Description Seeding Catalyst Award ISCF-TFP-SA-BGS: Knowledge dissemination event at the LAMMA2019 agricultural show 8/9 January 2019 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact BGS hosted a stand at the Lamma 2019 Show in order to engage with developers of agri-technology systems (specifically those using field scale mapping of soil characteristics) and members of the farming community who may be considering using more spatial technology in their farm management.
The aim of attending the event was to:
• raise awareness of high resolution soil data (from the UKSO.org platform),
• gather suggestions and feedback from attendees about current and future datasets they feel would be beneficial (via a questionaire),
• engage directly with professional practitioners of agritechnologies to discuss how they can access and add value to the datasets on UKSO,
• demonstrate the current web-based technology and digital datasets available to anyone wanting to know more about soils and landscape.
It was not possible to count the total number of visitors to the stand, but nearly 30 visitors assisted by completing a questionnaire about the type of farming/land management they were involved in, whether they used digital data and what kinds of future soil informatics may be relevant to them.
Very few visitors were aware of the UKSO portal, more were aware of the companion mySOIL app. One of the visitors who was aware of UKSO, was a farmer and supplier of agritechnology services who was keen to add the new datasets to his own software systems. There was positive support for making the map datasets easier to use and for better promotion of the website.
Year(s) Of Engagement Activity 2019
URL http://www.ukso.org
 
Description Seeding Catalyst Award ISCF-TFP-SA-BGS: Knowledge dissemination event at the Rural Business show 2019 agricultural show 6/7 February 2019 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact BGS hosted a stand at the Rural Business Show in order to engage with farmers and landowners who may be reviewing their business opportunities for their farms. Unlike other farming shows, this event is aimed at diversifying interests away from traditional farming practices into other uses of the landscape (tourism/energy etc). The purpose of the stand was to promote a better awareness of soil information, in order to help stakeholders make better decisions about the use of soils on their land.
The aim of attending the event was to:
• raise awareness of high resolution soil data (from the UKSO.org platform),
• gather suggestions and feedback from attendees about current and future datasets they feel would be beneficial (via a questionaire),
• demonstrate the current web-based technology and digital datasets available to anyone wanting to know more about soils and landscape.
It was not possible to count the total number of visitors to the stand, but over 40 visitors assisted by completing a questionnaire about the type of farming/land management they were involved in, whether they used digital data and what kinds of future soil informatics may be relevant to them.
Our stand was extremely busy. Surprisingly, most visitors were more interested in knowing more about digital soil from UKSO (rather than diversify away from traditional farming). Many were keen to develop 'best practice' methods to using their soil. A surprising number were aware of the mySOIL app. Several farmers who provide farm-tourism were keen to use the UKSO as part of their information centres/offerings for their clients (as the site is free to use and mobile enabled, it lends itself to being used as a 'guided walk' tool). There was wholly positive support for making the map datasets easier to use and for better promotion of the website. Two energy services companies (solar farming) expressed an interest in using the current soil data and terrain data as way of creating a preliminary farm assessment for the technology.
Year(s) Of Engagement Activity 2019
URL http://www.ukso.org
 
Description Seeding Catalyst Award ISCF-TFP-SA-BGS: Workshop event at BGS Keyworth 28th January 2019 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Industry/Business
Results and Impact BGS hosted a workshop for 10 members of the farming community working in the East and West Midlands. The purpose of the workshop was to get farmers (who had already expressed an interest in working with us), to visit BGS, review and suggest improvements to data and online mapping systems and develop som efurthe rideas for how they felt digital soil data would be beneficial.
Workshop attendees spent the day at BGS, learned more about the UKSO platform and took part in a range of idea/suggestion gathering processes. A report detailing the event and the wider findings of the 100+ questionaires distributed at events (and online) will be published shortly.
Year(s) Of Engagement Activity 2019
URL http://www.ukso.org