14TSB_ATC_IR A Catalyst for Automated Capture & Analysis of Behaviour & Performance Changes in Pigs for Early Detection of Health and Welfare Problems

Lead Research Organisation: Newcastle University
Department Name: Sch of Natural & Environmental Sciences

Abstract

Subclinical and clinical disease is the biggest factor responsible for pig system inefficiency and reductions in productivity and welfare. Currently disease or vice detection is done either via human observation or using diagnostic surveillance, both of which have limitations w.r.t. cost and effort required for continuous, high-frequency monitoring of large numbers of animals.

This project aims to develop and validate innovative technology to automatically monitor the performance and behaviour in grower and finisher pigs systems, with the objective of automatically detecting the consequences of health and welfare challenges on farm. Through automation we will enable continuous and objective analysis of animal well being. Combined with innovative analysis methods this serves as the basis for early detection of the consequences of health and welfare challenges, and thus for rapid intervention that will lead to increased efficiency on farms. Our technical approach will comprise computer vision and pattern recognition methods for monitoring groups of pigs in indoor pens. We will refine an existing visual analysis system that estimates liveweights at feeders, towards continuous, and location independent analysis. Furthermore, our visual monitoring system will track locations and dynamics of pig movements. Based on these continuous visual observations we will develop methods for modelling normal, i.e., expected performance development and behaviour, and for detecting deviations from this 'normality'. These analysis techniques will be calibrated such that they abstract from environmental factors such as temperature and humidity.

An automated early warning system will lead to: i) earlier detection of health & welfare issues enabling effective intervention, which is grounded in the academic partner's work demonstrating that behaviour changes manifest long before clinical disease signs; ii) increased efficiency and reduce costs, especially for large-scale operations. The project will thus contribute towards sustainability and competitiveness of the UK pig Industry.

The technical approach of the proposed project will: i) Develop a robust, camera-based monitoring system for the analysis of both behaviour and performance development in pigs that is suitable for continuous monitoring of groups of animals; ii) Develop algorithms that model normal behaviour of individuals and groups of animals, and allow for quantitative measurements of relevant development criteria and develop automatic assessment methods that detect deviations from normal, i.e., expected development and behaviour, during controlled and spontaneous health and welfare problems; iii) Implement the proposed system within a cloud- and mobile computing infrastructure for wide accessibility and near real-time feedback to farm personnel; iv) Validate the framework in realistic deployments as a means of detecting the onset of health/welfare problems on pig farms; and (v) Ensure effective KT to the relevant stakeholders. .

The project brings together the UK leading designer of innovative software solutions for the agricultural sector (Innovent), the world's leading animal health company (Zoetis) and two of the UK's leading companies for pig health and management (Raft and Harbro), with a UK University that is at the forefront of research in computer vision, pattern recognition techniques and pig management and health (Newcastle University). Additional funding from the British Pig Executive (BPEX) will ensure that the outcomes of the project will be relevant and disseminated to the wider UK pig industry.

Technical Summary

This project aims to develop and validate innovative technology to automatically monitor the performance and behaviour in grower and finisher pigs systems, with the objective of automatically detecting the consequences of health and welfare challenges on farm. Through automation we will enable continuous and objective analysis of animal well being. Combined with innovative analysis methods this serves as the basis for early detection of the consequences of health and welfare challenges, and thus for rapid intervention that will lead to increased efficiency on farms. Our technical approach will comprise computer vision and pattern recognition methods for monitoring groups of pigs in indoor pens. We will refine an existing visual analysis system that estimates liveweights at feeders, towards continuous, and location independent analysis. Furthermore, our visual monitoring system will track locations and dynamics of pig movements. Based on these continuous visual observations we will develop methods for modelling normal, i.e., expected performance development and behaviour, and for detecting deviations from this 'normality'. These analysis techniques will be calibrated such that they abstract from environmental factors such as temperature and humidity.

An automated early warning system will lead to: i) earlier detection of health & welfare issues enabling effective intervention, which is grounded in the academic partner's work demonstrating that behaviour changes manifest long before clinical disease signs; ii) increased efficiency and reduce costs, especially for large-scale operations. The project will thus contribute towards sustainability and competitiveness of the UK pig Industry.

Planned Impact

Impact on pork industry
Subclinical and clinical diseases in farm pigs contribute significantly to system inefficiency and its consequent environmental impact, especially in the system's carbon footprint. The onset of vices, such as tail biting, as well as being a significant welfare issue also results in significant losses for pig farms. The introduction of the proposed early detection system will lead to corrective action and will enhance the efficient use of resources in pig systems. The four industry partners and BPEX would be the major beneficiaries of the proposed re-search. The pig producers associated with the four companies will benefit from the devel-oped system for early health detection through increased efficiency on farm. We do not necessarily envisage that all UK pig operations will install the developed product on their farms, but expect that through licensing agreements to license the developed algorithms to other developers of similar equipment. Both Innovent and Zoetis operate internationally, either by being based in all the major pig producing countries (or having strategic alliances that enable them to do so. In addition both companies operate and have customers in emerging economies, including Brazil and China. The developed system is expected to be of relevance to all large scale operations of pig and pork producers in the EU, Americas and China.

Government Agencies and Societal impact
In general the outcomes of the project will be of particular relevance to policy makers, especially to those that aim to ensure the production of safe and high quality meat products, whilst having a minimum environmental impact.
There is increased public interest in the safety of livestock products, including authentication and incidence of zoonotic diseases, health and welfare standards of the livestock industries and the reduction in the environmental impact that arise from livestock operations. Processors and retailers are the conduit for such concerns. Part of the project outcomes will be the efficient production of safer pork products that minimizes environmental impact, which is of interest to retailers and public alike. Defra and FSA publish reports about the incidence of such diseases and pathologies on their websites and retailers are keen to disseminate information about the safety of their products.

Academic Impact
Academic partners will benefit from the application of their skills to pig production systems, and the challenges this brings, and the consequent enhancement of their on-going research. Potentially the algorithms developed for the detection of health and welfare problems in pig systems could be extended to detect similar issues in other livestock. This will significantly expand the scope of the research of the academic partners. The application of the developed algorithms to health detection will be subject to communication at the later stages of the project.

Exploitation and Application
The product generated by the project will require some development before it is applied widely on pig farms. Plans on how to achieve this are provided in the main application. We expect licensing of the developed algorithms for disease detection to be a main source of income generation. The application of the automated monitoring system can be adopted more widely, at least for larger scale operations (such as those with more than 300 sows), and therefore to benefit the UK pig Industry as a whole. RAFT and BPEX will have a pivotal role to play in ensuring the Industry-wide adoption. In addition ZOE and Harbro expect to increase their share of the pig health and feed market, respectively, through commercialisation of the developed product, i.e., licencing the product to their exclusive customers, within 5 years from product commercialisation.
 
Description We have conducted a literature review that has identified the pig behaviours that are modified by health and welfare challenges. This has informed the development of our experimental approached as we have focused specifically on these behaviours.
We have developed algorithms that enable automated detection of several behaviours of pigs, such as feeding, lying, standing etc. These algorithms operate at a group level, how much activity occurs within a group for a specific period of time. We have validated these algorithms against challenges in the health and welfare of pigs that may lead to changes in animal behaviour. These algorithms will be used as the basis of an early warning system that enables the early detection of behavioural changes in groups of pigs as a consequence of health and welfare challenges.

We have developed algorithms that allow the tracking of pigs for several minutes, without the use of electronic indentification. This is significant because not all classes of livestock will have an electronic identification. Tracking pigs for a signficant amount of time has enabled us to extract behavoural metrics for individuals as opposed to the group behavioural metrics. Such individual behavioural metrics include standing, lying and amount of time spent at a specific period of time.

Progress on the early detecion system of health and welfare compromises has been made. The early algorithms are able to detect changes from 'normal' behaviour and flag up warnings.

An EU grant has been awarded to continue the work initiated by this award.
Exploitation Route The review has been published in the Veterinary Journal. It can form the basis for identifying the behaviours affected by health and welfare challenges, and used for investigations by other scientists.
We have published a paper in Scientific Reports that details the development of algorithms that enable automated detection of several behaviours of pigs. The algorithms can be used by scientists who are interested in the automated detection of behavioural changes by pigs.
We have published a paper in the Journal of Science on the amount of disturbance in behaviour for a group of pigs in order for it to be detectable. This will be used as the basis for the automated detection of behavioural changes at a group level.
The algorithms developed are the basis of an application to ISCF to expand the scope of the work and incorporate it into the development of Pig Farming systems for the future.
Sectors Agriculture, Food and Drink

 
Description The outcomes of this research which is funded jointly by BBSRC and IUK are expected to lead to the development of an early warning system that enables the detection of health and welfare challenges in pigs as a consequence of changes in their behaviour. The early warning system is being developed in collaboration with Industry who are expected to make the system available to their clients and use it as the basis of a product development. The Industry already uses our algorithm to quantify changes in behaviour due to health and welfare challenges. The algorithms on early warning will be taken further for development by the Industry. They form the basis of an application submitted to the ISCF Call Transforming Food Production. The aim of the application is to develop future systems of pig production which rely more heavily on automation. Such systems are expected to have reduced environmental impact. An EU grant award has been awarded in order to continue the work initiated in this project. The aim of the EU grant is to apply the algorithms developed by the project to specific diseases of pigs. We have further modified and expanded the previous algorithms to detect contact behaviour between pigs. The contact behaviour constitutes a proxy for social behaviour of pigs within a group. Changes in the contact frequency may be indicative of arousal that precedes abnormal behaviour, such as tail-biting, or disease; in the former case there would be an increase in contact behaviour, whereas in the latter there would be a decrease. The algorithm is now been applied to situations with behavioural problems in commercial pig farms.
First Year Of Impact 2018
Sector Agriculture, Food and Drink,Creative Economy,Environment
Impact Types Societal,Economic

 
Description HealthyLivestock
Amount £527,085 (GBP)
Funding ID 773436 
Organisation European Commission H2020 
Sector Public
Country Belgium
Start  
 
Description SAM-CLOUD
Amount £14,053 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 08/2016 
End 03/2017
 
Description A Catalyst for Automated Capture & Analysis of Behaviour & Performance Changes in Pigs for Early Detection of Health and Welfare Problems 
Organisation Innovent
Country United Kingdom 
Sector Private 
PI Contribution The contributions from Newcastle were methods and software for an early warnign system that automatically detects changes in group behaviour of pigs. Controlle studies were also performed to validate the system.
Collaborator Contribution Zoetis provided financial support for computer hardware and cloud storage. Innovent provided knowledge on how to install computer hardware in a farm environment early on in the collaboration.
Impact An early warning system has been produced that takes the form of computer hardware and computer software.
Start Year 2014
 
Description A Catalyst for Automated Capture & Analysis of Behaviour & Performance Changes in Pigs for Early Detection of Health and Welfare Problems 
Organisation Zoetis
Country United States 
Sector Private 
PI Contribution The contributions from Newcastle were methods and software for an early warnign system that automatically detects changes in group behaviour of pigs. Controlle studies were also performed to validate the system.
Collaborator Contribution Zoetis provided financial support for computer hardware and cloud storage. Innovent provided knowledge on how to install computer hardware in a farm environment early on in the collaboration.
Impact An early warning system has been produced that takes the form of computer hardware and computer software.
Start Year 2014
 
Title Pig tracking, pig behaviour measurement, and early warning systems 
Description The pig tracking software uses depth images from a depth camera (e.g., Kinect and Basler cameras) and processes the data. Pigs are automtically deteced in the data and thier sptial positions within a house pen are tracked. The behaviour measurement software takes spatial poisitioning of pig tracks as input and processes these into behaviours, such as feeding, standing, speed, distance, and spatial clustering of the group. The early warning system usese machine learning to build models of normal pig behaviour (per pen) and automaticalyl detects any changes from normal to produce a warning. 
Type Of Technology Software 
Year Produced 2018 
Impact The software is operational in a project partner's infrastructure and is being processing live data that is streamed from a commerical farm. 
 
Description C-DIAL launch event 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact The Centre for Digitial Innovation Applied to Livestock (C-DIAL) was launched at a 1-day event at Cockle Park farm, Newcastle University.
Year(s) Of Engagement Activity 2017
 
Description IUK joint Centres Meeting - Harper Adams University College 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact A presentation of the outcomes of the project was made at the IUK joint AgriTech Centres meeting that took place at Harper Adams University College. The aim of the event was to showcase the CIEL activities to the relevant Industry.
Year(s) Of Engagement Activity 2018
 
Description Invited talk at UK Symposium on Knowledge Discovery and Data Mining (UKKDD 2017) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The UK Symposium on Knowledge Discovery and Data Mining series is intended to provide a forum for discussion, dissemination and exchange of ideas between practitioners and researchers working within the broad field of Knowledge Discovery and Data Mining (KDD).
Year(s) Of Engagement Activity 2017
URL http://ukkdd.org.uk/2017/
 
Description N8 AgriFood Digital Innovation in Livestock Industry Innovation Forum 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact This was a workshop that brought industry and academia together to address challenge in livestock farming through digital innovation. There were five work project groups on the day that produced initial concepts and plans for project funding. A number of these are being developed into funding applications.
Year(s) Of Engagement Activity 2017
 
Description Presentaion to EU consortia Meeting 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The progress on the project was presented at a meeting that was organised jointly by several EU projects that deal with the challenge of Improving Efficiency in pig and poultry Sectors. The event was attended by EU researchers and Industry Stakeholders. As a consequence of the presentation we are now involved in another EU proposal.
Year(s) Of Engagement Activity 2018
 
Description Workshop on Machine Vision of Animals and their Behaviour (in conjunction with British Machine Vision Conference) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Workshop on Machine Vision of Animals and their Behaviour (in conjunction with British Machine Vision Conference)
Year(s) Of Engagement Activity 2015
 
Description Workshop on Machine Vision of Animals and their Behaviour (in conjunction with British Machine Vision Conference) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Schools
Results and Impact The Machine Vision of Animals and their Behaviour (MVAB) workshop brought together members of the community researching computer vision for animals, from such diverse application areas as wildlife study, animal farming, and industrial inspection.
Year(s) Of Engagement Activity 2015
URL http://openlab.ncl.ac.uk/publicweb//mvab2015/
 
Description Workshop on Machine Vision of Animals and their Behaviour (in conjunction with British Machine Vision Conference) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Schools
Results and Impact The Machine Vision of Animals and their Behaviour (MVAB) workshop brought together members of the community researching computer vision for animals, from such diverse application areas as wildlife study, animal farming, and industrial inspection.
Year(s) Of Engagement Activity 2015
URL http://openlab.ncl.ac.uk/publicweb//mvab2015/