NEC06665 Automatic image recognition for Japanese Knotweed for the conveyancing sector

We will address our current knowledge gaps with a programme of activities aimed at increasing our understanding of the market need and potential end-users, as well as producing a proof-of-concept image classifier.

Work to be undertaken:

Proof-of-concept algorithm - Using over 8,000 images of Japanese Knotweed and over 20,000 images of other common garden plants, we will produce a proof-of-concept image classification algorithm that can identify images of Japanese Knotweed, with an estimate of certainty, and can be integrated with the Japanese Knotweed risk map to provide an overall assessment of the likelihood of the species being present on a property. Building this proof-of-concept is key for follow-on funding as it will be the basis of any future application. Additionally, the limitations and capabilities of the technique are unknown until a classifier has been built and evaluated. A functional proof-of-concept should increase stakeholder recruitment and engagement in the follow-on application.

RICS consultation - We will consult with the Royal Institute of Chartered Surveyors (RICS) as the trade body for surveyors to discuss the needs gap in the industry, the size of the market and to set out the evaluation criteria of the image classifier. Understanding the market and the specific end-users will be key to the follow-on application. Through previous work with RICS, we know that they are experts in Japanese Knotweed surveying and remediation industry and they can contribute significantly to identifying markets for an image classification tool, as well as connecting us with end-users who could be involved in a follow-on application.

Classifier report - The project will collate images of Japanese Knotweed, primarily from the Biological Records Centre's system 'iRecord'. We will report on the availability of images, the impact of image and model selection on classifier accuracy, the computational requirements, and the accuracy that the classifiers are able to achieve in 'real-world' conditions. The technical limitations of the project, both in terms of images available, and the accuracy of the classifier are key for identifying specific end user applications. This understanding will be used to specify objectives for the follow-on application and to select end-users for the co-design phase.

Code base - We will produce a library of code for designing, training, and implementing image classifiers which will be the basis of the follow-on application. This code base will be the intellectual property of CEH, derived from CEH's data and image holdings, which will form the core of the follow-on application.

Currently the value of images collected through iRecord is limited. The images are collected as a by-product of a requirement for evidence of what people record as seeing. These images allow experts to verify the recorders' sighting. These images do not currently have significant value beyond this use. The realisation of image classification technology in the past 5 years has dramatically increased the potential value of this wealth of expertly validated images. Without this pathfinder project, we cannot accurately estimate the true value of these images when used to create an image classifier. While we will focus on Japanese Knotweed in the pathfinder project, it is important to realise that the commercial implications of creating effective classifiers from our image database reach far beyond this one plant species. If the pathfinder is successful, it is hoped that the follow-on project can expand the scope of the classifier, for example identifying a range of garden weeds. This direction will be driven through consultation with RICS and other end-users.
A follow-on project will allow us to build a community of stakeholders to specify the best delivery mechanism for the service (e.g. smartphone application or website). The follow-on project will also seek to build upon the technical work of the pathfinder to improve the performance of the algorithm where opportunities are identified during the pathfinder project.