📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

Full automation of sewer CCTV surveys

Lead Research Organisation: South West Water
Department Name: Exeter Office

Abstract

Water companies across the UK (and world) regularly inspect their sewers to prioritise maintenance and ensure the effective operation of their network. Failure to do so can result in incidents, including the discharge of untreated sewage to the environment, pipe collapse or even the formation of sewer blocking fatbergs. The importance of minimising these events is reinforced by the UKWIR objective to achieve zero uncontrolled sewer discharges by 2050. In most cases these occurrences are prevented using CCTV surveying and resolved with an early intervention. However, surveys are time consuming and expensive. Moreover, these reports are often inconsistent and inaccurate, largely due to human error and the subjective nature of fault codes. This project aims to augment the existing annotation and reporting process, with the overall ambition of fully automating the full CCTV surveying process. This proposed combination of AI and robotics will revolutionise sewer surveying and maintenance, improving the speed accuracy and efficiency of the entire practice. In turn this should result in the completion of more surveys and a much higher chance of pre-empting sewer failure.

Currently SWW and the UoE are completing a KTP project, to internally implement the prototype fault detection method, investigated during the preceding PhD. The two-year partnership (due to complete in November 2020), has developed and trained the detection system on SWW's archive of CCTV footage and implementing this as a decision support tool. This is capable of highlighting faults and estimating their general type from recorded CCTV footage; extremely useful for the quick analysis of previously unused video that lacks annotation. Alongside technical developments, the project has built a network of collaborators (including iTouch and the WRc), whilst being widely publicised at both academic and industry events. Although the KTP has achieved its goal of bringing a functional tool to SWW, it is clear that the technology has potential for so much more, driving up efficiency and accuracy over current practices. The three key goals of the project are:

(1) Develop the annotation capabilities of the technology to achieve the full standards outlined in the MSCC.
(2) Implement the developed software so as to assist and perform live reporting.
(3) Record and annotate previously unreported pipe features.

The proposed project offers the opportunity to not only develop this research into a fully flourished technology for both UK and international use, but provides the resources and foundations for future image processing and machine learning research within SWW and the water industry as a whole. This research would continue to contribute solutions to national and global initiatives, aligning with the UN sustainable development goal ('protecting important sites for terrestrial and freshwater biodiversity'), UKWIR's Big Questions ('How do we achieve zero uncontrolled discharges from sewers by 2050?') and the UK industrial Strategy ('Increase sector productivity utilising AI'). Whether this takes the form of future visual inspection techniques or automation and support of other operational functions, the work would continue to drive efficiencies and improve performance using cutting edge computer science techniques.

Publications

10 25 50
 
Description As a result of this award, we have worked on the further application of computer vision technologies to the automated annotation of CCTV sewer surveys.
Key results from this first period include:
- Quantification of the inaccuracies seen in current human surveying. A high level of inaccuracy was previously suspected, but never quantified
- Automatic reading of hard-coded video chainage (the distance a camera is down a pipe)
- Automatic detection of pipe joints
- Proof of concept work around the annotation of pipe water levels
- Refinement of existing fault detection and classification methodologies (exploring both deep learning and "traditional" computer vision methods
- Collection of significant volumes of labelled CCTV sewer surveys, and manual validation of this data
Exploitation Route The outcomes of this research could be taken forward to application across the UK (and international) wastewater inspection industry.
Furthermore, this technology could be applied to other infrastructure elements which also require visual inspection. This would be best suited to applications where large volumes of video footage are currently used, for example railway line, gas main, clean water pipe or tunnel inspection.
Sectors Construction

Digital/Communication/Information Technologies (including Software)

Other

 
Description Ofwat Innovation Challenge: Artificial Intelligence and Sewers 
Organisation WRc
Country United Kingdom 
Sector Private 
PI Contribution We provided consultation and guidance on the annotation and data structuring process. Furthermore, SWW provided a collection of CCTV images to contribute towards the dataset.
Collaborator Contribution The WRc validated annotations on ~27,000 CCTV images of sewer pipe. Aiming for roughly 1,000 images per common fault code, this acts as a great resource for the developing AI to automate sewer CCTV annotation.
Impact - Dataset of 27,000 labelled and verified CCTV images, which are now publicly available for developers worldwide.
Start Year 2022
 
Description Univeristy of Exeter 
Organisation University of Exeter
Department College of Engineering, Mathematics & Physical Sciences
Country United Kingdom 
Sector Academic/University 
PI Contribution We worked closely with UoE to develop and implement the computer vision algorithms fundamental to the application of this technology.
Collaborator Contribution UoE work closely with the team, providing consultation and guidance for the effective use of computer vision technologies.
Impact There are currently no partner specific outputs.
Start Year 2021
 
Description Attendance at the Waste Water Smart Networks Forum - Technolog 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Attendance and networking with other water companies and supply chain partners about the technology and it's applicability to their networks and businesses.
Year(s) Of Engagement Activity 2024
 
Description Centre for Water Systems - invited talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Undergraduate students
Results and Impact 1 hour presentation on the project to an audience of around 30 students and academics
Year(s) Of Engagement Activity 2023
URL https://www.eventbrite.co.uk/e/cws-seminars-22-23-dr-josh-myrans-in-person-event-tickets-50747745773...
 
Description CoUD Labs presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Invitational (remote) presentation to the CoUD labs workshop, where we discussed the use of new innovation for sewer infrastructure inspection.
Year(s) Of Engagement Activity 2025
URL https://co-udlabs.eu/2025/02/19/webinar-techniques-for-monitoring-underground-infrastructure/
 
Description FLF 2 o'clock talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact A 20 minute online talk (and 10 minute Q&A) to colleagues and peers on the future leaders fellowship scheme.
Year(s) Of Engagement Activity 2021
 
Description ICUD 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Online conference presentation
Year(s) Of Engagement Activity 2021
URL https://iwa-network.org/events/15th-international-conference-on-urban-drainage/
 
Description Northumbrian Water Innovation Festival 2024 - Pipebots patrol 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact 1 week workshop at the northumbrian water innovation festival. Sharing insight into automated sewer inspections with the pipebots patrol (ofwat innovation project).
Year(s) Of Engagement Activity 2024
URL https://www.innovationfestival.org/the-festival/
 
Description Pennon Innovation and Commercialisation committee workshop 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Industry/Business
Results and Impact Invitational presentation to discuss the project and the journey of the technology to this point. Helping build a commercial strategy for innovation within the pennon group.
Year(s) Of Engagement Activity 2024
 
Description Presentation at Institute of water -south west 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact 5 minute presentation about the project at the Institute of Water young persons social.
This was to other peers in South West Water, students and other young professionals in the region.
Year(s) Of Engagement Activity 2025
 
Description Presentation to KTP leadership 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Invitational presentation to Richard Lamb (Director of KTP) and other local KTP advisers as part of the KTP 50th anniversary tour. This talked about the success of the project so far, alongside the journey of the project from inception as PhD project through to current implementation.
Year(s) Of Engagement Activity 2025
 
Description Promotional vendor stand, showing off AI tool at Metrorod annuyal conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact As part of the project partner (iTouch's) promotional vendor stand, we were able to promote the new AI technology giving demonstrations and receiving initial feedback from professionals int he industry.
Year(s) Of Engagement Activity 2024
URL https://www.metrorod.co.uk/
 
Description PyDaata Exeter presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Invitational presentation to the local PyData Exeter monthly meeting. This was to share information about the project, tools and techniques that we are using.
Year(s) Of Engagement Activity 2024
URL https://www.linkedin.com/posts/pydata-exeter_pydataexeter-datascience-ai-activity-724535140288811827...
 
Description Tech South West - south west innovation expo 2024 attendance 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Industry/Business
Results and Impact Attendance, networkign and workshops at the tech south west expo 2024. Here we engaged with local tech business, academia and policy makers discussing the project and its applicability to other fields.
Year(s) Of Engagement Activity 2024
URL https://www.techsouthwest.co.uk/south-west-innovation-expo-returns-to-exeter/
 
Description WISE cdt celebration event 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact A 15 minute presentation of the research, and progress since completing my Phd to all of the stakeholders of the WISE cdt program. This included current and past postgraduate students, academics from numerous universities and number of partner businesses (across the water sector)
Year(s) Of Engagement Activity 2023
URL https://www.linkedin.com/feed/update/urn:li:activity:7051840919938965505/