Full automation of sewer CCTV surveys
Lead Research Organisation:
South West Water Limited
Department Name: Exeter Office
Abstract
Water companies across the UK (and world) regularly inspect their sewers to prioritise maintenance and ensure the effective operation of their network. Failure to do so can result in incidents, including the discharge of untreated sewage to the environment, pipe collapse or even the formation of sewer blocking fatbergs. The importance of minimising these events is reinforced by the UKWIR objective to achieve zero uncontrolled sewer discharges by 2050. In most cases these occurrences are prevented using CCTV surveying and resolved with an early intervention. However, surveys are time consuming and expensive. Moreover, these reports are often inconsistent and inaccurate, largely due to human error and the subjective nature of fault codes. This project aims to augment the existing annotation and reporting process, with the overall ambition of fully automating the full CCTV surveying process. This proposed combination of AI and robotics will revolutionise sewer surveying and maintenance, improving the speed accuracy and efficiency of the entire practice. In turn this should result in the completion of more surveys and a much higher chance of pre-empting sewer failure.
Currently SWW and the UoE are completing a KTP project, to internally implement the prototype fault detection method, investigated during the preceding PhD. The two-year partnership (due to complete in November 2020), has developed and trained the detection system on SWW's archive of CCTV footage and implementing this as a decision support tool. This is capable of highlighting faults and estimating their general type from recorded CCTV footage; extremely useful for the quick analysis of previously unused video that lacks annotation. Alongside technical developments, the project has built a network of collaborators (including iTouch and the WRc), whilst being widely publicised at both academic and industry events. Although the KTP has achieved its goal of bringing a functional tool to SWW, it is clear that the technology has potential for so much more, driving up efficiency and accuracy over current practices. The three key goals of the project are:
(1) Develop the annotation capabilities of the technology to achieve the full standards outlined in the MSCC.
(2) Implement the developed software so as to assist and perform live reporting.
(3) Record and annotate previously unreported pipe features.
The proposed project offers the opportunity to not only develop this research into a fully flourished technology for both UK and international use, but provides the resources and foundations for future image processing and machine learning research within SWW and the water industry as a whole. This research would continue to contribute solutions to national and global initiatives, aligning with the UN sustainable development goal ('protecting important sites for terrestrial and freshwater biodiversity'), UKWIR's Big Questions ('How do we achieve zero uncontrolled discharges from sewers by 2050?') and the UK industrial Strategy ('Increase sector productivity utilising AI'). Whether this takes the form of future visual inspection techniques or automation and support of other operational functions, the work would continue to drive efficiencies and improve performance using cutting edge computer science techniques.
Currently SWW and the UoE are completing a KTP project, to internally implement the prototype fault detection method, investigated during the preceding PhD. The two-year partnership (due to complete in November 2020), has developed and trained the detection system on SWW's archive of CCTV footage and implementing this as a decision support tool. This is capable of highlighting faults and estimating their general type from recorded CCTV footage; extremely useful for the quick analysis of previously unused video that lacks annotation. Alongside technical developments, the project has built a network of collaborators (including iTouch and the WRc), whilst being widely publicised at both academic and industry events. Although the KTP has achieved its goal of bringing a functional tool to SWW, it is clear that the technology has potential for so much more, driving up efficiency and accuracy over current practices. The three key goals of the project are:
(1) Develop the annotation capabilities of the technology to achieve the full standards outlined in the MSCC.
(2) Implement the developed software so as to assist and perform live reporting.
(3) Record and annotate previously unreported pipe features.
The proposed project offers the opportunity to not only develop this research into a fully flourished technology for both UK and international use, but provides the resources and foundations for future image processing and machine learning research within SWW and the water industry as a whole. This research would continue to contribute solutions to national and global initiatives, aligning with the UN sustainable development goal ('protecting important sites for terrestrial and freshwater biodiversity'), UKWIR's Big Questions ('How do we achieve zero uncontrolled discharges from sewers by 2050?') and the UK industrial Strategy ('Increase sector productivity utilising AI'). Whether this takes the form of future visual inspection techniques or automation and support of other operational functions, the work would continue to drive efficiencies and improve performance using cutting edge computer science techniques.
Description | As a result of this award, we have worked on the further application of computer vision technologies to the automated annotation of CCTV sewer surveys. Key results from this first period include: - Quantification of the inaccuracies seen in current human surveying. A high level of inaccuracy was previously suspected, but never quantified - Automatic reading of hard-coded video chainage (the distance a camera is down a pipe) - Automatic detection of pipe joints - Proof of concept work around the annotation of pipe water levels - Refinement of existing fault detection and classification methodologies (exploring both deep learning and "traditional" computer vision methods - Collection of significant volumes of labelled CCTV sewer surveys, and manual validation of this data |
Exploitation Route | The outcomes of this research could be taken forward to application across the UK (and international) wastewater inspection industry. Furthermore, this technology could be applied to other infrastructure elements which also require visual inspection. This would be best suited to applications where large volumes of video footage are currently used, for example railway line, gas main, clean water pipe or tunnel inspection. |
Sectors | Construction Digital/Communication/Information Technologies (including Software) Other |
Description | Ofwat Innovation Challenge: Artificial Intelligence and Sewers |
Organisation | WRc |
Country | United Kingdom |
Sector | Private |
PI Contribution | We provided consultation and guidance on the annotation and data structuring process. Furthermore, SWW provided a collection of CCTV images to contribute towards the dataset. |
Collaborator Contribution | The WRc validated annotations on ~27,000 CCTV images of sewer pipe. Aiming for roughly 1,000 images per common fault code, this acts as a great resource for the developing AI to automate sewer CCTV annotation. |
Impact | - Dataset of 27,000 labelled and verified CCTV images, which are now publicly available for developers worldwide. |
Start Year | 2022 |
Description | Univeristy of Exeter |
Organisation | University of Exeter |
Department | College of Engineering, Mathematics & Physical Sciences |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | We worked closely with UoE to develop and implement the computer vision algorithms fundamental to the application of this technology. |
Collaborator Contribution | UoE work closely with the team, providing consultation and guidance for the effective use of computer vision technologies. |
Impact | There are currently no partner specific outputs. |
Start Year | 2021 |
Description | Centre for Water Systems - invited talk |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Undergraduate students |
Results and Impact | 1 hour presentation on the project to an audience of around 30 students and academics |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.eventbrite.co.uk/e/cws-seminars-22-23-dr-josh-myrans-in-person-event-tickets-50747745773... |
Description | FLF 2 o'clock talk |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Postgraduate students |
Results and Impact | A 20 minute online talk (and 10 minute Q&A) to colleagues and peers on the future leaders fellowship scheme. |
Year(s) Of Engagement Activity | 2021 |
Description | ICUD 2021 |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Postgraduate students |
Results and Impact | Online conference presentation |
Year(s) Of Engagement Activity | 2021 |
URL | https://iwa-network.org/events/15th-international-conference-on-urban-drainage/ |
Description | WISE cdt celebration event |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Postgraduate students |
Results and Impact | A 15 minute presentation of the research, and progress since completing my Phd to all of the stakeholders of the WISE cdt program. This included current and past postgraduate students, academics from numerous universities and number of partner businesses (across the water sector) |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.linkedin.com/feed/update/urn:li:activity:7051840919938965505/ |