Probabilistic Inference Based Utility Evaluation and Path Generation for Active Autonomous Exploration of USVs in Unknown Confined Marine Environments
Lead Research Organisation:
UNIVERSITY COLLEGE LONDON
Department Name: Mechanical Engineering
Abstract
Unmanned surface vessels (USVs) are water-borne vessels that are capable of operating on the surface of the water without any onboard human operators. USVs can operate in confined areas (ports, harbours, marinas, etc.) to conduct demanding and challenging missions such as port dredging survey, berth clearance monitoring and marine infrastructure maintenance, with significant benefits including reduced risk to personnel, improved spatial-temporal efficiency and increased operation endurance. However, when operating in confined marine environments, current USVs are usually remotely controlled. This is because in contrast to navigating in public waterways, confined marine environments are highly dynamic (the locations of docked/moored vessels in a port may be constantly changing) making static nautical charts or satellite and aerial imagery less useful for navigation. Such a factor makes the confined marine environment more highly unknown and associated with high levels of uncertainties. Autonomous exploration, as a process that can map an unknown confined environment in an automatic way, has therefore become critical to USV operation in unknown confined marine environments.
Current state-of-the-art autonomous exploration strategy employed by USVs is to leverage the Simultaneous Localisation And Mapping (SLAM) technology to build a map of an environment using sensory data without any prior information. Since SLAM is a passive process, regular teleoperation with human operators guiding the map-building process is required for existing USV platforms, making the exploration not fully autonomous. To make the SLAM based autonomous exploration an active process, planning functionality including two modules, i.e., a utility evaluation module and a path generation/selection module, has to be integrated. However, current studies about utility evaluation and path generation cannot address the issues caused by the sparse landmarks in a marine environment, which will compromise the exploration accuracy and efficiency.
This research therefore aims to develop a new active autonomous exploration framework using probabilistic inference based utility evaluation and path generation/selection. More specifically, we will construct a pseudo map which contains virtual landmarks as a proxy for an unknown confined marine environment with sparse real landmarks, and evaluate uncertainties as per marginal posterior distributions of poses and positions of virtual landmarks, respectively, using Bayesian probabilistic inference. We also propose to design a new Gaussian Process (GP) based path generation algorithm for autonomous exploration and solve the path generation problem as probabilistic inference on a factor graph. A cross-entropy optimisation method will be adapted to the path planning to enable efficient derivation of the GP mean and covariance updating rules by taking into account nonlinear constraints such as USVs' manoeuvrability.
Of key importance for the success of this work is the international collaboration with a leading marine robotics expert, Prof. Brendan Englot, Stevens Institute of Technology, to jointly develop the framework. This work will also have a close collaboration with experienced industrial partners, including Port of London Authority (PLA) and BMT Group Ltd. By working closely with PLA and BMT, innovations generated from this research will be implemented on the Otter USV to conduct use-case demonstrations (e.g., hydrographic survey) on the Tidal Thames. And the long-term vision of this international collaboration is to establish a strong UK-US research consortium on future marine innovations in advanced sensors, AI/machine learning and robotics to work collaboratively with more academic institutions, companies and regulators/organisations.
Current state-of-the-art autonomous exploration strategy employed by USVs is to leverage the Simultaneous Localisation And Mapping (SLAM) technology to build a map of an environment using sensory data without any prior information. Since SLAM is a passive process, regular teleoperation with human operators guiding the map-building process is required for existing USV platforms, making the exploration not fully autonomous. To make the SLAM based autonomous exploration an active process, planning functionality including two modules, i.e., a utility evaluation module and a path generation/selection module, has to be integrated. However, current studies about utility evaluation and path generation cannot address the issues caused by the sparse landmarks in a marine environment, which will compromise the exploration accuracy and efficiency.
This research therefore aims to develop a new active autonomous exploration framework using probabilistic inference based utility evaluation and path generation/selection. More specifically, we will construct a pseudo map which contains virtual landmarks as a proxy for an unknown confined marine environment with sparse real landmarks, and evaluate uncertainties as per marginal posterior distributions of poses and positions of virtual landmarks, respectively, using Bayesian probabilistic inference. We also propose to design a new Gaussian Process (GP) based path generation algorithm for autonomous exploration and solve the path generation problem as probabilistic inference on a factor graph. A cross-entropy optimisation method will be adapted to the path planning to enable efficient derivation of the GP mean and covariance updating rules by taking into account nonlinear constraints such as USVs' manoeuvrability.
Of key importance for the success of this work is the international collaboration with a leading marine robotics expert, Prof. Brendan Englot, Stevens Institute of Technology, to jointly develop the framework. This work will also have a close collaboration with experienced industrial partners, including Port of London Authority (PLA) and BMT Group Ltd. By working closely with PLA and BMT, innovations generated from this research will be implemented on the Otter USV to conduct use-case demonstrations (e.g., hydrographic survey) on the Tidal Thames. And the long-term vision of this international collaboration is to establish a strong UK-US research consortium on future marine innovations in advanced sensors, AI/machine learning and robotics to work collaboratively with more academic institutions, companies and regulators/organisations.
Publications
Ma S
(2025)
An End-to-End Deep Reinforcement Learning Based Modular Task Allocation Framework for Autonomous Mobile Systems
in IEEE Transactions on Automation Science and Engineering
Ma S
(2025)
Adaptive informative path planning for active reconstruction of spatio-temporal water pollution dispersion using Unmanned Surface Vehicles
in Applied Ocean Research
Xie Y
(2024)
Reliable LiDAR-based ship detection and tracking for Autonomous Surface Vehicles in busy maritime environments
in Ocean Engineering
| Description | This research has led to significant advancements in the development of autonomous exploration technologies for unmanned surface vehicles (USVs), which are robotic boats capable of navigating and exploring marine environments with minimal human intervention. One of the key achievements is the creation of an intelligent environmental perception system, powered by multi-modal sensors such as LiDAR, radar, and cameras. This system enables USVs to accurately detect obstacles, navigate safely, and operate in diverse and challenging conditions, including busy waterways and harsh weather environments. A major outcome of this work is the development of a real-world maritime LiDAR dataset, collected from the River Thames and marina environments. This dataset has been made openly available to researchers and industry professionals, providing a valuable resource for improving autonomous navigation, vessel detection, and machine learning models in maritime applications. Additionally, new intelligent path-planning algorithms have been designed, allowing USVs to make real-time decisions and optimize their routes while avoiding obstacles. These innovations have the potential to improve the efficiency and safety of marine research, environmental monitoring, offshore infrastructure inspection, and search-and-rescue operations. Through collaboration with partners such as the Port of London Authority (PLA) and Stevens Institute of Technology, this research has been tested and validated in real-world conditions, ensuring its practical applicability. The results of this work are not only advancing the field of marine autonomy but also supporting future developments in safer, more efficient, and environmentally friendly maritime operations. |
| Exploitation Route | The outcomes of this research funding can be applied in several key areas: 1. Advancing Autonomous Maritime Systems: The developed perception system and path-planning algorithms can enhance USVs, autonomous shipping, and offshore monitoring, improving safety and efficiency. 2. Supporting Research and Development: The open-access maritime LiDAR dataset enables researchers to develop better computer vision, sensor fusion, and navigation models, benefiting academia and industry. 3. Improving Maritime Safety & Navigation: Port authorities and regulators can use these technologies for collision avoidance, search-and-rescue, and navigation assistance, making waterways safer. 4. Enhancing Environmental Monitoring: Autonomous USVs can aid in marine environment monitoring, pollution detection, and biodiversity studies, supporting conservation efforts. 5. Driving Industry Innovation: Sectors like offshore energy, shipping, and logistics can integrate these advancements to optimise operations, reduce costs, and improve sustainability. |
| Sectors | Digital/Communication/Information Technologies (including Software) |
| Description | This research has led to significant advancements in autonomous maritime technology, with emerging economic and societal impacts across multiple sectors. The development of intelligent perception systems and path-planning algorithms has enhanced the capabilities of unmanned surface vehicles (USVs), enabling safer and more efficient navigation in complex marine environments. These innovations have the potential to transform operations in maritime transport, offshore energy, environmental monitoring, and search-and-rescue missions, reducing operational risks and costs. A key outcome of this award is the creation of an open-access maritime LiDAR dataset, collected from real-world settings such as the River Thames. This dataset is already being utilised by industry partners, academic researchers to develop improved autonomous navigation and vessel detection systems. The structured data format, modeled on the widely used KITTI dataset, ensures broad accessibility and usability, fostering further advancements in computer vision, sensor fusion, and machine learning applications for marine autonomy. Collaborations have enabled real-world testing and validation, paving the way for commercial applications in autonomous shipping, offshore inspections, and maritime logistics. The findings also contribute to discussions on maritime safety regulations and smart waterway management, offering insights for port authorities and policymakers. Additionally, autonomous USVs equipped with this technology can be deployed for marine ecosystem monitoring, pollution detection, and climate change research, supporting sustainability efforts. Overall, this project has laid the groundwork for long-term advancements in autonomous maritime operations, benefiting both industry and society by enabling safer, smarter, and more sustainable marine navigation. The impact continues to grow as new partnerships and applications emerge. |
| First Year Of Impact | 2024 |
| Sector | Digital/Communication/Information Technologies (including Software) |
| Impact Types | Economic Policy & public services |
| Title | Maritime LiDAR-based Ship Detection Datasets |
| Description | Real-world maritime LiDAR dataset for ship detection. The dataset was collected across a busy maritime environment, including the marina and the River Thames. A Velodyne VLP-16 LiDAR with 16 channels and a measurement range of up to 100m was employed. The processed dataset is managed in the same way as the KITTI datasets. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | The development of this real-world maritime LiDAR dataset for ship detection has had a significant impact on advancing autonomous navigation and perception systems in marine environments. By capturing data from busy waterways such as the River Thames and marina settings, this dataset provides a valuable resource for training and validating machine learning models for vessel detection, obstacle avoidance, and situational awareness. Its structured management, following the widely adopted KITTI dataset format, ensures accessibility and ease of integration into existing research workflows, fostering collaboration across academia and industry. The open-access nature of the dataset enables researchers to develop and benchmark novel deep learning algorithms, ultimately contributing to safer and more efficient autonomous maritime operations. |
| Description | UCL-PLA joint research on marine robotics and automation |
| Organisation | Port of London Authority |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | We have designed and developed a comprehensive sensory suite capable of providing a detailed and multi-dimensional perception of marine environments. This sensory system integrates a range of advanced sensors, including LiDAR, marine image radar, high-resolution cameras, and inertial measurement units (IMU), to enable real-time data acquisition and environmental awareness. The suite is designed to enhance the autonomous capabilities of unmanned surface vehicles (USVs) by improving object detection, obstacle avoidance, and situational awareness in diverse and dynamic water conditions. The sensory suite has been successfully implemented and tested on UCL Tamesis, a research vessel equipped for autonomous navigation experiments, as well as on the Port of London Authority's (PLA) survey boat, which operates on the River Thames. These deployments have facilitated extensive data collection under real-world conditions, capturing various environmental scenarios such as changing tides, variable weather conditions, and complex waterway traffic. The collected data has been instrumental in refining our deep learning models, validating our environmental perception system, and improving the robustness of our intelligent path-planning algorithms. This real-world testing has also provided valuable insights into the challenges of deploying autonomous marine systems in busy and highly dynamic waterways. |
| Collaborator Contribution | The Port of London Authority (PLA) has played a crucial role in supporting our research by providing access to their survey boat as well as UCL Tamesis for extensive data collection and testing. These vessels have been instrumental in facilitating real-world deployments of our sensory suite, allowing us to gather high-quality multi-modal data under diverse environmental conditions. In addition to providing research vessels, PLA has also assisted in managing and coordinating testing sites along the River Thames and several key ports along its course. Their support includes securing the necessary permissions for conducting experiments in busy waterways, ensuring compliance with maritime safety regulations, and providing logistical assistance during field trials. By enabling access to dynamic and challenging marine environments, PLA's contributions have been invaluable in validating our autonomous exploration algorithms, improving environmental perception models, and refining intelligent path-planning strategies for unmanned surface vehicles (USVs). This collaboration has also facilitated direct engagement with maritime professionals, offering valuable real-world insights into the operational challenges of deploying autonomous systems in commercial waterways. |
| Impact | This effort has led to the development of a comprehensive real-world dataset, capturing diverse environmental conditions, vessel interactions, and sensor modalities from various test sites along the River Thames and other key maritime locations. The dataset has been carefully processed, annotated, and structured to ensure its usability for a wide range of research applications, including autonomous navigation, environmental perception, and machine learning-based maritime analysis. To foster further innovation and collaboration within the research community, this dataset has been made open access, allowing researchers, industry professionals, and developers to utilise it for advancing autonomous marine systems, improving sensor fusion techniques, and enhancing situational awareness in complex maritime environments. |
| Start Year | 2024 |
| Description | UK-US research collaboration on marine autonomy and automation |
| Organisation | Stevens Institute of Technology |
| Country | United States |
| Sector | Academic/University |
| PI Contribution | This research focuses on developing intelligent and autonomous exploration algorithms for unmanned surface vehicles (USVs) operating in constrained and dynamic marine environments. The primary objective is to enhance the autonomy and situational awareness of USVs, enabling them to perform exploration, navigation, and decision-making tasks with minimal human intervention. My contribution to this research involves the collection and processing of multi-modal sensory data using an array of advanced sensors, including LiDAR, marine image radar, cameras, and inertial measurement units (IMU). These sensors provide diverse and complementary data streams that capture both spatial and environmental features critical for autonomous navigation. By leveraging this rich sensory input, we have developed a deep learning model designed to efficiently process and integrate the data, ultimately generating a reliable and robust environmental perception system. This system is capable of accurately detecting and interpreting obstacles, waterway structures, and other environmental factors across various marine conditions, including adverse weather and low-visibility scenarios. In addition to environmental perception, we have also designed and implemented intelligent path-planning algorithms that enable USVs to navigate safely and efficiently in complex marine settings. These algorithms incorporate real-time obstacle avoidance, adaptive route optimisation, and uncertainty-aware decision-making strategies to ensure reliable autonomous operation. The integration of these capabilities allows USVs to perform exploration tasks with greater efficiency, making them suitable for a range of real-world applications, including environmental monitoring, offshore infrastructure inspection, and search-and-rescue operations. |
| Collaborator Contribution | The partner's contribution to the project focuses on developing an advanced exploration algorithm that accounts for both pose and observation uncertainties. This is achieved through the introduction of a novel evaluation metric, which enhances the algorithm's ability to assess environmental conditions and improve decision-making under uncertain scenarios. In addition to algorithm development, the partner has played a significant role in the supervision and mentoring of researchers working on the project, providing guidance on technical challenges and methodological approaches. Furthermore, the partner has contributed by developing and sharing open-source simulators, which serve as essential tools for validating and verifying the proposed methodologies. These simulators enable comprehensive testing in a controlled virtual environment before real-world deployment, ensuring robustness and reliability in marine exploration applications. |
| Impact | This collaboration has resulted in several high-impact publications in peer-reviewed scientific journals |
| Start Year | 2024 |
