SEQuence-Analysis Based Hyperheuristics (SEQAH) for Real-World Optimisation Problems

Lead Research Organisation: University of Exeter
Department Name: Engineering Computer Science and Maths

Abstract

Selective hyperheuristics are a set of optimisation techniques that effectively optimise the search algorithm during an optimisation run by selecting combinations of lower level heuristic operations (e.g. mutation, crossover & replication). They operate at the level above metaheuristics (e.g. evolutionary algorithms) and are thus able to react to changes in the search space by modifying the heuristics that are applied to the search problem. Traditional selective hyperheuristics consider single heuristics and heuristic pair performance when determining the heuristic to select next. This project will develop new methods known as a sequence analysis based hyperheuristics (SEQAH) and will investigate the use of sequence analysis techniques, taken from other computational domains such as bioinformatics and natural-language processing, to determine heuristic selection. SEQAH methods will record the search process as a sequence of pairs of heuristic application and performance, and will process this information to inform the selection of the next heuristic to apply in the optimisation. This will allow the technique to automatically select the best heuristics to apply for a given problem - effectively tuning the algorithm to new optimisation problem types, regardless of the underlying application area. By selecting from a set of heuristics, the SEQAH techniques can combine ordinary heuristic operations (e.g. mutation and crossover) with more problem-specific heuristics such as human-designed 'rules-of-thumb' into one coherent algorithm that is able to generate near-optimal solutions in less computational time.

The developed techniques will be tested on problems from the literature and a suite of real-world problems in water distribution optimisation including the design, rehabilitation and operation of large-scale water systems. The optimisation of these systems has the potential to offer improved services in terms of reliability and water quality and to reduce the future cost and environmental impact of providing clean, safe drinking water to homes across the country. The SEQAH technique also has the potential to extend beyond the water industry and should be applicable to any number of optimisation problems in many application areas due to its ability to adapt to new problem spaces online.

Planned Impact

Water Distribution Impact
The initial impact from this project will be wide-ranging with beneficiaries including our partners, Mouchel Ltd., their clients (large UK water companies) and ultimately the consumers that require the provision of clean, safe drinking water with minimal financial and environmental cost. The effective optimisation of the operation and design of water distribution systems in the UK is having and will have a profound effect on the socio-economic wellbeing of the UK. With an ageing infrastructure, increasing demand and regulation and the pressure exerted by climate change UK water companies are required to optimise their operations as effectively as possible. This will yield reduced bills for customers, will go some way to preserving an increasingly scarce resource and promises to reduce the environmental impact (including carbon emissions) of water supply.

Wider Impact
The wider impact of the research will be achieved through the expansion of application fields to which the hyperheuristics will be applied. Many companies that currently do not employ optimisation as they do not have the expertise to tune the algorithms will be able to apply this self-tuning technique which can incorporate problem-specific expertise in the form of heuristics. The exploration of the relationship between problem type and optimisation algorithm will provide key information as to the extent to which algorithms must be modified and tuned from one problem type to another. The results from the investigation in water distribution problems will demonstrate the variation in heuristics and their sequencing required to generate good results for a problem type in reasonable computational time. However, towards the end of the project, we fully intend to develop and test the techniques on a wider number of application areas and industry sectors using the contacts from our industrial partner.

Background
Optimisation is a key component in delivering efficiency and cost savings to businesses in many sectors and evolutionary optimisation has been shown to provide excellent results within reasonable timeframes in a wide variety of sectors. The investigators for this project have been involved in high-impact research involving industry for a number of years. Dr Keedwell has developed evolutionary algorithms for the optimisation of city-scale water distribution systems [1] and work is ongoing under the auspices of a CASE studentship to improve discolouration risk modelling in UK water companies [2]. Prof. Savic has had significant involvement with industry in the UK and further afield through a large number of EPSRC, UKWIR & FRMRC funded projects including EP/H015736/1 (start May 2010) which names some 14 industrial partners and includes both Prof. Savic (PI) and Dr Keedwell (Co-I) as investigators. This background demonstrates that the investigators have a history of working with business and achieving impact through the use of innovative computing technology and their application to problems in the water industry.

[1] Randall-Smith, M, Rogers C, Keedwell E, Diduch R, Kapelan Z, (2006) "Optimized Design of the City of Ottawa Water Network: a Genetic Algorithm Case Study" 8th Annual Water Distribution Systems Analysis Symposium pp1-20
[2] McClymont, K., Keedwell,E. Savic, D. Randall-Smith, M. (2011): "A Hyper-heuristic Approach to Water Distribution Network Design", in the Proceedings of Computing and Control in the Water Industry 2011, University of Exeter, UK

Publications

10 25 50
 
Description - Developed new hyperheuristic algorithms that analyse and generate sequences of search operations
- These algorithms have been shown to improve on the state-of-the-art hyperheuristics from the CHESC 2011 competition
- Also (re-)discovered 13/25 best known solutions to the international timetabling problem
- Generating highly competitive results in water distribution problems, and operations research problems such as nurse rostering, wind farm layout optimisation and inventory routing.
- Multi-objective variants of these algorithms have also been developed which allow for the generation of a set of solutions to problems that optimise a trade-off between objectives
Exploitation Route - The developed algorithms are highly generalisable and it is hoped that they will be adopted by water companies, particularly as they can include expert (i.e. industrial) information. These algorithms could optimise many aspects of water distribution (e.g. rehabilitation, pump scheduling, discolouration management etc.)
- Operations research problems are prevalent in large numbers of businesses who wish to schedule, timetable and manage employees, processes (e.g. manufacturing, product deployment) and transportation (e.g. vehicle routing and scheduling) within their business. The methods developed here have been shown to generate world-class solutions to these tasks and so could be used to develop optimised solutions to these problems.
Sectors Aerospace, Defence and Marine,Agriculture, Food and Drink,Digital/Communication/Information Technologies (including Software),Energy,Environment,Manufacturing, including Industrial Biotechology,Transport,Other

URL https://emps.exeter.ac.uk/computer-science/staff/eckeedwe
 
Description The algorithms developed here have been used to solve problems in two industry-derived competitions, one in nurse rostering 3rd place) and one in inventory routing (ROADEF - 1st place). These contests were based on industrial problems and the ROADEF challenge has a prominent industrial sponsor. In 2018 , the methods developed in this work have led to follow-on funding with Innovate UK and two industrial partners for optimising transport systems in the City of Exeter. In 2020 an industrially funded studentship using findings from this grant commenced with BT plc.
First Year Of Impact 2016
Sector Digital/Communication/Information Technologies (including Software),Healthcare,Transport
Impact Types Societal,Economic

 
Description Hyper-heuristic Optimisation for Advanced Zero Carbon Public Transport Planning
Amount £394,795 (GBP)
Funding ID 10007532 
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 08/2021 
End 02/2023
 
Description Multi-Horizon Digital Twin Models for Transportation
Amount £596,442 (GBP)
Funding ID 104598 
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 12/2018 
End 02/2020
 
Description Invitation to COWS Workshop (UCL SBSE Group) to present project work 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact AK Presented work on this project to the COWS workshop in the CREST group at UCL (part of the DAASE EPSRC project). EK led parts of and AK took part in subsequent workshop discussions relating to hyperheuristics with postgraduate students, postdoctoral researchers and other academic staff.
Year(s) Of Engagement Activity 2015
URL http://crest.cs.ucl.ac.uk/cow/43/
 
Description Invited "Thought Leadership" Talk for BT 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Gave online "Thought Leadership" talk with 60-80 participants on hyper-heuristics focusing on the work in this grant and the SSHH approach that was developed. The talk explored the potential for application to the operations research challenges that BT faces.
Year(s) Of Engagement Activity 2020
 
Description Invited Talk at the University of Plymouth 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Invited talk given to researchers at Plymouth University in February 2019.
Year(s) Of Engagement Activity 2019
 
Description Invited talk at Universite de Haute Alsace, France 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Talk given to Computer Science department at Universite de Haute Alsace, Mulhouse, France in November 2018
Year(s) Of Engagement Activity 2018
 
Description Invited talk at the University of York 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Was invited to talk in the University of York's Electronic Engineering seminar series where I described the work we had done in this project. This led to some interesting discussions afterwards with staff and students and a reciprocal invitation to my contact there to speak in Exeter's seminar series on his work. We have an ongoing collaborative relationship as a result of this event.
Year(s) Of Engagement Activity 2016
URL https://www.york.ac.uk/electronic-engineering/events/past_events/2016/keedwell/
 
Description Keynote talk given at BCS SGAI AI-2021 Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Keynote talk given at AI-2021, Cambridge UK (Online due to COVID)
Year(s) Of Engagement Activity 2021
 
Description Keynote talk given at EA2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Invited keynote talk given at Evolution Artificielle 2019 conference at the University de Haute Alsace in Mulhouse, France by Prof. Ed Keedwell on HOWS outputs and
sequence-based hyperheuristics.
Year(s) Of Engagement Activity 2019
URL https://ea2019.inria.fr/
 
Description Presentation at Clean Water Management Advisory Group (CWMAG), Derby UK 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Presented latest hyperheuristic optimisation research from the grant to the annual meeting of water industry practitioners, including the main water companies and consultants in Derby. In subsequent discussions there was interest from a water company and a consultant in the methods presented.
Year(s) Of Engagement Activity 2015
URL http://www.cwmag.org/?y=11_conference/events_page.php
 
Description Website dedicated to the work on this grant 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Website constructed to convey the main methods, results and outputs arising from the grant.
Year(s) Of Engagement Activity 2014,2015,2016
URL http://emps.exeter.ac.uk/computer-science/research/computer-science/research-interests/nature-inspir...