Approximation theory for two-level value functions with applications

Lead Research Organisation: University of Southampton
Department Name: Sch of Mathematical Sciences

Abstract

A two-level value function is an optimal value function of a parametric optimization problem where the feasible set is described by the optimal solution set of another optimization problem. The primary goal of this project is to develop, for the first time ever in the literature, explicit approximations of two-level value functions. Being able to approximate these functions will enable the design of simple and efficient algorithms for unsolved problems in various areas of optimization, including multilevel, robust, and stochastic optimization. As pessimistic bilevel optimization represents the most prominent application of two-level value functions, the efficiency of the approximations developed in this project will be evaluated though algorithms to be constructed to solve the pessimistic bilevel program. This is one of the most challenging problems in the field of optimization, as the objective function does not have an explicit analytical expression and is typically only upper semicontinuous. These features of pessimistic bilevel optimizaion place the problem out of the framework of standard optimization, where the objective function to be minimized is usually given explicitly and required to be at least lower semicontinuous.

Solving the pessimistic bilevel program will unlock the potential of bilevel optimization as a powerful tool for optimal decision-making. To see this, note that the most basic rule in a bilevel optimization problem (also known as Stackelberg game) is that the leader (upper-level player) plays first by selecting a decision value that optimizes his/her utility function. Subsequently, the follower (lower-level player) selfishly reacts to this choice from the leader by choosing his/her own decision value that optimizes his/her utility function. This generally gives rise to two scenarios: the optimistic and pessimistic bilevel programs. In the optimistic case, one assumes that the follower will cooperate to make decisions that are in favour of the leader. However, if the leader is uncertain about the cooperation of the follower, as a risk-averse player, he/she will solve the pessimistic bilevel program to minimize any potential damage that might result from unfavorable choices from the follower. It is therefore clear that most practical applications of bilevel optimization will only fit into the pessimistic model, as it is more realistic for the leader to assume that the follower will not play in his/her favour. However, because solving the pessimistic bilevel program is very difficult, the literature on bilevel optimization has almost ignored the problem, and is therefore essentially concentrated around the optimistic model of the problem. This project will shift focus from optimistic to pessimistic bilevel optimization, while creating the first framework to efficiently solve the problem.

More broadly, bilevel optimization represents one of the most popular problems in the field of optimization thanks to its inherent mathematical challenges, as well as the wide range of applications which have been growing exponentially in the last 40 years. The results from this project can help to solve problems of major importance in the UK and internationally. For instance, for the large transportation projects currently planned or ongoing in the UK (e.g., Crossrail, HS2, and Heathrow 3rd Runway), bilevel optimization offers a framework for the government (as upper-level player) to maximize their outputs while ensuring that taxpayers (as lower-level player) are also able to achieve their expected objectives. Suitable bilevel optimization models in this context can be constructed around the optimal network design, establishing optimal toll policies where necessary or the optimal estimation of the demand for these facilities.
 
Description So far, approximations for two-level value functions based on the Karush-Kuhn-Tucker reformulation has been, studied, and used to build an algorithmic framework for pessimistic bilevel optimization problem. Substantial progress has been made on the theoretical analysis and numerical implementation also substantially advanced. We expect the first two papers with these results to be completed in the next month or so.
Exploitation Route We expect to produce an open source software toolbox that will hopefully be tested on data from partners and also made available online.
Sectors Aerospace, Defence and Marine,Electronics,Energy,Healthcare,Manufacturing, including Industrial Biotechology

 
Description DAS Ltd 
Organisation Decision Analysis Services Ltd
Country Australia 
Sector Private 
PI Contribution The work of this project led to a secondment with DAS Ltd through the EPSRC IAA project on using data analytics to improve renewable energy production, April - September 2019
Collaborator Contribution The secondment with DAS Ltd (impact partner of this project) led to the development of a tool (see paper "Infrequent adverse event prediction in low carbon energy production using machine learning") to predict infrequent events. For our foam prediction tool to work properly, some expert intervention was needed to select suitable hyperparameters to enable good performance and generalization properties. Considering the fact that the plan operators do not have machine learning expertise, new staff recruitment cost and the possibility that hand-tuning these parameters can lead to inaccuracies in the results, the aim of the secondment is to propose a fully automatic system to predict foaming events in anaerobic digestion. The tool based on bilevel optimization will improve the current tool and make it more attractive for commercial use.
Impact Coniglio, S., Dunn, A.J. and Zemkoho, A.B., 2020. Infrequent adverse event prediction in low carbon energy production using machine learning. arXiv preprint arXiv:2001.06916.
Start Year 2018
 
Description The Alan Turing Institute for data science and artificial intelligence 
Organisation Alan Turing Institute
Country United Kingdom 
Sector Academic/University 
PI Contribution The PI's collaboration with the Turing Institute started in 2019 when he was appointed as Turing Fellow (https://www.southampton.ac.uk/the-alan-turing-institute/news/2021/10/turing-fellows-announced-2021.page); part of his goals as Turing Fellows is to conduct research that falls within the remit of the Institute, taking advantage of the large network of relevant experts to develop new ideas and devevelop collaborations and disseminate his results. The institute also provides some opportunities for grants to support research and collaboration activities, and in this context, the PI won a £5k grant to organize a workshop on optimization and machine learning (https://www.southampton.ac.uk/cormsis/news/events/2019/10/18-optml-event.page); I have also published two papers so far as part of my research related to the Turing remit.
Collaborator Contribution First, the Turing Institute provided £5,500 grant to support the PI's one month visit to the RIKEN Center for Avanced Intelligence (Tokyo, Japan) during this project. This visit is scheduled to take place in August 2022. They also pledged supercomputer resources for large scale computations in the context of this project.
Impact Dunn, A.J., ElRefai, M.H., Roberts, P.R., Coniglio, S., Wiles, B.M., & Zemkoho, A.B. (2021). Deep learning methods for screening patients' S-ICD implantation eligibility. Articial Intelligence in Medicine 119:102139. Link: https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.sciencedirect.com%2Fscience%2Farticle%2Fpii%2FS0933365721001329&data=04%7C01%7CA.B.Zemkoho%40soton.ac.uk%7C2fb26fe14397492b679108da0296fb94%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637825144722248406%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=0KDNhLCIxeK0%2BrPJtkjL8oYMK91t3e%2BQ%2FtSk4WneTvQ%3D&reserved=0 5. Dinh, L.C., Nguyen, T.-D., Zemkoho, A.B. & Tran-Thanh, L. (2021). Last Round Convergence and No-Dynamic Regret in Asymmetric Repeated Games. Proceedings of Machine Learning Research 132:1-25. Link: https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fproceedings.mlr.press%2Fv132%2Fdinh21a.html&data=04%7C01%7CA.B.Zemkoho%40soton.ac.uk%7C2fb26fe14397492b679108da0296fb94%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637825144722248406%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=7nZ%2B%2Feh6LlwCPmvKrJ7r7wFVWZmjvA5ghTFP3CbQjSY%3D&reserved=0 Li, Q., Li, Z., and Zemkoho, A.B., 2021. Bilevel hyperparameter optimization for support vector classication: theoretical analysis and a solution method. arXiv preprint arXiv:2110.01697. Link: https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Farxiv.org%2Fabs%2F2110.01697&data=04%7C01%7CA.B.Zemkoho%40soton.ac.uk%7C2fb26fe14397492b679108da0296fb94%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637825144722248406%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=jo%2F5e%2BaIbYZyKAz7KYhJvnQZFWIyTGgJuJ9lQxDnlBQ%3D&reserved=0
Start Year 2019
 
Description Transport for London (TfL) collaboration 
Organisation Transport for London
Country United Kingdom 
Sector Public 
PI Contribution The PI's collaboration with Transport for London (TfL) started in 2017 with a data license agreement for data access for research on transportation for one of his PhD students; and in the context of this project our collaboration is to be expanded to data analytics-based tools for transport systems management.
Collaborator Contribution TfL is particularly interested in the case studies planned in this EPSRC project on topics such as optimal network design and demand estimation for network and transportation facilities, as well as the use of machine learning techniques to better understand some of the related models. As partner in this project, TfL to sponsor a CORMSIS MSc Summer Project for a threemonth placement at TfL and access to further data as necessary for work on case studies.
Impact Laura Murray's doctoral thesis - it will be soon available online via the University of Southampton's eprints service
Start Year 2017