📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

COSTRA -- The Cost of Winning Strategies

Lead Research Organisation: University of Liverpool
Department Name: Computer Science

Abstract

We investigate mathematical models of computation, which is a necessary precondition to understand and explain the behaviour of AI systems and other computer programs.

Cyber-physical systems increasingly affect most aspects of our lives: they are used in pacemakers, manage factory supply chains, trade in stocks and autonomously pilot modern planes and cars. Software deficiencies can have serious economic and life-threatening consequences. While traditional methods of testing and simulations can be effective for finding errors, they are hopelessly inadequate for showing their absence. A more promising approach is to use mathematical arguments to prove that a system behaves as intended, in all possible situations. Verification is the area of research based on this idea. It is truly interdisciplinary and has fascinating connections to Artificial Intelligence, Discrete Mathematics and Software Engineering.

To prove the correctness of some system one starts with a formal model of the system itself as well as a specification that defines what correctness means. In model-checking, for instance, we model systems as a finite-state machine and the specifications as temporal logic formulae. Correctness then ammounts to the fact that the finite-state machine satisfies the formula, which can often be verified automatically. Naturally, there are many different ways to formalize systems and specifications, and some formalisms are more expressive than others.

Current methods are very good at analysing models with only finitely many internal configurations, such as microchips or hardware drivers. However, if we move to more expressive models we quickly go beyond the reach of known techniques or even cross theoretical limits. At this point the research frontier is on so-called infinite-state models, which enable us to argue directly about unbounded quantities such as realtime constraints, recursion depth or simultaneous user requests.
For example, imagine a network server that can receive any number of requests concurrently and which should eventually respond to all of them. The total number of requests is not determined in advance and so it is necessary to incorporate it into the model, which consequently has infinitely many possible internal configurations. However, we do have good finite representations, such as Counter Machines or Pushdown Automata, that can be used in such situations. The result is a trade-off between the expressibility of these formalisms and the feasibility of their verification.

A key mathematical tool for correctness checks and decision making in the presence of environmental uncertainty are games between antagonistic players, who try to cause and prevent errors, respectively. Closely related formalisms are used in Economics, Biology, Chemistry and other sciences, in the form of Markov Chains and Markov Decision Processes.
Correctness here corresponds to the existence of winning strategies, which tell their player how to move in order to secure a win. Winning strategies are important not only because they act as correctness certificates but also because they can often be directly translated into executable code.
Our research seeks to understand more general, infinitary strategies, which are often necessary for realistic specifications. We will investigate the mathematical structure, internal complexity, and thus the cost of winning strategies. Advancing our understanding of strategies promises to yield better finite representations, which in turn makes it easier to verify that winning strategies exist (checking correctness) as well as automatically generating and executing them.

Our research leads to a deeper understanding of the nature of computation and decision making and provides new and improved methods for automated program verification.
 
Description This project resulted in a string of new theoretical bounds on the complexity/cost of strategies in stochastic games, Markov decision processes, and non-stochastic games on infinite state systems with applications in reactive synthesis.
Noteworthy are the join papers with collaborators Kiefer, Mayer, and Shimmoharmadi, which provide deep new results on countable MDPs and games, and have been published at top CS conferences/journals but also in mathematical journals (Operations Research/Game Theory).
Separately, we have provided new algorithms for approximating large classes of games, improving the status quo and providing new leads for further interdisciplinary research.
Finally, we some of our outputs directly concern the cutting edge in reactive synthesis, an area that seeks to automatically construct correct-by-design mechanisms. We published several results on "history-determinism", a novel concept motivated by enabling fast game solvers, and showed that these techniques are applicable to much more expressive (game) situations. This again created new research directions, some of which are now being investigated as part of a follow-up project funded by the EPSRC.

We have also hosted several workshops and had the expected positive impact on early-career researchers, as outlined in the original proposal, thus benefiting the academic community in addition to the immediate scientific outputs.
Exploitation Route The majority of our outputs are in the form of research papers in theoretical computer science. These have, and will further, impact other researchers in our and neighbouring disciplines, in particular in Maths and Economics (Game theory). Other outputs in the form of software tools are still under development and unpublished, but we expect these to be built on by other academics and possibly lead to more mature implementations in more practical settings.
Sectors Aerospace

Defence and Marine

Digital/Communication/Information Technologies (including Software)

Electronics

Financial Services

and Management Consultancy

 
Description Below the Branches of Universal Trees
Amount £202,160 (GBP)
Funding ID EP/X017796/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 03/2023 
End 08/2024
 
Description Games for Good
Amount £493,930 (GBP)
Funding ID EP/X042596/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 03/2024 
End 02/2027
 
Description Open problem workshops 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact We organize regular open-problem workshops that coordinate and facilitate new research within the department and other local universities (LJMU, and further, Keele and Warwick). The audience are researchers, PhD and at times MSc students woring in Theoretical Computer Science. The workshop runs at irregular intervals but at least once a year since 2021.
Several of our reported publications are the result of collaborations that grew out of these workshops.
Year(s) Of Engagement Activity 2021,2022,2023,2024,2025
 
Description Workshop on games on graphs 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a special interest group workshop, held in Maastricht and organised by the PI. The aim of the workshop was to bring together researchers working on graph and stochastic games, various forms of which are studied in computer science, economics and mathematics. Despite clear differences in the emphasis, these fields share a number of research goals and use similar proof techniques and there is a scope for an interdisciplinary collaboration. The workshop will serve as a forum to facilitate such collaboration.
Year(s) Of Engagement Activity 2022
URL https://gamenet22.csc.liv.ac.uk/