COSTRA -- The Cost of Winning Strategies
Lead Research Organisation:
University of Liverpool
Department Name: Computer Science
Abstract
We investigate mathematical models of computation, which is a necessary precondition to understand and explain the behaviour of AI systems and other computer programs.
Cyber-physical systems increasingly affect most aspects of our lives: they are used in pacemakers, manage factory supply chains, trade in stocks and autonomously pilot modern planes and cars. Software deficiencies can have serious economic and life-threatening consequences. While traditional methods of testing and simulations can be effective for finding errors, they are hopelessly inadequate for showing their absence. A more promising approach is to use mathematical arguments to prove that a system behaves as intended, in all possible situations. Verification is the area of research based on this idea. It is truly interdisciplinary and has fascinating connections to Artificial Intelligence, Discrete Mathematics and Software Engineering.
To prove the correctness of some system one starts with a formal model of the system itself as well as a specification that defines what correctness means. In model-checking, for instance, we model systems as a finite-state machine and the specifications as temporal logic formulae. Correctness then ammounts to the fact that the finite-state machine satisfies the formula, which can often be verified automatically. Naturally, there are many different ways to formalize systems and specifications, and some formalisms are more expressive than others.
Current methods are very good at analysing models with only finitely many internal configurations, such as microchips or hardware drivers. However, if we move to more expressive models we quickly go beyond the reach of known techniques or even cross theoretical limits. At this point the research frontier is on so-called infinite-state models, which enable us to argue directly about unbounded quantities such as realtime constraints, recursion depth or simultaneous user requests.
For example, imagine a network server that can receive any number of requests concurrently and which should eventually respond to all of them. The total number of requests is not determined in advance and so it is necessary to incorporate it into the model, which consequently has infinitely many possible internal configurations. However, we do have good finite representations, such as Counter Machines or Pushdown Automata, that can be used in such situations. The result is a trade-off between the expressibility of these formalisms and the feasibility of their verification.
A key mathematical tool for correctness checks and decision making in the presence of environmental uncertainty are games between antagonistic players, who try to cause and prevent errors, respectively. Closely related formalisms are used in Economics, Biology, Chemistry and other sciences, in the form of Markov Chains and Markov Decision Processes.
Correctness here corresponds to the existence of winning strategies, which tell their player how to move in order to secure a win. Winning strategies are important not only because they act as correctness certificates but also because they can often be directly translated into executable code.
Our research seeks to understand more general, infinitary strategies, which are often necessary for realistic specifications. We will investigate the mathematical structure, internal complexity, and thus the cost of winning strategies. Advancing our understanding of strategies promises to yield better finite representations, which in turn makes it easier to verify that winning strategies exist (checking correctness) as well as automatically generating and executing them.
Our research leads to a deeper understanding of the nature of computation and decision making and provides new and improved methods for automated program verification.
Cyber-physical systems increasingly affect most aspects of our lives: they are used in pacemakers, manage factory supply chains, trade in stocks and autonomously pilot modern planes and cars. Software deficiencies can have serious economic and life-threatening consequences. While traditional methods of testing and simulations can be effective for finding errors, they are hopelessly inadequate for showing their absence. A more promising approach is to use mathematical arguments to prove that a system behaves as intended, in all possible situations. Verification is the area of research based on this idea. It is truly interdisciplinary and has fascinating connections to Artificial Intelligence, Discrete Mathematics and Software Engineering.
To prove the correctness of some system one starts with a formal model of the system itself as well as a specification that defines what correctness means. In model-checking, for instance, we model systems as a finite-state machine and the specifications as temporal logic formulae. Correctness then ammounts to the fact that the finite-state machine satisfies the formula, which can often be verified automatically. Naturally, there are many different ways to formalize systems and specifications, and some formalisms are more expressive than others.
Current methods are very good at analysing models with only finitely many internal configurations, such as microchips or hardware drivers. However, if we move to more expressive models we quickly go beyond the reach of known techniques or even cross theoretical limits. At this point the research frontier is on so-called infinite-state models, which enable us to argue directly about unbounded quantities such as realtime constraints, recursion depth or simultaneous user requests.
For example, imagine a network server that can receive any number of requests concurrently and which should eventually respond to all of them. The total number of requests is not determined in advance and so it is necessary to incorporate it into the model, which consequently has infinitely many possible internal configurations. However, we do have good finite representations, such as Counter Machines or Pushdown Automata, that can be used in such situations. The result is a trade-off between the expressibility of these formalisms and the feasibility of their verification.
A key mathematical tool for correctness checks and decision making in the presence of environmental uncertainty are games between antagonistic players, who try to cause and prevent errors, respectively. Closely related formalisms are used in Economics, Biology, Chemistry and other sciences, in the form of Markov Chains and Markov Decision Processes.
Correctness here corresponds to the existence of winning strategies, which tell their player how to move in order to secure a win. Winning strategies are important not only because they act as correctness certificates but also because they can often be directly translated into executable code.
Our research seeks to understand more general, infinitary strategies, which are often necessary for realistic specifications. We will investigate the mathematical structure, internal complexity, and thus the cost of winning strategies. Advancing our understanding of strategies promises to yield better finite representations, which in turn makes it easier to verify that winning strategies exist (checking correctness) as well as automatically generating and executing them.
Our research leads to a deeper understanding of the nature of computation and decision making and provides new and improved methods for automated program verification.
Publications
Austin P
(2023)
Parity Games on Temporal Graphs
Blondin M
(2021)
The Reachability Problem for Two-Dimensional Vector Addition Systems with States
in Journal of the ACM
Bose S
(2023)
History-deterministic Vector Addition Systems
Bose S
(2023)
History-Deterministic Vector Addition Systems
Bose S
(2024)
History-deterministic Timed Automata
in Logical Methods in Computer Science
Bose S
(2024)
Bounded-Memory Strategies in Partial-Information Games
Bose S
(2024)
Bounded-Memory Strategies in Partial-Information Games
| Description | This project resulted in a string of new theoretical bounds on the complexity/cost of strategies in stochastic games, Markov decision processes, and non-stochastic games on infinite state systems with applications in reactive synthesis. Noteworthy are the join papers with collaborators Kiefer, Mayer, and Shimmoharmadi, which provide deep new results on countable MDPs and games, and have been published at top CS conferences/journals but also in mathematical journals (Operations Research/Game Theory). Separately, we have provided new algorithms for approximating large classes of games, improving the status quo and providing new leads for further interdisciplinary research. Finally, we some of our outputs directly concern the cutting edge in reactive synthesis, an area that seeks to automatically construct correct-by-design mechanisms. We published several results on "history-determinism", a novel concept motivated by enabling fast game solvers, and showed that these techniques are applicable to much more expressive (game) situations. This again created new research directions, some of which are now being investigated as part of a follow-up project funded by the EPSRC. We have also hosted several workshops and had the expected positive impact on early-career researchers, as outlined in the original proposal, thus benefiting the academic community in addition to the immediate scientific outputs. |
| Exploitation Route | The majority of our outputs are in the form of research papers in theoretical computer science. These have, and will further, impact other researchers in our and neighbouring disciplines, in particular in Maths and Economics (Game theory). Other outputs in the form of software tools are still under development and unpublished, but we expect these to be built on by other academics and possibly lead to more mature implementations in more practical settings. |
| Sectors | Aerospace Defence and Marine Digital/Communication/Information Technologies (including Software) Electronics Financial Services and Management Consultancy |
| Description | Below the Branches of Universal Trees |
| Amount | £202,160 (GBP) |
| Funding ID | EP/X017796/1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 03/2023 |
| End | 08/2024 |
| Description | Games for Good |
| Amount | £493,930 (GBP) |
| Funding ID | EP/X042596/1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 03/2024 |
| End | 02/2027 |
| Description | Open problem workshops |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Other audiences |
| Results and Impact | We organize regular open-problem workshops that coordinate and facilitate new research within the department and other local universities (LJMU, and further, Keele and Warwick). The audience are researchers, PhD and at times MSc students woring in Theoretical Computer Science. The workshop runs at irregular intervals but at least once a year since 2021. Several of our reported publications are the result of collaborations that grew out of these workshops. |
| Year(s) Of Engagement Activity | 2021,2022,2023,2024,2025 |
| Description | Workshop on games on graphs |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | This was a special interest group workshop, held in Maastricht and organised by the PI. The aim of the workshop was to bring together researchers working on graph and stochastic games, various forms of which are studied in computer science, economics and mathematics. Despite clear differences in the emphasis, these fields share a number of research goals and use similar proof techniques and there is a scope for an interdisciplinary collaboration. The workshop will serve as a forum to facilitate such collaboration. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://gamenet22.csc.liv.ac.uk/ |
