At the limits of adaptive systems: constrained adaptive control

Lead Research Organisation: University of Leicester
Department Name: Engineering

Abstract

Adaptive control systems are able to adapt themselves to their environment automatically by using algorithms which update their parameters; simply put, they are self-tuning controllers. This is a very appealing feature and, in principle, allows a controller to evolve in order to enhance its performance or to increase its tolerance of uncertainty. In niche applications (most notably in the US aerospace industry) adaptive controllers have proven to be very successful. At the same time all control systems have limits on the "input" they apply to a system (e.g. limits on voltage and current in electrical systems; limits on force and torque in mechanical systems). It is well known if these limits are not accounted for properly in controller design, they can cause the system performance to degrade and may even drive it to instability.

In otherwise linear systems these features are reasonably well understood and so-called "anti-windup" compensators have been devised which can protect a controller against this sort of catastrophic performance degradation. Unfortunately, adaptive controllers are, by their very nature, nonlinear and it is far more difficult to devise control strategies which can handle the potentially toxic mix of adaptation algorithms and control constraints.

This research aims to address the above gap in the control engineer's toolbox by proposing anti-windup compensators for adaptive control systems subject to input constraints. These compensators will serve as retro-fits to existing adaptive control schemes and will only become active when saturation occurs. When this happens the compensators will assist the adaptive controller in maintaining stability and performance and also, via a mechanism we call an "adaptive freeze", prevent the adaptive update algorithms from entering instability themselves. The research will provide mathematical algorithms which can be used to (i) design the adaptive anti-windup compensators and (ii) can be used to analyse constrained input adaptive systems. This second part of the research will enable one to compare the new anti-windup compensators with other measures which have been proposed to tackle input constraints in adaptive control systems.

The research aims to demonstrate these new anti-windup compensators on an in-house developed uninhabited aerial vehicle (UAV) in order to understand the merits and deficiencies of the proposed compensators. The Leicester UAV requires an adaptive control system to extract the best performance from it but, due to its small size and limited motor capacity, is very vulnerable to saturation effects during gusty flight conditions. It will provide a challenging application on which to test the new anti-windup algorithms. Both simulation studies and flight tests will be undertaken.

Ultimately, it is hoped that the research will enable the control engineer to glimpse a hitherto hidden aspect of adaptive control and that the tools developed will better equip him/her for tackling input constraints in adaptive systems.

Planned Impact

Beyond academics there are several groups who will stand to benefit from the proposed research

1. The UK/European Aerospace industry. The benefit to this group will be both direct and indirect. Adaptive control is of particular interest to branches of the aerospace industry because it, potentially, lessens the need for high-fidelity (and therefore time-consuming and costly) mathematical models of the system under control. However applied adaptive control has had considerable set-backs over the years. This research will develop adaptive control laws which may be applied more confidently in practice and hence help the industry to achieve similar levels of performance without the cost involved. Indirect benefit will also be felt by the research adding new impetus to the subject of adaptive aerospace control which has been forgotten in recent years. Together the direct and indirect benefits may, potentially, increase the competitiveness and agility of the UK aerospace industry over the medium to long term. An obvious beneficiary would be the Anglo-French company MBDA, with whom the investigators have recently worked on adaptive controller design.

2. In the longer term adaptive control has the potential to revolutionise the design of controllers for healthcare applications. Healthcare applications of control, such as insulin control, control of artificial organs and depth of anaesthesia control typically suffer from modelling problems: models are difficult to obtain, difficult to validate and have a large degree of variability. Adaptive control is an idea candidate design technique for such systems but, due to the extreme care with which such healthcare control systems must be implemented, these systems have very stringent constraints placed upon them and thus anti-windup-type controllers are vital to ensure their safe functionality. Therefore, overall society as a whole stands to benefit (longer term) from the research through improved and safe healthcare control systems.

Publications

10 25 50
 
Description The grant has made several key discoveries.

1. The existing mechanism of model-reference-adaptive control can be successfully enhanced using a certain form of anti-windup compensation when there are limits on the control (actuator) variables. Although the problem set-up seems quite complicated, the actual way to combine both control elements transpires to be quite simple and intuitive. This has value for practical applications.

2. Existing anti-windup schemes may be enhanced in several ways which either simplify their implementation (which is useful when combined with adaptive control schemes) or increase their performance. Again, this is useful for practical applications.

3. Some extensive simulation studies have revealed that the techniques developed are suitable for certain aircraft most notably, but not restricted to, quadcopter UAVs. This work is currently on-going.

4. The techniques used for anti-windup compensation for systems with magnitude limits may be extended to systems with magnitude limited actuators, although such an extension requires some non-trivial technical development and an additional dynamic component to estimate the actuator's internal state.
Exploitation Route There are several ways in which the findings may be taken forward and put to use by others

1. Practitioners and researchers in the aerospace, space, defence and, more widely transport, sectors may be able to harness the general algorithms developed for use in practical systems; academics and researchers may take the algorithms and improve on them, either to widen their applicability or to develop them in different directions

2. Researchers in communication networks and medicine/biology may be able to exploit some of the broader ideas about constrained adaptive control in their work. For instance, adaptation is often used in networks and constraints (of various types) are also always present. Thus, with some modification the tools developed in this project could be used by this type of researcher in order to obtain networks which perform better in the face of constraints.

3. The techniques studied are ripe for further development by academic researchers and there are several ways in which the theoretical results can be improved.
Sectors Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Education,Pharmaceuticals and Medical Biotechnology,Transport

 
Description Adaptive Control Systems are attractive to control engineers because they enable, in principle, controller design for systems for which little is known, or uncertainty in the mathematical model is large. The downside is that they require significant expertise to design and are particularly vulnerable to certain "uncertainties". This research has addressed a major one of these deficiencies: actuator magnitude and rate-limiting.Findings of the research have been communicated to various industrial organisations within the investigators' networks. In particular, some of the research findings have been communicated to MBDA (UK and France), BAE Systems, DSTL and other partners. DSTL have part-funded a PhD project which is geared at exploiting wider adaptive algorithms and, ultimately, getting them to work in practice. The findings of the research are expected to gradually filter down to industry, but the uptake of the methods develop may take a little longer.
First Year Of Impact 2015
Sector Aerospace, Defence and Marine
Impact Types Economic

 
Description CMMI-EPSRC: Enhanced Control Methods for Aerial and Space Vehicles Equipped with Limited Force Actuators
Amount £600,000 (GBP)
Organisation National Science Foundation (NSF) 
Sector Public
Country United States
Start 03/2022 
End 02/2025
 
Title Systematic design approach for anti-windup compensators for rate-constrained control systems controller using model-reference-adaptive controllers 
Description The approach enables one to consider any constrained control system which is stable and for which full state feedback is available and then design an anti-windup compensator which ensures, under natural conditions, performance enhancement and stability. The method applies to systems for which the system matrix (A) is unknown, but satisfies the matching conditions required by standard model-reference-control approaches. The approach ensures global asymptotic stability of the tracking error, and boundedness of the adaptive control gains if certain conditions are satisfied. The associated complexity of the scheme is low and easily done on-line, with the most complex aspect of the scheme being the solution of an (off-line) Lyapunov equation. This should make it easily implementable on practical adaptive control systems. 
Type Of Material Improvements to research infrastructure 
Year Produced 2020 
Provided To Others? Yes  
Impact This method is one of the few systematic approaches for rate-constrained adaptive control schemes. The approach is used with the Southampton/Leicester research teams and also has inspired work of Dr. Christopher Richards' team at University of Louisville, USA. 
URL https://www.sciencedirect.com/science/article/abs/pii/S0167691120300104
 
Description Collabration with University of Louisville, USA 
Organisation University of Louisville
Country United States 
Sector Academic/University 
PI Contribution Partnership involved exchange of ideas about anti-windup for a quadcopter UAV experiencing large wind-gust disturbances. Contribution by Leicester team was anti-windup stability analysis.
Collaborator Contribution Contribution by Dr. Chris Richards at University of Louisville was quadcopter expertise and a new idea for anti-windup control for such systems.
Impact Two conference papers and two journal papers have been published due to this partnership. In addition, funding from a joint NSF-EPSRC scheme was sought and a grant recently awarded, due to start in March 2022.
Start Year 2017
 
Description Discussions with BAE Systems, Aerodynamics Department 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presentation, and follow-in discussion, to BAE Systems and some personnel from DSTL on the subject of anti-windup. In addition, various email exchanges have taken place in advance and following on from this presentation.

Outcome is that collaboration is intended for the future, through either a BAE Systems "Future Flight Control Engagement" actiivty, or through some other means.
Year(s) Of Engagement Activity 2021