Scalability and robustness in large scale networks and fundamental performance limits

Lead Research Organisation: University of Cambridge
Department Name: Engineering

Abstract

The proposed research will make a contribution towards the analysis and synthesis of large scale complex networks: fundamental theory will be developed and important applications will be addressed, by extending tools from control theory. Networks are present throughout the physical and biological world, but nowadays they also pervade our societies and everyday lives. Such celebrated examples include the Internet, power networks, financial markets; many other emerging applications such as platoons of vehicles, satellite formations, sensor networks; and also examples found in nature, ranging from flocking phenomena to gene regulatory networks. Major challenges that will be addressed are:1. The engineering of large scale heterogeneous networks that are guaranteed to be robust and scalable.2. The reverse engineering of biological networks.A distinctive feature of the networks we would like to engineer, which falls outside more traditional domains in systems and control, is that of scalability. Scalability here refers to the fact that network stability and robustness must be preserved as the network evolves with the addition or removal of heterogeneous agents. Imagine, for example, having to redesign congestion control algorithms each time a new computer/router enters the Internet. A main objective of the proposed research is to develop methodologies for addressing this need for scalability, i.e. be able to guarantee robust stability of the entire arbitrary network by conditions on only local interactions. Previous results in this context show that this is indeed possible by exploiting interconnection structure. Nevertheless many questions still remain unanswered. The aim is to merge less conservative linear results, with corresponding more conservative nonlinear approaches on a common solid theoretical framework. This will lead to non-conservative designs, which are thus of practical interest. These methodologies will have a significant impact on the design of Internet congestion control protocols; improved, less conservative algorithms will lead to a better utilization of the network resources. The same abstract theory can also guarantee robust stability of other networks where scalability is an issue, with the novelty lying in the heterogeneity of the participating dynamics. These include flocking phenomena, coordination of unmanned vehicle formations, distributed computations in sensor networks and other related applications such as vehicle platoons and synchronous operation in power networks.The proposed project will also make a contribution towards the reverse engineering of biological networks at the molecular level, by focusing on the analysis of intrinsic stochasticity within the cell. Life in the cell is dictated by chance; noise is ubiquitous with its sources ranging from fluctuating environments to intrinsic fluctuations due to the random births and deaths of individual molecules. The fact that a substantial part of the noise is intrinsic (and not additive) provides a major challenge in control theoretic methodologies. How can feedback be used to suppress these fluctuations, what are the associated tradeoffs and limitations, and how does nature manage to handle these so efficiently in specific mechanisms? These are questions that will be addressed with our research by developing tools for analyzing known configurations, but more importantly, by deriving fundamental limitations that hold for an arbitrary feedback policy. These hard performance bounds are a result of simple features of these processes such as the presence of delays and noisy feedback channels. Specific feedback mechanisms, such as plasmid replication control in bacteria, will be studied using this theory, thus leading to a better understanding of the underlying functionality. More broadly, feedback is present in many biological processes and understanding the underlying principles is important.

Planned Impact

Both industry and academia will benefit from this research. The novelty and significance lies in the fact that we address certain important features in network analysis and design, which, though essential from a practical perspective, introduce major complications in more conventional approaches. Data networks. From the early stages of the evolution of the Internet, it has been recognized that unrestricted access leads to low network utilization and high packet loss rates, a phenomenon known as congestion collapse. This has lead to the deployment of congestion control algorithms such as TCP and its different versions. These are variations of simple additive increase multiplicative decrease rules, usually tuned after analysis and extensive simulation on specific topologies, with no guarantees for their scalability. Nevertheless in the continuously evolving Internet, with large capacities and large, heterogeneous roundtrip times, current protocols have often turned out to be conservative; this is, for example, the case with long transatlantic links. A major challenge currently worldwide within the communications industry, is the development of improved algorithms which are scalable, with guarantees that they will be well behaved on an arbitrary interconnection. The proposed research will have a major impact in this direction: systematic methods for addressing this need for scalability will be developed. This will lead to improved versions of data network protocols where network resources will be better utilized. Flocking, vehicle platoons, sensor networks, power networks. These are all examples of networks where scalability is also important and therefore our analysis and design methodologies would be of value. The novelty in our setting is that the participating dynamics are heterogeneous, an important feature in such applications which renders the analysis much more demanding. Biological networks. Noise is ubiquitous in life processes within the cell; the importance of understanding the way this is suppressed within gene regulatory networks has been extensively reported by biologists in recent years, in corresponding leading international journals such as Nature, Science, PNAS. The fundamental limits we derive for noise suppression will be high impact contributions in this context bearing in mind the complexity of biological networks and the fact that these are often poorly characterized. More broadly, negative feedback is thought to be an integral part of many biological processes, and understanding the underlying principles is important. Academic beneficiaries. The notion of scalability in the domain control, the derivation of fundamental limitations for the suppression of intrinsic noise, as well as attempts to merge fundamental principles from control and information theory, provide elegant theoretical contributions within the context of control and information sciences. The way these results are applied is also of value to other academic communities such as computer scientists and biologists.
 
Description Various results have been developed for the analysis and control of large scale networks. These include:

(i) Distributed schemes for the control of power allocations in wireless networks have been analysed and convergence of such schemes has been proved despite the presence of time varying delays as well as time variation within the network topology.

(ii) Various decentralized stability results have been developed for large scale networks comprised of interconnected heterogeneous dynamical systems. These results extend various approaches in this context that have been applied in areas such as communication networks and group coordination.

(iii) The problem of optimal power flow in power distribution networks has been addressed and distributed schemes with guaranteed convergence to the optimal solution, have been developed for this important optimization problem.

(iv) Problems of distributed resource allocation that are relevant in economic markets and communication networks have been studied and oscillatory behaviours that arise in such schemes have been characterized. Modification in the dynamics that can eliminate these problematic effects have also been suggested.

(v) The effects of feedback delays in the performance of gene regulatory networks has been studied. In particular, fundamental limits for noise suppression have been derived in the presence of both fixed and distributed delays.
Exploitation Route A number of importnat applications have been addressed, such as distributed power control in wireless netowrks, and distributed schemes for optimization in power systems. The methodologies that have been devloped are direclty applicable in these areas, and can improve the performance of these networks.

Also the fundmamental limits that have been derived for noise suppression in gene regulatory netowrks are of major importance within the biology community, as they can help improve our understanding of the role of feedback in such networks, which are in general poorly characterized.
Sectors Digital/Communication/Information Technologies (including Software),Energy

 
Description The results that have been developed have thus had a significant academic impact, as they have been recognized among academic peers through publications in the leading international journals in the field and presentations in the corresponding leading international conferences. We expect there is going to be more direct impact to both industry and society in the near future through the use of these methodologies in the design of protocols for communication networks and also the development of grid codes in power systems and smart grids.
First Year Of Impact 2012
Sector Digital/Communication/Information Technologies (including Software),Energy
Impact Types Societal,Economic

 
Description Collaboration with Prof Johan Paulsson at Harvard University 
Organisation Harvard University
Country United States 
Sector Academic/University 
PI Contribution This collaboration is associaed with the analysis of biological and the derivation of fudamental limits for noise suppression in gene regulatory networks. The PI has been a visitor at Harvard in June/July 2011, and there was also a continuing interaction during vists of Prof Paulsson at Cambridge. This collaboration is a continuation of previous joint work with Prof Paulsson that was published in the journal Narture as a full article which was also highlighted in the cover of the issue.
Start Year 2009
 
Description Invitted talks at Caltech, Harvard, KTH, Bell Labs meeting, University of Stuttgart, UC Louvain, NTU Singapore, University of Warwick 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talks where given at the following Institutions/meetings:



- Caltech, Control and dynamical Systems Division, 2011

- Harvard University, Department of Systems Biology, 2011

- KTH, Depatment of Electrical Engineering, 2011

- Bell Labs meeting, Cambridge, 2012

- University of Stuttgart, Institute for Systems theory and Automatic Control, 2012

- NTU Singapore, Department of Electrical Engineering, 2013

- UC Louvain, Department of Mathematical Engineering, 2013

- University of Warwick, Centre of Complexity Science, 2013.

Collaborations were initiated with researchers/academics at other institutions
Year(s) Of Engagement Activity 2011,2012,2013