UKLIGHT Monitoring and Analysis at many Scales

Lead Research Organisation: University of Cambridge
Department Name: Computer Laboratory

Abstract

This proposal is to develop, set-up and exploit a monitoring system for the UKLIGHT international high capacity experimental network. The system will record data flow and topological information at a range of time-scales (from micro-second to years). Along with the monitoring of this data, this project proposes to make this information available to the community as a web service and will develop advanced monitoring and analysis algorithms.UKLIGHT will provide Points of Prescences at three key international points (Amsterdam, Chicago and London) linking together the National Research Networks to provide high bandwidth network capability, with switched (optical) circuit emulation. This will provide the research environment required to develop, what is in effect, the backplane of the World Wide Grid.In the worst case, monitoring such a system can generate 1TB of data a day; thus posing substantial challenges regarding; real time analysis and compression, data storage and science analysis. This project thus has substantial intrinsic research challenges.UKLIGHT will be used by a wide range of researchers involved with; applications, communications, networking, control and management. In all these cases understanding the perfomance of the network is a key issue. This project will thus provide important information, in real time, to a wide range of other users of the UKLIGHT facility - thus substantially adding to the value of the initiative.The accquired & archived data from the monitoring system will be made available to the research community through grid & web-services; providing data at a range of granularities and analysis levels.

Publications

10 25 50

publication icon
Haddadi H (2008) Modeling internet topology dynamics in ACM SIGCOMM Computer Communication Review

publication icon
Haddadi H (2008) Network topologies: inference, modeling, and generation in IEEE Communications Surveys & Tutorials

Related Projects

Project Reference Relationship Related To Start End Award Value
GR/T10510/02 01/08/2006 31/03/2007 £241,925
GR/T10510/03 Transfer GR/T10510/02 01/10/2007 31/03/2009 £107,413
 
Description CRASH
Amount £2,000,000 (GBP)
Funding ID CTSRD 
Organisation Defense Advanced Research Projects Agency (DARPA) 
Sector Public
Country United States
Start 11/2010 
End 09/2011
 
Description Mission Resiliant Clouds
Amount £1,824,010 (GBP)
Funding ID MRC 
Organisation Defense Advanced Research Projects Agency (DARPA) 
Sector Public
Country United States
Start 10/2011 
End 09/2015
 
Description NetFPGA Community Support
Amount $299,000 (USD)
Organisation National Science Foundation (NSF) 
Sector Public
Country United States
Start 08/2013 
End 07/2014
 
Description MASTS 
Organisation Loughborough University
Country United Kingdom 
Sector Academic/University 
PI Contribution Networking technologies, practices and experience
Collaborator Contribution alternative skills in data handling and processing. Operational expertise
Impact open source software Data-use licenses numerous papers detailing best-practice, experinences, particularly processing methodologies and results from the processing and interpretation of results.
Start Year 2007
 
Description MASTS 
Organisation University College London
Country United Kingdom 
Sector Academic/University 
PI Contribution Networking technologies, practices and experience
Collaborator Contribution alternative skills in data handling and processing. Operational expertise
Impact open source software Data-use licenses numerous papers detailing best-practice, experinences, particularly processing methodologies and results from the processing and interpretation of results.
Start Year 2007