Accelerating NFS/CIFS to produce a tenfold performance improvement for Office/Database applications over the WAN/Grid
Lead Research Organisation:
CRANFIELD UNIVERSITY
Department Name: Sch of Engineering
Abstract
This proposal focuses on studying how applications can best take advantage of the increased transfer bandwidth. A model for end-to-end available bandwidth estimation will be established to close the growing gap between the utilized bandwidth and available bandwidth. In our lab, a core engine jetFS has been developed, which melds distributed file system technology with high performance data transfer techniques to meet the needs of WAN/Grid-based virtual organizations. In a real-world test, jetFS beats classic protocols by 2-25 times. The source code of the developed jetFS is of 40,000 lines in length and we have spent four plus man years in developing and revamping it within the context of an EPSRC/DTI project Grid-oriented Storage . This work has already been accepted for publication in IEEE Transactions on Computers. In this proposal, we will implement NFS/CIFS's alternative protocols (a-NFS/CIFS) by incorporating the developed multi-streamed jetFS engine to accelerate the file sharing traffic. With the accelerated and secure a-NFS/CIFS that remain fully compatible with the existing IT infrastructures, computer users can open and share remote files (such as vi, Emacs, MySQL, OpenOffice Writer/Impress/Calc, and MS Office Word/PowerPoint/Excel) on the Internet without having to install new software, upgrade to any new platform or change the way they work. The a-NFS/CIFS are believed to extend established Internet architectures and protocols to meet the immediate needs and are positioned to adapt to the future needs of Grid computing through the minor versioning provision of the existing data communication protocols. The resulting a-NFS/CIFS will be made available and supported as open-source under the GPL, strengthening the competitiveness of the UK-led open-source products in the global market.
People |
ORCID iD |
Frank Wang (Principal Investigator) |
Publications
Deng Y
(2011)
LAG: Achieving transparent access to legacy data by leveraging grid environment
in Future Generation Computer Systems
Frank Wang
(2011)
Towards 2020 Computing
Frank Wang
(2010)
Accelerating Mobile Data Communication Tenfold
Wang F
(2010)
Delayed Switching in Memristors and Memristive Systems
in IEEE Electron Device Letters
Wang F
(2012)
Delayed switching applied to memristor neural networks
in Journal of Applied Physics
Wang F
(2013)
A Triangular Periodic Table of Elementary Circuit Elements
in IEEE Transactions on Circuits and Systems I: Regular Papers
Wang F
(2009)
Eight Times Acceleration of Geospatial Data Archiving and Distribution on the Grids
in IEEE Transactions on Geoscience and Remote Sensing
Wang FZ
(2013)
Adaptive Neuromorphic Architecture (ANA).
in Neural networks : the official journal of the International Neural Network Society
Description | CloudJet has been developed to deal with long-distance, bulk data, cross-domain data operations - a capability lacking in the current Cloud solutions. The source code is of 20,000 lines in length. |
Exploitation Route | Our findings have been reported widely, eg at IEEE Big Data Conference in USA. Others might use our findings via open source. |
Sectors | Education |
URL | http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6906835&tag=1 |
Description | The GOS-FS has been used as an underlying engine in the EC-funded EuroAsiaGrid, the EC-funded QuickLinux and other testbeds. |
First Year Of Impact | 2010 |
Sector | Education |
Impact Types | Cultural Societal Policy & public services |
Description | EC QuickLinux |
Amount | € 1,000,000 (EUR) |
Organisation | European Commission |
Sector | Public |
Country | European Union (EU) |
Start | 08/2008 |
End | 08/2010 |
Description | CISCO |
Organisation | CISCO Systems |
Country | United States |
Sector | Private |
PI Contribution | CloudJet to be incorporated into OpenStack |
Collaborator Contribution | Elastic Networking |
Impact | A joint Lab & 20 students placed each year at CISCO, California. |
Start Year | 2010 |
Description | Euro Electronics UK Limited |
Organisation | Euro Electronics UK |
Country | United Kingdom |
Sector | Private |
PI Contribution | Grid-oriented storage |
Collaborator Contribution | design, testing & real-world scenario |
Impact | joint papers |
Description | IBM |
Organisation | IBM |
Department | IBM UK Ltd |
Country | United Kingdom |
Sector | Private |
PI Contribution | CloudJet4BigData as a big data platform in the Cloud. |
Collaborator Contribution | Design, testing, real-world scenario, chairship of KITC (Kent IT Consultancy) to engage the School of Computing with local communities and Kent students with real-world projects to enrich their industrial experience. |
Impact | 1. Frank Zhigang Wang, Theo Dimitrakos, Na Helian, Sining Wu, Yuhui Deng, Ling Li, Rodric Yates (IBM), DIANA: Data Interface All-iN-A-place (DIANA) for Big Data, IEEE Big Data Science & Engineering, Beijing, 24-26 September, 2014 2. Frank Zhigang Wang, Sining Wu, Na Helian, Ling Li, Rodric Yates (IBM), "CloudJet4BigData: Streamlining Big Data via an accelerated socket interface", IEEE 3rd International Congress on Big Data, June 27 - July 2, 2014, Alaska, USA |
Start Year | 2013 |