Hyper Flux

Lead Research Organisation: Imperial College London
Department Name: Aeronautics

Abstract

Computer simulations of fluid flow are playing an increasingly important role in aerodynamic design of numerous complex
systems, including aircraft, cars, ships and wind turbines. It is becoming apparent, however, that for a wide range of flow
problems current generation software packages used for aerodynamic design are not fit for purpose.
Specifically, for scenarios where flow is unsteady (highly separated flows, vortex dominated flows, acoustics problems etc.)
current generation software packages lack the required accuracy; since they are ubiquitously based on 'low-order' (first- or
second-order) accurate numerical methods. To solve challenging unsteady flow problems, and remove the need for
expensive physical prototyping, newer software based on advanced 'high-order' accurate numerical methods is required.
Additionally, this software must be able to achieve high-order accuracy on so-called 'unstructured grids' - used to mesh
complex engineering geometries, and it must be able to make effective use of next-generation 'many-core' computing
hardware (such as Nvidia Tesla GPUs, Intel Xeon Phi Co-Processors, and AMD FirePro GPUs), which will likely underpin
future HPC platforms.
Advanced high-order Flux Reconstruction (FR) methods, combined with many-core accelerators, could provide a `gamechanging'
technology capable of performing currently intractable unsteady turbulent flow simulations within the vicinity of
complex engineering geometries. However, various technical issues still need to be addressed before the above technology can be used `in anger' to solve real-world flow problems, which often involve `sliding planes' (situations when
two computational meshes slide across one another in a non-conforming fashion). The key objectives (of the academic
component) of the proposal are to develop a treatment for sliding planes that works effectively with FR methods on manycore
accelerators, and demonstrate the performance of FR methods on many-core accelerators for a range of industry led
test cases proposed by the financial (CFMS and Zenotech) and non-financial (Airbus, EADS, BAE, Rolls-Royce, ARA, UK
Aerodynamics Centre) project partners.
The academic component of the proposal will be lead by Dr. Peter Vincent (a Lecturer in the department of Aeronautics at
Imperial College London), and will build upon current work funded by 3 x EPSRC DTAs, 1 x Airbus/EPSRC iCASE DTA,
and an EPSRC Early Career Fellowship (EP/K027379/1).

Planned Impact

Beneficiaries include all UK industries that rely on Computational Fluid Dynamics (CFD) simulations and High-Performance
Computing (HPC), such as the UK the aerospace sector (see Economic Impact below). Other beneficiaries include the UK
Government and the general public, via impact of the technology on computational design capabilities within the UK
defence sector; and thus on UK defence capabilities per se (see Societal Impact below). Academic beneficiaries and
impact are discussed in Academic Beneficiaries.
Economic Impact:
i.) Knowledge and Skills (People): Knowledge and skills generated in the areas of CFD and HPC will benefit various
industries that are important to the UK economy. Such industries include the aerospace, automotive, and financial sectors.
ii.) Aerospace: The UK has traditionally been an exporter of high-tech aerospace products, providing significant financial
benefits to the UK economy. Specifically, turnover of the UK aerospace industry was £23.1 billion in 2010, of which 70%
was from exports. Technology developed under this proposal will provide the UK aerospace sector with a 'game-changing'
aerodynamic design capability, allowing it to move to the forefront in important emerging areas, such as design and
manufacture of Unmanned Aerial Vehicles (UAVs). This will have a significant positive impact on the UK economy.
Societal Impact:
i.) Knowledge and Skills (People): Knowledge and skills generated in the areas of CFD and HPC can be applied in various
fields of research that have significant societal impact. Such fields include weather prediction, climate modelling and design
if quieter aircraft.
ii.) Defence Capabilities: In a time of significant defence cuts, it is becoming increasingly important that the UK Government
leverage technological advances to maintain and improve defence capabilities on a reduced budget. Technology
developed under this proposal will have a direct impact on computational design capabilities within the UK defence sector.
For example, it will have a significant impact on how CFD is used to design UAVs; leading to reduced design costs, and
more sophisticated and capable UAV technology. As such, the proposed work will have a significant impact on UK defence
capabilities.
 
Description Integration of next-generation high-order accurate numerical methods into the commercial zCFD solver from Zenotech
Exploitation Route Use of zCFD by industry.
Sectors Aerospace, Defence and Marine,Energy,Healthcare,Manufacturing, including Industrial Biotechology,Pharmaceuticals and Medical Biotechnology,Security and Diplomacy,Transport

URL http://zenotech.com/zcfd-zenotech-computational-fluid-dynamics/
 
Description The zCFD software developed by Zenotech has underpinned various industry led research projects, including Hyperflux++, SWEPT2, and the Aeroflux project with Bombardier and Airbus. SWEPT2 demonstrated that zCFD enables tractable simulation of wind turbine wake interactions for the first time. Moreover, it was deemed to generate £7.7M of value from immediate outputs alone. zCFD is also used by Zenotech to perform simulations for industrial clients in the aerospace sector, as well as by third parties to perform simulations for clients in the automotive sector. It has also generated software/services exports to the USA.
First Year Of Impact 2018
Impact Types Societal,Economic

 
Description Horizon 2020 (ERC) - TILDA
Amount € 231,629 (EUR)
Funding ID 635962-2 
Organisation European Research Council (ERC) 
Sector Public
Country Belgium
Start 05/2015 
End 04/2018
 
Description Philip Leverhulme Prize
Amount £100,000 (GBP)
Organisation The Leverhulme Trust 
Sector Charity/Non Profit
Country United Kingdom
Start 06/2017 
End 05/2020
 
Description CFMS 
Organisation Centre Modelling and Simulation (CFMS)
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Collaborating on the Hyperflux project. We have provided them with insight into details of high-order methods for CFD.
Collaborator Contribution Collaborating on the Hyperflux project. They have provided us we meshes for CFD.
Impact In0situ visualisation demo with PyFr running on Titan at SC15.
Start Year 2014
 
Description Kitware 
Organisation Kitware, Inc.
Country United States 
Sector Private 
PI Contribution Worked together to develop in-situ visualisation technology for PyFR.
Collaborator Contribution Worked together to develop in-situ visualisation technology for PyFR.
Impact -
Start Year 2014
 
Description Pointwise 
Organisation Pointwise
Country United States 
Sector Private 
PI Contribution Provided them with meshing challenges! And insight into PyFR mesh format.
Collaborator Contribution Added PyFr mesh output to Pointwise meshing software, and have started to make us meshes.
Impact -
Start Year 2015
 
Description Zenotech 
Organisation Zenotech
Country United Kingdom 
Sector Private 
PI Contribution Visits. Share findings.
Collaborator Contribution Visits. Share findings.
Impact Multi-disciplinary - mathematics, computer science, computational fluid dynamics, aerospace engineering.
Start Year 2013
 
Title PyFR v0.2.4 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2015 
Open Source License? Yes  
Impact Publications. Further grants. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v0.3.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2015 
Open Source License? Yes  
Impact Publications. Further grants. Preliminary industrial adoption 
URL http://www.pyfr.org
 
Title PyFR v0.8.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2015 
Open Source License? Yes  
Impact Pubications. Further grants. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.0.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2015 
Open Source License? Yes  
Impact Publications. Further grants. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.1.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2015 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary ndustrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.10.0 
Description High-order flow solver. 
Type Of Technology Software 
Year Produced 2020 
Open Source License? Yes  
Impact Ongoing use of the solver. 
URL https://www.pyfr.org/
 
Title PyFR v1.11.0 
Description High-order flow solver. 
Type Of Technology Software 
Year Produced 2021 
Open Source License? Yes  
Impact Ongoing use of the software. 
URL https://www.pyfr.org/
 
Title PyFR v1.12.0 
Description High-order flow solver. 
Type Of Technology Software 
Year Produced 2021 
Open Source License? Yes  
Impact Ongoing use of the software. 
URL https://www.pyfr.org/
 
Title PyFR v1.13.0 
Description High-order flow solver. 
Type Of Technology Software 
Year Produced 2022 
Open Source License? Yes  
Impact Ongoing use of the software. 
URL https://www.pyfr.org/
 
Title PyFR v1.2.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2015 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.3.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2016 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.4.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2016 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.5.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2016 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.6.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2017 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org/
 
Title PyFR v1.7.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2017 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org/
 
Title PyFR v1.7.5 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2018 
Open Source License? Yes  
Impact Publications. Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org/
 
Title PyFR v1.7.6 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2018 
Open Source License? Yes  
Impact Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.8.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2018 
Open Source License? Yes  
Impact Further funding. Preliminary industrial adoption. 
URL http://www.pyfr.org
 
Title PyFR v1.8.5 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2019 
Open Source License? Yes  
Impact
URL http://www.pyfr.org
 
Title PyFR v1.9.0 
Description PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine. 
Type Of Technology Software 
Year Produced 2019 
Open Source License? Yes  
Impact
URL http://www.pyfr.org
 
Title zCFD 
Description Adding high-order FR schemes to the zCFD solver from Zenotech. 
Type Of Technology Software 
Year Produced 2016 
Impact
URL http://zenotech.com/i-want-it-all-and-i-want-it-now-high-order-zcfd-on-nvidia-gpus-via-amazon-aws/?u...
 
Description Academic Insight - Unsteady Flows 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact IMECHE article on PyFR
Year(s) Of Engagement Activity 2015
URL http://www.imeche.org/news/engineering/academic-insight-unsteady-flows
 
Description Accelerating CFD with PyFR on GPUs 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Inside HPC Article on PyFR
Year(s) Of Engagement Activity 2015
URL http://insidehpc.com/2014/08/accelerating-cfd-pyfr-gpus/
 
Description Bringing Zoomable CFD Simulation to the Industrial End User 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Eureka article on Hyper Flux project
Year(s) Of Engagement Activity 2015
URL http://www.eurekamagazine.co.uk/design-engineering-products-ezine/technology-spotlights/Bringing-zoo...
 
Description High Order CFD Webiner at CFMS 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Webinar
Year(s) Of Engagement Activity 2015
URL https://www.youtube.com/watch?v=Oo39fLmb03Q
 
Description How HPC can Influence our World: HPCAC-ISC Student Cluster Competition Highlights 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Scientific Computing World article mentioning use of PyFR as benchmark at Student Cluster Contest 2015
Year(s) Of Engagement Activity 2015
URL http://www.scientificcomputing.com/blogs/2015/07/how-hpc-can-influence-our-world-hpcac-isc-student-c...
 
Description Imperial College YouTube Video 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Video interview with Imperial College press office about release of PyFR v1.0.0
Year(s) Of Engagement Activity 2015
URL https://youtu.be/UvzuIougABE
 
Description Imperial Engineers Develop Modelling Tool to Harness the Power of Unsteady Air 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Imperial College article on release of PyFR v1.0.0
Year(s) Of Engagement Activity 2015
URL http://www3.imperial.ac.uk/newsandeventspggrp/imperialcollege/newssummary/news_25-6-2015-9-10-10
 
Description Leveraging Rescale for High-Order CFD Simulation 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Rescale article on PyFR
Year(s) Of Engagement Activity 2014
URL http://blog.rescale.com/leveraging-rescale-for-high-order-cfd-simulation/
 
Description On a Wing and PyFR: How GPU Technology Is Transforming Flow Simulation 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Nvidia blog post about release of PyFR v1.0.0
Year(s) Of Engagement Activity 2015
URL http://blogs.nvidia.com/blog/2015/06/26/pyfr-gpu-computational-fluid-dynamics/
 
Description PyFR: A GPU-Accelerated Next-Generation Computational Fluid Dynamics Python Framework 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Tech Enablement article on PyFR
Year(s) Of Engagement Activity 2014
URL http://www.techenablement.com/pyfr-a-gpu-accelerated-next-generation-computational-fluid-dynamics-py...
 
Description Shining the spotlight - Dr Peter Vincent, Senior Lecturer Aeronautics and EPSRC Early Career Fellow, Imperial College 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact CFMS News Letter
Year(s) Of Engagement Activity 2015
URL http://cfms.org.uk/1693.aspx?utm_source=CFMS+Quarterly+Newsletter&utm_campaign=5f894ecf0b-CFMS_Newsl...
 
Description Solving Unsteady Fluid Flows with Hyperflux 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact CFI article on industrial collaborations under the Hyper Flux project
Year(s) Of Engagement Activity 2015
URL https://www.cfi.ses.ac.uk/solving-unsteady-fluid-flows-with-hyperflux-new/?utm_content=buffer9b518&u...
 
Description Titan Becomes World's Largest GPU-Powered Visualization System for Scientific Discovery 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Nvidia article on our use of worlds largest GPU super-computer for in-situ visualisation
Year(s) Of Engagement Activity 2015
URL http://blogs.nvidia.com/blog/2015/11/17/titan-largest-gpu-visualization/
 
Description Tsinghua University Wins Gold at ISC Student Cluster Contest 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact HPC Wire article mentioning use of PyFR as benchmark at Student Cluster Contest 2015
Year(s) Of Engagement Activity 2015
URL http://www.hpcwire.com/2015/07/16/tsinghua-university-wins-gold-at-isc-student-cluster-contest/