Strategic Partnership in Computational Science for Advanced Simulation and Modelling of Engineering Systems - ASiMoV

Lead Research Organisation: University of Edinburgh
Department Name: Edinburgh Parallel Computing Centre

Abstract

The strategic vision of this Prosperity Partnership for Advanced Simulation and Modelling of Virtual Systems (ASiMoV) is to enable the research and development of the next generation of engineering simulation and modelling techniques. Our aim is to achieve the world's first high fidelity simulation of a complete gas-turbine engine during operation, simultaneously including the effects of thermo-mechanics, electromagnetics, and CFD. This level of simulation will require breakthroughs at all levels, including physical models, numerical solvers, algorithms, software infrastructure, and Exascale HPC hardware. Our partnership uniquely combines fundamental engineering and computational science research with two high tech SMEs and Rolls-Royce plc to address a challenge that is well beyond the capabilities of today's numerical solvers.

Simulation and modelling, enabled by high performance computing, have transformed the way products are designed and engineered. The technology developed for the Trent XWB, the world's most efficient aero engine, could only have been achieved through simulation and modelling. However, next generation products will place demands on simulation that cannot be met by incremental changes to current techniques. The ACARE Flightpath 2050 goals demand fundamental changes to engine architectures and the 2015 Aerospace Technology Institute Propulsion Strategy identified "virtual certification" as a key technology needed in the 2025-30 timeframe. The journey to virtual certification is an incremental one requiring a thorough evidential database to convince the certification authorities that the analysis can be trusted. It will move forward on a number of fronts. One of those is the whole engine tests to certify operational performance and thrust.

Our driving ambition is to realise new simulation technology for the ultra-high resolution and extreme scale needed for meaningful virtual certification models. For Rolls-Royce, virtual certification will bring a major business transformation requiring unprecedented trust in simulation and fundamental changes to design processes and skills. Estimated cost savings for virtual certification are measured in the many £millions per engine programme; but, we also estimate that each simulation will require a billion core hours. At this scale, savings from computational cost and performance optimisation will be £millions per design study. Hence the need for ASiMoV to push forward the boundaries of numerical modelling and simulation on the next generation of Exascale supercomputers.

Planned Impact

The Prosperity Partnership for Advanced Simulation and Modelling of Virtual Systems (ASiMoV) will deliver the modelling and simulation techniques and software technologies to bring virtual certification into the mainstream of the aerospace propulsion sector. Its anticipated impact will be transformational in this sector and the science and engineering knowledge gained will have broad impact across many disciplines. Although the sector tackled is a very specific one, the challenges this sector faces are repeated across many disciplines that require to perform high-fidelity simulations of complex, large systems on today and tomorrow's massively parallel High Performance Computing (HPC) systems as we approach the age of Exascale computing.

Impact will occur at multiple levels. First and foremost, ASiMoV will undertake a carefully structured programme of research and development designed to develop the next generation of engineering simulation and modelling techniques leading to the world's first high-fidelity simulation of a complete gas-turbine engine during operation. This will simultaneously include the effects of thermo-mechanics, electromagnetics, and computational fluid dynamics. The immediate economic impact to Rolls Royce plc, one of the UK's most successful and innovative companies, cannot be underestimated. Likewise, the two SMEs in the partnership, CFMS and ZenoTech will see direct economic impacts. Building from these direct impacts, a host of concurrent and complementary impacts across a broad range of engineering and scientific disciplines will be realised. The specific challenges facing ASiMoV, which are described in detail in the Case for Support, are widely recognised across the computational science engineering community worldwide.

From an academic research standpoint, there are broad knowledge impacts which the University partners will seek to realise through a comprehensive publication and communication strategy. The challenges posed to computational science and engineering by massively parallel HPC systems are broadly similar across a wide range of disciplines. As parallelism increases, memory hierarchies become more complex and memory bandwidth issues become dominant. Coupled to this, internode communication latencies and bandwidth issues lead to poor scaling and limit the fidelity and complexity of simulations across all scientific and engineering domains.

In addition to the broad academic research impacts expected of such a large project, ASiMoV will help to address the severe shortage of people with computational science skills in the UK today. The University partnership represented in ASiMoV represents the vast majority of research groups and centres who operate MSc and PhD programmes in this area. Graduates have no difficulty finding jobs and are in demand. Growing this pipeline will go beyond the small number of PhD studentships funded in ASiMoV and any resulting MSc projects. For example, we will develop stories and interactive activities on the work of ASiMoV and use these in its schools' outreach work such as at the annual Big Bang Fair - the UK's largest STEM fair for schools - held in Birmingham each year. This material will be shared with and augmented by all the partners in the partnership.

In summary, ASiMoV will have impact in many areas of science and engineering. These will benefit the industry and academic partners directly, but also the country more generally through the many related activities it will stimulate.

Publications

10 25 50

publication icon
Pennycook S (2021) Navigating Performance, Portability, and Productivity in Computing in Science & Engineering

publication icon
McIntosh-Smith S (2019) Benchmarking the first generation of production quality Arm-based supercomputers in Concurrency and Computation: Practice and Experience

publication icon
Sulyok A (2019) Locality optimized unstructured mesh algorithms on GPUs in Journal of Parallel and Distributed Computing

publication icon
Owenson A (2019) An unstructured CFD mini-application for the performance prediction of a production CFD code in Concurrency and Computation: Practice and Experience

publication icon
McIntosh-Smith S (2019) A performance analysis of the first generation of HPC-optimized Arm processors in Concurrency and Computation: Practice and Experience

 
Description The ASiMoV project transformed the partners' understanding of how to model gas turbine engines in greater detail and faster than ever before. As an example, the work done in ASiMoV reduced a 5 billion cell computational fluid dynamics simulation from 9 days on the ARCHER supercomputer to 6 hours on the ARCHER2 supercomputer. The project also demonstrated how to couple complex combustion, thermomechanical, structural and fluid dynamics computational codes at scale on the UK's current national service ARCHER2. This has transformed the scale and complexity of the gas turbines models that Rolls Royce can simulate - providing a step along the path to virtual certification of engine designs.
Exploitation Route The ASiMoV project was always understood to be a 10 year programme. This project represented the first 5 years of that programme of development required to meet its goal of virtual certification of high-fidelity whole engine models of the world's leading gas turbine designs. Much of the software developed in the project has been released as Open Source Software and is now available to the broader engineering and scientific communities.
Sectors Aerospace

Defence and Marine

Digital/Communication/Information Technologies (including Software)

Energy

Manufacturing

including Industrial Biotechology

Transport

 
Description The ASiMoV project is helping Rolls Royce increase the resolution and accuracy of its simulation of gas turbine engines in operation. The project is pushing the boundaries of modelling and simulation of combustion processes, structures, electromagnetic and fluid dynamics.
First Year Of Impact 2022
Sector Aerospace, Defence and Marine
Impact Types Economic

 
Description FAN Design And INtegrity, GO (FANDANGO), Innovate UK ref.no. 113232
Amount £16,900,000 (GBP)
Organisation University of Oxford 
Sector Academic/University
Country United Kingdom
Start 01/2020 
End 12/2024
 
Description The GW4 Isambard Tier-2 service for advanced computer architectures
Amount £8,500,000 (GBP)
Funding ID EP/K035746/1 
Organisation United Kingdom Research and Innovation 
Sector Public
Country United Kingdom
Start 02/2023 
End 03/2023
 
Title Analysis of Lid-Driven Cavity and Taylor-Green Vortex using ASiMoV-CCS 
Description Replace previous upload. 
Type Of Material Database/Collection of data 
Year Produced 2024 
Provided To Others? Yes  
URL https://zenodo.org/doi/10.5281/zenodo.14357034
 
Title Analysis of Lid-Driven Cavity and Taylor-Green Vortex using ASiMoV-CCS 
Description Replace previous upload. 
Type Of Material Database/Collection of data 
Year Produced 2024 
Provided To Others? Yes  
URL https://zenodo.org/doi/10.5281/zenodo.14355931
 
Title Analysis of Lid-Driven Cavity and Taylor-Green Vortex using ASiMoV-CCS 
Description  
Type Of Material Database/Collection of data 
Year Produced 2024 
Provided To Others? Yes  
URL https://zenodo.org/doi/10.5281/zenodo.14355932
 
Title Software, Dataset, and Techreport: Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration 
Description This upload contains a techreport titled "Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration" together with the software (with documentation) and dataset generating the results. The software is also available on GitHub at https://github.com/croci/mpfem-paper-experiments-2024/ . The GitHub version may be updated in the future. This upload corresponds to commit number 8506dd368b84655201c8c72b1307239b9b4e43fd . See README.md file for installation instructions. The manuscript is also available on the arXiv: https://arxiv.org/abs/2410.12614. 
Type Of Material Database/Collection of data 
Year Produced 2024 
Provided To Others? Yes  
URL https://zenodo.org/doi/10.5281/zenodo.13941629
 
Title Software, Dataset, and Techreport: Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration 
Description This upload contains a techreport titled "Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration" together with the software (with documentation) and dataset generating the results. The software is also available on GitHub at https://github.com/croci/mpfem-paper-experiments-2024/ . The GitHub version may be updated in the future. This upload corresponds to commit number 8506dd368b84655201c8c72b1307239b9b4e43fd . See README.md file for installation instructions. The manuscript is also available on the arXiv: https://arxiv.org/abs/2410.12614. 
Type Of Material Database/Collection of data 
Year Produced 2024 
Provided To Others? Yes  
URL https://zenodo.org/doi/10.5281/zenodo.13941628
 
Description conference talk ADMOS 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Y. Ammouche and A. Jérusalem. A modular nonlinear stochastic finite element formulation for uncertainty estimation. X International Conference on Adaptive Modeling and Simulation ADMOS2021, Gothenburg, Sweden (2021)
Year(s) Of Engagement Activity 2021
 
Description conference talk UKACM 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact A. Abdollahi, P.S. Naharro, J.M. Peña and A. Jérusalem. A machine learning-based soft finite element method. UK Association for Computational Mechanics Conference UKACM2021, Loughborough, UK (2021)
Year(s) Of Engagement Activity 2021
 
Description conference talks COMPLAS 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact S. Garzon-Hernandez and A. Jérusalem. Simulation of the selective laser melting process: Influence of processing parameters. XVI International Conference on Computational Plasticity. Fundamentals and Applications. COMPLAS 2021, Barcelona, Spain (2021)

Y. Ammouche and A. Jérusalem. A Modular Nonlinear Stochastic Finite Element Formulation for Uncertainty Estimation. XVI International Conference on Computational Plasticity. Fundamentals and Applications. COMPLAS 2021, Barcelona, Spain (2021)
Year(s) Of Engagement Activity 2021