DiRAC 2.5y - Networks and Data Management
Lead Research Organisation:
UNIVERSITY COLLEGE LONDON
Department Name: Physics and Astronomy
Abstract
Physicists across the astronomy, nuclear and particle physics communities are focussed
on understanding how the Universe works at a very fundamental level. The distance scales
with which they work vary by 50 orders of magnitude from the smallest distances probed
by experiments at the Large Hadron Collider, deep within the atomic
nucleus, to the largest scale galaxy clusters discovered out in space. The Science challenges,
however, are linked through questions such as: How did the Universe begin and how is it evolving?
and What are the fundamental constituents and fabric of the Universe and how do they interact?
Progress requires new astronomical observations and experimental data but also
new theoretical insights. Theoretical understanding comes increasingly from large-scale
computations that allow us to confront the consequences of our theories very accurately
with the data or allow us to interrogate the data in detail to extract information that has
impact on our theories. These computations test the fastest computers that we have and
push the boundaries of technology in this sector. They also provide an excellent
environment for training students in state-of-the-art techniques for code optimisation and
data mining and visualisation.
The DiRAC2 HPC facility has been operating since 2012, providing computing resources for theoretical research
in all areas of particle physics, astronomy, cosmology and nuclear physics supported by STFC. It is a highly productive facility, generating 200-250 papers annually in international, peer-reviewed journals. However, the DiRAC facility risks becoming uncompetitive as it has remained static in terms of overall capability since 2012. The DiRAC-2.5x investment in 2017/18 mitigated the risk of hardware failures, by replacing our oldest hardware components. However, as the factor 5 oversubscription of the most recent RAC call demonstrated, the science programme in 2019/20 and beyond requires a significant uplift in DiRAC's compute capability. The main purpose of the requested funding for the DiRAC2.5y project is to provide a factor 2 increase in computing across all DiRAC services to enable the facility to remain competitive during 2019/20 in anticipation of future funding for DiRAC-3.
DiRAC2.5y builds on the success of the DiRAC HPC facility and will provide the resources needed to support cutting-edge research during 2019 in all areas of science supported by STFC. While the funding is required to remain competitive, the science programme will continue to be world-leading. Examples of the projects which will benefit from this investment include:
(i) lattice quantum chromodynamics (QCD) calculations of the properties of fundamental particles from first principles;
(ii) improving the potential of experiments at CERN's Large Hadron Collider for discovery of new physics by increasing the accuracy of theoretical predictions for rare processes involving the fundamental constituents of matter known as quarks;
(iii) simulations of the merger of pairs of black holes amnwhich generate gravitational waves such as those recently discovered by the LIGO consortium;
(iv) the most realistic simulations to date of the formation and evolution of galaxies in the Universe;
(v) the accretion of gas onto supermassive black holes, the most efficient means of extracting energy from matter and the engine which drives galaxy evolution;
(vi) new models of our own Milky Way galaxy calibrated using new data from the European Space Agency's GAIA satellite;
(vii) detailed simulations of the interior of the sun and of planetary interiors;
(viii) the formation of stars in clusters - for the first time it will be possible to follow the formation of massive stars.
on understanding how the Universe works at a very fundamental level. The distance scales
with which they work vary by 50 orders of magnitude from the smallest distances probed
by experiments at the Large Hadron Collider, deep within the atomic
nucleus, to the largest scale galaxy clusters discovered out in space. The Science challenges,
however, are linked through questions such as: How did the Universe begin and how is it evolving?
and What are the fundamental constituents and fabric of the Universe and how do they interact?
Progress requires new astronomical observations and experimental data but also
new theoretical insights. Theoretical understanding comes increasingly from large-scale
computations that allow us to confront the consequences of our theories very accurately
with the data or allow us to interrogate the data in detail to extract information that has
impact on our theories. These computations test the fastest computers that we have and
push the boundaries of technology in this sector. They also provide an excellent
environment for training students in state-of-the-art techniques for code optimisation and
data mining and visualisation.
The DiRAC2 HPC facility has been operating since 2012, providing computing resources for theoretical research
in all areas of particle physics, astronomy, cosmology and nuclear physics supported by STFC. It is a highly productive facility, generating 200-250 papers annually in international, peer-reviewed journals. However, the DiRAC facility risks becoming uncompetitive as it has remained static in terms of overall capability since 2012. The DiRAC-2.5x investment in 2017/18 mitigated the risk of hardware failures, by replacing our oldest hardware components. However, as the factor 5 oversubscription of the most recent RAC call demonstrated, the science programme in 2019/20 and beyond requires a significant uplift in DiRAC's compute capability. The main purpose of the requested funding for the DiRAC2.5y project is to provide a factor 2 increase in computing across all DiRAC services to enable the facility to remain competitive during 2019/20 in anticipation of future funding for DiRAC-3.
DiRAC2.5y builds on the success of the DiRAC HPC facility and will provide the resources needed to support cutting-edge research during 2019 in all areas of science supported by STFC. While the funding is required to remain competitive, the science programme will continue to be world-leading. Examples of the projects which will benefit from this investment include:
(i) lattice quantum chromodynamics (QCD) calculations of the properties of fundamental particles from first principles;
(ii) improving the potential of experiments at CERN's Large Hadron Collider for discovery of new physics by increasing the accuracy of theoretical predictions for rare processes involving the fundamental constituents of matter known as quarks;
(iii) simulations of the merger of pairs of black holes amnwhich generate gravitational waves such as those recently discovered by the LIGO consortium;
(iv) the most realistic simulations to date of the formation and evolution of galaxies in the Universe;
(v) the accretion of gas onto supermassive black holes, the most efficient means of extracting energy from matter and the engine which drives galaxy evolution;
(vi) new models of our own Milky Way galaxy calibrated using new data from the European Space Agency's GAIA satellite;
(vii) detailed simulations of the interior of the sun and of planetary interiors;
(viii) the formation of stars in clusters - for the first time it will be possible to follow the formation of massive stars.
Planned Impact
The anticipated impact of the DiRAC2.5y HPC facility aligns closely with the recently published UK Industrial Strategy. As such, many of our key impacts will be driven by our engagements with industry. Each service provider for DiRAC2.5y has a local industrial strategy to deliver increased levels of industrial returns over the next three years.
The "Pathways to impact" document which is attached to this proposal describes the overall industrial strategy for the DiRAC facility, including our strategic goals and key performance indicators.
The "Pathways to impact" document which is attached to this proposal describes the overall industrial strategy for the DiRAC facility, including our strategic goals and key performance indicators.
Organisations
Publications
Jara-Ferreira F
(2024)
The metallicity gradients of star-forming regions store information of the assembly history of galaxies
in Monthly Notices of the Royal Astronomical Society
Jiang A
(2024)
Minkowski functionals of large-scale structure as a probe of modified gravity
in Physical Review D
Jones C
(2025)
Low inertia reversing geodynamos
in Physics of the Earth and Planetary Interiors
Juodžbalis I
(2024)
A dormant overmassive black hole in the early Universe
in Nature
Kalusche G
(2025)
Gribov copies in the quark propagator
in Physical Review D
Karpen J
(2024)
Solar Eruptions in Nested Magnetic Flux Systems
in The Astrophysical Journal
Kay S
(2024)
Relativistic SZ temperatures and hydrostatic mass bias for massive clusters in the FLAMINGO simulations
in Monthly Notices of the Royal Astronomical Society
Keating L
(2024)
The origin of the characteristic shape and scatter of intergalactic damping wings during reionization
in Monthly Notices of the Royal Astronomical Society: Letters
Keating L
(2024)
JWST observations of galaxy-damping wings during reionization interpreted with cosmological simulations
in Monthly Notices of the Royal Astronomical Society
Kesri K
(2024)
Dependence of Spicule Properties on the Magnetic Field-Results from Magnetohydrodynamics Simulations
in The Astrophysical Journal
Khan N
(2024)
Particle initialization effects on Lyman-a forest statistics in cosmological SPH simulations
in Monthly Notices of the Royal Astronomical Society
Kirchschlager F
(2024)
From total destruction to complete survival: dust processing at different evolutionary stages in the supernova remnant Cassiopeia A
in Monthly Notices of the Royal Astronomical Society
Koksbang S
(2024)
Redshift drift in a universe with structure. III. Numerical relativity
in Physical Review D
Kong (??) S
(2024)
Filamentary Molecular Cloud Formation via Collision-induced Magnetic Reconnection in a Cold Neutral Medium
in The Astrophysical Journal
Koudmani S
(2024)
A unified accretion disc model for supermassive black holes in galaxy formation simulations: method and implementation
in Monthly Notices of the Royal Astronomical Society
Kroupa N
(2024)
Kernel-, mean-, and noise-marginalized Gaussian processes for exoplanet transits and H 0 inference
in Monthly Notices of the Royal Astronomical Society
Kugel R
(2024)
The FLAMINGO project: a comparison of galaxy cluster samples selected on mass, X-ray luminosity, Compton-Y parameter, or galaxy richness
in Monthly Notices of the Royal Astronomical Society
Kwan J
(2024)
Revisiting the effects of baryon physics on small-scale redshift space distortions
in Monthly Notices of the Royal Astronomical Society
Lachini N
(2024)
Towards a high-precision description of the ? and K* resonances
Lance S
(2024)
Viscous dissipation and dynamics in simulations of rotating, stratified plane-layer convection
in Monthly Notices of the Royal Astronomical Society
Lawlor D
(2025)
Dense QC$_2$D: What's up with that?!?
Lim S
(2024)
The FLAMINGO simulation view of cluster progenitors observed in the epoch of reionization with JWST
in Monthly Notices of the Royal Astronomical Society
Lindert J
(2024)
Logarithmic EW corrections at one-loop
in The European Physical Journal C
Linh B
(2024)
Onset of collectivity for argon isotopes close to N = 32
in Physical Review C
Liu Y
(2024)
The mass accretion history of dark matter haloes down to Earth mass
in Monthly Notices of the Royal Astronomical Society
| Title | Collaboration with Atempo |
| Description | Tape to Tape data transfter between DiRAC sites. |
| Type Of Technology | Software |
| Year Produced | 2019 |
| Open Source License? | Yes |
| Impact | Proof of COncept that data could be read from Tape stores remotely via a remote file system |
| Title | Fast Network Links for Durham and Cambridge Univeristies |
| Description | The Universeities and Cambridge are now linked by a highly performant Network |
| Type Of Technology | Physical Model/Kit |
| Year Produced | 2019 |
| Impact | Both HEIs are able to ingest data at a faster rate |
| Description | Member of UKRI E-Infrastructure Expert Panel 2017-2019 |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Created 7 white papers for UKRI which detailed a Roadmap for future e-Infrastructure funding in the UK |
| Year(s) Of Engagement Activity | 2017,2018,2019 |
