31 July 2017 to 4 August 2017
Fermi National Accelerator Laboratory
US/Central timezone

HEPCloud: Provisioning 160,000 Compute Cores for Science

3 Aug 2017, 13:30
17m
Hornets Nest (Fermi National Accelerator Laboratory)

Hornets Nest

Fermi National Accelerator Laboratory

Presentation Computing, Analysis Tools and Data Handling Computing, Analysis Tools, and Data Handling

Speaker

Dr Burt Holzman (FNAL)

Description

The High Energy Physics (HEP) community is facing a daunting computing challenge in the upcoming years, as upgrades to the Large Hadron Collider and new technologies such as liquid argon detectors will require vast amounts of simulation and processing. Additionally, the stochastic nature of research suggests that leveraging elastically available resources would increase efficiency and cost-effectiveness. At the same time, the decreasing cost of renting commercial cloud resources and the increasing scale of High Performance Computing (HPC) facilities make them attractive targets for HEP workflows. The HEPCloud program aims to seamlessly integrate grid, cloud, and allocation-based facilities into a single virtual facility, as transparently to the user as possible. In the last year, we have integrated Amazon Web Services, Google Cloud Platform, and the Cori supercomputer at the National Energy Research Scientific Computing Center (NERSC). Results from these studies will be discussed.

Primary author

Dr Burt Holzman (FNAL)

Co-authors

Mr Anthony Tiradani (Fermilab) Dr Dave Dykstra (Fermilab) Dr David Mason (FNAL) Dr Dirk Hufnagel (Fermilab) Dr Eric Vaandering (Fermilab) Dr Gabriele Garzoglio (Fermilab) Hyunwoo Kim (Fermilab) Kevin Retzke (FNAL) Ms Krista Majewski (Fermilab) Dr Lothar Bauerdick (Fermilab) Neha Sharma (Fermilab) Dr Nicolo Magini (Fermilab) Dr Oliver Gutsche (Fermi National Accelerator Laboratory) Dr Panagiotis Spentzouris (Fermilab) Mr Parag Mhashilkar (Fermi National Accelerator Laboratory) Dr Robert Kennedy (FNAL-CD) Dr Steven Timm (Fermilab) Dr Stuart Fuess (Fermilab)

Presentation materials