HEP-CCE: Scalable IO for Energy and Intensity Frontier Experiments

US/Central
1404, 1405, 1406 & 1407 (Argonne - Bldg 240)

1404, 1405, 1406 & 1407

Argonne - Bldg 240

9700 Cass Ave, Lemont, IL 60439
Peter Van Gemmeren (Argonne National Laboratory), Philippe Canal (Fermilab), Samantha Tezak (Argonne National Lab), Taylor Childers (Argonne National Laboratory)
Description
High Energy Physics experiments continue to become more data and simulation intensive. There is an expected factor of ten gap (or more) between projected computing needs for HL-LHC experiments and projected growth of current HEP resources. In the US, High Performance Computing resources are going to be growing by more than an order of magnitude by 2021/2022 with the deployment of the US DOE's first exascale supercomputers. These resources are already becoming an important piece of the HEP computing landscape and will continue to become more important.

One challenge of using leadership computing resources is reading and writing data in scalable ways that does not lead to bottlenecks or performance penalties on the shared filesystems. This Workshop aims to bring together leading IO experts in the HEP field with experts from DOE ASCR Facilities to discuss how to move forward in the next years to make HEP software more friendly to millions of parallel threads accessing files on shared disks.
Argonne Site Map
Participants
  • Andrew Norman
  • Anmol Paudel
  • Bo Jayatilaka
  • Brian Bockelman
  • Bronson Messer
  • Burt Holzman
  • Chris Jones
  • Daniel Riley
  • David Malon
  • Dirk Hufnagel
  • Doug Benjamin
  • Elizabeth Sexton-Kennedy
  • Francois Tessier
  • Glenn Lockwood
  • Heidi Schellman
  • Jack Cranshaw
  • Jakob Blomer
  • Jim Kowalkowski
  • Kenneth Herner
  • Kevin Harms
  • Kyle Knoepfel
  • Marc Paterno
  • Marcel Demarteau
  • Marcin Nowak
  • Peter van Gemmeren
  • Philippe Canal
  • Richard Zamora
  • Rob Ross
  • Saba Sehrish
  • Salman Habib
  • Satish Puri
  • Taylor Childers
  • Thomas Uram
  • Vakho Tsulaia
  • Venkat Vishwanath
  • Thursday, 23 August
    • 09:00 10:30
      Thursday Morning Intro

      Introduction to HPC IO & HEP IO

      • 09:00
        Brief Introduction to HPC IO 45m
        Speaker: Richard Zamora (Argonne)
      • 09:45
        Intro to ROOT IO 45m
        Speaker: Mr Philippe Canal (FERMILAB)
        Slides
    • 10:30 11:00
      Coffee Break 30m
    • 11:00 14:00
      Thursday Afternoon Discussion
      • 11:00
        CMS IO Overview 40m
        Speakers: Brian Bockelman, Dr Christopher Jones (Fermilab)
        Slides
      • 11:40
        ATLAS IO Overview 40m
        Speaker: Dr Peter van Gemmeren (ANL)
      • 12:20
        NERSC Overview 30m
        Speaker: Glen Lockwood (NERSC)
      • 12:50
        OLCF Overview 30m
        Speaker: Dr Bronson Messer (Oak Ridge National Laboratory)
      • 13:20
        ALCF Overview 30m
        Speaker: Harms Kevin
    • 12:20 12:50
      Working Lunch 30m
    • 14:00 14:30
      Coffee Break 30m
    • 14:30 18:00
      Thursday Evening Discussion
      • 14:30
        Overview of HEP Activities in IO 30m
        Speaker: Jim Kowalkowski (Fermilab)
        Slides
      • 15:00
        Discussion 2h
    • 18:45 20:00
      Dinner

      We have a reservation for 15 at The Craftsman in Naperville. Please fill out the doodle sent via email if you intend to attend.

    • 08:00 10:30
      Friday Morning Discussion
      • 08:00
        Discussion of ROOT Scalable IO 2h 30m
        A discussion of how ROOT could be modified and expanded to support HPC shared IO for HEP experiments. Discussing MPI, OpenMP, TBB, etc. Interfaces required to do this.
        Speaker: Mr Philippe Canal (FERMILAB)
    • 10:30 11:00
      Coffee Break 30m
    • 11:00 14:00
      Friday Afternoon Discussion
      • 11:00
        Discussing Experiment Needs 1h 30m
        This session we will discuss the needs of current and future experiments with respect to scalable IO on HPCs. This should follow on from the needs for ROOT, and discuss how experiments can then utilize extensions to take advantage of parallel IO at scale on HPCs.
        Speakers: Brian Bockelman, Dr Peter van Gemmeren (ANL)
      • 12:00
        Working Lunch 30m

        Boxed lunches will be handed out during the last 30 minutes of Peter and Brian's discussion.

      • 12:30
        Compression 1h 30m
        This session will be focused on how compression impacts scalable IO in HEP experiments. Most experiments store their data using compression. Can we utilize non-CPU resources to do this? What would the impact be on uncompressing on CPUs if compressed on GPUs? What tools can we use? ROOT? ZLIB? VarInt? ProMC?
        Speakers: Brian Bockelman, Dr Peter van Gemmeren (ANL)