HEP-CCE: Scalable IO for Energy and Intensity Frontier Experiments

chaired by Philippe Canal (Fermilab), Peter Van Gemmeren (Argonne National Laboratory), Taylor Childers (Argonne National Laboratory), Samantha Tezak (Argonne National Lab)
from to (US/Central)
at Argonne - Bldg 240 ( 1404, 1405, 1406 & 1407 )
9700 Cass Ave, Lemont, IL 60439
Description High Energy Physics experiments continue to become more data and simulation intensive. There is an expected factor of ten gap (or more) between projected computing needs for HL-LHC experiments and projected growth of current HEP resources. In the US, High Performance Computing resources are going to be growing by more than an order of magnitude by 2021/2022 with the deployment of the US DOE's first exascale supercomputers. These resources are already becoming an important piece of the HEP computing landscape and will continue to become more important.

One challenge of using leadership computing resources is reading and writing data in scalable ways that does not lead to bottlenecks or performance penalties on the shared filesystems. This Workshop aims to bring together leading IO experts in the HEP field with experts from DOE ASCR Facilities to discuss how to move forward in the next years to make HEP software more friendly to millions of parallel threads accessing files on shared disks.
Go to day
  • Thursday, August 23, 2018
    • 09:00 - 10:30 Thursday Morning Intro
      Introduction to HPC IO & HEP IO
      • 09:00 Brief Introduction to HPC IO 45'
        Speaker: Richard Zamora (Argonne)
      • 09:45 Intro to ROOT IO 45'
        Speaker: Mr. Philippe Canal (FERMILAB)
        Material: Slides pdf file
    • 10:30 - 11:00 Coffee Break
    • 11:00 - 14:00 Thursday Afternoon Discussion
      • 11:00 CMS IO Overview 40' ( )
        Speakers: Brian Bockelman, Brian Bockelman, Dr. Christopher Jones (Fermilab)
        Material: Slides pdf file
      • 11:40 ATLAS IO Overview 40' ( )
        Speaker: Dr. Peter van Gemmeren (ANL)
      • 12:20 NERSC Overview 30' ( )
        Speaker: Glen Lockwood (NERSC)
      • 12:50 OLCF Overview 30' ( )
        Speaker: Dr. Bronson Messer (Oak Ridge National Laboratory)
      • 13:20 ALCF Overview 30' ( )
        Speaker: Harms Kevin
    • 12:20 - 12:50 Working Lunch
    • 14:00 - 14:30 Coffee Break
    • 14:30 - 18:00 Thursday Evening Discussion
      • 14:30 Overview of HEP Activities in IO 30'
        Speaker: Jim Kowalkowski (Fermilab)
        Material: Slides pdf file
      • 15:00 Discussion 2h0'
    • 18:45 - 20:00 Dinner
      We have a reservation for 15 at The Craftsman in Naperville. Please fill out the doodle sent via email if you intend to attend.
  • Friday, August 24, 2018
    • 08:00 - 10:30 Friday Morning Discussion
      • 08:00 Discussion of ROOT Scalable IO 2h30'
        A discussion of how ROOT could be modified and expanded to support HPC shared IO for HEP experiments. Discussing MPI, OpenMP, TBB, etc. Interfaces required to do this.
        Speaker: Mr. Philippe Canal (FERMILAB)
    • 10:30 - 11:00 Coffee Break
    • 11:00 - 14:00 Friday Afternoon Discussion
      • 11:00 Discussing Experiment Needs 1h30'
        This session we will discuss the needs of current and future experiments with respect to scalable IO on HPCs. This should follow on from the needs for ROOT, and discuss how experiments can then utilize extensions to take advantage of parallel IO at scale on HPCs.
        Speakers: Dr. Peter van Gemmeren (ANL), Brian Bockelman
      • 12:00 Working Lunch 30'
        Boxed lunches will be handed out during the last 30 minutes of Peter and Brian's discussion.
      • 12:30 Compression 1h30'
        This session will be focused on how compression impacts scalable IO in HEP experiments. Most experiments store their data using compression. Can we utilize non-CPU resources to do this? What would the impact be on uncompressing on CPUs if compressed on GPUs? What tools can we use? ROOT? ZLIB? VarInt? ProMC?
        Speakers: Dr. Peter van Gemmeren (ANL), Brian Bockelman