Timetable: HEP-CCE: Scalable IO for Energy and Intensity Frontier Experiments

23 Aug 2018, 07:00 → 24 Aug 2018, 21:05 US/Central

1404, 1405, 1406 & 1407 (Argonne - Bldg 240)

Peter Van Gemmeren (Argonne National Laboratory), Philippe Canal (Fermilab), Samantha Tezak (Argonne National Lab), Taylor Childers (Argonne National Laboratory)

High Energy Physics experiments continue to become more data and simulation intensive. There is an expected factor of ten gap (or more) between projected computing needs for HL-LHC experiments and projected growth of current HEP resources. In the US, High Performance Computing resources are going to be growing by more than an order of magnitude by 2021/2022 with the deployment of the US DOE's first exascale supercomputers. These resources are already becoming an important piece of the HEP computing landscape and will continue to become more important.

One challenge of using leadership computing resources is reading and writing data in scalable ways that does not lead to bottlenecks or performance penalties on the shared filesystems. This Workshop aims to bring together leading IO experts in the HEP field with experts from DOE ASCR Facilities to discuss how to move forward in the next years to make HEP software more friendly to millions of parallel threads accessing files on shared disks.

Google Doc https://docs.google.com/document/d/1lMfVNZroXKpbStFUAQdpyUvdSjOsaZEBcU67I_QrdEI/edit?usp=sharing

photo1 IMG_0140.JPG

photo2 IMG_0139-1.JPG

Thursday, 23 August

09:00 → 10:30 Thursday Morning Intro

Introduction to HPC IO & HEP IO

Conveners: Mr Philippe Canal (FERMILAB), Dr Taylor Childers (Argonne National Laboratory)

09:00 Brief Introduction to HPC IO

Speaker: Richard Zamora (Argonne)

Slides HEPIOworkshop-Zamora.pdf

09:45 Intro to ROOT IO

Speaker: Mr Philippe Canal (FERMILAB)

Slides 2018-HPC-IO-ROOT.pdf

10:30 → 11:00 Coffee Break

11:00 → 14:00 Thursday Afternoon Intro

Conveners: Mr Philippe Canal (FERMILAB), Dr Taylor Childers (Argonne National Laboratory)

11:00 CMS IO Overview

Speakers: Brian Bockelman, Dr Christopher Jones (Fermilab)

Slides CMSIO.pdf

11:40 ATLAS IO Overview

Speaker: Dr Peter van Gemmeren (ANL)

Slides ATLAS_IO_Overview.pdf ATLAS_IO_Overview.pptx

12:20 NERSC Overview

Speaker: Glen Lockwood (NERSC)

Slides Future_of_Storage_at_NERSC.pdf

12:50 OLCF Overview

Speaker: Sarp Oral (Oak Ridge)

13:20 ALCF Overview

Speaker: Kevin Harms (Argonne)

Slides hep-cce-io-alcf-harms.pdf

12:20 → 12:50 Working Lunch

14:00 → 14:30 Coffee Break

14:30 → 18:00 Thursday Evening Discussion

14:30 Overview of HEP Activities in IO

Speaker: Jim Kowalkowski (Fermilab)

Slides ScalableIOWorkshop.pdf ScalableIOWorkshop.pptx

15:00 HEP/HPC Tech Discussion

Discuss pros/cons of ROOT format vs HDF5 (others?). What's the future of Object Stores? Any IO tech in the pipeline to be aware of?

Speakers: Mr Philippe Canal (FERMILAB), Dr Taylor Childers (Argonne National Laboratory)

18:45 → 20:00 Dinner

We have a reservation for 15 at The Craftsman in Naperville. Please fill out the doodle sent via email if you intend to attend.

Friday, 24 August

08:00 → 10:30 Friday Morning Discussion

08:00 Object Stores

Quick introduction to Object Stores which the facilities indicate will be the leading scalable IO tool for the next ten years of Exascale.

Speaker: Glen Lockwood

Slides Fundamentals_of_Object_Stores.pdf

09:00 HEP Transient Object Store

Deeper dive into R&D being done in HEP related to Object Stores. How can these solutions be generalized? How can LHC experiments utilized Object Stores to enable large scale IO on HPCs?

Speaker: Rob Ross (Argonne)

10:30 → 11:00 Coffee Break

11:00 → 14:00 Friday Afternoon Discussion

11:00 Compression

This session will be focused on how compression impacts scalable IO in HEP experiments. Most experiments store their data using compression. Can we utilize non-CPU resources to do this? What would the impact be on uncompressing on CPUs if compressed on GPUs? What tools can we use? ROOT? ZLIB?

Speakers: Brian Bockelman, David Blythe (Argonne), Dr Peter van Gemmeren (ANL)

Slides https://docs.google.com/presentation/d/1OSDxaYJx90L4yKnyGdz6ZwyeehE1HRqxVqBXV88l2Mk/edit#slide=id.g4082bc8727_0_6

12:00 Future Directions, Proposals, Action Items.

What action items have we identified. What joint projects can be tackled to prepare for Exascale use? ROOT IO? Object Stores?

12:00 Working Lunch

Boxed lunches will be handed out during the last 30 minutes of Peter and Brian's discussion.