Weekly CCE-SOP tele-conference

Wednesday 22 May 2024, 11:00 → 12:25 US/Central

Peter van Gemmeren (ANL), Saba Sehrish (Fermilab)

Topic: HEP-CCE2/SOP video conference

Join Zoom Meeting

https://cern.zoom.us/j/63214151964?pwd=OXNtZWJuZFBvT3FWN1RhWG9EMzE1QT09

 

Meeting ID: 632 1415 1964

Passcode: 528737

Live notes

# Attendees
-  Peter, RobL, Saba, Chis, Paolo, Salman, Shane, Patrick, Jean Luca, Marcin, Philippe, Serhan, Rui, Matti, Dan

# Introduction/Management News
Please fill out poll for All Hands Meeting availability: Doodle  – accurate attendance will help secure meeting rooms
DoE says “focus on AI”
Everyone’s going to see a 6% cut next year
CCE can use this new AI focus – AI already part of proposed work
“Logical ways that we can proceed”

# Applying Lessons Learned to HEP Experiments, Mimicking Framework, Darshan and HDF5
Mimicking Framework, Darshan and HDF5
Amit Bashyal, Christopher Jones, Kenneth Herner, Patrick Gartung , Peter van Gemmeren, Rui Wang, Saba Sehrish, Shane Snyder
Extending Jean Luca tools to deal with multiple files
Saba wants to make sure we continue to look at HDF5 in addition to TTree and RNTuple

# Tracking and aiding the evolution of ROOT I/O, in particular RNTuple
    Alaettin Serhan Mete, Amit Bashyal, Barnali Chowdhury, Christopher Jones, Daniel Riley, Kyle Knoepfel, Marcin Nowak, Matti Kortelainen, Peter van Gemmeren, Philippe Canal

Next RNTuple API review meeting likely in 3 weeks, modules tbd

Matti/Peter: Will have a review meeting dedicated to error handling (exception based) and documentation.

# Reduced Precision and Intelligent Domain-specific Compression Algorithms 
    Amit Bashyal, Meghna Bhattacharya, Peter van Gemmeren

# Object Stores and Strategies for Data Placement and Replication
    Bo Jayatilaka, Doug Benjamin, Nicholas Smith, Rob Latham, Rob Ross, Saba Sehrish, Shane Snyder 

Saba going to make some calls to “get this topic moving”
Peter: work to evaluate three replication strategies in object store

# Optimized Data Delivery to HPC systems
    Marco Mambelli, Saba Sehrish
Marco still looking on SBN transfers

# Any Other Business

11:00 → 11:05 Introduction/Management News

All Hands Meeting:

We expect the meeting to last 2.5 days, during which we will (among other things):
1) Review the impact of our Phase I and Phase II activities on our stakeholders (experiments and HPC centers)
2) Highlight early results and open issues from each Phase II area: PAW, SOP, SIM, and SML.
3) Discuss priorities and update milestones for Year 2 of the project, taking into account the input from our program manager and the report from the project review (which we should receive in the coming weeks).
3a) Specifically, in Year 2, we have been encouraged to increase the scope of AI/ML activities in CCE to ~25% of the total effort
We look forward to seeing you all in person at LBL or virtually.

Please fill out AHM poll.

Speakers: Paolo Calafiura (LBNL), Peter van Gemmeren (ANL), Saba Sehrish (Fermilab), Salman Habib (Argonne National Laboratory)

AHM poll

11:10 → 11:20 Applying Lessons Learned to HEP Experiments, Mimicking Framework, Darshan and HDF5

Conveners: Amit Bashyal (Argonne National Lab), Christopher Jones (Fermilab), Kenneth Herner (Fermilab), Patrick Gartung (Fermilib), Peter van Gemmeren (ANL), Rui Wang (ANL), Saba Sehrish (Fermilab), Shane Snyder (Argonne National Laboratory)

11:20 → 11:30 Tracking and aiding the evolution of ROOT I/O, in particular RNTuple

Speakers: Alaettin Serhan Mete (Argonne National Laboratory (US)), Amit Bashyal (Argonne National Lab), Barnali Chowdhury (Argonne National Laboratory), Christopher Jones (Fermilab), Daniel Riley (Cornell University), Kyle Knoepfel (Fermilab), Marcin Nowak (BNL), Matti Kortelainen (Fermilab), Peter van Gemmeren (ANL), Philippe Canal (FERMILAB)

11:30 → 11:40 Reduced Precision and Intelligent Domain-specific Compression Algorithms

Speakers: Amit Bashyal (Argonne National Lab), Meghna Bhattacharya, Peter van Gemmeren (ANL)

11:40 → 11:50 Object Stores and Strategies for Data Placement and Replication

Speakers: Bo Jayatilaka (Fermilab), Doug Benjamin (Brookhaven National Laboratory (US)), Nicholas Smith (Fermilab), Rob Latham (Argonne National Laboratory), Rob Ross (ANL), Saba Sehrish (Fermilab), Shane Snyder (Argonne National Laboratory)

11:50 → 12:00 Optimized Data Delivery to HPC systems

Speakers: Marco Mambelli (Fermilab), Peter van Gemmeren (ANL), Saba Sehrish (Fermilab)