DUNE Core Software & Computing Meeting

Name: DUNE Core Software & Computing Meeting
Start: 2025-01-06T09:30:00-06:00
End: 2025-01-06T11:20:00-06:00
Location: https://bnl.zoomgov.com/j/1601301980

Monday 6 Jan 2025, 09:30 → 11:20 US/Central

https://bnl.zoomgov.com/j/1601301980

Aaron Higuera Pichardo (Rice University), Andrew McNab (University of Manchester), Doug Benjamin (Brookhaven National Laboratory (US)), Elisabetta Pennacchio (IN2P3), Heidi Schellman (Oregon state), Michael Kirby (BNL), Steven Timm (Fermilab), Thomas Junk (Fermilab)

Description

We will have the DUNE Core Software & Computing meeting:

Topic: DUNE General CS&C Meeting

Time: Oct 28, 2024 09:30 AM Central Time (US and Canada)

https://bnl.zoomgov.com/j/1601301980

Meeting ID: 1601301980

Standard computing password, will be sent by email for those who don't know it.

- 09:30 → 10:15
  General Computing Presentations
  
  Convener: Dr Michael Kirby (BNL)
  - 09:30
    
    News from Computing Consortium 15m
    
    Speaker: Dr Michael Kirby (BNL)
    
    DUNE_Computing_6Jan2025.pdf
- 10:15 → 10:45
  Operations
  - 10:15
    
    Operations Meeting report 10m
    
    Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).
    
    Speakers: Kenneth Herner (Fermilab), Dr Steven Timm (Fermilab)
    
    2025jan6_opsmeetingsummary.pdf
  - 10:25
    
    Production status report 15m
    
    Minutes
    
    https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?orgId=1&from=now-30d&to=now-5m&var-experiment=dune
    
    Speakers: Aaron Higuera Pichardo (Rice University), Elisabetta Pennacchio (IN2P3), Dr Kenneth Herner (Fermilab), Matt Kramer (Lawrence Berkeley National Laboratory), Sophia Farrell (Rice University)
    
    LE production status:
    
    Dataset #1 (VD, no background) Aaron is taking care of merging
    
    Dataset #2 (VD no background) merging finished
    
    metacat query -s "files from fardet-hd:fardet-hd__hit-reconstructed__v09_91_04d00__reco1_supernova_dune10kt_1x2x6__prodmarley_nue_cc_flat_dune10kt_1x2x6__out1__official"
    
    Files: 320
    
    Total size: 455096595374 (455.097 GB)
    
    (files to be merged in scratch, resultant merged files copied into the DeclaD drop box)
    
    Dataset #3 (VD with background): no merging needed, production will start once justin upgrade finished. Production output to be stored on RSEs identified by data management team
    
    (2.4 M of events, expected volume ~560 TB)
    
    PD-VD keepup processing: a presentation is scheduled at the production meeting this week
    
    dune production hours:
    
    https://landscape.fnal.gov/kibana/goto/9e40ee53d481f51da72610b714e39389
- 10:45 → 10:55
  Computing Services Development
  - 10:45
    
    Data Management development 5m
    
    SAM, RUCIO etc
    
    Speakers: Aaron Higuera Pichardo (Rice University), Doug Benjamin (Brookhaven National Laboratory (US)), Dr Steven Timm (Fermilab)
    
    2025jan06_dunedatamgmt.pdf
  - 10:50
    
    Workflow Development 5m
    
    justIN, HEPCloud, GlideinWMS, POMS, etc.
    
    Speakers: Dr Andrew McNab (University of Manchester), Christopher Brew, Kenneth Herner (Fermilab), Raja Nandakumar (STFC Rutherford Appleton Laboratory)
- 10:55 → 11:05
  Software Development
  - 10:55
    
    Databases Development 5m
    
    Speakers: Ana Paula Vizcaya Hernandez (Colorado State University), Prof. Norm Buchanan (Colorado State University), Norman Buchanan
  - 11:00
    
    PD/FD/ND Software Development 5m
    
    (This item should probably be split into smaller units?)
    
    Add in Coldbox (Iceberg/np02/np04) and 2x2
    
    Speakers: Barnali Chowdhury (Argonne National Laboratory), Elisabetta Pennacchio, Dr Elisabetta Pennacchio (IN2P3), Dr Mathew Muether (Wichita State University), Mathew Muether (Wichita State), Dr Thomas Junk (Fermilab)