DUNE Core Software & Computing Meeting

Monday 6 Jan 2025, 09:30 → 11:20 US/Central

https://bnl.zoomgov.com/j/1601301980

Aaron Higuera Pichardo (Rice University), Andrew McNab (University of Manchester), Doug Benjamin (Brookhaven National Laboratory (US)), Elisabetta Pennacchio (IN2P3), Heidi Schellman (Oregon state), Michael Kirby (BNL), Steven Timm (Fermilab), Thomas Junk (Fermilab)

We will have the DUNE Core Software & Computing meeting:

Topic: DUNE General CS&C Meeting

Time: Oct 28, 2024 09:30 AM Central Time (US and Canada)

https://bnl.zoomgov.com/j/1601301980

Meeting ID: 1601301980

Standard computing password, will be sent by email for those who don't know it.

09:30 → 10:15 General Computing Presentations

Convener: Dr Michael Kirby (BNL)

09:30 News from Computing Consortium

Speaker: Dr Michael Kirby (BNL)

DUNE_Computing_6Jan2025.pdf

10:15 → 10:45 Operations

10:15 Operations Meeting report

Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).

Speakers: Kenneth Herner (Fermilab), Dr Steven Timm (Fermilab)

2025jan6_opsmeetingsummary.pdf

10:25 Production status report

https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?orgId=1&from=now-30d&to=now-5m&var-experiment=dune

Speakers: Aaron Higuera Pichardo (Rice University), Elisabetta Pennacchio (IN2P3), Dr Kenneth Herner (Fermilab), Matt Kramer (Lawrence Berkeley National Laboratory), Sophia Farrell (Rice University)

LE production status:

Dataset #1 (VD, no background) Aaron is taking care of merging

Dataset #2 (VD no background)  merging finished

metacat query -s "files from fardet-hd:fardet-hd__hit-reconstructed__v09_91_04d00__reco1_supernova_dune10kt_1x2x6__prodmarley_nue_cc_flat_dune10kt_1x2x6__out1__official"

Files:    320

Total size:   455096595374 (455.097 GB)

(files to be merged in scratch,   resultant merged files copied  into the DeclaD drop box) 

Dataset #3 (VD with background): no merging needed, production will start once justin upgrade  finished. Production output to be stored on RSEs identified by data management team

 (2.4 M of events, expected volume ~560 TB)

PD-VD keepup processing: a presentation is scheduled at the production meeting this week

 

dune production hours:

https://landscape.fnal.gov/kibana/goto/9e40ee53d481f51da72610b714e39389

 

10:45 → 10:55 Computing Services Development

10:45 Data Management development

SAM, RUCIO etc

Speakers: Aaron Higuera Pichardo (Rice University), Doug Benjamin (Brookhaven National Laboratory (US)), Dr Steven Timm (Fermilab)

2025jan06_dunedatamgmt.pdf

10:50 Workflow Development

justIN, HEPCloud, GlideinWMS, POMS, etc.

Speakers: Dr Andrew McNab (University of Manchester), Christopher Brew, Kenneth Herner (Fermilab), Raja Nandakumar (STFC Rutherford Appleton Laboratory)

10:55 → 11:05 Software Development

10:55 Databases Development

Speakers: Ana Paula Vizcaya Hernandez (Colorado State University), Prof. Norm Buchanan (Colorado State University), Norman Buchanan

11:00 PD/FD/ND Software Development

(This item should probably be split into smaller units?)

Add in Coldbox (Iceberg/np02/np04) and 2x2

Speakers: Barnali Chowdhury (Argonne National Laboratory), Elisabetta Pennacchio, Dr Elisabetta Pennacchio (IN2P3), Dr Mathew Muether (Wichita State University), Mathew Muether (Wichita State), Dr Thomas Junk (Fermilab)