DUNE Core Computing Meeting

Monday 3 May 2021, 09:30 → 11:05 US/Central

https://fnal.zoom.us/j/336647590

Andrew McNab (University of Manchester), Andrew Norman (Fermilab), Brett Viren (BNL), David Adams (BNL), Heidi Schellman (Oregon state), Michael Kirby (FNAL), Steven Timm (Fermilab), Thomas Junk (Fermilab)

We will have the DUNE General computing meeting:

https://fnal.zoom.us/j/336647590

Meeting ID: 336 647 590

standard computing password, will be sent by email for those who don't know it.

One tap mobile
+16699006833,,336647590# US (San Jose)
+16465588656,,336647590# US (New York)

Dial by your location
        +1 669 900 6833 US (San Jose)
        +1 646 558 8656 US (New York)
Meeting ID: 336 647 590
Find your local number: https://fnal.zoom.us/u/adJsct1aBR

09:30 → 10:00 News from Computing Management etc: News from Computing Management

09:30 News from Computing Consortium

Speakers: Dr Andrew McNab (University of Manchester), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL)

09:33 News from partner projects (OSG, WLCG etc)

Andrew McNab on the benchmarking project

Speaker: Andrew McNab (University of Manchester)

20210421-mcnab-dune-hepscore.pdf

09:36 News from RRB and Fermilab Scrutity group

Speakers: Dr Michael Kirby (FNAL), Peter Clarke, Prof. peter clarke (University Edinburgh)

09:39 Special talk - OSU Rucio Monitoring project

OSU students show their monitoring results from a project with Steve Timm tracking Rucio transfers.

Speakers: Heidi Schellman (Oregon state), Steven Timm (Fermilab)

Dune Fermilab Presentation (3).pdf

link for the system, requires VPN

09:50 → 10:15 Operations

09:50 protoDUNE SP operational status

Speaker: Andrea Dell'Acqua (CERN)

NP04 was turned off all last week due to cooling intervention.

09:55 protoDUNE DP operational status

Speakers: Dr Elisabetta Pennacchio (IN2P3), Elisabetta Pennacchio

NP02 also off all week due to cooling intervention

10:00 Operations Meeting report

Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).

Speaker: Dr Steven Timm (Fermilab)

Also from operations

BNL working on submit node to join DUNE global pool

May move BERN  (UNIBE-LHEP) to DUNE global pool to get around dune/microboone ambiguity

on the DN.

Will close Manchester ticket because this is problem on DUNE data ops slide.

 

Welcome Amit Bashyal @ANL

TIFR/India has new network switch.

 

 

10:05 Production status report

Speaker: Dr Kenneth Herner (Fermilab)

Request in for 6GeV MC with the revised pdspprod4A software base, similar to the 1GeV MC  that was

recently redone.

 

Meeting was had between Ken/Elisabetta and the vertical drift task force  leaders Dominque/Alessandro 

a vertical drift geometry is understood and they are working to make a 10-event sample

 

10:10 User analysis status report

10:15 → 10:40 Software Development

10:15 Databases Development

Speakers: Prof. Norm Buchanan (Colorado State University), Norman Buchanan, Paul Laycock (Brookhaven National Laboratory)

We will meet with the APA consortia folks on Wednesday to discuss updating the interface document to include something brief on the hardware DB, basically to point out they're responsible for putting things in it.

We're also following up with the PartsID DB developer to make sure he gets useful feedback on the interface, currently it's mainly a GUI and could use a REST API to allow easy bulk updates.

10:20 Software Management

Speakers: Mr Christoph Alt (ETH Zurich), David Adams (BNL), David Adams, Etienne Chardonnet, Dr Kurt Biery (Fermilab), Dr Thomas Junk (Fermilab)

LArSoft -> HDF5 needs to be rolled back. 

CENTOS -> ???

10:25 Frameworks Task Force

Speakers: Dr Andrew Norman (Fermilab), Paul Laycock (Brookhaven National Laboratory)

Frameworks task force ...  Monday at 930 FNAL time... Probably

10:30 SP/DP/ND Software Development

(This item should probably be split into smaller units?)

Speakers: Andrea Dell'Acqua (CERN), Elisabetta Pennacchio, Dr Elisabetta Pennacchio (IN2P3), Dr Mathew Muether (Fermilab), Mathew Muether (Whichita State)

From Mathew,

I have a conflict at 10 am today. ND update is that we’re preparing for an ND round of production. This week groups are working to finalize their geometries, the e-dep sim configuration and, production scripts. We are documenting code locations (and centralizing where possible).  We hope that by the end of this week we can have initial instructions of all the group from our primary samples (GENIE LAr +GAr, and Genie LAr + TMS) so that production can give a sample run a try and we can see what’s broken. We have a ND software meeting this Wednesday.

10:30 → 10:50 Computing Services Development

10:30 Data Management development

SAM, RUCIO etc

Speakers: Dr Adam Aurisano (University of Cincinnati), Dr Andrew Norman (Fermilab), Igor Mandrichenko (FNAL), Dr Steven Timm (Fermilab), Dr Stuart Fuess (Fermilab)

10:35 Workload and Workflow development

HEPCloud, GlideinWMS, POMS, etc. https://github.com/DUNE/dist-comp/labels/WMSdev

Speakers: Dr Andrew McNab (University of Manchester), Dr Andrew Norman (Fermilab), Kenneth Herner (Fermilab), Dr Steven Timm (Fermilab)

10:40 Information Systems development

CRIC

Speaker: Andrew McNab (University of Manchester)

Get more location info into CRIC for RSE's.

10:45 Monitoring Systems development

ETF site monitoring, perfSonar network monitoring

Speakers: Christopher Brew, Peter Clarke, Raja Nandakumar, Prof. peter clarke (University Edinburgh)

10:45 → 10:50 Documentation and Training

Speakers: Claire David (York University / FNAL), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL), Dr Thomas Junk (Fermilab)

 

DUNE Computing Training May 2021

Registration

• in progress
• closing May the Fourth
• 80 people so far!

HELP!

It would be great to have:

• mentors (people helping during the event to reply to questions)
• people to check the material

https://dune.github.io/computing-training/setup.html

• people to test     the material

Code-makeover

Some of you asked what is a 'code-makeover'. Think of it as an 'on demand' tutorial/review on a specific aspect of programming.

I went through the registration survey and here is a list of possible code-makeover topics:

(ranked in numbers of requests)

A) Switch from Project.py to POMS: step by step guide (2)

B) Tips on how to make your code run more efficiently (2)

C) Clever way(s) to implement the systematic variations (1)

D) How to implement a new event generator in LArSoft  (1)

E) What are the best practices for handling large files (1)

F) How to create relocatable build and submitting grid jobs using relocatable build (1)