New Official: DUNE Core Computing Meeting

Monday 20 Jul 2020, 09:30 → 13:05 US/Central

https://fnal.zoom.us/j/336647590

Andrew McNab (University of Manchester), Andrew Norman (Fermilab), Brett Viren (BNL), David Adams (BNL), Heidi Schellman (Oregon state), Michael Kirby (FNAL), Steven Timm (Fermilab), Thomas Junk (Fermilab)

We will have the DUNE General computing meeting:

https://fnal.zoom.us/j/336647590

Meeting ID: 336 647 590

standard computing password, will be sent by email for those who don't know it.

One tap mobile
+16699006833,,336647590# US (San Jose)
+16465588656,,336647590# US (New York)

Dial by your location
        +1 669 900 6833 US (San Jose)
        +1 646 558 8656 US (New York)
Meeting ID: 336 647 590
Find your local number: https://fnal.zoom.us/u/adJsct1aBR

09:30 → 09:59 News from Computing Management etc: News from Computing Management

09:30 News from Computing Consortium

Speakers: Dr Andrew McNab (University of Manchester), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL)

09:35 News from Computing Contributions Board

Speakers: Peter Clarke, Prof. peter clarke (University Edinburgh)

09:37 News from partner projects (OSG, WLCG etc)

09:39 ICHEP practice talk

20th July is Kirby's ICHEP practice talk

Speaker: Michael Kirby (FNAL)

DUNE_Computing_Overview_ICHEP2020.pdf

09:45 → 10:10 Software Development

09:45 Databases Development

Speakers: Prof. Norm Buchanan (Colorado State University), Norman Buchanan, Paul Laycock (Brookhaven National Laboratory)

09:50 Software Management

Speakers: Mr Christoph Alt (ETH Zurich), David Adams, David Adams (BNL), Dr Kurt Biery (Fermilab), Dr Thomas Junk (Fermilab)

dunetpc v08_58_00 is available.  The new pull request model makes for better release notes:
https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/ReleaseNotes085800

We have requested Pandora LC Content to be added to the LArSoft Pandora UPS product, and for a new bxdecay0 UPS product to be created.  Pierre Lasorak has a module which calls it.  We figured out some details needed for it to be relocated -- some hardcoded paths were present in the setup scripts it makes when built and installed.

We assume that the pandora product with Pandora LC Content in it will be released with the latest (e19 and c7) compilers with dependencies on the current ROOT version.  So Tom updated (but hasn't pushed yet) GArSoft source to be compatible with art v3_05_01 and nutools v3_06_05 (a lot of things have moved around since art v3_00_00 and nutools v2_26_02 including some code that checked the version of ROOT and failed to compile if it was too big.  The new corresponding version of ROOT is v6_18_04d.  An interesting problem arose with reading GDML files which redefined zinc.  GENIE has no splines for neutrino interactions on 65Zn (it's an unstable nuclide), but the average atomic weight of Zinc rounds to 65.  GArSoft GDML files had redefined zinc to be 100% 64Zn but this stopped working, but works again if we call the purified zinc by another name.  The current hypothesis is that zinc is now predefined (and probably every other element), and that A is an average atomic weight.  GENIE however interprets A to be a specific number of nucleons.  This may have been discovered by others a while ago but GArSoft had not updated ROOT or art in a year and a half.  We also have to discuss the GENIE version, as v2.x was used for the TDR, while new development in LArSoft is with v3.x.  The ND TDR has yet to be written, though the CDR is available.  There had been mention of a mechanism to allow arbitrary GENIE versions to be run with larsoft and not automatically forced by the UPS dependency -- Tom is asking if this has been implemented.

09:55 Frameworks Task Force

Speakers: Dr Andrew Norman (Fermilab), Paul Laycock (Brookhaven National Laboratory)

10:00 SP/DP/ND Software Development

(This item should probably be split into smaller units?)

Speakers: Andrea Dell'Acqua (CERN), Elisabetta Pennacchio, Dr Elisabetta Pennacchio (IN2P3), Dr Mathew Muether (Fermilab), Mathew Muether (Whichita State)

10:10 → 10:35 Operations

10:10 protoDUNE SP operational status

Speaker: Andrea Dell'Acqua (CERN)

10:15 protoDUNE DP operational status

Speakers: Dr Elisabetta Pennacchio (IN2P3), Elisabetta Pennacchio

10:20 Operations Meeting report

Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).

Speaker: Dr Steven Timm (Fermilab)

duneopssummary_2020jul20.pptx

10:25 Production status report

Speaker: Dr Kenneth Herner (Fermilab)

10:30 User analysis status report

10:35 → 10:55 Computing Services Development

10:35 Data Management development

SAM, RUCIO etc

Speakers: Dr Adam Aurisano (University of Cincinnati), Dr Andrew Norman (Fermilab), Igor Mandrichenko (FNAL), Dr Steven Timm (Fermilab), Dr Stuart Fuess (Fermilab)

dunedatadev_2020jul20.pptx

10:40 Workload and Workflow development

HEPCloud, GlideinWMS, POMS, etc

Speakers: Dr Andrew McNab (University of Manchester), Dr Andrew Norman (Fermilab), Kenneth Herner (Fermilab), Dr Steven Timm (Fermilab)

10:45 Information Systems development

CRIC

Speaker: Andrew McNab (University of Manchester)

10:50 Monitoring Systems development

ETF site monitoring, perfSonar network monitoring

Speakers: Christopher Brew, Peter Clarke, Raja Nandakumar, Prof. peter clarke (University Edinburgh)

10:55 → 11:00 Documentation and Training

Speakers: Claire David (York University / FNAL), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL), Dr Thomas Junk (Fermilab)

20200713_DavidC_DUNE_computing_wiki.pdf

Computing Wiki, updated

Categories:

• Management
• Operation status (caution with overlapping with tools, see below)
• User / Accounts
• Working group (template)
• Training / Tutorials
• Tools
  • online monitoring tools
  • data management tools
  • code (github repo)
• Softwares
  • detector softwares
  • Argon-based softwares
  • reconstruction libraries
• System Development
• Infrastructure / or distributed computing?

 

Suggestion from Vivek Jain (chatting with him tomorrow Tuesday, July 21): breadcrumb feature

Example:

DUNE Computing > Operations > Monitoring tools

Menu on the left: categories or something else?

 

11:00 → 12:10 Copied from old agenda format for comparison

Will be deleted when we finish editing

11:00 Operations/Production report

Speakers: Andrew McNab (University of Manchester), Dr Kenneth Herner (Fermilab), Michael Kirby (FNAL), Steven Timm (Fermilab)

11:05 Databases

Speakers: Prof. Norm Buchanan (Colorado State University), Dr Paul Laycock (Brookhaven National Laboratory)

11:10 Software Management

Speakers: Mr Christoph Alt (ETH Zurich), David Adams (BNL), David Adams, Dr Kurt Biery (Fermilab), Dr Thomas Junk (Fermilab)

11:15 Near Detector

Speakers: Mathew Muether (Whichita State), Dr Mathew Muether (Fermilab)

11:20 ProtoDUNE-DP

Speaker: Dr Elisabetta Pennacchio (IN2P3)

11:25 ProtoDUNE-SP

Speaker: Andrea Dell'Acqua (CERN)

11:30 Frameworks Task Force

Speaker: Dr Andrew Norman (Fermilab)

11:35 WLCG etc

Internationalization of DUNE computing operations and activities; national infrastructures; WLCG meeting reports

Speakers: Dr Andrew McNab (University of Manchester), Prof. peter clarke (University Edinburgh)

11:40 Data Management

Speakers: Dr Adam Aurisano (University of Cincinnati), Dr Andrew Norman (Fermilab), Igor Mandrichenko (FNAL), Dr Steven Timm (Fermilab), Dr Stuart Fuess (Fermilab)

11:45 Workload, Monitoring, and Information Systems

Development and evaluation of workload management (glideinWMS, ...), site monitoring (ETF, ...), and site information systems (CRIC, ...)

Speakers: Dr Andrew McNab (University of Manchester), Dr Kenneth Herner (Fermilab), Dr Raja Nandakumar

11:50 Documentation and training

Speakers: Claire David (York University / FNAL), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL), Dr Thomas Junk (Fermilab)

12:05 networking

Speakers: Dr Michael Kirby (FNAL), Prof. peter clarke (University Edinburgh)