DUNE Core Computing Meeting

US/Central
https://fnal.zoom.us/j/336647590

https://fnal.zoom.us/j/336647590

Andrew McNab (University of Manchester), Andrew Norman (Fermilab), Brett Viren (BNL), David Adams (BNL), Heidi Schellman (Oregon state), Michael Kirby (FNAL), Paul Laycock (Brookhaven National Laboratory (US)), Steven Timm (Fermilab), Thomas Junk (Fermilab)
Description

We will have the DUNE General computing meeting:

https://fnal.zoom.us/j/336647590

Meeting ID: 336 647 590

standard computing password, will be sent by email for those who don't know it.

One tap mobile
+16699006833,,336647590# US (San Jose)
+16465588656,,336647590# US (New York)

Dial by your location
        +1 669 900 6833 US (San Jose)
        +1 646 558 8656 US (New York)
Meeting ID: 336 647 590
Find your local number: https://fnal.zoom.us/u/adJsct1aBR

    • 9:30 AM 9:55 AM
      News from Computing Management etc: News from Computing Management
      • 9:30 AM
        News from Computing Consortium 5m
        Speakers: Dr Andrew McNab (University of Manchester), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL)
      • 9:35 AM
        News from partner projects (OSG, WLCG, IRIS, HEP-CCE, HSF, Root ... etc) 5m
      • 9:40 AM
        Collab meeting sessions and CDR update 15m
        Speaker: Heidi Schellman (Oregon state)
    • 9:55 AM 10:20 AM
      Operations
      • 9:55 AM
        protoDUNE II Horizontal Drift (np04) operational status 5m
        Speaker: Dr Michael Kirby (FNAL)
      • 10:00 AM
        protoDUNE II Vertical Drift (np02) operational status 5m
        Speakers: Dr Elisabetta Pennacchio (IN2P3), Elisabetta Pennacchio
      • 10:05 AM
        Operations Meeting report 5m

        Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).

        Speaker: Dr Steven Timm (Fermilab)
      • 10:10 AM
        Production status report 5m

        https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?orgId=1&from=now-30d&to=now-5m&var-experiment=dune

        Speaker: Dr Kenneth Herner (Fermilab)
      • 10:15 AM
        User analysis status report 5m

        https://samweb.fnal.gov:8483/station_monitor/dune/stations/dune/projects

    • 10:20 AM 10:40 AM
      Software Development
      • 10:20 AM
        SP/DP/ND Software Development 5m

        (This item should probably be split into smaller units?)

        Add in Coldbox (Iceberg/np02/np04)

        Speakers: Barnali Chowdhury (Argonne National Laboratory), Elisabetta Pennacchio, Dr Elisabetta Pennacchio (IN2P3), Dr Mathew Muether (Fermilab), Mathew Muether (Whichita State), Dr Thomas Junk (Fermilab)
      • 10:25 AM
        Databases Development 5m
        Speakers: Prof. Norm Buchanan (Colorado State University), Norman Buchanan, Paul Laycock (Brookhaven National Laboratory)
      • 10:30 AM
        Software Management 5m
        Speakers: David Adams (BNL), David Adams, Jake Calcutt (Michigan State University), Dr Kurt Biery (Fermilab), Dr Thomas Junk (Fermilab)

          Jake and Tom have deployed the split dunetpc to GitHub, and udpated the Jenkins build script and protoduneana.  Still to do: migrate the wiki pages, and exercise the release procedure.  Coach users.  Maintain the releases.  We'd like the art/LArSoft team to continue providing feature branches for the new products similar to how they did for dunetpc when the art and LArSoft APIs change (mostly include-file location changes and CMakeLists.txt file changes).  It would be nice to add garsoft, garana and duneanaobj to that list of products with feature branches to be added. 

        There is a legacy dunetpc repository in https://github.com/DUNE/ made (we think) by Ben Morgan.  It is three years old and has no tags.  Ben is no longer on the DUNE collaboration list.  It would be good to make that one go away, or update it to the final version that's in Redmine and disable pushes, as has been done for the Redmine repo.  The history of each file has been preserved in the new split repositories, but the old dunetpc will be kept on Redmine for inspection purposes.  We don't want people developing and pushing to the dunetpc in GitHub though -- should use the new repositories.  The wiki page and the README.md for dunetpc in GitHub say it's legacy and not maintained.

        Chris Backhouse noted that there are mentions of dunetpc in the new repositories.  Almost all instances of that reflect poor design choices made over the years and some instances correspond to code that would not work on the grid, or even with recent releases of dunetpc.  So there is some cleanup to do.  And conventions for library specifications in CMakeLists.txt files have evolved over time, and we have a mixture that currently works, but it may need some maintenance.

        Jake has been in touch with Vito about updating the CI tests. 

        The Spack migration will also need to work with the new products.

        duneanaobj is still rather "standalone".  We did not touch that product this round.  And dune-raw-data is really a daq-group product, but we have been incrementing version numbers and doing small maintenance to it in order to keep ProtoDUNE-SP data readin alive.  It still is in Redmine and has a separate release procedure. 

      • 10:35 AM
        Frameworks Task Force 5m
        Speakers: Dr Andrew Norman (Fermilab), Paul Laycock (Brookhaven National Laboratory)
    • 10:40 AM 10:55 AM
      Computing Services Development
      • 10:40 AM
        Data Management development 5m

        SAM, RUCIO etc

        Speakers: Dr Andrew Norman (Fermilab), Igor Mandrichenko (FNAL), Dr Steven Timm (Fermilab), Dr Stuart Fuess (Fermilab)
      • 10:45 AM
        Workflow Development 5m

        WFS, HEPCloud, GlideinWMS, POMS, etc. https://github.com/DUNE/dist-comp/labels/WMSdev

        Speakers: Dr Andrew McNab (University of Manchester), Dr Andrew Norman (Fermilab), Kenneth Herner (Fermilab), Dr Steven Timm (Fermilab)
      • 10:50 AM
        Information Systems development 2m

        CRIC

      • 10:52 AM
        Monitoring Systems development 2m

        ETF site monitoring, RUCIO monitoring, perfSonar network monitoring

        https://etf-dune-preprod.cern.ch/etf/check_mk/index.py?start_url=%2Fetf%2Fcheck_mk%2Fview.py%3Fview_name%3Dallhosts

        https://dune.monitoring.edi.scotgrid.ac.uk/app/dashboards#/view/7eb1cea0-ca5e-11ea-b9a5-15b75a959b33?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-1d,to:now))

        Speakers: Christopher Brew, Heidi Schellman (Oregon state), Peter Clarke, Raja Nandakumar, Steven Timm (Fermilab), Prof. peter clarke (University Edinburgh)
    • 10:55 AM 11:00 AM
      Documentation and Training 5m
      Speakers: Claire David (York University / FNAL), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL), Dr Thomas Junk (Fermilab)