DUNE Core Computing Meeting

US/Central
https://fnal.zoom.us/j/336647590

https://fnal.zoom.us/j/336647590

Andrew McNab (University of Manchester), Andrew Norman (Fermilab), Brett Viren (BNL), David Adams (BNL), Heidi Schellman (Oregon state), Michael Kirby (FNAL), Steven Timm (Fermilab), Thomas Junk (Fermilab)
Description

We will have the DUNE General computing meeting:

https://fnal.zoom.us/j/336647590

Meeting ID: 336 647 590

standard computing password, will be sent by email for those who don't know it.

One tap mobile
+16699006833,,336647590# US (San Jose)
+16465588656,,336647590# US (New York)

Dial by your location
        +1 669 900 6833 US (San Jose)
        +1 646 558 8656 US (New York)
Meeting ID: 336 647 590
Find your local number: https://fnal.zoom.us/u/adJsct1aBR

    • 09:30 10:00
      News from Computing Management etc: News from Computing Management
      • 09:30
        News from Computing Consortium 3m
        Speakers: Dr Andrew McNab (University of Manchester), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL)
      • 09:33
        News from partner projects (OSG, WLCG etc) 5m

        Andrew McNab on the benchmarking project

        Speaker: Andrew McNab (University of Manchester)

        Oct 12-14  HDF5  (Amit B. and Barnali C.)

        Oct 14-15 Tokens workshop (Steve T., Doug B. )

         

      • 09:35
        HDF5 discussion 15m

        HDF5 discussion

        Speaker: Heidi Schellman (Oregon state)

        Streaming data with HDF5, frameworks allows it.  

        Two problems

        How does art read from HDF5  

        How do we stream remote HDF5  xhdf5d

        Come up with listserv and slack channel

    • 09:50 10:15
      Operations
      • 09:50
        protoDUNE II Horizontal Drift (np04) operational status 3m
        Speakers: Andrea Dell'Acqua (CERN), Dr Michael Kirby (FNAL)
      • 09:55
        protoDUNE II Vertical Drift (np02) operational status 3m
        Speakers: Dr Elisabetta Pennacchio (IN2P3), Elisabetta Pennacchio

        Test data from CRP possibly end of october

      • 10:00
        Operations Meeting report 5m

        Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).

        Speaker: Dr Steven Timm (Fermilab)
      • 10:05
        Production status report 5m

        https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?orgId=1&from=now-30d&to=now-5m&var-experiment=dune

        Speaker: Dr Kenneth Herner (Fermilab)
      • 10:10
        User analysis status report 5m
    • 10:00 10:40
      Software Development
      • 10:05
        SP/DP/ND Software Development 10m

        (This item should probably be split into smaller units?)

        Speakers: Andrea Dell'Acqua (CERN), Elisabetta Pennacchio, Dr Elisabetta Pennacchio (IN2P3), Dr Mathew Muether (Fermilab), Mathew Muether (Whichita State)
      • 10:15
        Databases Development 5m
        Speakers: Prof. Norm Buchanan (Colorado State University), Norman Buchanan, Paul Laycock (Brookhaven National Laboratory)
      • 10:20
        Software Management 5m
        Speakers: Mr Christoph Alt (ETH Zurich), David Adams (BNL), David Adams, Etienne Chardonnet, Dr Kurt Biery (Fermilab), Dr Thomas Junk (Fermilab)

        David Adams is moving on from DUNE, and Etienne Chardonnet just defended his thesis.  We are in need of help with software management staffing.

        We are still cleaning up little problems seen after we moved to art v3.0.9 and cetbuildtools 8 and mrb 5.  mrb is set up by default in the /cvmfs/dune.opensciencegrid.org/products/dune/setup_dune.sh

        Tom updated garsoft and it seems fine.  There is a lingering problem with protoduneana in that the PROTODUNEANA_FQ_DIR is not set properly, which affects the setting of LD_LIBRARY_PATH.  There is a feature branch for protoduneana.

        The getByLabel data accessors are "obsolete" but not deprecated, so they don't cause compiler warnings (which get turned into error) yet.  We have quite a few of them however.  There are replacements, but it takes some hand-fixing -- not easy to script that.  The getMayByType accessor method was deprecated and that too had to be fixed by hand, but there were not too many of these.

        There is some problem building dunetpc in develop with the latest cetbuildtools -- Etienne notified scisoft and they are investigating.

      • 10:25
        Frameworks Task Force 5m
        Speakers: Dr Andrew Norman (Fermilab), Paul Laycock (Brookhaven National Laboratory)

        Workshop Oct 27, 9am to ..? 

    • 10:30 11:00
      Computing Services Development
      • 10:30
        Data Management development 5m

        SAM, RUCIO etc

        Speakers: Dr Andrew Norman (Fermilab), Igor Mandrichenko (FNAL), Dr Steven Timm (Fermilab), Dr Stuart Fuess (Fermilab)
      • 10:35
        Workload and Workflow development 5m

        HEPCloud, GlideinWMS, POMS, etc. https://github.com/DUNE/dist-comp/labels/WMSdev

        Speakers: Dr Andrew McNab (University of Manchester), Dr Andrew Norman (Fermilab), Kenneth Herner (Fermilab), Dr Steven Timm (Fermilab)

        Andrew - doing prototyping.  

        Simple allocator... queries for single project - extend to global view of projects for optimization...

         

      • 10:40
        Information Systems development 5m

        CRIC

        Speaker: Andrew McNab (University of Manchester)
      • 10:45
        Monitoring Systems development 15m

        ETF site monitoring, perfSonar network monitoring

        Speakers: Christopher Brew, Heidi Schellman (Oregon state), Peter Clarke, Raja Nandakumar, Steven Timm (Fermilab), Prof. peter clarke (University Edinburgh)
    • 10:45 10:50
      Documentation and Training 5m
      Speakers: Claire David (York University / FNAL), Heidi Schellman (Oregon state), Dr Michael Kirby (FNAL), Dr Thomas Junk (Fermilab)