Please read these instructions before posting any event on Fermilab Indico

Indico search will be reestablished in the next version upgrade of the software: https://getindico.io/roadmap/


   

This search is only for public events. Restricted events are not available.

DUNE Core Computing Meeting

US/Central
https://fnal.zoom.us/j/336647590

https://fnal.zoom.us/j/336647590

Andrew McNab (University of Manchester) , Andrew Norman (Fermilab) , Brett Viren (BNL) , David Adams (BNL) , Heidi Schellman (Oregon state) , Michael Kirby (FNAL) , Steven Timm (Fermilab) , Thomas Junk (Fermilab)
Description

We will have the DUNE General computing meeting:

https://fnal.zoom.us/j/336647590

Meeting ID: 336 647 590

standard computing password, will be sent by email for those who don't know it.

One tap mobile
+16699006833,,336647590# US (San Jose)
+16465588656,,336647590# US (New York)

Dial by your location
        +1 669 900 6833 US (San Jose)
        +1 646 558 8656 US (New York)
Meeting ID: 336 647 590
Find your local number: https://fnal.zoom.us/u/adJsct1aBR

    • 9:30 AM 10:00 AM
      News from Computing Management etc: News from Computing Management
      • 9:30 AM
        News from Computing Consortium 3m
        Speakers: Dr Andrew McNab (University of Manchester) , Heidi Schellman (Oregon state) , Dr Michael Kirby (FNAL)

        Slack channel #dealingwithlargedata

        email list dune-large-data

        Join these for discussions of how we actually deal with large data.

         

      • 9:33 AM
        News from partner projects (OSG, WLCG etc) 5m

        Andrew McNab on the benchmarking project

        Speaker: Andrew McNab (University of Manchester)

        GDB - report from network data challenges from collider experiment

        Rucio/condor workshop reports.  

        GDB last week. Network DC, RUCIO and HTCondor workshops. See agenda for slides: https://indico.cern.ch/event/876794/

      • 9:35 AM
        HDF5 discussion 15m

        HDF5 discussion

        Speakers: Heidi Schellman (Oregon state) , Thomas Junk (Fermilab)

        hdf5 equivalent of config_dumper

        we need to have some kind of metadata in the hdf5 files. 

        (normal tuples also don't have art metadata, so need it for them as well)

        working on a header-only reader- has a specialized exception ERS package that may introduce more dependence than we want. 

        Working on channel map. 

        Compression out of the daq - do it on SSD?  Cost estimate?  LDRD

    • 9:50 AM 10:15 AM
      Operations
      • 9:50 AM
        protoDUNE II Horizontal Drift (np04) operational status 3m
        Speaker: Dr Michael Kirby (FNAL)
      • 9:55 AM
        protoDUNE II Vertical Drift (np02) operational status 3m
        Speakers: Elisabetta Pennacchio, Dr Elisabetta Pennacchio (IN2P3)
      • 10:00 AM
        Operations Meeting report 5m

        Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).

        Speaker: Dr Steven Timm (Fermilab)

        Progress on rucio -> RAL and Manchester

        GPU's available at QM. A100's

      • 10:05 AM
        Production status report 5m

        https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?orgId=1&from=now-30d&to=now-5m&var-experiment=dune

        Speaker: Dr Kenneth Herner (Fermilab)
      • 10:10 AM
        User analysis status report 5m
    • 10:00 AM 10:40 AM
      Software Development
      • 10:05 AM
        SP/DP/ND Software Development 10m

        (This item should probably be split into smaller units?)

        Speakers: Dr Elisabetta Pennacchio (IN2P3) , Elisabetta Pennacchio, Mathew Muether (Whichita State) , Dr Mathew Muether (Fermilab)
      • 10:15 AM
        Databases Development 5m
        Speakers: Prof. Norm Buchanan (Colorado State University) , Norman Buchanan, Paul Laycock (Brookhaven National Laboratory)

        DB report.  Centralized database for conditions. Next meeting will be metacat... (runs db?)

        new postdocs.  Organization meeting once they arrive. 

      • 10:20 AM
        Software Management 5m
        Speakers: David Adams, David Adams (BNL) , Etienne Chardonnet, Jake Calcutt (Michigan State University) , Dr Kurt Biery (Fermilab) , Dr Thomas Junk (Fermilab)
      • 10:25 AM
        Frameworks Task Force 5m
        Speakers: Dr Andrew Norman (Fermilab) , Paul Laycock (Brookhaven National Laboratory)
    • 10:30 AM 11:00 AM
      Computing Services Development
      • 10:30 AM
        Data Management development 5m

        SAM, RUCIO etc

        Speakers: Dr Andrew Norman (Fermilab) , Igor Mandrichenko (FNAL) , Dr Steven Timm (Fermilab) , Dr Stuart Fuess (Fermilab)

        Andrew McNab has gotten rucio client to work within jobs. 

        need python3 and then install pip -> rucio clients. Bit complicated. 

        will we put the job environment in cvmfs? containers? 

        how does this work on the grid? Do Robert and Brandon have a script that does this? 

        in the end we need a ups/spack product for rucio client

         

      • 10:35 AM
        Workload and Workflow development 5m

        HEPCloud, GlideinWMS, POMS, etc. https://github.com/DUNE/dist-comp/labels/WMSdev

        Speakers: Dr Andrew McNab (University of Manchester) , Dr Andrew Norman (Fermilab) , Kenneth Herner (Fermilab) , Dr Steven Timm (Fermilab)
      • 10:40 AM
        Information Systems development 5m

        CRIC

        Speaker: Andrew McNab (University of Manchester)
      • 10:45 AM
        Monitoring Systems development 15m

        ETF site monitoring, perfSonar network monitoring

        Speakers: Christopher Brew, Heidi Schellman (Oregon state) , Peter Clarke, Raja Nandakumar, Steven Timm (Fermilab) , Prof. peter clarke (University Edinburgh)
    • 10:45 AM 10:50 AM
      Documentation and Training 5m
      Speakers: Claire David (York University / FNAL) , Heidi Schellman (Oregon state) , Dr Michael Kirby (FNAL) , Dr Thomas Junk (Fermilab)