DUNE Computing Model Workshop

chaired by Michael Kirby (FNAL), Heidi Schellman (Oregon state), Andrew McNab (University of Manchester)
from to (US/Central)
at Fermilab
Description

 

This is a followup workshop to go over the computing infrastructure aspects of the DUNE computing model.

It meets Monday and Tuesday, Sept 9-10 at Fermilab and is open to the HEP community if you have registered to attend.

Join Zoom Meeting https://fnal.zoom.us/j/6308404326

Tuesday will be meet in Wilson Hall in the Curia II (WH2SW).

Venue: Illinois Accelerator Research Center (IARC) at Fermilab

- Illinois Accelerator Research Center (IARC) will appear on Google Maps. Use that for directions.
- There is ample parking directly across from the IARC bldg.

It is joint with several other meetings on identity management and the Grid Deployment Board meeting:

https://indico.cern.ch/event/739896/ pre-GDB - AuthZ WG (Tuesday)

https://indico.cern.ch/event/739882/ GDB (Wednesday)

https://indico.cern.ch/event/834658/ mini-FIM4R (Thursday)

If you plan to attend this meeting or any of the above, please register for each so the organizers can estimate room capacities.

Live minutes/notes/actions: https://docs.google.com/document/d/1EJ1dSSJyL7ojTbBhUV41CK0HW4MobfZimpDn09cdtBY/edit

Go to day
  • Monday, September 9, 2019
    • 09:00 - 10:00 Introduction and welcome
      Material: Minutes unknown type file
      • 09:00 Welcome 10'
        Including other meetings this week and logistics
        Speaker: Dr. Michael Kirby (FNAL)
        Material: Slides link
      • 09:10 Goals of the workshop 10'
        Speaker: Andrew McNab (University of Manchester)
        Material: Slides pdf file
      • 09:20 Requirements from Data Model 40'
        * Data volume, volume per year plan, peak data rates to offline
        * Job geometries: hours, processors, memory, temp disk
        * CPU requirements per year plan
        
        Speaker: Heidi Schellman (Oregon state)
        Material: Slides pdf file
    • 10:00 - 10:15 Coffee/discussion
    • 10:15 - 12:30 Mapping requirements to sites
      * Mapping on to the WLCG Tier model
      * Disk vs Tape
      * 24/7 vs 8/5 sites
      * CPU architectures: AVX etc; GPUs; ???
      * Site architectures: HTC vs HPC vs commercial cloud
      * Network/transfers between sites
      
    • 12:30 - 13:30 Lunch
    • 13:30 - 14:40 Data management technologies
      SAM, Bookkeeping, RUCIO, DIRAC/RUCIO ???
      • 13:30 SAM data management 10'
        Speakers: Dr. Steven Timm (Fermilab), Heidi Schellman (Oregon state)
        Material: Slides powerpoint file
      • 13:40 Bookkeeping database 10'
        Speaker: Dr. Steven Timm (Fermilab)
      • 13:50 RUCIO 10'
        Speaker: Dr. Robert Illingworth (Fermilab)
        Material: Slides pdf file
      • 14:00 DIRAC/RUCIO plugin 10'
        Speaker: Dr. Paul Laycock (Brookhaven National Laboratory)
        Material: Slides pdf file
      • 14:10 DIRAC data management? 10'
        Speaker: Christopher Brew
        Material: Slides powerpoint file
      • 14:20 Discussion 20'
    • 14:40 - 14:55 Coffee/discussion
    • 14:55 - 16:15 Workload management technologies
      GlideinWMS, DIRAC, PanDA, HEPCloud, Vcycle, ...
      
      • 14:55 GlideInWMS 10'
        Speaker: Marco Mambelli (Fermilab)
        Material: Slides pdf file
      • 15:05 DIRAC workload management 10'
        Speaker: Christopher Brew
      • 15:15 PanDA 10'
        Speaker: Dr. Torre Wenaus (BNL)
        Material: Slides pdf file
      • 15:25 HEPCloud 10'
        Speaker: Mr. Anthony Tiradani (Fermilab)
        Material: Slides pdf file
      • 15:35 Vcycle cloud management 10'
        Speaker: Andrew McNab (University of Manchester)
        Material: Slides pdf file
      • 15:45 Discussion 20'
    • 16:05 - 16:20 Coffee/discussion
    • 16:20 - 17:30 Workflow/production technologies
      POMS, SAM, LHCb for comparison, ...
      • 16:20 LHCb workflow interface 10'
        Screenshots etc as an example of what else is being done
        Speaker: Andrew McNab (University of Manchester)
        Material: Slides pdf file
      • 16:30 SAM as workflow management 10'
        Speaker: Dr. Kenneth Herner (Fermilab)
        Material: Slides pdf file
      • 16:40 POMS 10'
        Speaker: Mr. Marc Mengel (Fermilab)
        Material: Slides pdf file
      • 16:50 Discussion 40'
  • Tuesday, September 10, 2019
    • 09:00 - 10:30 Representative workflow designs
      Take some important foreseeable workflows (Monte Carlo, reconstruction, user analysis, ...) and work through how we would do them based on the site resources and technologies
      Location: Curia II (WH2SW)
      • 09:00 Technologies discussion 45'
        Material: Slides pdf file
    • 10:30 - 10:45 Coffee/discussion
    • 10:45 - 12:30 Computing model doc/slides drafting
      Preparation for summaries, writing a document, additional discussion, other ideas as they come up
      Location: Curia II (WH2SW)
    • 12:30 - 13:30 Lunch
    • 13:30 - 17:30 Joint session with WLCG Authz WG: https://indico.cern.ch/event/739896/
  • Wednesday, September 11, 2019
    • 09:30 - 15:40 WLCG GDB: https://indico.cern.ch/event/739882/
    • 16:00 - 17:30 Mon/Tue session summaries
      Presentation of summaries of DUNE computing sessions on Monday and Tuesday
  • Thursday, September 12, 2019
    • 09:00 - 12:30 FIM4R Workshop (all day): https://indico.cern.ch/event/834658/
    • 13:30 - 15:30 DUNE Computing Ops discussion
      * Tickets model: internal and/or GGUS/OSGHelpDesk
      * Operations meetings: daily? Weekly? Non-COMP ops meetings?
      * Ops shifts: FNAL or remote?
      * User support shifts
      * Staffing implications of the above (as input to grant requests etc)
      
      • 13:30 Introduction/ideas 20'
        Speaker: Andrew McNab (University of Manchester)