DUNE Global Computing Operations

US/Central
https://fnal.zoom.us/j/636941598

https://fnal.zoom.us/j/636941598

Andrew Mcnab, Heidi Schellman (Oregon state), Kenneth Herner (Fermilab), Michael Kirby (FNAL), Steven Timm (Fermilab), Stuart Fuess (Fermilab), peter clarke (University Edinburgh)
Description

Weekly operations meeting for sites doing DUNE computing

Operations meeting

 

No active GGUS

No active CERN tickets

No active operations issue at FNAL

Factory setting for DUNE gpce03/04 is in, Steve will file ticket to modify gpfrontend

Need a new vofeed.xml for Raja

 

Np02

 

Elisabetta—resumed np02 operations

Bubbles are still happening.

After pressure bump they don’t go away as long as they did before.

Will go higher pressure bump

 

Then try to operate the CRP that is not/cted by the bubbling

Seeing maximum voltage it can take.

 

Steve will try to do the two full-reconstructed runs and get them to CCIN2P3

 

Np04

 

Still trying to ping np04 to get their run spreadsheet updated.

Still some cold box data and noise runs.

 

Iceberg still taking data and we are ingesting, still quite small.

 

Near detector ArgonCube supposed to go test beam sometime, when?

 

——

 

Production operations

Running at NERSC—messed up disk space size request

Single particle MC

Intermediate detsim files are huge.

 

GPU as service test coming up this week.

 

Haven’t heard back from CPBF on job router stuff

 

Some environment variables had to be set in the job router to find the certificates

Helio—have we contacted Renato?  Renato was on the ticket.

 

Steve—can we override cert locations from the factory end.

 

Prod3 runs of 3, 5, 6, 7 —they want to wait on the MC, to have another go at fixing the space charge effect.   New name to be determined.

Data reco—probably want that to be with same release as MC.

 

——

Data management ops

 

Discussion—is SNOW the best way to track?

Production requests data movement requests,

Wenlong is trying to get as many sites as possible to put on SRR

 

 

——

 

Site report

 

LHCB has seen problems streaming data out of RAL_ECHO

CMS and ATLAS may be seeing hint out of same thing.

DUNE may also be affected.

Contacting xrootd developers

 

————

 

Info systems ETF and CRIC

There are minutes attached to this event. Show them.
    • 08:30 08:40
      Open Tickets. GGUS/SNOW/Github 10m

      Github task tracker

      https://github.com/DUNE/dist-comp/issues/

      Fermi and CERN ServiceNow

      DUNE GGUS tickets: http://cern.ch/go/p6s8

      Speakers: Dr Andrew McNab (University of Manchester), Dr Michael Kirby (FNAL), Dr Steven Timm (Fermilab)
    • 08:40 08:55
      Time slot for big presentation if necessary 15m
    • 08:55 09:00
      Updates from running np04/np02 5m
    • 09:00 09:05
      Production Operation Items 5m
      Speaker: Dr Kenneth Herner (Fermilab)
    • 09:05 09:10
      Data Management Operation Items 5m
      Speakers: Dr Steven Timm (Fermilab), Wenlong Yuan
    • 09:10 09:20
      Computing Sites Roundtable 10m

      Any sites having issues to raise with DUNE operations can do it at this time.

    • 09:20 09:25
      Information Systems Operations (ETF, CRIC) 5m
      Speakers: Andrew Mcnab, Raja Nandakumar
    • 09:25 09:30
      Any Other Business / Announcements 5m