We will have the DUNE General computing meeting:
https://fnal.zoom.us/j/336647590
Meeting ID: 336 647 590
standard computing password, will be sent by email for those who don't know it.
One tap mobile
+16699006833,,336647590# US (San Jose)
+16465588656,,336647590# US (New York)
Dial by your location
+1 669 900 6833 US (San Jose)
+1 646 558 8656 US (New York)
Meeting ID: 336 647 590
Find your local number: https://fnal.zoom.us/u/adJsct1aBR
https://arxiv.org/abs/2210.15665
Go over CHEP abstracts and then practice talks for the WLCG/Rucio meeting at Lancaster at the end of this meeting
https://docs.google.com/document/d/1nwppQu0OUrl13z8R6Cyn1UJJfMRkuEnS39PHf_MyA1o/edit?usp=sharing is a commenting link for abstracts
Hi Steve,
today is holiday in France, so I will not connect.
This week (Wednesday--> Friday) we will operate again the coldbox, and new data will appear in the dropbox
Production: the fcl files to reconstruct CRP2 and CRP3 have been prepared, and will be part of the next release.
I plan to reconstruct a couple of runs, to provide a test sample before moving to the reconstruction of the whole data sample
Best regard
Elisabetta
Sites, networking, and central DUNE computing services (GlideinWMS, SAM, RUCIO, CRIC, ETF, Databases).
Fermilab tape robot prestaging problems less acute now
dunesamgpvm01 legacy FTS server had memory fault, was rebooted
All GGUS tickets closed at the moment
Long-standing OSG ticket open with Bern.. taking a while to figure out what is wrong there.
OSG ticket open with Grid Canada, pilots aren't authenticating right.
https://fifemon.fnal.gov/monitor/d/000000053/experiment-batch-details?orgId=1&from=now-30d&to=now-5m&var-experiment=dune
Small supernova production coming up
Also trying to merge the VD production anatree stuff
So just add their location to sam directly and merge them and then
Remove them from persistent.
MCC11 replacement, coming Real Soon Now
Near detector small production may run at NERSC.
•retention.status = live, deprecated, removed, missing
•retention.disk = date 2 years after creation
•retention.tape = date N years after creation
•retention.policy = raw, reco, test, sim, sim-hits, … one for each different policy
https://samweb.fnal.gov:8483/station_monitor/dune/stations/dune/projects
(This item should probably be split into smaller units?)
Add in Coldbox (Iceberg/np02/np04)
A new UPS product, srproxy, which is part of the CAFAna stack, has been added to SciSoft. It's a header-only product and so building the product in CVMFS and the tarball is easy. Other CAFAna products are osclib, cafanacore, and cafanafit. CAFAna has extensive use on NOvA and many of the main users and maintainers are also DUNE collaborators. duneanaobj, part of the interface to CAFAna, was added as a dependency of the dunesw stack in August, dragging in srproxy.
The products detdataformats, daqdataformats, detchannelmaps, ers, nlohmann_json, hdf5libs are being provided by the DAQ group as source and Spack recipes. The SciSoft group has volunteered to provide UPS products for all of these. There is already a daqdataformats product in SciSoft with old NOvA stuff from 2012 in it.
Jake has pushed forwards with implementing the CMS bot to require code contributions to the dunesw stack to be in the form of pull requests. The CMS bot checks each PR with the CI system and coordinates approvals via e-mails. It organizes its work via GitHub actions.
David Adams has continued to develop analysis tools that run on the Elastic Analysis Facility and gave a tutorial at the Vertical Drift analysis meeting on Friday.
(HMS may need to start getting parts of the DUNE setup use Spack instead of ups) .
SAM, RUCIO etc
WFS, HEPCloud, GlideinWMS, POMS, etc. https://github.com/DUNE/dist-comp/labels/WMSdev
CRIC
ETF site monitoring, RUCIO monitoring, perfSonar network monitoring
https://etf-dune-preprod.cern.ch/etf/check_mk/index.py?start_url=%2Fetf%2Fcheck_mk%2Fview.py%3Fview_name%3Dallhosts
https://dune.monitoring.edi.scotgrid.ac.uk/app/dashboards#/view/7eb1cea0-ca5e-11ea-b9a5-15b75a959b33?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-1d,to:now))
Workflow Testing Framework: https://wfs.dune.hep.ac.uk/dashboard/?method=wtf-results