Please read these instructions before posting any event on Fermilab Indico

Indico will be unavailable on Wed., Dec 18th from 7 - 7:30am due to server maintenance.

XCache DevOps Meeting July 02, 2020

US/Central
Derek Weitzel (University of Nebraska - Lincoln), Marian Zvada (US CMS)
Description

Time: 11AM PT/1PM CT/2PM ET/8PM CET
Where: ZOOM.US

Join from PC, Mac, Linux, iOS or Android: https://unl.zoom.us/j/651969661
Meeting is password-protected: ask #xcache slack channel or xcache@opensciencegrid.org

Or iPhone one-tap :
    US: +16699006833,,651969661#  or +14086380968,,651969661#
Or Telephone:
    Dial(for higher quality, dial a number based on your current location):
        US: +1 669 900 6833  or +1 408 638 0968  or +1 646 876 9923
    Meeting ID: 651 969 661
    International numbers available: https://unl.zoom.us/zoomconference?m=wxCNSgMZiA-cVKSNowGYlQ

Attendees: Derek, Matevz, Marian, BrianL, Diego, Mat, Riccardo, Wei, Ilija, Andy

News
----
* 2020 XRootD Workshop Rescheduled for late Spring or early Summer 2021

Issues
------
* nothing to report
* Riccardo cut ticket, pfs info error:
https://gitbhub.com/xrootd/xrootd/issues/1241
* broken dependency 4.12.2 of lcmaps resolved
* google doc shared with the issue: https://docs.google.com/document/u/0/d/1vC2ZXia8yo1MfkcPQ8xU4M17hlccutw-8oJ9VY4-29E/mobilebasic#heading=h.pbyrg49k034g
* cannot do curl request, the show-stopper that will be disscussed offline

XRootD development for XCache
-----------------------------
* froze everything!
* next week cut official release of v5 (already 6 months late)
* short time to test RC5 before the release, though

ATLAS XCache deployment
-----------------------
* citing Ilija's post to me via Slack: all VP queues that were using XCaches were put in brokeroff mode, this basically means we can't get realistic loads on xcaches. This state will be kept until two issues where solved: dCache bug and TChain bug. dCache bug has been solved by moving to 5.0.0_rc4. TChain bug was fixed in January, patches to ROOT made in April, few weeks ago patched version was added to LCG97a. Pushing for a new software release. Hope to have it in a week or two. Majority of people will continue using old releases but at least we can ask people with a lot of failing jobs to upgrade. Working on creating OSG based image for ATLAS. A lot of issues being dealt with Brian L. Waiting for OSG to produce N2N plugin rpm compiled with V5.0_rc5.

CMS XCache deployment
---------------------
* BrianB troubleshoot xcache container this week

Monitoring
----------
* validation done, in ~2 weeks report ready
* couple of email iterations with Andy on the monitoring pieces

OSG StashCache deployment
-------------------------
* 4.12.3 released, package requirements, plugins, etc
* v5 RC5 builds name2name plugin fix
* sent question to mailing list, oss.space directive not clear, manual should have a good graphics to understand it, Andy will send a link

AOB
---
* Escape project ongoing, few deployments 4.12.2 v5 RC5 one for docker one for kubernetes, need to tackle issues reported earlier to avoid,
* IN2P3 colleagues are in the works for xrootd operator for kubernetes, part of google summer of code project, work under the subrepo gitbhub.com/xrootd/xrootd-k8s-operator, Andy can ask IN2P3 guys give us big picture on the project next week
* integration of SWAN and RUCIO, xrootd xcache
* question on subrepo on github.com/xrootd/xrootd-scitokens whether this is milestone of IRIS-HEP project plan - yes - deadline is ~year from now
* "Streamlining builds of XCache hotfix containers"
- looking good, most of things are OK and were addressed
- who is going to contribute to hotfix? The proposal is whoever is able to commit changes can do it.
- mock up ready how the workflow would look like, tag something and it'll kick-off the build
- discussion on "xcache hotfix" vs generic "hotfix", long-term it would be hotfix for anything, fixed number of categories would suffice?
- will continue discussion in the document

There are minutes attached to this event. Show them.
    • News
      Conveners: Dr Derek Weitzel (University of Nebraska - Lincoln), Mr Marian Zvada (US CMS)
    • XRootD development for XCache

      General status of development, XRootD releases with new cache features, bug fixes, etc...

      Conveners: Mr Andrew Hanushevsky (SLAC National Accelerator Laboratory), Matevz Tadel (UCSD), Wei Yang (SLAC)
    • ATLAS XCache deployment
      Conveners: Dr Ilija Vukotic (LAL), Wei Yang (SLAC)
    • CMS XCache deployment
      Conveners: Diego Ciangottini (Universita e INFN, Perugia (IT)), Prof. Frank Wuerthwein (UCSD)
    • OSG StashCache deployment

      Status of OSG deployment, origin/caches operations, stashcp, usage, etc...

      Conveners: Brian Bockelman, Brian Lin (University of Wisconsin-Madison), Dr Derek Weitzel (University of Nebraska - Lincoln), Mr Edgar Fajardo Hernandez (UCSD), John Hicks (Internet2), Mr John Thiltges (University of Nebraska - Lincoln), Mr Marian Zvada (US CMS), Mr Matyas Selmeci (University of Wisconsin-Madison)
    • AOB