XCache DevOps Meeting Oct 08, 2020

US/Central
Derek Weitzel (University of Nebraska - Lincoln), Marian Zvada (US CMS)
Description

Time: 11AM PT/1PM CT/2PM ET/8PM CET
Where: ZOOM.US

Join from PC, Mac, Linux, iOS or Android: https://unl.zoom.us/j/651969661
Meeting is password-protected: ask #xcache slack channel or xcache@opensciencegrid.org

Or iPhone one-tap :
    US: +16699006833,,651969661#  or +14086380968,,651969661#
Or Telephone:
    Dial(for higher quality, dial a number based on your current location):
        US: +1 669 900 6833  or +1 408 638 0968  or +1 646 876 9923
    Meeting ID: 651 969 661
    International numbers available: https://unl.zoom.us/zoomconference?m=wxCNSgMZiA-cVKSNowGYlQ

Attending: Marian, Derek, Andy, Diego, Ilija, Matevz, Matyas

Development (Andy reporting)
  • Working on the checksumming “stuff”
  • Finishing checkpointing in xroot
    • Zip files are popular
    • Want to append to zip files.
    • Checkpoint changes to file, restore the file.
    • Updates to zip file without worry about corrupting file.
  • Token handling with client comes to server
    • Client will present token to “something” (server)
    • A plugin will verify the token was issued by some issuer
    • Identical to scitokens handling tokens
    • Not authenticating yet, just showing proof that the user “belongs”
    • The issue is that many operations in the xrootd server can be performed without authentication.
  • Andy - RAL is running 600+ xcache instances, probably on worker nodes
  • Andy wants to add a “call home” UDP packet on xrootd startup.
    • Have some data about the server, hostname, if xcache,…
    • Discussion about technical details about how store and send this data
    • Maybe not UDP, may not be the best way to send data
  • Andy talked with others about tagging XRootD packet marking
    • Be able to tell the kernel what the packet is “for”
    • Slow moving progress.
    • Goal is to categorize traffic
ATLAS (Ilija reporting)
  • 1 more xcache deployed in slate
  • All of US ATLAS are now running a XCache.  All are in slate except BNL.
  • gfal-copy causing occasional failures, Ilija investigating
  • Limiting UDP packets?
    • Ilija would prefer a default small packet size because of large packet sizes across routers are difficult
CMS
  • Nothing to report
OSG (Matyas reporting)
  • Holding off on releasing 4.12.4 because of failures in testing at UCSD
    • It is refusing to startup due to configuration issue
    • Diego will investigate.
  • OSG and Ilija should talk so Ilija can use atlas-xcache containers directly.
    • Ilija likes the fast changes enabled by using his own dockerfile
    • OSG wants to be able to label an atlas-xcache container as “stable” because it’s used by Ilija.
  • No update from John Hicks.
  • xrootd #1279: https://github.com/xrootd/xrootd/issues/1279
    • Andy would like to close it.

Ricardo
  • Dress rehearsal of data lake in November
  • XCache inclusion
  • Requested server from CERN for XCache
There are minutes attached to this event. Show them.
    • 13:00 13:05
      News
      Conveners: Dr Derek Weitzel (University of Nebraska - Lincoln), Mr Marian Zvada (US CMS)
    • 13:05 13:10
      XRootD development for XCache

      General status of development, XRootD releases with new cache features, bug fixes, etc...

      Conveners: Mr Andrew Hanushevsky (SLAC National Accelerator Laboratory), Matevz Tadel (UCSD), Wei Yang (SLAC)
    • 13:10 13:15
      XCache issues

      XCache issues experienced during the deployment, configuration or otherwise causing problems in production or development.

    • 13:15 13:20
      ATLAS XCache deployment
      Conveners: Dr Ilija Vukotic (LAL), Wei Yang (SLAC)
    • 13:20 13:25
      CMS XCache deployment
      Conveners: Diego Ciangottini (Universita e INFN, Perugia (IT)), Mr Edgar Fajardo Hernandez (UCSD), Prof. Frank Wuerthwein (UCSD)
    • 13:25 13:35
      OSG StashCache deployment

      Status of OSG deployment, origin/caches operations, stashcp, usage, etc...

      Conveners: Brian Bockelman, Brian Lin (University of Wisconsin-Madison), Dr Derek Weitzel (University of Nebraska - Lincoln), Mr Edgar Fajardo Hernandez (UCSD), John Hicks (Internet2), Mr John Thiltges (University of Nebraska - Lincoln), Mr Marian Zvada (US CMS), Mr Matyas Selmeci (University of Wisconsin-Madison)
    • 13:35 13:40
      XRootD transfers monitoring
      Conveners: Dr Derek Weitzel (University of Nebraska - Lincoln), Diego Davila (CMS), Mr Edgar Fajardo Hernandez (UCSD)
    • 13:40 13:45
      AOB