This is the weekly DUNE Data Management Meeting. We discuss the Data Management Project for the upcoming DUNE experiment, and also data management operations issues. Attendees are people who are actually working on data management plus higher DUNE computing management as required.
Data management 7/16/24
Agenda
Rucio workshop
Attendees Yuyi Guo, possibly Dennis Lee
Martin has sent messages
May have other experiments sent too.
DUNE collaboration talk —has to go through consortium
Operational issues observed by running
Things we have added
Big features
Tokens
Globus
Minor others
Steve+ Doug to copy Kirby. On a site.
Doug strong that it should be a DUNE-only talk.
Complex metadata in metacat
Heidi has sample merged tuple up to 300 MB
All calibration
Should keep the virtual file ids
Have to flag the vfid as merged but not stored.
Leverage output status to determine which root-tuples have been merged and which haven’t
Metacat DB upgrade
DBAs are in process of upgrading all databases
Would like to upgrade to newer version of database utilities
Rucio DB needs upgrade too.
Window is to be July 24-31