DUNE Data Management Meeting

US/Central
203 (Feynman Computing Center)

203

Feynman Computing Center

Description
This is the weekly DUNE Data Management Meeting. We discuss the Data Management Project for the upcoming DUNE experiment, and also data management operations issues. Attendees are people who are actually working on data management plus higher DUNE computing management as required.

Data management

 

Ops status

When does new rucio server get deployed — next week sometime

 

Rucio issues with BNL, NERSC, Manchester

 

FTS deployment still to do on SL7

 

Mengel’s ticket still pending

 

200-some GB of iceberg data ingested

 

 

Wenlong—

Still looking at SAM 

Got notice from CERN that account is ready on Friday.  Can log in.  Info sent on the CERN machines

Got notice from Fermilab that account will still be ready.

 

 

Service desk tickets— should we store anything we are doing in ServiceNow

Agree for now that we will put requests for data movement in Dune Data Management

Service now group

And anything that requires effort of data mgmt group beyond Robert will 

Go to the SDC Data management group

 

 

Igor—fixed the demo to be able to run some of headi’s queries on the big “Detector” set.

Experimented with putting the whole data in json in a single column

 

 

Robert—will present rucio project to projects on Mar 5

Steve—will give practice talk for rucio workshop in this meeting next week Mar 3

 

What’s next steps for metadata project

Robert—need formal requirements—so far we have been adding features in a ad-hoc manner

Need to synthesize Igor’s document with the data management workshop thing and Heidi’s various documents into a single document.

—if the son-based storage worked, could have a dictionary of data types with a number of versions.

 

Data location going forward—what is priority on reco, how many different reconsructed versions to keep, how and when to fill CERN

There are minutes attached to this event. Show them.
The agenda of this meeting is empty