CCM Meeting

Wednesday 11 Sep 2024, 08:00 → 09:00 US/Central

Zoom: https://cern.zoom.us/j/66569029743 (usual password)

08:00 → 08:05 News

Speakers: Alexander Tapper (Imperial College London), Pierre Lasorak (Imperial College London)

08:05 → 08:10 Round table: control

Speakers: Pawel Plesniak (Imperial College London), Pierre Lasorak (Imperial College London), Tiago Alves (Imperial College London), Zbynek Kral (CTU Prague)

drunc gantt chart

drunc issues prioritisation

Pawel:

• Progress since last meeting
  • Zombie process issue published, requires tag
  • OpMon work commenced.
• Objectives to complete until next week
  • Continue OpMon work

Pierre

• Progress
  • Started to look into drunc/ERS (merged a PR in erskafka for the python bindings)
  • Run control environment variable (removing variables from the configuration and setting them in the run control)
• This week
  • Continue drunc/ERS
  • Finish up the run control environment variable PRs
  • Restore FSM sequences 
  • drunc-unified-shell / PM splitteroo
• Items for discussion
  • Session renaming, are we doing it? yes
  • Hard coded port number, are we removing them? yes if time allows
  • grpc endpoint for applications -- design for v5.2

 

08:10 → 08:15 Round table: config

Speakers: Alessandro Thea (STFC Rutherford Appleton Laboratory), Giovanna Lehmann (CERN), Gordon Crone (University College London), Henry Wallace (Royal Holloway, University of London), John Freeman, John Freeman (Fermi National Accelerator Laboratory)

DAQ_plot.svg

mlt_plot.svg

ru-01_plot.svg

John

• Automated display of OKS configurations (examples in the material)
  • Can be put automatically in the documentation when we build or generate the doc
• Marco can help testing on other configurations
• Pierre: Where do we go from here?
  • John: unclear, this is a prototype

Gordon

• PR in confmodel:
  • Added get_all_enabled_applications (no need to use get_all_application and check for enabled anymore).
  • Enhanced list-app script (need to compare it with Alessandro's python script)
• Bugfixes in DBE

08:15 → 08:20 Round table: k8s etc.

Speakers: Alessandro Thea (STFC Rutherford Appleton Laboratory), Bonnie King (FNAL), Jonathan Hancock (University of Birmingham), Patrick Riehecky (Fermilab), Pierre Lasorak (Imperial College London), Tiago Alves (Imperial College London), Tiago Alves (Imperial College London)

08:20 → 08:25 Round table: monitoring

Speaker: Marco Roda (University of Liverpool)

opmon_conf_objects.png

opmon_uri_objects.png

schema.png

Marco:

• OpMon Transition - link to status 
  • only missing repos to be recovered are timing, timinglibs and HSI. All is available in develop and in the nightly. 
  • Dashboards are updated accordingly.
  • more addition expected soon on trigger, these are changes available in v4 and not yet ported in v5
     
• Started working on the the opmon configuration
  • The building order of the nightly has been changed
  • Conf schema is done - to be discussed here
    • Values are already in place for a provisional run
    • Only for test session for now, the develop branch of eh1-config is not working as far as I know
    • What is the status of listrev? This should be changed there as well, has it been aligned with the action plans changes?
    • After a discussion with Gordon, we are planning to remove OpMonService from the schema. Any objections? 
  • Now I'm adapting the rest of the infrastructure to the new configuration. This will also drop the usage of environmental variables for the monitoring.
    • Some notable changes:
      • The construction of a facility optionally takes an OpMonId as an origin. in general the facility can set things and behave according to the origin. 
        • different file name according to the application
        • using a specific kafka topic for each session
        • ...
      • Removal of the -i option in daq_application 
      • Others might come later but it's all for now
    • Eventually, there will be a set of PRs in the following repos. Name of the branches mroda/opmon. Who is going to review them? Pierre & Eric
    • The list:
      • confmodel
      • appmodel
      • appfwk
      • opmonlib
      • kafkaopmon
      • listrev (?)
      • eh1-config (not part of the release)

08:25 → 08:30 Round table: others