DAQ Coordination Meeting

Monday 1 Nov 2021, 09:00 → 10:45 America/Chicago

 https://fnal.zoom.us/j/369714575

09:00 → 09:10 News

Speakers: Alessandro Thea (STFC - RAL), Asher Kaboth (Royal Holloway University of London/Rutherford Appleton Laboratory), Giovanna Lehmann (CERN)

20211101CT.pdf

09:10 → 09:20 Specifications document status

Speaker: Giovanna Lehmann (CERN)

09:20 → 10:25 Round Table

09:20 FD Upstream DAQ

Speakers: Jim Brooke (University of Bristol), Mr Roland Sipos (CERN)

Progress since last CT mtg :

• TPG
  • TP-FLX firmware interface demonstrated with dummy TP gen
  • changes ported to real TPGand test builds now underway
• Readout
  • "Zero copy" prototype SNB readout implemented 
• Timing
  • random trigger generation support delivered for 2.8.1
  • Timing MIB commissioning/firmware ongoing (iteration on board will be required)
  • Component supply issues may affect future Timing FMC orders (ie endpoint dev kit)
  • Progress with tests in WR lab - WR switch ordered for Bristol lab to continue tests there
• Ethernet DAQ
  • Work towards demonstrator FW based on Xilinx QDMA / dpdk
  • Xilinx Alveo U50 delivered to DT-TI lab for tests
• Integration
  • supported coldbox DAQ setups
• Presentations
  • TP format/SW profiling (ongoing)
  • TP integration

 

Next two weeks :

• TPG
  • complete FLX integration (build 1 link, 5 link, 10 link designs)
  • commission basic data validation package (for soak tests at VST)
  • finalise profiling of TP post-processing
• Readout
  • finalise profiling of SNB readout performance
• Timing
  • Understand the need for development kits across DUNE
• Presentations
  • DTS/WR tests (tbc)
  • SNB readout profiling

09:25 ND Upstream DAQ

Speakers: Patrick Dunne, Patrick Dunne (Imperial College London)

Continued progress on unit and integration tests.

Have integration test working that runs a pacman-readout that uses 'larpix-control' package from ND-LAr to make fake data. Understand from Alessandro that it is not desired to include packages like this in the DAQ repo so looking for a way around including it (probably pre-generate data packets to be sent in test)

Looking to get hold of physical pacman hardware (meeting with SLAC group later) for testing. After testing is complete will focus on adding ND-LAr light and ND-GAr charge readout.

09:30 FD Dataselection/Physics Performance

Speakers: Joshua Klein (University of Pennsylvania), Joshua Klein, Philip Rodrigues (University of Oxford)

• Alex's horizontal muon trigger has been adapted to TA/TC generation
• Still waiting on TPs at VD coldbox to test on data
• Working on getting manpower help for horizontal muon trigger implementation support at VD/HD coldboxes and ultimately the PDs
• Discussions ongoing with DQM about where relevant metrics should come from; all just HLF or earlier in chain also?

09:35 ND Data Selection/Physics Performance

Speaker: Dr Jonathan Hays (Queen Mary University of London)

 - no substantive update this week for ND

 - Alex is working on the horizontal muon trigger (See FD DS report)

 

09:40 Dataflow

Speaker: Dr Kurt Biery (Fermilab)

Recent work:

* incremental NetworkManager progress; couple of changes to mainline dfmodules code for Coldbox running; meeting with offline to talk about data formats

 

Next two weeks:

* get back to NetMgr work; some small updates to other parts of the dfmodules code

09:45 CCM

Speakers: Alexander Tapper (Imperial College London), Alexander Tapper

Progress

• Development of nanorc to support parallel commands and sub-systems completed.
• Run number generation and run registry database integrated with nanorc.
• Grafana dashboard development and management: overview dashboard and reasonably complete set of expert dashboards built up below.

Intended work

• Short term:
  • Improve documentation for Run Control.
  • Expect to learn a lot from the data taking and adapt dashboards for example.
  • Starting to prototype FSM systems. (maybe medium term not short term).
• Longer term:
  • Kubernetes related studies (Enrico, Gordon ...).

Cross group

• PR from Brett on minidaq config -- dangling

09:50 Data Quality Monitoring

Speaker: Pip Hamilton (Imperial College)

Progress

v1.1.2 deployed for cold box.

• Some teething issues with the untested VD channel map.
• Live ADC monitoring + offline HDF5 reading are in.

Next Steps

• HDF5 reading through core monitoring suite.
• Expansion of core monitoring plots.
• Integration of input from new SSP data formats.

Cross-WG

• Productive discussions with data filter & near detector groups.

09:55 Facility

Speakers: Prof. Alec Habig (Univ. of Minnesota Duluth), Bonnie King (FNAL)

Since last meeting:

• disk space cleanup
• local /etc/hosts set up in ansible
• general pocket and sysadmin support
• NP04 reinstalls (disk server 004 being upgraded to 8)
• (also starting to support ArgonCube 2x2 demonstrator)

Until next meeting

• a tour of commandline k8s tools and working with containers at Integration WG meeting this week

For further discussion

• app deployment in NP04: move to OpenShift or Stack?

 

 

10:00 SW/FW coordination

Speaker: Alessandro Thea (STFC Rutherford Appleton Laboratory)

10:25 → 10:35 Topics for next general meeting