DUNE DAQ Core Software Meeting

US/Central
Kurt Biery (Fermilab), Roland Sipos (CERN)
    • 09:00 09:15
      Performance optimizations for readout 15m
      • description of changes that helped eliminating missed packets
      Speaker: Roland Sipos (CERN)
    • 09:15 09:30
      TPG status update 15m
      • what features and changes went into the release
      • status update on ongoing activities (Gantt chart)
      Speaker: Adam Abed Abud (CERN)
    • 09:30 09:45
      Data inspection utilities improvements 15m
      Speaker: Kurt Biery (Fermilab)

      In case we don't have time for a demo, here is a screen capture:

       

      HDF5LIBS_TestDumpRecord swtest_run000103_0000_dataflow0_datawriter_0_20240403T030143.hdf5

      ...

      2024-Apr-03 07:17:18,002 LOG [main(...) at /home/nfs/biery/dunedaq/02AprFDv4.4.0rc3Testing/sourcecode/hdf5libs/test/apps/HDF5LIBS_TestDumpRecord.cpp:104]
          TriggerRecordHeader: check_word: 33334444, version: 4, trigger_number: 357, run_number: 103, trigger_timestamp: 79554163327349063, trigger_type: 32, error_bits: 0, num_requested_components: 17, sequence_number: 0, max_sequence_number: 0, element_id: { subsystem: TR_Builder id: 0 }
          WIBEth fragment with SourceID Detector_Readout_0x00000000 from subdetector HD_TPC has size = 7272 -----
              Readout window before = 0, after = 32
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 0, slot 0, link 0
          WIBEth fragment with SourceID Detector_Readout_0x00000001 from subdetector HD_TPC has size = 7272 -----
              Readout window before = 0, after = 32
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 0, slot 0, link 1
          WIBEth fragment with SourceID Detector_Readout_0x00000002 from subdetector HD_TPC has size = 7272 -----
              Readout window before = 0, after = 32
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 1, slot 0, link 0
          WIBEth fragment with SourceID Detector_Readout_0x00000003 from subdetector HD_TPC has size = 7272 -----
              Readout window before = 0, after = 32
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 1, slot 0, link 1
          WIBEth fragment with SourceID Detector_Readout_0x00000004 from subdetector HD_TPC has size = 7272 -----
              Readout window before = 0, after = 32
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 2, slot 0, link 0
          WIBEth fragment with SourceID Detector_Readout_0x00000005 from subdetector HD_TPC has size = 7272 -----
              Readout window before = 0, after = 32
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 2, slot 0, link 1
          Hardware_Signal fragment with SourceID HW_Signals_Interface_0x00000000 from subdetector DAQ has size = 72 -----
              Readout window before = 0, after = 32
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Primitive fragment with SourceID Trigger_0x00000000 from subdetector DAQ has size = 184 -----
              Readout window before = 0, after = 32
              Number of TPs in this fragment=2, size of TP data structure=56, size of Fragment Header=72
              First TP type = 1, TP algorithm = 1
              First TP start time=79554163327349063, peak time=79554163327349063, and time over threshold=32

          Trigger_Primitive fragment with SourceID Trigger_0x00000001 from subdetector DAQ has size = 184 -----
              Readout window before = 0, after = 32
              Number of TPs in this fragment=2, size of TP data structure=56, size of Fragment Header=72
              First TP type = 1, TP algorithm = 1
              First TP start time=79554163327349063, peak time=79554163327349063, and time over threshold=32
          Trigger_Primitive fragment with SourceID Trigger_0x00000002 from subdetector DAQ has size = 184 -----
              Readout window before = 0, after = 32
              Number of TPs in this fragment=2, size of TP data structure=56, size of Fragment Header=72
              First TP type = 1, TP algorithm = 1
              First TP start time=79554163327349063, peak time=79554163327349063, and time over threshold=32
          Trigger_Primitive fragment with SourceID Trigger_0x00000003 from subdetector DAQ has size = 128 -----
              Readout window before = 0, after = 32
              Number of TPs in this fragment=1, size of TP data structure=56, size of Fragment Header=72
              First TP type = 1, TP algorithm = 1
              First TP start time=79554163327349063, peak time=79554163327349063, and time over threshold=32
          Trigger_Primitive fragment with SourceID Trigger_0x00000004 from subdetector DAQ has size = 128 -----
              Readout window before = 0, after = 32
              Number of TPs in this fragment=1, size of TP data structure=56, size of Fragment Header=72
              First TP type = 1, TP algorithm = 1
              First TP start time=79554163327349063, peak time=79554163327349063, and time over threshold=32
          Trigger_Primitive fragment with SourceID Trigger_0x00000005 from subdetector DAQ has size = 128 -----
              Readout window before = 0, after = 32
              Number of TPs in this fragment=1, size of TP data structure=56, size of Fragment Header=72
              First TP type = 1, TP algorithm = 1
              First TP start time=79554163327349063, peak time=79554163327349063, and time over threshold=32
          Trigger_Activity fragment with SourceID Trigger_0x00000006 from subdetector DAQ has size = 216 -----
              Readout window before = 0, after = 32
              Number of TAs in this fragment=1, overall number of referenced TPs=1, size of TA data=88
              First TA type = 1, TA algorithm = 2, number of TPs = 1
              First TA start time=79554163327349063, end time=79554163327349095, and activity time=0

          Trigger_Activity fragment with SourceID Trigger_0x00000007 from subdetector DAQ has size = 216 -----
              Readout window before = 0, after = 32
              Number of TAs in this fragment=1, overall number of referenced TPs=1, size of TA data=88
              First TA type = 1, TA algorithm = 2, number of TPs = 1
              First TA start time=79554163327349063, end time=79554163327349095, and activity time=0
          Trigger_Activity fragment with SourceID Trigger_0x00000008 from subdetector DAQ has size = 72 -----
              Readout window before = 0, after = 32
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Candidate fragment with SourceID Trigger_0x00000009 from subdetector DAQ has size = 208 -----
              Readout window before = 0, after = 32
              Number of TCs in this fragment=1, overall number of referenced TAs=1, size of TC data=56
              First TC type =
      kPrescale (5), TC algorithm = 3, number of TAs = 1
              First TC start time=79554163327349063, end time=79554163327349095, and candidate time=79554163327349063

       

      2024-Apr-03 07:17:18,003 LOG [main(...) at /home/nfs/biery/dunedaq/02AprFDv4.4.0rc3Testing/sourcecode/hdf5libs/test/apps/HDF5LIBS_TestDumpRecord.cpp:104]
          TriggerRecordHeader: check_word: 33334444, version: 4, trigger_number: 360, run_number: 103, trigger_timestamp: 79554163346051030, trigger_type: 2, error_bits: 0, num_requested_components: 17, sequence_number: 0, max_sequence_number: 0, element_id: { subsystem: TR_Builder id: 0 }
          WIBEth fragment with SourceID Detector_Readout_0x00000000 from subdetector HD_TPC has size = 14472 -----
              Readout window before = 1000, after = 1000
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 0, slot 0, link 0
          WIBEth fragment with SourceID Detector_Readout_0x00000001 from subdetector HD_TPC has size = 14472 -----
              Readout window before = 1000, after = 1000
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 0, slot 0, link 1
          WIBEth fragment with SourceID Detector_Readout_0x00000002 from subdetector HD_TPC has size = 14472 -----
              Readout window before = 1000, after = 1000
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 1, slot 0, link 0
          WIBEth fragment with SourceID Detector_Readout_0x00000003 from subdetector HD_TPC has size = 14472 -----
              Readout window before = 1000, after = 1000
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 1, slot 0, link 1
          WIBEth fragment with SourceID Detector_Readout_0x00000004 from subdetector HD_TPC has size = 14472 -----
              Readout window before = 1000, after = 1000
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 2, slot 0, link 0
          WIBEth fragment with SourceID Detector_Readout_0x00000005 from subdetector HD_TPC has size = 14472 -----
              Readout window before = 1000, after = 1000
              It may contain data from the following detector components:
                  subdetector HD_TPC, crate 2, slot 0, link 1
          Hardware_Signal fragment with SourceID HW_Signals_Interface_0x00000000 from subdetector DAQ has size = 100 -----
              Readout window before = 1000, after = 1000
              Detector ID = 1, Crate = 0, Slot = 0, Link = 0,
              Sequence = 62, Trigger = 1, Version = 1,
              Timestamp = 79554163346051030,
              Input Low Bitmap = 4294967295, Input Low Bit Positions = 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 ,
              Input High Bitmap = 0.

          Trigger_Primitive fragment with SourceID Trigger_0x00000000 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Primitive fragment with SourceID Trigger_0x00000001 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Primitive fragment with SourceID Trigger_0x00000002 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Primitive fragment with SourceID Trigger_0x00000003 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Primitive fragment with SourceID Trigger_0x00000004 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Primitive fragment with SourceID Trigger_0x00000005 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Activity fragment with SourceID Trigger_0x00000006 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Activity fragment with SourceID Trigger_0x00000007 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Activity fragment with SourceID Trigger_0x00000008 from subdetector DAQ has size = 72 -----
              Readout window before = 1000, after = 1000
              *** Empty fragment! Moving to next fragment. ***
          Trigger_Candidate fragment with SourceID Trigger_0x00000009 from subdetector DAQ has size = 128 -----
              Readout window before = 1000, after = 1000
              Number of TCs in this fragment=1, overall number of referenced TAs=0, size of TC data=56
              First TC type = kTiming (1), TC algorithm = 2, number of TAs = 0
              First TC start time=79554163346050030, end time=79554163346052030, and candidate time=79554163346051030

    • 09:45 10:00
      AOB 15m
      • other ongoing activities
      • request for updates on activities
      • next week's agenda
      Speakers: Kurt Biery (Fermilab), Roland Sipos (CERN)

      Update on the new file-transfer metadata files (Kurt)

      I received a sample from Steve Timm yesterday and have started on the changes.

      I will attached samples of the old and new format to the agenda item.

      The new format has a few new fields, all of which will have hard-coded values except for the one that we suggested (dune.daq_test).