27–30 Jun 2023
Ramsey Auditorium
America/Chicago timezone

"Freight Train" production model on the NOvA experiment and NOvA efforts at Argonne Leadership Computing Facility

Not scheduled
2h 30m
Ramsey Auditorium

Ramsey Auditorium

Fermilab

Speaker

Andrew Dye

Description

A large obstacle for any experiment is how to store, move, and process a large amount of data effectively. On the NuMI Off-axis $\nu_e$ Appearance (NO$\nu$A) experiment this is a rather substantial obstacle. The traditional method of grabbing a file is by categorizing all the files we care about by event-type and then going through each tape and gathering all files of that type. This is not ideal as it leads to multiple readings of the same tape. The Freight Train model of production at NO$\nu$A aims to address this inefficiency. Additionally, NO$\nu$A has implemented a scheme to run a pre-reconstruction filter (neural network-based) to remove the most obvious cosmic rays from our large recorded cosmic ray sample to reduce processing needs. This step is processed at the Argonne Leadership Computing Facility (ALCF), leveraging the additional GPU resources offered by the Theta GPU system.

Primary author

Presentation materials