FIFE Workshop in 2017

21 Jun 2017, 09:00 → 22 Jun 2017, 18:25 US/Central

Hornets' Nest (Fermilab)

Kenneth Herner (Fermilab), Margaret Votava (SCD/SCS), Michael Kirby (FNAL), Tanya Levshina (Fermilab)

FabrIc for Frontier Experiments (FIFE) is a project within Scientific Computing Division that provides collaborative scientific-data processing solutions for Frontier Experiments.

Last year, we introduced products and services available from SCD and other computing resources. This year, we hope to add to recommended set of end-to-end tools for experiments to use to design and implement their offline computing. FIFE includes architecture, design, services and support for:

• Grid submission to dedicated and opportunistic resources and user-friendly monitoring of submitted jobs.
• Data management and handling with co-scheduling of data and job services and integrated into the art analysis framework
• Database and dataset applications such as beam monitoring, conditions, and hardware
• Collaborative tools such as an electronic control room logbook and shift scheduler
• Collaborations with experiments to build integrated solutions
• FIFE is based on common toolsets wherever possible to increase flexibility, provide for efficient evolution, and reduce the maintenance load

We are soliciting feedback to decide what tutorials are needed. Please select tutorials you are interested to attend: https://www.surveymonkey.com/r/HHWY8DG

ROOM CHANGE: Wed: IARC   Thu: Hornets' Nest (WH8)

Wednesday, 21 June

09:25 → 09:55 Meet and Greet

Drink coffee, eat doughnuts and socialize with fellow experimenters and members of FIFE team.

09:50 → 09:55 Introduction

Speaker: Dr Michael Kirby (FNAL)

Slides FIFE_workshop_2017_intro.pdf

10:00 → 10:30 HEP Cloud Program Vision

HEP Cloud Roadmap Storage and data handling roadmap

Speaker: Dr Panagiotis Spentzouris (Fermilab)

Slides OSCloud.pdf OSCloud.pptx

10:30 → 12:00 FIFE Roadmap

FIFE Infrastructure Reconfiguration in preparation for HEP Cloud: GPGrid refactoring Bluearc unmounting Site agnostic submission Singularity & Docker GPU availability SL& migration Efficiency policy Extended monitoring and site blacklisting

Speaker: Dr Michael Kirby (FNAL)

Slides FIFE_workshop_2017_roadmap.pdf

12:00 → 13:00 Lunch

Order your lunch from Chipolte

13:00 → 15:35 Case Studies

13:00 POMS: Workflow management for off-line production

Speakers: Dr Anna Mazzacane (Fermilab), Mr Marc Mengel (Fermilab)

Slides https://docs.google.com/presentation/d/1jwefYvu6R9Q2y25cEsWZLrx5xUVFK2V-s-MZZFHArqs/edit?usp=sharing

13:20 POMS: experiments feedback (LArIAT, NOvA)

Speakers: Dr Alexander Himmel (Fermilab), Dr Jason St. John (University of Cincinnati)

Slides 2017-06-21-POMS-feedback.pdf

13:35 CI: Testing and physics validation of production software

Speaker: Vito Di Benedetto (Fermilab)

Slides FIFE_Workshop_2017_CI.pdf

13:50 CI: experiments feedback (NOvA, Genie)

Speakers: Dr Alexander Himmel (Fermilab), Dr Gabriel Perdue (Fermilab)

Slides 2017-06-21-CI-feedback.pdf GENIE_CI.pdf

14:05 CVMFS: the right way for software distribution and maintenance tips

Speaker: Dr Dave Dykstra (Fermilab)

Slides FIFE_Workshop_170621_CVMFS.pdf

14:25 Coffee Break

14:35 Data Handling: SAM update, file access via XRootD and StashCache, FTS status

Speakers: Mr Marc Mengel (Fermilab), Robert Illingworth (Fermilab)

Slides DH_FIFE_Workshop_2017.pdf

15:10 Data handling: experiments feedback

Speakers: Dr Alexander Himmel (Fermilab), Dr Herbert Greenlee (Fermilab)

Slides 2017-06-21-Storage-feedback.pdf uboone_dm_jun21_2017.pdf

Thursday, 22 June

09:00 → 11:15 Best Practice Talks

09:00 Campaign preparation: what do you need to know before you start

Speaker: Dr Michael Kirby (FNAL)

Slides FIFE_Workshop_2017_Know_before_you_go.pdf

09:30 Grid Submission

Speaker: Dr Kenneth Herner (Fermilab)

Slides FIFE_Job_Submission_Best_Practices_06_22_17.pdf

10:00 Data handling

Speaker: Mr Marc Mengel (Fermilab)

Slides https://docs.google.com/presentation/d/1hEcIP_gcHE8ZfzbJDB8eIfLtd5K88i8m9VwCQuzR6HI/edit?usp=sharing

10:30 Coffee Break

10:45 Troubleshooting

Speaker: Mr Shreyas Bhat (Fermilab)

Slides Troubleshooting_Batch_Job_Submission(2).pdf

11:15 → 11:45 Tutorials

11:15 SAM4Users

Speaker: Dr Pengfei Ding (Fermilab)

script http://home.fnal.gov/~dingpf/sam4users_tutorial_commands.txt sam4users_tutorial_commands.txt

Slides dingpf_sam4users_fife_workshop_20170622.pdf dingpf_sam4users_fife_workshop_20170622.pptx

11:45 → 13:00 Lunch

13:00 → 16:05 Tutorials

13:00 Job Submission to the Grid

Speaker: Dr Kenneth Herner (Fermilab)

Slides FIFE_Job_Submission_Tutorial_06_22_17.pdf

14:00 Data handling with IFDH

Speaker: Mr Marc Mengel (Fermilab)

Slides https://docs.google.com/presentation/d/1ALQhqJMlwlAcTUTavsJY9gIbdO4x7rC6UkY2keGzudI/edit?usp=sharing

14:30 Coffee Break

14:45 Workload Management with POMS

Speakers: Dr Anna Mazzacane (Fermilab), Mr Marc Mengel (Fermilab)

Slides https://docs.google.com/presentation/d/1-kRf1PkC5Y4k7b4YjLSMtWsmZYBIHS9o-8mQKA7kvLQ/edit?usp=sharing

15:15 Job Monitoring with FIFEMON

Speaker: Kevin Retzke (Fermilab)

Slides Fifemon_Tutorial.pdf

13:20 → 15:30 Meeting with experts

13:30 Talk to expert: CI Support

Speaker: Vito Di Benedetto (Fermilab)

13:30 Talk to Expert: CVMFS

Speaker: Dr Dave Dykstra (Fermilab)