LArSoft Coordination Meeting

Tuesday 5 Jan 2016, 09:00 → 10:30 US/Central

Conjectorium (WH3NE)

ReadyTalk: +1 (866) 740-1260 (U.S. toll free), +1 (303) 248-0285 (U.S. toll number)
Code: 886 7778

At Fermilab:  WH3NE

Present: Ruth Pordes, Marc Paterno, Jim Kowalkowski, Wes Ketchum, Laura Fields, Lynn Garren, Tom Junk, Tingjun Wang, Gianluca Petrillo

Remote: Matt Bass, Saba Sehrish, Vito Di Benedetto, (?)

 

There is no formal agenda of the meeting, round-table discussion only

 

Lynn Garren reported the build times of LArSoft code (i.e. building code from all the lar repositories)

• In August, complete build of larsoft on GPVM took 36 min
  • Yesterday it was 68 min, and it took 65 min when products are from CVMFS
  • Building on woof takes  7 min instead of 4.5 min over the same time period
  • The load on the machines was unknown when these builds were run
  • Change in the time from Aug to date means there is issue in our code (assuming loading was similar)
• Will send around a link pointing to information and results when completed.
• There is a meeting tomorrow to discuss the build performance project
  • Jim Amundson is leading that. He  should be able to report weekly on status / progress
• Meeting with Glenn Cooper this week (Jim Amundson and Lynn Garren)
  • the build numbers will be presented
  • Marc noted that people there was success in setting up machines for the art / LArSoft course that allowed people to build quickly. They know what is needed to do be able to do this.
• Wes:  two issues - The platform and the build code. Lynn believes at least some of the problems and changes needed are in the code

 

• Gianluca will begin usability project on Jan 20, at close of architecture project.

 

Lynn Garren reported on LArSoft Releases 

• There will be a release candidate rc2 because dunetpc was not working with the tests
  • dunetpc now tests successfully
• There will be a regular release this week
  • Matt Bass has code to discard particles
    • The mentioned code is in larcore and larsim
      • there are two corresponding feature branches that need to be added in conjunction
      • This code is needed for uboone production
    • An official request from uboone is needed, Matt Bass will request through redmine (Herb and Wes can review and add).
      • Tickets will be opened

 

Erica gave an update on LArSoft workshop and art/LArSoft course plans for this year

• There will a 1-day LArSoft workshop in June to discuss the usability issues 
• It will be coupled to the FIFE 2-day workshop, as it was last year
• There will be no art/LArSoft this year due to budget constraints
• The LArSoft (and art) material needs to be updated and expanded, but no effort for this
• If the class is a priority for the experiments, then need to bring this situation to the attention of experiment management

 

Gianluca gave an update on Architecture project status

• Architecture review closing by Jan 20
  • Track3DKalmanHit is last target for Saba

• Corey is porting new version of Shower3D from LArLite
  • Some time since last port (March 2015). Significant changes since then
  • The work has not been coordinated with the integration project
  • Timelines:  week or two weeks GP thinks
    • Have issue tracking, but no time estimate is noted
  • ES:  Critical to understand what is involved in “porting”. Make sure that the integration project is addressing the right issues.
  • RP:  uboone needs to be present at the integration project meeting on Monday’s.
    • Corey should also consider whether he needs to be at the architecture meeting
    • Need to get uB effort involved in the integration project. Has not really contributed promised work yet.

 

CI test suite status

• New test suite is in production since just before Chirstmas
  • the feature branch that was doing regression test was merged in the develop branch
• First commits went well.
• One issue from last coordination meeting
  • Mac OS reference data file reference problem
    • not the same as the linux reference file
    • Managed to create an appropriate reference file, so this part of the problem is resolve. Still do not understand why
    • Starting to work on this
• Recent issue:  uboone reco stage 1 is failing. The results appear not to be reproducible. Believe there is a random number in there.
  • Issue on MacOS build service only (??)

 

libwda

• Brandon Eberly noted a problem with libwda. Do we need this for uboone production?
  • Follow up with him to see what is going on here.

 

Mac OS support for El Capitan (Marc Paterno)

• A major problem
  • LD_LIBRARY_PATH critical assumption for CET build system
  • Apple always discouraged use of Mac OS equivalent, DYLD_LIBRARY_PATH
  • New OS version does not inherit this equivalent, so it (i.e., DYLD_LIBRARY_PATH) cannot be set at a high level in the build configuration. 
  • An Apple security feature. There is a work around, but this turns off the security feature. MP does not believe this is a reasonable thing to ask people to do.
  • Ruth:  believes this falls under usability issues, so Jim A. He is already taking a survey via liaisons to find out what OS’s are in use
    • We need a statement to art community
  • Noted we do not build in the way that Apple has long recommended. The Linux world is different. Apple now does not use environment variables to find libraries.
    • This greatly increases the pain of supporting both Linux and Mac OS.
  • Send email to LArSoft noting this, stating that MP will send more information.

 

LArSoft implementation plan (Ruth Pordes)

• LArSoft implementation plan.
• Met with Matt Toups about efficiency goals in short term
  • Believe we need the real goals for this
  • Need a way to validate that we have met requirements
  • Noted that ES wants to go through capabilities, but we need to tie this to an end-to-end analysis. That is a lot of work
• Bottom line: do not know how to do the implementation plan
• Need regular reports from ES on integration of wire-cell and Pandora, and Ruth for FLUKA

1 Round-table discussion