Sao Paulo OSG school

6 Dec 2010, 08:00 → 10 Dec 2010, 18:00 America/Sao_Paulo

Núcleo de Computação Científica - Unesp

OSG School in Sao Paulo (Brazil) Scientific Computing on Grids: Introductory Grid Computing Overviews and User Capabilities During this school students will learn how to get the maximum benefit that modern Grid Computing technologies offer to the scientific communities. Starting from the basics, attendees will learn how to dramatically improve the efficiency and performance of their scientific research using Grid Computing infrastructures. At the school the skills to work efficiently on this platform will be acquired and the students will be ready to start making use of those skills. This course will focus on the Open Science Grid (OSG) approach to the Grid Computing, in a good balance between lectures and practices. This training school will place special emphasis on the CMS experiment, as it is one of the biggest scientific communities in Brazil. However, the content of this school is very general and open to everyone involved in science willing to learn how to use Grid Computing to improve their research performance. Especially interesting for PhD students, senior investigators, and scientific team leaders. Lessons will be given by five staff members of OSG (in alphabetic order): Jose Caballero Zach Miller Robert Quick Mats Rynge Horst Severini Joel Snow The course will contain several remote presentations from the USA, and one special talk by invited speaker Jairo Panetta. The lectures will be delivered in English. Some basic knowledge of Linux command line is required. Students can bring their own laptops if they want. Please take this brief survey after attending the classes: http://www.surveymonkey.com/s/P79Y37H

Monday, 6 December

Welcome and Introduction

1 Introductions, Welcome & Logistics

Speaker: Prof. Sergio Novaes (Universidade Estadual Paulista (UNESP))

Slides GridUNESP_OSGSchool.pdf

2 Overview of the workshop

Instructions Instruction_to_join_mailing_list

Slides whoarewe.pdf

Introduction to OSG Grid computing

slides introduction.pdf

10:30 coffee break

Introduction to OSG Grid Computing (II)

12:30 lunch

Getting ready (1st part)

3 Installing the client

recipe for client installation https://twiki.grid.iu.edu/bin/viewauth/ReleaseDocumentation/ClientInstallationGuide

4 Getting a grid certificate from DOE

Grid certificate from DOE https://pki1.doegrids.org/ca/

Using the certificate certificates

15:30 coffee break

Getting ready (II)

5 Joining a VO

Joining VO OSGEDU https://voms.grid.iu.edu:8443/voms/osgedu

Special talk by invited speaker Jairo Panetta: "Case studies of HPC production in Brazil and the impact of novel computing architectures"

Tuesday, 7 December

Job management: running jobs locally with Condor

Materials (lectures and exercises) http://pages.cs.wisc.edu/~zmiller/osg-sp/

6 Running jobs locally with Condor

7 Hands-on: Running jobs locally with Condor

10:30 coffee break

Job management: running jobs locally with Condor (II)

8 Hands-on (II)

12:30 lunch

Turning science problems into HTC jobs

15:30 coffee break

Decomposing and running large jobs

Wednesday, 8 December

From local to Grid: Condor-G and OSGMM

9 Condor-G

Speaker: Mats Rynge (USC / Information Sciences Institute)

Slides Condor-G.pdf

10 Match making and Discovery: OSGMM

Speaker: Mats Rynge (USC / Information Sciences Institute)

Slides OSGMM.pdf

10:30 coffee break

Running jobs on the Grid: hands-on

Condor-G Exercises https://twiki.grid.iu.edu/bin/view/Education/CondorGExercises

OSGMM Exercises https://twiki.grid.iu.edu/bin/view/Education/OSGMMExercises

12:30 lunch

Job management frameworks

11 Introduction to pilot jobs

Speaker: Mats Rynge (USC / Information Sciences Institute)

Slides Pilots.pdf

12 Example of job framework (II): PanDA

Speaker: Dr Jose Caballero (Brookhaven National Laboratory)

Exercises panda

Slides PanDA.pdf

13 Example of job framework (I): glideinWMS

Speaker: Mats Rynge (USC / Information Sciences Institute)

Slides glideinWMS.pdf

15:30 coffee break

Running jobs on the Grid with glideinWMS: hands-on

glideinWMS exercises https://twiki.grid.iu.edu/bin/view/Education/GlideinWMSExercises

Thursday, 9 December

Storage and Data Management

14 Storage and Data Transfer

Slides OSG_STORAGE_And_Data_Movement.pdf OSG_STORAGE_And_Data_Movement.pptx

15 File Catalogs

10:30 coffee break

Data management: Exercises

Exercise 1 https://twiki.grid.iu.edu/bin/view/Education/DataManagement1Oss2010

Exercise 2 https://twiki.grid.iu.edu/bin/view/Education/DataManagement2Oss2010

12:30 lunch

Examples of data management frameworks in OSG

16 CMS data management framework: PhEDEx

Speaker: Mr Paul Rossman

Slides PhEDEx_and_CMS_Data_Transfers.pdf

17 ATLAS data management framework: DQ2

Slides issuesinDDM.pdf

18 LIGO data management framework

19 LSST data management framework

Slides LSST_and_Data_Management_12_9_10b.pdf

Remote talk: Security on the Grid

slides osg_spaulo_security.pdf

15:30 coffee break

Remote talks from the OSG bosses

20 Talk from Miron Livny

21 Talk from Ruth Pordes

Friday, 10 December

REDDnet - Data Logistics for OSG

Slides Paul-Hunter-OSG-SP2.pdf

Grid Operation Center (GOC) Services

slides OpsGridSchool.pdf

slides OpsGridSchool.pptx

10:30 coffee break

Grid Operation Center (GOC) Services (II)

GridUnesp Infrastructure and Services: Orientation for local users

12:30 lunch

Advanced topic: Expanding the HTC horizon with HTPC

Slides Brazil_HTPC.pdf

Open Science Grid Use By DZero

slides osgsp2010.pdf

15:45 coffee break

Survey and discussion

Q & As comments

Survey http://www.surveymonkey.com/s/P79Y37H

Closing session