1. Grids and the Home Institution A Campus Grids Overview by Laura F M c Ginnis Pittsburgh Supercomputing Center

2. lfm@psc.edu26 June 2006© 2006 PSC/CMU Agenda What is a campus grid? Who uses campus grids? Why are they using them? Where are the resources coming from? When can resources be used as a grid? How can we set up a grid on our campus? Bonus : What next?

3. lfm@psc.edu26 June 2006© 2006 PSC/CMU What is a campus grid? Heterogeneous dedicated and non-dedicated resources Designed to enable resource sharing and (over time) cost saving A system to federate compute and data resources across a campus Abstracts the interface to each from users Resources contributed from diverse campus organizations, but with centralized coordination Thanks to David Wallom, Oxford University

4. Campus Windows Machines (WSRF.NET) UVA Campus Grid Overview Web portal OGCE / uPortal UVA PubCookie Server ITC LDAP Server GGF OGSA SAML Authz Service MyProxy Server PubCookie compatible Campus Linux Machines (NMI / GT4) ExistingWe built

5. Grids at Indiana University Gary Purdue West Lafayette Indianapolis Bloomington Richmond Chicago 1 TFLOPS SP – INGEN, IBM 2 TFLOPS AVIDD – NSF, IBM 2.2 PB Storage – STK, NSF, INGEN Indiana/Purdue University Partnership

6. lfm@psc.edu26 June 2006© 2006 PSC/CMU Who uses campus grids? Harvard University, CrimsonGrid University of Wisconsin- Madison, GLOW University of Virgina, UVaCG University of Alabama- Birmingham, UABGrid University of Oxford, UK e- Science Campus Grids Indiana University, Hydra Indiana University, Campus Grids at Indiana Purdue University, Campus Grids at Purdue Langston University, DOSAR Fermi Lab, SAMGrid Greek Research & Technology Network, EGEE Texas Tech, TIGRE, THEGrid Cambridge University, CamGrid Global Grid Forum – GGF15 Campus Grids Workshop & Followup University of Iowa: HawkGrid University of Michigan: M-Grid

7. Example Uses ATLAS –Over 15 Million proton collision events simulated at 10 minutes each CMS –Over 10 Million events simulated in a month - many more events reconstructed and analyzed Computational Genomics –Prof. Shwartz asserts that GLOW has opened up new paradigm of work patterns in his group They no longer think about how long a particular computational job will take - they just do it Chemical Engineering –Students do not know where the computing cycles are coming from - they just do it

8. DOSAR – Grids on Campus Joel Snow Langston University Desktop Analysis Stations Institutional Analysis Centers Regional Analysis Centers Normal Interaction Communication Path Occasional Interaction Communication Path Central Analysis Center (CAC) DAS …. DAS …. IAC... IAC … RAC …. RAC DØ Remote Analysis Model (DØRAM) Fermilab Data and Resource hub MC Production Data processing Data analysis

9. lfm@psc.edu26 June 2006© 2006 PSC/CMU Why are they using them? Applications – Workflow Parallel programming Loosely coupled – “pleasingly parallel” Tightly coupled - mpich-g Coursework – Expand pool of resources available for class work Reduce bottlenecks during peak academic usage

10. Requirements for our GRID  Data collected by each running experiment 1 PetaByte p.a.  experiments with a High Energy physics user community Consequences for our GRID: data driven GRID interoperability possible data people CPU FermiLab, SAMGrid

11. Enabling Grids for E-sciencE INFSO-RI-508833 EGEE Applications Pilot New

12. lfm@psc.edu26 June 2006© 2006 PSC/CMU Where are the resources coming from ? Campus compute pools Underutilized departmental resources Student machines University of Iowa: HawkGrid University of Michigan: MGrid

13. lfm@psc.edu26 June 2006© 2006 PSC/CMU

14. lfm@psc.edu26 June 2006© 2006 PSC/CMU When can resources be used as a grid? Opportunistic Off-hours Scheduling by policy

15. Utilization of Idle Cycles Red: total owner Blue: total idle Green: total Condor Hydra – Indiana University

16. lfm@psc.edu26 June 2006© 2006 PSC/CMU Caveats : Things to Beware of Security System administration Resource management – “fair share” No “plug and play” solutions (yet)

17. lfm@psc.edu26 June 2006© 2006 PSC/CMU How can we set up a grid on our campus? Condor Globus Commercial Vendors Univa Platform Computing Microsoft

18. lfm@psc.edu26 June 2006© 2006 PSC/CMU Bonus : What next? Grids of Grids – interoperability Open Science Grid TeraGrid Campus Affiliates SURAGrid Global Grid Forum

19. Architecture

20. lfm@psc.edu26 June 2006© 2006 PSC/CMU

21. lfm@psc.edu26 June 2006© 2006 PSC/CMU Acknowledgements Jayanta Sircar, Harvard University, CrimsonGrid Sridhara Dasu, University of Wisconsin-Madison, GLOW Glenn Wasson, University of Virgina, UVaCG Jill Gemmill, University of Alabama-Birmingham, UABGrid David Wallom, University of Oxford, UK e-Science Campus Grids Arvind Gopu, Indiana University, Hydra Scott McCaulay, Indiana University, Campus Grids at Indiana Preston Smith, Purdue University, Campus Grids at Purdue Joel Snow, Langston University, DOSAR Valeria Bartsch, Fermi Lab, SAMGrid Ognjen Prnjat, Greek Research & Technology Network, EGEE Alan Sill, Texas Tech, TIGRE, THEGrid

22. lfm@psc.edu26 June 2006© 2006 PSC/CMU For More Information Condor: www.cs.wisc.edu/condor Globus: www.globus.org TeraGrid: www.teragrid.org SURAGrid: www1.sura.org/3000/SURAgrid.html Open Science Grid: www.opensciencegrid.org GGF: gridforum.org Campus Grids Workshop Slides: www.psc.edu/~lfm/PSC/Grid/PGS-RG