GIN Testbed Status 5/11/2006 Peter Arzberger, Cindy Zheng

Slides:



Advertisements
Similar presentations
PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.
Advertisements

Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA – 28 March 2006.
National Institute of Advanced Industrial Science and Technology Experiences through Grid Challenge Event Yoshio Tanaka.
Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.
TeraGrid Community Software Areas (CSA) JP (John-Paul) Navarro TeraGrid Grid Infrastructure Group Software Integration University of Chicago and Argonne.
PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Reports from Resource Breakout PRAGMA 16 KISTI, Korea.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Reports from Resource Breakout PRAGMA 15 USM, Malaysia.
PRAGMA 10 Townsville, Australia Re-Capping John OCallaghan APAC.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.
Cindy Zheng, Pragma Grid, 5/30/2006 The PRAGMA Testbed Building a Multi-Application International Grid Cindy Zheng P acific R im A pplication and G rid.
Resource/data WG Summary Yoshio Tanaka Mason Katz.
Cindy Zheng, PRAGMA 11, 10/16/2006 Resources Group P acific R im A pplication and G rid M iddleware A ssembly
PRAGMA Application (GridFMO) on OSG/FermiGrid Neha Sharma (on behalf of FermiGrid group) Fermilab Work supported by the U.S. Department of Energy under.
Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.
Resource WG Report. Projects Applications EOL Ninf-G Climate model GridBlast GOC Gangla / SCMSWeb => Uniform Database Goodness Status map (e.g. IVDGL)
Introduction of Grid Security
Message Lab Monash e-Science and Grid Engineering Laboratory Bridging Grid Islands for Large Scale e-Science Blair Bethwaite, David Abramson, Ashley Buckle.
Kejun Dong, Kai Nan CNIC/CAS CNIC Resources And Activities Update Resources Working Group PRAGMA11 Workshop, Oct.16/17 Osaka, Japan.
CCGrid 2006, 5/19//2006 The PRAGMA Testbed Building a Multi-Application International Grid San Diego Supercomputer Center / University of California, San.
Cindy Zheng, SC2006, 11/12/2006 Cindy Zheng PRAGMA Grid Testbed Coordinator P acific R im A pplication and G rid M iddleware A ssembly San Diego Supercomputer.
ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,
National Institute of Advanced Industrial Science and Technology Ninf-G - Core GridRPC Infrastructure Software OGF19 Yoshio Tanaka (AIST) On behalf.
© 2007 Open Grid Forum GIN-CG Session I – Charter/Docs Morris Riedel (Forschungszentrum Jülich & OMII - Europe) GIN Secretary …and many others…
Does the implementation give solutions for the requirements? Flexibility GridRPC enables dynamic join/leave of QM servers. GridRPC enables dynamic expansion.
2nd International Workshop on Campus and Community Grids Wolfgang Gentzsch, Laura McGinnis & David Wallom.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
GGF16, Athens AuthZ Interoperability Here and Now Workshop, 16 Feb 2006.
OSG/TeraGrid Interopations: The Authz Perspective Von Welch (NCSA) Presenting work by Christopher A. Baumbauer (Purdue U.) Greg Cross (U. Chicago) Stuart.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
PRAGMA19, Sep. 15 Resources breakout Migration from Globus-based Grid to Cloud Mason Katz, Yoshio Tanaka.
National Institute of Advanced Industrial Science and Technology ApGrid: Current Status and Future Direction Yoshio Tanaka (AIST)
VGrids Virtual Grids in MiG. Idea Virtual organizations are a central point in the Grid model VO’s share –Resources –Files –Credits A VO is a set of users.
National Institute of Advanced Industrial Science and Technology Introduction to Grid Activities in the Asia Pacific Region jointly presented by Yoshio.
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
Cindy Zheng, PRAGMA9, 10/21/2005 PRAGMA Grid Testbed & Routine-basis Experiments May – October 2005 Cindy Zheng Pacific Rim Application and Grid Middleware.
A. Sim, CRD, L B N L GIN-Data : SRM Island Inter-Op Testing With SRM-TESTER Alex Sim, Vijaya Natarajan Computational Research Division Lawrence Berkeley.
Somsak Sriprayoonskul, Nopparat Nopkuat, Putchong Uthayopas, Sugree Phatanapherom ThaiGrid, Thailand Cindy Zheng, SDSC.
PRAGMA: Cyberinfrastructure, Applications, People Yoshio Tanaka (AIST, Japan) Peter Arzberger (UCSD, USA)
Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.
Cindy Zheng, Geon Workshop, 7/20/2006 PRAGMA Grid A Multi-Application Route-Use Global Grid Cindy Zheng PRAGMA Grid Coordinator P acific R im A pplication.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
National Institute of Advanced Industrial Science and Technology Introduction of PRAGMA routine-basis experiments Yoshio Tanaka
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware Assembly San Diego Supercomputer Center.
GridShib: Grid/Shibboleth Interoperability September 14, 2006 Washington, DC Tom Barton, Tim Freeman, Kate Keahey, Raj Kettimuthu, Tom Scavo, Frank Siebenlist,
Routine-Basis Experiments in PRAGMA Grid Testbed Yusuke Tanimura Grid Technology Research Center National Institute of AIST.
© 2006 Open Grid Forum Enabling Pervasive Grids The OGF GIN Effort Erwin Laure GIN-CG co-chair, EGEE Technical Director
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
National Institute of Advanced Industrial Science and Technology APGrid PMA: Stauts Yoshio Tanaka Grid Technology Research Center,
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
Open Science Grid & its Security Technical Group ESCC22 Jul 2004 Bob Cowles
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
Grid Interoperability Update on GridFTP tests Gregor von Laszewski
APGrid PMA face-to-face meeting, 9/16/2008 PRAGMA-UCSD CA Team Pacific Rim Application and Grid Middleware Assembly
OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.
Interoperability Activity Frederick Luehring Indiana University July 20, 2005 OSG Consortium Meeting.
Kento Aida, Tokyo Institute of Technology Joint Meeting Grid activities committee and Grid working group Jan. 28 th, 2004 Honolulu.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
Monitoring and Information Services Technical Group Report
Ian Bird GDB Meeting CERN 9 September 2003
Presentation transcript:

GIN Testbed Status 5/11/2006 Peter Arzberger, Cindy Zheng

Grids and People EGEE EGEE Erwin Laure, Olivier van der Aa, Mona Aggarwal, Oscar Koeroo, etc.Erwin Laure, Olivier van der Aa, Mona Aggarwal, Oscar Koeroo, etc. PRAGMA PRAGMA Peter Arzberger, Phil Papadoupolos, Mason Katz, Cindy Zheng, Yoshio Tanaka, Yusuke Tanimura, Somsak Sriprayoonsakul, Putchong Uthayopas etc.Peter Arzberger, Phil Papadoupolos, Mason Katz, Cindy Zheng, Yoshio Tanaka, Yusuke Tanimura, Somsak Sriprayoonsakul, Putchong Uthayopas etc. TeraGrid TeraGrid Charlie Catlett, Dane Skow, JP Navarro, Laura Pearlman etc.Charlie Catlett, Dane Skow, JP Navarro, Laura Pearlman etc.

First Application and Middleware Test TDDFT/Ninf-G TDDFT/Ninf-G Lead: Yoshio Tanaka, Yusuke Tanimura (AIST)Lead: Yoshio Tanaka, Yusuke Tanimura (AIST) Deployed and runDeployed and run PRAGMA - AIST, NCSA, SDSC PRAGMA - AIST, NCSA, SDSC TeraGrid – ANL TeraGrid – ANL Working on deployment to EGEE – LCGWorking on deployment to EGEE – LCG Middleware interoperability problem Middleware interoperability problem Assumptions by middleware about local architecture are the main cause – bad ideaAssumptions by middleware about local architecture are the main cause – bad idea head node, home directory, etc. head node, home directory, etc. New version of Ninf-G should resolve current problem New version of Ninf-G should resolve current problem Release todayRelease today Resume deployment and testing after GGF17Resume deployment and testing after GGF17

Lessons Learned, Issues and Work (1) Progress Progress Committed individualsCommitted individuals Authentication Authentication People involved so farPeople involved so far gin-auth, gin-ops, Globus people gin-auth, gin-ops, Globus people User obtain initial accessUser obtain initial access Process documented by Cindy Zheng, goc.rocksclusters.org/gin/gin-egee.htm Process documented by Cindy Zheng, goc.rocksclusters.org/gin/gin-egee.htmhttp://pragma- goc.rocksclusters.org/gin/gin-egee.htmhttp://pragma- goc.rocksclusters.org/gin/gin-egee.htm Not easy, not simple Not easy, not simple Need documentation to guide users Need documentation to guide users Need to simply the process. How? Can this be tied to any other GIN working groups effort? Need to simply the process. How? Can this be tied to any other GIN working groups effort? DN incompatibilityDN incompatibility Summarized by Oscar Koeroo, grid.net/gin/Cert-probs-GIN.pdf Summarized by Oscar Koeroo, grid.net/gin/Cert-probs-GIN.pdfhttp://goc.pragma- grid.net/gin/Cert-probs-GIN.pdfhttp://goc.pragma- grid.net/gin/Cert-probs-GIN.pdf Commented by Charles Bacon (Globus), grid.net/gin/DN_Charles-Bacon.htm Commented by Charles Bacon (Globus), grid.net/gin/DN_Charles-Bacon.htmhttp://goc.pragma- grid.net/gin/DN_Charles-Bacon.htmhttp://goc.pragma- grid.net/gin/DN_Charles-Bacon.htm Need both standard and flexibility Need both standard and flexibility Voms server is modified to handle both styles of DN strings Voms server is modified to handle both styles of DN strings

Lessons Learned, Issues and Work (2) Software stack and Community Software Area (CSA) Software stack and Community Software Area (CSA) People involved so farPeople involved so far JP Navarro, Yoshio Tanaka, Yusuke Tanimura, Mason Katz, etc. JP Navarro, Yoshio Tanaka, Yusuke Tanimura, Mason Katz, etc. Software stack is different among grids. Problems with conflicting requirements.Software stack is different among grids. Problems with conflicting requirements. CSA as a solution for users to deploy their sub- stack and share installed software CSA as a solution for users to deploy their sub- stack and share installed software JP Navarro will summarize the discussionsJP Navarro will summarize the discussions Near term - work on CSA within each gridNear term - work on CSA within each grid Need focused discussion on solution for GINNeed focused discussion on solution for GIN Any other GIN working groups are working on related issues?Any other GIN working groups are working on related issues?

Lessons Learned, Issues and Work (3) Cross-grid monitoring Cross-grid monitoring Need to view/monitor jobs/resources in GIN environmentNeed to view/monitor jobs/resources in GIN environment People involved so far:People involved so far: Somsak Sriprayoonsakul, JP Navarro, Laura Pearlman, Oxana Smirnova, Ben Evans, etc. Somsak Sriprayoonsakul, JP Navarro, Laura Pearlman, Oxana Smirnova, Ben Evans, etc. Summary by Somsak Sriprayoonsakul, by Somsak Sriprayoonsakul, Get some monitoring software together, develop a common schema Get some monitoring software together, develop a common schema Wiki - grid.net/index.php?title=GIN_%28Grid_Inter- operation_Now%29_MonitoringWiki - grid.net/index.php?title=GIN_%28Grid_Inter- operation_Now%29_Monitoringhttp://wiki.pragma- grid.net/index.php?title=GIN_%28Grid_Inter- operation_Now%29_Monitoringhttp://wiki.pragma- grid.net/index.php?title=GIN_%28Grid_Inter- operation_Now%29_Monitoring Multiple ideas and works should be fineMultiple ideas and works should be fine Needs more communication with gin-info. (Other groups?) How to do that.Needs more communication with gin-info. (Other groups?) How to do that.

Questions How do we communicate our lessons learned to GIN community and beyond? How do we communicate our lessons learned to GIN community and beyond? How do we get enough human resources for work? How do we get enough human resources for work? Do we expand the activity? If so: Do we expand the activity? If so: Do we grow the number of grids in participating in the testbed?Do we grow the number of grids in participating in the testbed? Do we start a second application?Do we start a second application? Possible candidate: Savanah Study (Climate simulation; greater data needs) Possible candidate: Savanah Study (Climate simulation; greater data needs) Middleware – Nimrod/GMiddleware – Nimrod/G David Abramson, Colin Enticott, Monash University, AustraliaDavid Abramson, Colin Enticott, Monash University, Australia Requirements: user account, GT2,3,4, 75GB user disk spaceRequirements: user account, GT2,3,4, 75GB user disk space Do we focus next on a simplest application that runs easily on most machines (e.g. Hello World)Do we focus next on a simplest application that runs easily on most machines (e.g. Hello World) To systematically document process To systematically document process To involve more grids To involve more grids

Proposed Next Steps More communications between groups More communications between groups Group leads on all groups mailing lists?Group leads on all groups mailing lists? Combined list to post info/status from all groups?Combined list to post info/status from all groups? Complete TDDFT / Ninf-G interoperation between PRAGMA, TeraGrid, EGEE Complete TDDFT / Ninf-G interoperation between PRAGMA, TeraGrid, EGEE Community Software Area Community Software Area Work on within each gridWork on within each grid Need to discuss/work on what to do for GIN.Need to discuss/work on what to do for GIN. Cross-grid monitoring Cross-grid monitoring Support grass-root effortSupport grass-root effort Encourage exchange ideas/info with other groupsEncourage exchange ideas/info with other groups New application/middleware testcase New application/middleware testcase Hello World?Hello World? Something already on EGEE, TeraGrid..?Something already on EGEE, TeraGrid..? Nimrod/Savanah?Nimrod/Savanah? More grids? More grids? Recommendation of an immediate GIN activity… Recommendation of an immediate GIN activity… Need committed peopleNeed committed people

Enjoy Kabuki at Kabuki-ZA Feast at Ginza Drink GIN