National Institute of Advanced Industrial Science and Technology Recent activities on building a production Grid in the Asia Pacific Region - PRAGMA routine-basis.

Slides:



Advertisements
Similar presentations
PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.
Advertisements

Kento Aida, Tokyo Institute of Technology Grid Working Group Meeting Aug. 27 th, 2003 Tokyo Institute of Technology Kento Aida.
Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
National Institute of Advanced Industrial Science and Technology Asia Pacific Grid PMA Yoshio Tanaka APGrid PMA, Chair Grid Technology Research Center,
Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.
PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Steering Committee Meeting Summary PRAGMA 18 4 March 2010.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.
Cindy Zheng, Pragma Grid, 5/30/2006 The PRAGMA Testbed Building a Multi-Application International Grid Cindy Zheng P acific R im A pplication and G rid.
Resource/data WG Summary Yoshio Tanaka Mason Katz.
2 nd APGrid PMA F2F Meeting Osaka University Convention Center October 15 09: :20 # Participants: 26.
Cindy Zheng, PRAGMA 11, 10/16/2006 Resources Group P acific R im A pplication and G rid M iddleware A ssembly
Resource WG Report. Projects Applications EOL Ninf-G Climate model GridBlast GOC Gangla / SCMSWeb => Uniform Database Goodness Status map (e.g. IVDGL)
CCGrid 2006, 5/19//2006 The PRAGMA Testbed Building a Multi-Application International Grid San Diego Supercomputer Center / University of California, San.
Cindy Zheng, SC2006, 11/12/2006 Cindy Zheng PRAGMA Grid Testbed Coordinator P acific R im A pplication and G rid M iddleware A ssembly San Diego Supercomputer.
ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,
Updates of the APGrid PMA Catania March 3, 2009 Yoshio Tanaka APGridPMA Chair, AIST, Japan.
International Grid Trust Federation Session GGF 20 Manchester, UK Wednesday, May CAOPS-WG session #2.
Grid Computing in Higher Education (Scott Rea) EDUCAUSE PKI Deployment Forum Madison, WI - April 15, 2008.
National Institute of Advanced Industrial Science and Technology Proposals for auditing Yoshio Tanaka Grid Technology Research.
4 th APGrid PMA F2F Meeting Academia Sinica, Taipei, Taiwan April 8, 2008 Agendahttp:// Call for note takers!
National Institute of Advanced Industrial Science and Technology Status and plans of the APGrid PMA Yoshio Tanaka Grid Technology.
INFSO-RI Enabling Grids for E-sciencE JRA3 2 nd EU Review Input David Groep NIKHEF.
2 nd APGrid PMA F2F Meeting Osaka University Convention Center October 15 Wireless LAN SSID: PRAGMA11 Wep key: PRAGMA11JAPAN.
National Institute of Advanced Industrial Science and Technology Auditing, auditing template and experiences on being audited Yoshio Tanaka
National Institute of Advanced Industrial Science and Technology ApGrid: Current Status and Future Direction Yoshio Tanaka (AIST)
PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.
Cindy Zheng, PRAGMA9, 10/21/2005 PRAGMA Grid Testbed & Routine-basis Experiments May – October 2005 Cindy Zheng Pacific Rim Application and Grid Middleware.
Updates of APGrid PMA 22 June, Members (15 + 1) 15 Accredited CAs AIST (JP) APAC (AU) ASGC (TW) CNIC (CN), SDG IGCA (IN) IHEP (CN) KEK (JP) KISTI.
PRAGMA: Cyberinfrastructure, Applications, People Yoshio Tanaka (AIST, Japan) Peter Arzberger (UCSD, USA)
Status of PRAGMA Activities at KISTI Jongbae Moon 1.
Cindy Zheng, Geon Workshop, 7/20/2006 PRAGMA Grid A Multi-Application Route-Use Global Grid Cindy Zheng PRAGMA Grid Coordinator P acific R im A pplication.
National Institute of Advanced Industrial Science and Technology Introduction of PRAGMA routine-basis experiments Yoshio Tanaka
National Institute of Advanced Industrial Science and Technology Updates of the APGrid PMA Yoshio Tanaka Grid Technology Research.
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware Assembly San Diego Supercomputer Center.
APGrid PMA face-to-face meeting, 4/8/2008 Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng, SDSC, USA Yusuke Tanimura, AIST, Japan Pacific Rim Application Grid Middleware.
PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.
National Institute of Advanced Industrial Science and Technology Updates of the APGrid PMA Yoshio Tanaka APGrid PMA, Chair Grid Technology Research Center,
Routine-Basis Experiments in PRAGMA Grid Testbed Yusuke Tanimura Grid Technology Research Center National Institute of AIST.
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng, SDSC, USA Yusuke Tanimura, AIST, Japan Pacific Rim Application Grid Middleware.
TAGPMA & the Bridge WG (Scott Rea – Dartmouth College) Internet2 Member Meeting, Dec 2006 PKI Activities and Applications Update - Chicago, IL.
Resources Working Group Update Cindy Zheng (SDSC) Yoshio Tanaka (AIST) Phil Papadopoulos (SDSC)
National Institute of Advanced Industrial Science and Technology APGrid PMA: Stauts Yoshio Tanaka Grid Technology Research Center,
Pacific Rim Application and Grid Middleware Assembly: PRAGMA A community building collaborations and advancing grid-based applications Peter Arzberger,
National Institute of Advanced Industrial Science and Technology Some topics from the OGF20 and the EUGrid PMA F2F Meeting Yoshio Tanaka Grid Technology.
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
International Grid Trust Federation Session GGF 20 Manchester, UK Wednesday, May CAOPS-WG session #2.
Kento Aida, Tokyo Institute of Technology Grid Working Group Aug. 29 th, 2003 Tokyo Institute of Technology Kento Aida.
National Institute of Advanced Industrial Science and Technology ApGrid: Asia Pacific Partnership for Grid Computing - Introduction of testbed development.
National Institute of Advanced Industrial Science and Technology Updates of the APGrid PMA Yoshio Tanaka APGrid PMA, Chair Grid Technology Research Center,
National Institute of Advanced Industrial Science and Technology GGF12 Workshop on Operational Security for the Grid Cross-site authentication and access.
Opening Remarks and Updates of the APGrid PMA 5 th APGridPMA September 16, 2008 Yoshio Tanaka APGridPMA Chair, AIST, Japan.
Thoughts on International e-Science Infrastructure Kevin Thompson U.S. National Science Foundation Office of Cyberinfrastructure iGrid2005 9/27/2005.
APGrid PMA face-to-face meeting, 9/16/2008 PRAGMA-UCSD CA Team Pacific Rim Application and Grid Middleware Assembly
EGI-InSPIRE RI EGI EGI-InSPIRE RI Establishing Identity in EGI the authentication trust fabric of the IGTF and EUGridPMA.
Kento Aida, Tokyo Institute of Technology Joint Meeting Grid activities committee and Grid working group Jan. 28 th, 2004 Honolulu.
Update of APGridPMA APGridPMA Meeting Academia Sinica, Taiwan 22 March,
APGridPMA Update Eric Yen APGridPMA August, 2014.
Update of APGridPMA Eric Yen 25 th EUGridPMA & IGTF All Hands Meeting KIT, Germany 7 May, 2012.
APGridPMA Update Eric Yen 35 th Amsterdam, NL September 7, 2015.
Updates of APGrid PMA 18 th EUGridPMA Meeting 18 th EUGridPMA Meeting 18 January, 2010 Eric Yen ASGCCA Taiwan.
International Grid Trust Federation Session GGF 19 Chapel Hill, NC, USA Thursday, Feb CAOPS-WG session #1.
Updates of the APGrid PMA
Grids & PKI: TAGPMA & Bridges (Scott Rea – Dartmouth College) Internet2 Member Meeting, Dec 2006 PKI Implementers Workshop - Chicago, IL.
Presentation transcript:

National Institute of Advanced Industrial Science and Technology Recent activities on building a production Grid in the Asia Pacific Region - PRAGMA routine-basis experiments – - APGrid PMA and the IGTF - Yoshio Tanaka APGrid PMA, Chair PRAGMA Grid Technology Research Center, AIST, Japan

National Institute of Advanced Industrial Science and Technology PRAGMA routine-basis experiments All slides in this part are by courtesy of Mason Katz and Cindy Zheng (SDSC/PRAGMA)

Cindy Zheng, PRAGMA9, 10/21/2005 PRAGMA Grid Testbed AIST, Japan CNIC, China KISTI, Korea ASCC, Taiwan NCHC, Taiwan UoHyd, India MU, Australia BII, Singapore KU, Thailand USM, Malaysia NCSA, USA SDSC, USA CICESE, Mexico UNAM, Mexico UChile, Chile TITECH, Japan UMC, USA UZurich, Switzerland GUCAS, China

Cindy Zheng, PRAGMA9, 10/21/2005 Application vs. Infrastructure Middleware

Cindy Zheng, PRAGMA9, 10/21/2005 PRAGMA Grid resources

Cindy Zheng, PRAGMA9, 10/21/2005 Why Routine-basis Experiments? Resources group Missions and goals –Improve interoperability of Grid middleware –Improve usability and productivity of global grid PRAGMA from March, 2002 to May, 2004 –Computation resources 10 countries/regions, 26 institutions, 27 clusters, 889 CPUs –Technologies (Ninf-G, Nimrod, SCE, Gfarm, etc.) –Collaboration projects (Gamess, EOL, etc.) –Grid is still hard to use, especially global grid How to make a global grid easy to use? –More organized testbed operation –Full-scale and integrated testing/research –Long daily application runs –Find problems, develop/research/test solutions Cindy Zheng, GGF13, 3/14/05

Cindy Zheng, PRAGMA9, 10/21/2005 Routine-basis Experiments Initiated in May 2004 PRAGMA6 workshop Testbed –Voluntary contribution (8 -> 17) –Computational resources first –Production grid is the goal Applications –QM/MD, TDDFT, mpiBlast-g2, Savannah, –iGAP over Gfarm –Ocean science, Geoscience (proposed) Learn requirements/issues Research/implement solutions Improve application/middleware/infrastructure integrations Collaboration, coordination, consensus Cindy Zheng, GGF13, 3/14/05

Cindy Zheng, PRAGMA9, 10/21/2005 QMMD Quantum mechanics application Ninf-G based Driver: Hiroshi Takemiya (AIST) Ready on 12 sites: –AIST: Yoshio Tanaka, Yusuke Tanimura –ASCC: Hurng-Chun Lee, Mike Chiang –CNIC: Kai Nan, Kevin Dong –KISTI: Jysoo Lee, Jae-Hyuck Kwak –KU: Somsak Sriprayoonsakul, Sugree Phatanapherom –NCHC: Weicheng Huang, Chien-Lin Huang –NCSA: Radha Nandkumar, Tom Roney –SDSC: Mason Katz, Cindy Zheng –TITECH: Satoshi Matsuoka, Hitoshi Aoki –UNAM: Jose Luis Gordillo Ruiz, Eduardo Murrieta Leon –UoHyd: Arun Agarwal, Rajeev Wankar, Neelakanta Reddy –USM(hawk): Habibah Wahab, Suhaini Ahmad

Cindy Zheng, PRAGMA9, 10/21/2005 Lessons Learned Information sharing Trust and access (Naregi-CA, Gridsphere) Grid software installation (Rocks) Resource requirements (NCSA script, INCA) User/application environment (Gfarm) Job submission (Portal/service/middleware) System/job monitoring (SCMSWeb) Network monitoring (APAN, NLANR) Resource/job accounting (NTU) Fault tolerance (Ninf-G, Nimrod) Collaborations

National Institute of Advanced Industrial Science and Technology Introduction of APGrid PMA and International Grid Trust Federation

Background Many Asia-Pacific countries are going to have strong motivation for international collaboration with the outside of Asia Pacific. LCG, OSC, TeraGrid, etc … PRAGMA & TeraGrid, UK-eScience, EGEE, etc. Key issue for the collaboration is CA operation Most Certificate Authorities in Asia-Pacific countries were experimental-level No CP/CPS Not strictly operated

Background (cont ’ d) Problems of authentication federations All CAs should keep the same level of operation. How the CA is securely operated? Use HSM? Dedicated CA room? … All CAs should have no conflict in policy How the CA identifies end entities? Use face-to-face meeting? Telephone? etc. … Policy Management Authority (PMA) is a coordination body of CA policies and operations.

Policy Management Authority (PMA) Currently, there are three regional PMAs EUGrid PMA (established May 2004) Former: EUDG WP6 CA Coordination Group (started in 2002) TAG PMA (going to be established) One of the founding members: DOEGrid PMA (started in 2002) APGrid PMA (established June 2004) Unofficially started in 2003 Each regional PMA is responsible for coordination of CA policy within the region coordination of CA policy with the other regional PMAs

History of PMAs March 2003 First meeting with EU, DOE, and AP members Agreed with working on forming the Grid PMA. develop minimum requirements develop GridPMA charter Continuous discussions between AP, EU, and TAG PMA for International Grid Trust Federation. GGF12 and EUGrid PMA September 2004 March 2005 EUGridPMA May We (AP, EU, TAG PMAs) have agreed with trust with each other for the federation.

APGrid PMA: Asia Pacific Grid PMA General Policy Management Authority in Asia Pacific Not specific for ApGrid, Not specific for PRAGMA … Launched on June 1 st, 2004 Defines minimum CA requirements APGrid PMA approved that we accept two levels of CA: Experimental-level CA Alternative of the Globus CA Can be trusted within A-P communities Production-level CA Strict management is necessary Expected to be trusted by international communities

APGridPMA: Status (Members and CAs) AffiliationNameProduction CAExperimental CA AIST / JapanYoshio Tanakain operationwill close ASCC / TaiwanEric Yenin operationnone KISTI / KoreaJae-Hyuck Kwakin operation CAS / ChinaKai NanUnder reviewin operation IHEP / ChinaGonxing Sunin operationnone APAC/AustraliaDavid BannonUnder reviewin operation NAREGI/JapanShinji ShimojoIn operationin operation NCHC / TaiwanJulian Yu-Chung ChenUnder reviewin operation SDSC / USAMason Katzplanning NECTEC / ThailandSornthep VannaratPlanningIn operation NGO / SingaporeJon LauPlanningnone KEK / JapanTakashi SasakiPlanningnone HKU / HongKongChen Lin, Elaineno planin operation U of Hyd / IndiaArun Agarwalno planin operation USM / MalaysiaBoon Yaikno planin operation Osaka U / JapanSusumu Dateno planin operation

APGridPMA: Activities (cont ’ d) Defines and approves documents such as charter and the minimum CA requirements Accreditation of CAs 6 accredited CAs AIST, IHEP, KISTI, NAREGI, ASGCC in operation APAC, KEK going to be in operationAudit Audit checklist was drafted based on WebTrust criteria and the minimum CA requirement AIST, ASGCC, IHEP, CNIC have been audited by the other CAs.

APGridPMA: Activities Regular (monthly) VTC. Brief status reports of each CA In-depth report of a CA Decisions Examination for accreditation of a CA Approval of charter, minimum CA requirements, etc. Open discussions (physical) face-to-face meeting once per year. 1 st face-to-face meeting was in Dec. 2005, Beijing. Discussions by s Discussions with the other PMAs

Status and challenges International Grid Trust Federation (IGTF) has been officially approved at the GGF15, Boston, October Three PMAs are the founders of the IGTF Three PMAs agreed with trust with each other. e.g. CAs accredited by APGrid PMA can be trusted by EUGrid PMA and TAGPMA. Information (CA certificate, policy file, etc.) of Asia Pacific CAs accredited by APGrid PMA has been included a CA distribution package released by EUGrid PMA.

First APGridPMA Face-to-Face Meeting Beijing – Nov David Groep – Distribution of CA information  Periodic, monthly, distribution of all trust anchors  Common for the entire IGTF  Includes all trust anchors for all profiles classic, SLCS, experimental*, …  Does not distinguished between accrediting PMAs  Wide variety of formats  RedHat Package Management (RPM) system including a ‘ meta ’ package with dependencies per profile  ‘ tar ’ archives per CA, ordered per profile  Installation bundle suitable for ‘./configure && make install ’  New formats (like JKS) on request  Chairs can update the common back-end repository

Summary of the APGrid PMA and the IGTF CA CA CA CA EUGrid PMA CA CA CA CA CA CA APGrid PMA CA CA CA CA TAG PMA Regional PMA is responsible for coordination of security policies within the region Three PMAs compose IGTF