Presentation is loading. Please wait.

Presentation is loading. Please wait.

ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,

Published byEvelyn Davidson Modified over 10 years ago

Similar presentations

Presentation on theme: "ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,"— Presentation transcript:

1 ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California, San Diego http://www.pragma-grid.net http://goc.pragma-grid.net PRAGMA Grid – Testbed For Collaborations

2 ACOMP, 3/15/2007 Overview PRAGMA Grid –Goal and approach –Structures and resources Collaborations in PRAGMA Grid –Applications and middleware –With science and technology teams –Grid interoperation experiments –Research publications Collaboration benefit –Form and leverage rich resources –Form and leverage collaboration networks –Enhance software quality and usability –Enhance vision and involvement –Enhance research visibility and software dissemination –Enhance funding positions Join us

3 ACOMP, 3/15/2007 Goals and Approaches Routine-use experiments and testbed (2004 - ) Grass-roots PRAGMA membership not necessary Dont have to be in pacific rim Contribute work and resources (of local grids) long term collaborations Application driven Issues, solutions, collaborations, interoperate middleware interoperability Make grid easier to use for scientists

4 ACOMP, 3/15/2007 PRAGMA Grid Testbed 32 Clusters from 29 institutions in 14 countries/regions (+ 7 in preparation) UZurich Switzerland NECTEC ThaiGrid Thailand UoHyd India MIMOS USM Malaysia CUHK HongKong ASGC NCHC Taiwan IOIT-HCM Vietnam AIST OsakaU UTsukuba TITech Japan BII IHPC NGO Singapore MU Australia APAC QUT Australia KISTI Korea JLU China SDSC USA CICESE Mexico UNAM Mexico UCN Chile UChile Chile UMC USA UUtah USA NCSA USA BU USA ASURC Costa Rica BESTGrid New Zealand CNIC GUCAS China AIST SDSC NGO NECTEC ThaiGrid 7 gfarm sites ASGC LZU China CNIC

5 ACOMP, 3/15/2007 Software Layers Heterogeneous environment Minimal requirements Globus 2, 3, 4 Moving recommendations

6 ACOMP, 3/15/2007 Applications and Middleware http://goc.pragma-grid.net/applications/default.html http://goc.pragma-grid.net/applications/default.html Real science applications pair and drive middleware development Achieve long-run and scientific results Open to applications of all scientific disciplines –Climate simulation Savannah/Nimrod (MU, Australia) MM5/Mpich-Gx (CICESE, Mexico; KISTI, Korea) –Quantum-mechanics, quantum-chemistry: TDDFT, QM-MD, FMO/Ninf-G (AIST, Japan) –Genomics iGAP/Gfarm/CSF (UCSD, USA; AIST, Japan; JLU, China) HPM: genomics (IOIT-HCM, Vietnam) mpiBlast/Mpich-G2 (ASGC, Taiwan) –Organic chemistry Gamess-APBS/Nimrod (UZurich, Switzerland) –Molecular simulation Siesta/Nimrod (UZurich, Switzerland; MU, Australia) Amber/Rsh ( USM, Malaysia) –Computer Science Load Balancer (VAST-HCM, Vietnam) GriddLeS (MU, Australia) 2 applications from Vietnam!

7 ACOMP, 3/15/2007 Mutually beneficial Nimrod based Gamess-APBS –Gamess-APBS: UZurich, Switzerland –Nimrod: MU, Australia Mpich-Gx based MM5 and WRF –MM5 and WRF: CICESE, Mexico –Mpich-Gx: KISTI, Korea Test/develop Gfarm and CSF with iGAP –Gfarm: AIST, Japan –CSF: JLU, China –iGAP: UCSD, USA Application/Middleware Collaborations http://goc.pragma-grid.net/wiki http://goc.pragma-grid.net/wiki

8 ACOMP, 3/15/2007 Technologies And Expertise Rocks – cluster management and grid software integration (SDSC, USA) Ninf-G – Grid-RPC (AIST, Japan) Nimrod – parameter sweep (MU, Australia) Mpich-Gx – Mpich-G2+ (KISTI, Korea) SCMSWeb – grid monitoring (ThaiGrid, Thailand) Gfarm – Grid file system (AIST/TsukubaU, Japan) MOGAS – Grid accounting (NTU, Singapore) CSF – Meta-scheduling (JLU, China) Grid security – APGrid (IGTF), Naregi-CA CSE-Online – cyber-environment (UUtah, USA) OptIPuter – high Performance Networking …

9 ACOMP, 3/15/2007 Grid security –Naregi (Japan), APGrid, GAMA (SDSC, USA) Grid monitoring –Monitoring - SCMSWeb (ThaiGrid, Thailand) –Accounting - MOGAS (NTU, Singapore) –Gfarm (AIST/UTsukuta, Japan) Cyber-environment –Cyber-environment - CSE-Online (UUtah, USA) –SCMSWeb (ThaiGrid, Thailand) –Myproxy (APAC, Australia) Rocks and middleware (SDSC, USA; …) –Ninf-G, SCE, Gfarm, Bio, K*Rocks, Condor, … Datagrid, sensor, network –Gfarm-fuse (AIST, Japan) –GEON data network –GLEON sensor network –OptIPuter High performance networked TDW Telescience Collaborations With Science and Technology Teams

10 ACOMP, 3/15/2007 Grid Interoperation Experiments http://goc.pragma-grid.net/wiki/index.php/Main_Page#Grid_Inter-operations OGF – Grid Interoperation Now (GIN), GIN-OPS –GIN testbed (February, 2006 – on-going) –TDDFT/Ninf-G (PRAGMA - AIST, Japan) PRAGMA, TeraGrid, OSG, NorduGrid; EGEE –Savanah fire simulation (PRAGMA - MU, Australia) PRAGMA, TeraGrid, OSG –Multi-Grid monitoring SCMSWeb probe matrix (PRAGMA - ThaiGrid, Thailand) Common schema (PRAGMA, TeraGrid, EGEE, NorduGrid) Peer-grid interoperation experiments –PRAGMA->TeraGrid (October, 2006 – on-going) PRAGMA member runs application across both grids QM/MD/Ninf-G (AIST, Japan) Manual reservation, 7 sites in PRAGMA, 3 sites in TeraGrid –OSG PRAGMA (January, 2007 – on-going) Members from both grids run applications across both grids OSG - Spatial Interpolation (UIowa, USA) PRAGMA - FMO/Ninf-G (AIST, Japan) OSG - FermilabGrid PRAGMA – SDSC, USA; NECTEC, Thailand; NGO, Singapore; ThaiGrid, Thailand

11 ACOMP, 3/15/2007 Grid Interoperation Now (GIN) http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps OGF – GIN-OPS GIN testbed (February, 2006 – on-going) TDDFT/Ninf-G (PRAGMA - AIST, Japan) –PRAGMA, TeraGrid, OSG, NorduGrid; EGEE Savanah fire simulation (PRAGMA - MU, Australia) –PRAGMA, TeraGrid, OSG Multi-Grid monitoring –SCMSWeb probe matrix (PRAGMA - ThaiGrid, Thailand) –Common schema (PRAGMA, TeraGrid, EGEE, NorduGrid)

12 ACOMP, 3/15/2007 PRAGMA->TeraGrid (October, 2006 – on-going) –PRAGMA member runs application across both grids –QM/MD/Ninf-G (AIST, Japan) –Manual reservation, 7 sites in PRAGMA, 3 sites in TeraGrid OSG PRAGMA (January, 2007 – on-going) –VDT and Rocks integration –Members from both grids run applications across both grids Peer-grid Interoperation Experiments http://goc.pragma-grid.net/wiki/index.php/Main_Page#Grid_Inter-operations

13 ACOMP, 3/15/2007 Collaborate in Publishing Research Results Some published papers in 2006: Arzberger P, Papadopoulos P. PRAGMA: Example of Grass-Roots Grid Promoting Collaborative EScience Teams. CTWatch. Vol 2, No. 1 Feb 2006. www.ctwatch.org/quarterly/articles/2006/02/pragmaexample-of-grass-roots-grid-promoting- collaborativee-science-teams Abramson D, Lynch A, Takemiya H, Tanimura Y, Date S, Nakamura H, Jeong K, Hwang S, Zhu J, Lu Z, Amoreira C, Baldridge K, Lee H, Wang C, Shih HL, Molina T, Li, W, Arzberger P. Deploying Scientific Applications on the PRAGMA Grid testbed: Ways, Means and Lessons. IEEE/CCGRID International Workshop on Grid Computing, 2006, Singapore. Lee B-S, Tang M, Zhang J, Soon O Y, Zheng C, Arzberger P. Analysis of Jobs on a Multi- Organizational Grid Testbed. IEEE/CCGRID Intl Workshop on Grid Computing, 2006, Singapore. Zheng C, Abramson D, Arzberger P, Ayuub S, Enticott C, Garic S, Katz M, Kwak J, Lee B S, Papadopoulos P, Phatanapherom S, Sriprayoonsakul S, Tanaka Y, Tanimura Y, Tatebe O, Uthayopas P. The PRAGMA Testbed: Building a Multi-Application International Grid. 2005 IEEE/CCGRID International Workshop on Grid Computing, 2006, Singapore. Li WW, Arzberger PW, Yeo CL, Ang L, Tatebe O, Sekiguchi S, Jeong K, Wuang S, Date S, Kwak JH. Proteome Analysis Using iGAP in Gfarm. The Second International Life Science Grid Workshop 2005, Grid Asia 2005, Singapore 2005. Wei X, Ding Z, Li W W, Tatebe O, Jiang J, et al. GDIA: A Scalable Grid Infrastructure for Data Intensive Applications. IEEE Intl Conference on Hybrid Information Technology, ICHIT 2006, Cheju Island, Korea. Krishnan S, Baldridge K K, Greenberg J. P, Stearn B, Bhatia K. An End-to-End Web Services- Based Infrastructure for Biomedical Applications. Proceedings of Grid 2005, 6th IEEE/ACM Intl Workshop on Grid Computing, November 13-14, 2005, Seattle, WA, U.S. …

14 ACOMP, 3/15/2007 PRAGMA Grid Collaborations Benefits Form and leverage rich resources Form and leverage collaboration networks Enhance software quality and usability Enhance vision and involvement Enhance research visibility and software dissemination Enhance funding positions

15 ACOMP, 3/15/2007 Form and Leverage Rich Resources Heterogeneous global grid –31 clusters, 28 institutions, 14 countries, >900 cpus, >900GB memory, >23TB user disk space –Contribution big or small –Access everything immediately –Example: USM Technologies and expertise –Develop, test, integrate, collaborate –Learn and adopt with best help –Example: UChile Purchase, Rocks, Naregi-CA, SCMSWeb, Gfarm, … Organize, collaborate, CLGrid

16 ACOMP, 3/15/2007 Form and Leverage Collaboration Networks Geosciences Network (GeoN) –From US-based, going global –PRAGMA grid geosciences sites AIST, Japan GUCAS, CNIC, China SDSC, USA UoHyd, India –Geogrid workgroup –Conjoint workshops Global Lake Ecological Observetory Network (GLEON) Community Cyberinfrastructure for Advanced Microbial Ecology Research and Analysis (CAMERA)

17 ACOMP, 3/15/2007 Enhance Software Quality and Usability From familiar local grid environment to heterogeneous global grid Feedbacks from diverse user communities Fault-tolerance (ie. Ninf-g) Deployment (ie. MOGAS) Performance and interoperation (ie. Gfarm) Functionalities and user friendly (ie. SCMSWeb) Speed up development Enhance middleware

18 ACOMP, 3/15/2007 Enhance Vision and Involvement Learning and collaborating –New possibilities –New discoveries –New directions Example –SCMSWeb Cluster -> grid -> multi-grid Integrate accounting, network performance, … Common schema among grid monitors

19 ACOMP, 3/15/2007 Enhance Research Visibility and Software Dissemination Global exposure Users learn/contribute hands-on Local grids adopts quality software –Naregi-ca APGrid, UCSD, Chile, … –SCMSWeb GIN-OPS, Chile, … –Gfarm Chile, Puerto Rico,

20 ACOMP, 3/15/2007 Enhance Funding Positions PRAGMAs track records and growth Significant, effective, visible collaborations Increase funding sources and prospects Many sites got new or renewed fundings –PRAGMA, Mexico, Chile, Thailand, … In turn, help PRAGMA grow

21 ACOMP, 3/15/2007 Join us PRAGMA Grid Run applications Work on grid technologies Grid interoperaton Thank You http://goc.pragma-grid.net http://goc.pragma-grid.net/wiki

Download ppt "ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,"

Similar presentations

PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.

PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.
Kento Aida, Tokyo Institute of Technology Grid Working Group Meeting Aug. 27 th, 2003 Tokyo Institute of Technology Kento Aida.

Kento Aida, Tokyo Institute of Technology Grid Working Group Meeting Aug. 27 th, 2003 Tokyo Institute of Technology Kento Aida.
Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.

Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
OSG All Hands, 3/5/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University.

OSG All Hands, 3/5/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University.
Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA 10 26 – 28 March 2006.

Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA – 28 March 2006.
CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or

CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.

Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.
PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.

Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29, 2009.

Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29, 2009.
Steering Committee Meeting Summary PRAGMA 18 4 March 2010.

Steering Committee Meeting Summary PRAGMA 18 4 March 2010.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Daejeon, Korea, March 24, 2009.

Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Daejeon, Korea, March 24, 2009.
Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006.

Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Slides Please send to Arun

Slides Please send to Arun
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.

Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.

Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.

Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.

Similar presentations

Ads by Google