Presentation on theme: "Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006."— Presentation transcript:
Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006
PRAGMA Excitement Cyclone Larry Tropical cyclone Larry is seen striking the coast of Australia in this satellite image.
Magnitude 5.8 - OFF THE EAST COAST OF HONSHU, JAPAN 2006 October 10 23:58:07 UTC
NSF Renews PRAGMA for Five Year Thanks to the work of all of us
And what is expected of PRAGMA? Validate the investments in cyberinfrastructure One (not to be lost in) translation: Have scientist use the grid to do science!
Savannah Burn: How tightly linked are burning, vegetation, and rainfall? PRAGMA Testbed ran CSIRO climate model called CCAM in combination with Nimrod/G tool set. Executed on a maximum of 90 processors (out of a maximum 159) across 7 PRAGMA grid resources located in Australia, Japan, Korea, Taiwan, Thailand and the U.S. David Abramson, Amanda Lynch
Validation of Cyberinfrastructure Investments by the Savannah Burn experiment Science Resulted: The hypothesis that burning the Savanna can affect the strength and timing of the monsoon was confirmed. Testbed Exercised: The testbed operated for 170 days, and delivered over 1.25 million processor hours! Importantly, we were able to do a live upgrade of a number of the cyberinfrastructure components during the period. Middleware Improved: Improved Nimrod's ability to schedule computations by incorporating both data location and transport delays. –Allowing it to make a better choice of resources, improving the performance of the system as well as its fault tolerance. –We also enhanced Nimrod's ability to handle faults in the Grid testbed. Policy Impacted: The experiment shipped some 1.6TB of data across national and international networks. This exposed some interesting features of Australias network charging policy, and will lead to lasting improvements.
PRAGMA Overview and Approach Process to Promote Routine Use Team Science Application-Driven Collaborations ApplicationsMiddleware Routine Use Lab/Testbed Testing Applications Building Grid and GOC Multiway Dissemination Key Middleware Workshops and Organization Information Exchange Planning and Review New Collaborations New Members Expand Users Expand Impact Outcomes Improved middleware Broader Use New Collaborations Transfer Tech. Standards Publications New Knowledge Data Access Education
PRAGMA Continues to Experiment Expand our impact to new application areas –GEO and Geosciences*; Metagenomics* Increase emphasis on data in our routine use laboratory –Establish data grid testbed* (AIST, SDSC, Tsukuba, NCHC) –GEO and Geosciences and others Harness the potential of lambda grids –Telescience and Tile Display Walls* with demo at SC06 Work with productions grids to achieve interoperations –Grid Interoperations Now (GIN)* Broaden involvement of middleware developments from outside the Pacific Rim –U Amsterdam; UK National e-science Center, U Zurich Build the community –Develop federated approach to training and to establishing research directions* –Understand organizational aspects of how virtual organizations work* * Well already be seeing results of some of these activities
PRAGMA Grid Testbed AIST OSAKAU TITECH Japan CNIC GUCAS China KISTI Korea ASCC NCHC Taiwan UoHyd India MU Australia BII IHPC NGO Singapore KU NECTEC Thailand NCSA USA SDSC USA CICESE Mexico UNAM Mexico UChile Chile QUT Australia UZurich Switzerland JLU China MIMOS USM Malaysia IOIT-HCM Vietnam BU USA UMC USA 30 Clusters from 27 institutions in 14 countries Source Cindy Zheng
Applications http://goc.pragma-grid.net Achieved long run and scientific results –Savannah/Nimrod, MU, Australia –FMO/Ninf-G, AIST, Japan Successful run –MM5/Mpich-Gx, CICESE/KISTI, Mexico/KISTI 11 applications continue run in testbed –Savannah: climate model, MU, Australia –MM5: climate model, CICESE, Mexico –QM-MD, FMO: quantum-mechanics, AIST, Japan –iGAP: genomics, UCSD, USA –HPM: genomics, IOIT-HCM, Vietnam –mpiBlast: genomics, ASCC, Taiwan –Gamess-APBS: organic chemistry, UZurich, Switzerland –Siesta: molecular simulation, UZurich, Switzerland –Amber: molecular simulation, USM, Malaysia Source Cindy Zheng Coupling of applications with middleware
Grid Security APGrid PMA Meeting (yesterday) –See Yoshio Tanaka IGTF (OGF) http://www.gridpma.org/ http://www.gridpma.org/ –APGrid PMA, http://www.apgridpma.org/ http://www.apgridpma.org/ 5 site-CAs are IGTF accredited –AIST, ASGC, CNIC, NCSA, NECTEC PRAGMA CA –Naregi-CA, https://www.naregi.org/ca/ https://www.naregi.org/ca/ APGrid, UChile, … –Experimental CA in use for users/hosts –Working on production CA under APGRID PMA GAMA and Naregi-CA integration –GAMA, http://grid-devel.sdsc.edu/gridsphere/gridsphere?cid=gama http://grid-devel.sdsc.edu/gridsphere/gridsphere?cid=gama –User private key issue
Grid Interoperation Now (GIN) http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps GIN testbed (started Feb. 2006) –PRAGMA, TeraGrid, EGEE, OSG, NorduGrid Applications –TDDFT/Ninf-G Lead: Yoshio Tanaka, Yusuke Tanimura (AIST, Japan) Deployed and run –PRAGMA - AIST, NCSA, SDSC –TeraGrid – ANL –OSG – UCSD –NordiGrid Working on deployment to EGEE –Savanah Study (data intensive) Lead: Colin Enticott (MU, Australia) In preparation Presentation at SC06
Grid Interoperation Now (GIN)  http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps Somsak Sriprayoonsakul, Sugree Phatanapherom, (KU, ThaiGrid) Infrastructure testing matrix –Test 7 clusters from 5 grids http://goc.pragma-grid.net/cgi-bin/scmsweb/probe.cgi –New version to handle various grid service configurations/tests GIN map –implemented a XML-> LDIF translator for GIN map http://maps.google.com/maps?q=http://lfield.home.cern.ch/lfield/gin.kml Cross-grid monitoring –Common schema http://wiki.pragma-grid.net/index.php?title=GIN_%28Grid_Inter- operation_Now%29_Monitoring
Telescience Osaka has deployed software and tested with UCSD and NCHC Transferred dv and hdv bidirectionally using pixer movie Hope to have Osaka University President Miyahara tomorrow from Thailand!
SOFTWARE Global Engagement Examples and Programs GRID EDUCATION SCIENCE GLEON –Global Ecological Observatory Network –Grassroots effort to understand lake dynamics PRIME –Pacific Rim Undergraduate Experiences –Prepares globally-enabled workforce PRIUS –Pacific Rim International UniverSity at Osaka University –Prepares global workforce in context of curriculum PRAGMA –Pacific Rim Application and Grid Middleware Assembly –Catalyzes collaborations OptIPuter: –Optical networking, Internet Protocol, computer storage, processing and visualization technologies –Develops technologies for data intensive computing and collaborations Source: Philip Papadopoulos – Talk to NSF about Global Engagement
3 rd GLEON and CREON Joint Workshop 3-4 October 2006 Hsinchu Science: –Qualitative explanation of diel oxygen –Understanding biological and physical influences on metabolism by modeling –Publications Data Infrastructure: –Metadata about lakes; controlled vocabulary Students: –Find funding Next Meeting: GLEON –Finland, March 2-5 2007
PRIME: A Pilot Project for Global Engagement Built on top of PRAGMA people network and activities for Undergraduate Research: –Summer Internship in a host country laboratory –Mentors in US and Abroad –Pre-/Post experience research opportunities –Cultural pre-/during-/post-activity awareness component (use www.pacific.edu/culture) –Professional development seminars PRIME Class 2006
PRIME 2006 and Beyond Sustainability Enhancement of research, cultural component, extended sites Transfer, assess, and disseminate Challenges for our renewal With President Miyahara Osaka U NCHCs New Facility Taichung Monash U in Melbourne Melissa DiCiero-Monash Lao She Tea House
PRIUS Students 2006 Queensland University of Technology: Raj Chhabra, Yohei Sawai, Junya Seo Bioscience Portal Nanyang Technological University (NTU), Singapore: Francis Lee, Shingo Takeda, Junwei Zhang Grid Security National Center for High-performance Computing: Seiki Kuwabara, Fang-Pang Lin, Sun-In Lin, Yi-Haur Shiau, Jer-Huang Shiau and Shi-Wei Lo Tile Display Walls
Some Members and Participants http://pragma-goc.rocksclusters.org/pragma-doc/org.htmlhttp://pragma-goc.rocksclusters.org/pragma-doc/org.html; Resource Group Album: Total 85 Pictures – and another album Warning: Be wary of people with cameras
Annual Reports Prepare for SCxy Highlight Accomplishments Promote PRIME and PRIUS Describe Working Group Progress Summarize Individual Institution Contributions Give Additional Information, e.g. Publications, Sponsors
Highlights of 2006 - 2007 Simulating the Australian Monsoon and the Effect of Wildfires PRAGMA Biosciences Portal PRAGMA Leads Grid Interoperation Experiments in GIN Testbed PRAGMA Establishes Certificate Authority (CA) Using Naregi-CA Software Expanding the Collaboration Grid Building Communities, Catalyzing Collaborations PRIME and PRIUS More accomplishments in the Working Group sections
Steering Committee Agenda Business Issues –New Membership Applications: Thai National Grid Center –Workshop Applications: Proposal to host PRAGMA 15 (Fall 2008) in Penang Malaysia, by Universiti Sains Malaysia –PRAGMA Annual Report: Review and Approve –SC06 Schedule: Coordinate and Promote Activities Governance –Steering Committee Composition Other –PRAGMA Training / Research Institute –HPDC and PRAGMA collaboration (Satoshi Matsuoka, Carl Kesselman)
Investing in the Future of PRAGMA Challenges and Opportunities Build the community –Grow shared resources; Set research directions; Engage new applications; Create new generation of researchers and developers; Grow future leadership –What leadership opportunities or challenges can we create? Focus on science we can enable –Make routine use of testbed a reality Specific Challenges and Opportunities –Working Groups What other activities should be highlighted in the Annual Report? What science accomplishment will you enable? What type of PRAGMA Institute would benefit your members? –HPDC – an opportunity to focus on a topic and engage others – similar to CCGrid activities –How do we engage more students and postdocs?
Potential New Participants to help address these challenges Chinese University Hong Kong, Sammy Tang Academic State University Research Center, Costa Rica, Jose Castro University of Auckland, New Zealand, Paul Bonnington BeSTGRID New Zealand, Neil Gemmell National Institute of Information and Communications Technology, Asako Toyoda, Akiyoshi Nishiura, Masayuki Shimada, Yamaguchi Megumi Kyoto University, Yasuo Okabe Senri International Information Institute, Ryuichi Shimizu, Keishi Kimura Kyushu University, Koji Okamura Hyogo College of Medicine, Seiichi Kato High Energy Accelerator Research Organization (KEK), Go Iwai National Applied Research Laboratory, Taiwan, Joe Juang, Guey-Shin Chang, Cheyenne Chen Disaster Prevention & Research Center, National Cheng-Kung University,Taiwan, Min-Lang Huang National Chung Hsing University, Ye-Nu Wan Institute of High-Energy Physics - Beijing, Huaxiang Fan University of Utah, representing Vietnams Grid Effort, Thanh Truong Florida International University, Julio Ibarra and Kuldeep Kumar
The Enablers of the Workshop NEC Corporation SGI Japan Ltd. Sun Microsystems Nippon Telegraph and Telephone West Corporation KDDI Corporation KDDI R&D Laboratories Foundry Networks, Inc.
Thanks to the Local Organizing Committee Shinji Shimojo Susumu Date Kazunori Nozaki Tomomi Takeo Kae Nakagawa Many others
Welcome Looking Forward to an Exciting Meeting And see the second floor