OSG All Hands, 3/5/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University.

Slides:



Advertisements
Similar presentations
PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.
Advertisements

Kento Aida, Tokyo Institute of Technology Grid Working Group Meeting Aug. 27 th, 2003 Tokyo Institute of Technology Kento Aida.
Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA – 28 March 2006.
CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.
PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD Karpjoo Jeong, Ph.D., Konkuk University, South Korea Habibah Wahab, Ph.D., USM, Malaysia.
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
CAMPUS GRID WORKSHOP, ICT RESEARCH PLATFORM, 16 MAY 2007 PRAGMA : My personal hope & future Habibah A Wahab, School of Pharmaceutical Sciences, Universiti.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Update on Internships Pacific Rim Undergraduate Experiences prime.ucsd.edu.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29, 2009.
21 st Century Science and Education for Global Economic Competition William Y.B. Chang Director, NSF Beijing Office NATIONAL SCIENCE FOUNDATION.
Steering Committee Meeting Summary PRAGMA 18 4 March 2010.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Daejeon, Korea, March 24, 2009.
Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Slides Please send to Arun
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
PRAGMA 14 Geosciences WG Activities Update G. S. Chang, W. F. Tsai NARL, Taiwan March 11, 2008.
Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.
Cindy Zheng, Pragma Grid, 5/30/2006 The PRAGMA Testbed Building a Multi-Application International Grid Cindy Zheng P acific R im A pplication and G rid.
PRAGMA 11 Biosciences Working Group Activities Raj Chhabra Wilfred W. Li, Ph.D. Habibah Wahab, Ph.D.
Resource/data WG Summary Yoshio Tanaka Mason Katz.
2 nd APGrid PMA F2F Meeting Osaka University Convention Center October 15 09: :20 # Participants: 26.
Cindy Zheng, PRAGMA 11, 10/16/2006 Resources Group P acific R im A pplication and G rid M iddleware A ssembly
PRAGMA Update 21 October 2005 Hyderabad. PRAGMAs Founding Motivations – Updated 2005 The grid is transforming e-science: computing, data *, and collaboration.
PRAGMA Institute, 9/26/2007 Cindy Zheng, David Abramson, Peter Arzberger, Shahaan Ayyub, Colin Enticott, Slavisa Garic, Wojtek Goscinski, Mason J. Katz,
PRAGMA Summit, 3/17/2008 Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly
Kejun Dong, Kai Nan CNIC/CAS CNIC Resources And Activities Update Resources Working Group PRAGMA11 Workshop, Oct.16/17 Osaka, Japan.
Biosciences Working Group Update & Report Back Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29,
CCGrid 2006, 5/19//2006 The PRAGMA Testbed Building a Multi-Application International Grid San Diego Supercomputer Center / University of California, San.
GIN Testbed Status 5/11/2006 Peter Arzberger, Cindy Zheng
Cindy Zheng, SC2006, 11/12/2006 Cindy Zheng PRAGMA Grid Testbed Coordinator P acific R im A pplication and G rid M iddleware A ssembly San Diego Supercomputer.
ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,
GRID COMPUTING AND SOME RESEARCH ISSUES IN DEVELOPMENT GEOGRID AT VAST Dao Van Tuyet Department for Computational & Knowledge Engineering.
Strengthen Existing and Establish New Collaborations Work with Science Teams to Advance Grid Technologies and Improve the Underlying Infrastructure In.
PRAGMA Overview and Future Directions Workshop on Building Collaborations in Clouds, HPC and Applications 17 July 2012.
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
Overview of PRAGMA View to the Future Examples of Team Science and Global Engagement in Asia Pacific and South Asia Peter Arzberger Philip Papadopoulos.
Progress Since PRAGMA 19 Planning for PRAGMA’s Future PRAGMA March2011 University of Hong Kong.
Global Lake Ecological Observatory Network - GLEON: Catalyzing Global Team Science based on PRAGMA Peter Arzberger Tim Kratz, Fang-Pang Lin Philip Papadopoulos,
CANS2006, 12/7/2006 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of.
PRAGMA21 – PRAGMA 22 Collaborative Activities Resources Working Group.
PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.
Cindy Zheng, PRAGMA9, 10/21/2005 PRAGMA Grid Testbed & Routine-basis Experiments May – October 2005 Cindy Zheng Pacific Rim Application and Grid Middleware.
Cindy Zheng, Pragma Cloud, 3/20/2013 Building The PRAGMA International Cloud Cindy Zheng For Resources Working Group.
Pacific Rim International University - Fostering Globally-leading Researchers in Integrated Sciences - Susumu Date Shoji Miyanaga Osaka University, Japan.
PRAGMA: Cyberinfrastructure, Applications, People Yoshio Tanaka (AIST, Japan) Peter Arzberger (UCSD, USA)
Bioinformatics Grid-based Applications and IOIT-HCM Grid Tran Van Lang, Do Van Long Members of VNGrid Project HCM City Institute of Information Technology.
24th APAN Meeting, Xian, China - August 2007 e-Science on VNGrid Project Tran Van Lang, Do Van Long Members of VNGrid Project HCM City Institute of Information.
Status of PRAGMA Activities at KISTI Jongbae Moon 1.
Cindy Zheng, Geon Workshop, 7/20/2006 PRAGMA Grid A Multi-Application Route-Use Global Grid Cindy Zheng PRAGMA Grid Coordinator P acific R im A pplication.
National Institute of Advanced Industrial Science and Technology Introduction of PRAGMA routine-basis experiments Yoshio Tanaka
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware Assembly San Diego Supercomputer Center.
1 The state of Grid computing in Vietnam, and which aims the VNGrid Project wants to reach Dr. Lang Van, Tran HCM City Institute of Information Technology.
APGrid PMA face-to-face meeting, 4/8/2008 Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.
PRAGMA Avian Flu Grid: Drug Discovery against Infectious Diseases Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia.
Resources Working Group Update Cindy Zheng (SDSC) Yoshio Tanaka (AIST) Phil Papadopoulos (SDSC)
National Institute of Advanced Industrial Science and Technology APGrid PMA: Stauts Yoshio Tanaka Grid Technology Research Center,
Pacific Rim Application and Grid Middleware Assembly: PRAGMA A community building collaborations and advancing grid-based applications Peter Arzberger,
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
Thoughts on International e-Science Infrastructure Kevin Thompson U.S. National Science Foundation Office of Cyberinfrastructure iGrid2005 9/27/2005.
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by UCSD San Diego, USA, March 3, 2010.
Presentation transcript:

OSG All Hands, 3/5/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California, San Diego PRAGMA: A Framework For Collaborations

OSG All Hands, 3/5/2007 Overview PRAGMA –Goal and approach Collaborations –In testbed Applications and middleware With science and technology teams –With other Grids GIN-OPS, Peer-grids –In education and training PRIME, PRIUS, NBCR institute

OSG All Hands, 3/5/ pragma -grid.net Overarching Goals PRAGMA A Practical Collaborative Framework. Strengthen Existing and Establish New Collaborations Work with Science Teams to Advance Grid Technologies and Improve the Underlying Infrastructure In the Pacific Rim and Globally

OSG All Hands, 3/5/2007 Overview and Approach Process to Promote Routine Use Team Science Application-Driven Collaborations ApplicationsMiddleware Routine Use Lab/Testbed Testing Applications Building Grid and GOC Multiway Dissemination Key Middleware Workshops and Organization Information Exchange Planning and Review New Collaborations New Members Expand Users Expand Impact Outcomes Improved middleware Broader Use New Collaborations Transfer Tech. Standards Publications New Knowledge Data Access Education

OSG All Hands, 3/5/2007 PRAGMA Grid Testbed 31 Clusters from 27 institutions in 14 countries/regions (+8 in preparation) UZurich Switzerland NECTEC ThaiGrid Thailand UoHyd India MIMOS USM Malaysia CUHK HongKong ASGC NCHC Taiwan IOIT-HCM Vietnam AIST OsakaU UTsukuba TITech Japan BII IHPC NGO Singapore MU Australia APAC QUT Australia KISTI Korea JLU China SDSC USA CICESE Mexico UNAM Mexico UCN Chile UChile Chile UMC USA UUtah USA NCSA USA BU USA ASURC Costa Rica BESTGrid New Zealand CNIC GUCAS China AIST SDSC NGO NECTEC ThaiGrid 5 gfarm sites

OSG All Hands, 3/5/2007 Applications and Middleware Real science applications pair and drive middleware development Achieve long-run and scientific results Open to applications of all scientific disciplines –Climate simulation Savannah/Nimrod (MU, Australia) MM5/Mpich-Gx (CICESE, Mexico; KISTI, Korea) –Quantum-mechanics, quantum-chemistry: TDDFT, QM-MD, FMO/Ninf-G (AIST, Japan) –Genomics iGAP/Gfarm/CSF (UCSD, USA; AIST, Japan; JLU, China) HPM: genomics (IOIT-HCM, Vietnam) mpiBlast/Mpich-G2 (ASGC, Taiwan) –Organic chemistry Gamess-APBS/Nimrod (UZurich, Switzerland) –Molecular simulation Siesta/Nimrod (UZurich, Switzerland; MU, Australia) Amber/Rsh ( USM, Malaysia) –Compute Science Load Balancer (VAST-HCM, Vietnam) GriddLeS (MU, Australia)

OSG All Hands, 3/5/2007 Mutually beneficial Nimrod based Gamess-APBS –Gamess-APBS: UZurich, Switzerland –Nimrod: MU, Australia Mpich-Gx based MM5 and WRF –MM5 and WRF: CICESE, Mexico –Mpich-Gx: KISTI, Korea Test/develop Gfarm and CSF with iGAP –Gfarm: AIST, Japan –CSF: JLU, China –iGAP: UCSD, USA Application/Middleware Collaborations

OSG All Hands, 3/5/2007 Grid security –Naregi (Japan), APGrid, GAMA (SDSC, USA) Grid infrastructure –Monitoring - SCMSWeb (ThaiGrid, Thailand) –Accounting - MOGAS (NTU Singapore) –Metascheduling - Community Scheduling Forum (JLU, China) –Cyber-environment - CSE-Online (UUtah, USA) –Rocks and middleware (SDSC, USA; …) Ninf-G, SCE, Gfarm, Bio, K*Rocks, Condor, … Datagrid, sensor, network –Gfarm-fuse (AIST, Japan) –GEON data network –GLEON sensor network –OptIPuter High performance networked TDW Telescience Collaborations With Science and Technology Teams

OSG All Hands, 3/5/2007 CNIC UCSD TDW/OptIPuter Example Source: Elaine Liu, PRIME 2006

OSG All Hands, 3/5/2007 Collaborations in BioScience Avian Flu Research Project –UCSD, CNIC, JLU, Uni. Of Tskuba/AIST, University of Hawaii and Konkuk University –EGEE – Academia Sinica Biosciences Portal –Collaboration between Osaka University, University of Queensland, JLU, UCSD. –Involves PRIME, PRIUS and summer students from UCSD, Osaka and JLU. Metagenomics Research and Genome Informatics –Bioinformatics, computational biology software –Gfarm/CSF4, TskubaU/JLU, Japan/China –With University of Wisconsin, UCSD, PRIME project

OSG All Hands, 3/5/2007 GEON-iGEON-PRAGMA GEON is a coalition among IT and Earth Science researchers with the goal of developing advanced information technologies to enable new modes of geosciences research GEON is developing technologies for information integration and knowledge discovery Internationalization of GEON – iGEON PRAGMA Some sites already working on geoscience projects Building a datagrid Welcome geoscience applications Seeking collaboration in grid interoperation

OSG All Hands, 3/5/2007 PRAGMA and GEON/iGEON collaboration Sharing data, software know-how, interoperate grids Geoscience workgroup established at PRAGMA11, joint conferences with PRAGMA GUCAS (China) –Setup a GEON node in PRAGMA testbed UMC (USA) and GUCAS –Preparing a GEON application to run in PRAGMA testbed CNIC (China) –Is setting up a GEON data node in PRAGMA testbed UoHyd (India) –has setup a GEON node, will join PRAGMA testbed AIST Geogrid (Japan) plan –Share data with GEON –Interoperate with PRAGMA testbed

OSG All Hands, 3/5/2007 Collaboration in Environmental Science GLEON –A grassroots network of People: lake scientists, engineers, information technology experts Institutions: universities, national laboratories, agencies Programs: PRAGMA, AS-Forest Biogeochemistry,US-LTER, TERN, KING, EcoGrid, etc. Instruments Data –Linked by a common purpose and cyberinfrastructure –With a goal of understanding lake dynamics at local, regional, continental, and global scales

OSG All Hands, 3/5/2007 Collaborate in Publishing Research Results Some published papers in 2006: Arzberger P, Papadopoulos P. PRAGMA: Example of Grass-Roots Grid Promoting Collaborative EScience Teams. CTWatch. Vol 2, No. 1 Feb collaborativee-science-teams Abramson D, Lynch A, Takemiya H, Tanimura Y, Date S, Nakamura H, Jeong K, Hwang S, Zhu J, Lu Z, Amoreira C, Baldridge K, Lee H, Wang C, Shih HL, Molina T, Li, W, Arzberger P. Deploying Scientific Applications on the PRAGMA Grid testbed: Ways, Means and Lessons. IEEE/CCGRID International Workshop on Grid Computing, 2006, Singapore. Lee B-S, Tang M, Zhang J, Soon O Y, Zheng C, Arzberger P. Analysis of Jobs on a Multi- Organizational Grid Testbed. IEEE/CCGRID Intl Workshop on Grid Computing, 2006, Singapore. Zheng C, Abramson D, Arzberger P, Ayuub S, Enticott C, Garic S, Katz M, Kwak J, Lee B S, Papadopoulos P, Phatanapherom S, Sriprayoonsakul S, Tanaka Y, Tanimura Y, Tatebe O, Uthayopas P. The PRAGMA Testbed: Building a Multi-Application International Grid IEEE/CCGRID International Workshop on Grid Computing, 2006, Singapore. Li WW, Arzberger PW, Yeo CL, Ang L, Tatebe O, Sekiguchi S, Jeong K, Wuang S, Date S, Kwak JH. Proteome Analysis Using iGAP in Gfarm. The Second International Life Science Grid Workshop 2005, Grid Asia 2005, Singapore Wei X, Ding Z, Li W W, Tatebe O, Jiang J, et al. GDIA: A Scalable Grid Infrastructure for Data Intensive Applications. IEEE Intl Conference on Hybrid Information Technology, ICHIT 2006, Cheju Island, Korea. Krishnan S, Baldridge K K, Greenberg J. P, Stearn B, Bhatia K. An End-to-End Web Services- Based Infrastructure for Biomedical Applications. Proceedings of Grid 2005, 6th IEEE/ACM Intl Workshop on Grid Computing, November 13-14, 2005, Seattle, WA, U.S. …

OSG All Hands, 3/5/2007 Grid Interoperation Now (GIN) OGF – GIN-OPS GIN testbed (February, 2006 – on-going) TDDFT/Ninf-G (PRAGMA - AIST, Japan) –PRAGMA, TeraGrid, OSG, NorduGrid; EGEE Savanah fire simulation (PRAGMA - MU, Australia) –PRAGMA, TeraGrid, OSG Multi-Grid monitoring –SCMSWeb probe matrix (PRAGMA - ThaiGrid, Thailand) –Common schema (PRAGMA, TeraGrid, EGEE, NorduGrid)

OSG All Hands, 3/5/2007 PRAGMA->TeraGrid (October, 2006 – on-going) –PRAGMA member runs application across both grids –QM/MD/Ninf-G (AIST, Japan) –Manual reservation, 7 sites in PRAGMA, 3 sites in TeraGrid OSG PRAGMA (January, 2007 – on-going) –Members from both grids run applications across both grids –Applications: OSG –GISolve –spatial Interpolation –UIowa, USA PRAGMA –FMO/Ninf-G –quantum Chemistry –AIST, Japan Peer-grid Interoperation Experiments

OSG All Hands, 3/5/2007 OSG-PRAGMA Interoperation Experiment Resources OSG –FermilabGrid PRAGMA –SDSC, USA –NECTEC, Thailand –NGO, Singapore –ThaiGrid, Thailand Process Jan 4, 2007, identify who and how –Coordinator, application drivers, resource supporters –Wiki, application, requirements Jan 25, 2007, initial VTC –Goals, Q/A exchange Start working – immediately issues, solutions –Weekly status, , wiki Status Feb 26 - March 1, started application runs successfully A set of jobs are processed on the VO, collected, and updated for the next iteration. Learned Differences in grid environment effect users and applications –Job submission Change RSL parameter Remove inter-node parallel execution –Security policy Take work to setup access Account on gatekeeper node Large scale calculations are possible Middleware fault tolerance and flexible resource management is important

OSG All Hands, 3/5/2007 PRIME Providing UCSD undergraduate students international interdisciplinary research internships and Cultural experiences Preparing the global work place of the 21 st century Built on top of PRAGMA R&D network and activities for Undergraduate Research A Pilot Project for Global Engagement PRIME Class 2006 Summer research abroad Mentors from UCSD and host institutions Real science and practical projects Learning science, technology and culture Demos and talks Continuing research involvement thereafter

PRIME 2006 (Thrid Year) Host Institutions and Projects at a Glance CNIC, China –Virtual Screening of Avian Influenza H5N1 Neuraminidase and Hemagglutinin proteins against two libraries of ligands –High-resolution astronomial visualization and visual collaboration environment MU, Australia –Computational analysis of biological structures using GAMESS-APBS/Nimrod programs –Develop efficient method for large scale virtual screening of ligands –More stable ionic model of ventricular myocytes OsakaU, Japan –Homology modeling of the protein kinases and binding site prediction –Docking simulations of protein kinases and virtual screening of ligands for inhibitors –Established networked Tile Display Wall NCHC, Taiwan –implementing image-processing software for neural networks –Develop software tools for earthquake experiments, monitoring and analysis Prime Students 2006 Hosted by CNIC, China At Lao She Tea House

OSG All Hands, 3/5/2007 PRIUS - Pacific Rim International UniverSity Based at Osaka University Establish a consistent educational program for graduate students. On-the-Job-training and education with PRAGMA Lecture course: Stimulate students ambitious Short Abroad Internship: Offer trial opportunities Long Abroad Internship: Provide skill building chances M1 M2 Doc P.D Exchange prgm: produces liquidity in human resource P.D Educational Part Research Part Source: Susumu Date, Osaka University

OSG All Hands, 3/5/2007 PRIUS (First Year) 10 International instructors –All from PRAGMA members UCSD, USA NCHC, Taiwan NTU, Singapore QUT, MU, Australia –Grid computing/applications Grid and web services Clustering tools Optical network computing Grid accounting systems Biomedical grid applications Economic and social impact of cyberinfrastructure –Interaction with students Internship abroad –UCSD, USA Develop QM/MM hybrid simulation program for protein research using OPAL –NTU, Singapore Design/prototype a grid security monitoring system as an add-on to MOGAS –QUT, Australia Develop a bioscience portal for PRAGMA –NCHC, Taiwan Implement high-definition-quality streaming video over a high-speed network with various TDW technologies

OSG All Hands, 3/5/2007 Future Meeting 20 – 22 March 2007, Bangkok Thailand –PRAGMA 12 Hosted by NECTEC and Thai National Grid Center –18 – 20 March 2007: GEOGrid Workshop Fall 2007, Urbana-Champaign USA –PRAGMA 13 Hosted by NCSA Spring 2008, Hsinchu Taiwan –PRAGMA 14 Hosted by NCHC Fall 2008, Penang Malaysia –PRAGMA 15 Hosted by USM

OSG All Hands, 3/5/ pragma -grid.net Thank You PRAGMA is supported by the National Science Foundation (Grant No. INT , INT , OCI ), and member institutions PRIME is supported by the National Science Foundation under NSF INT