28.09.2006 / 1W. Sudholt, K. Baldridge Swiss Grid Day, Geneva 28.09.2006 Grid Computing for Computational Chemistry and Beyond Wibke Sudholt 1 and Kim.

Slides:



Advertisements
Similar presentations
Nimrod/K: Towards Massively Parallel Dynamic Grid Workflows David Abramson, Colin Enticott, Monash Ilkay Altinas, UCSD.
Advertisements

The Telescience Project - ATOMIC (Applications to Middleware Interaction Components) Transparent Grid Access for Scientific.
SAN DIEGO SUPERCOMPUTER CENTER Gemstone: a mozilla-based rich client for accessing grid services Kurt Mueller / Karan Bhatia Grid Middleware Development.
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
6th Biennial Ptolemy Miniconference Berkeley, CA May 12, 2005 Distributed Computing in Kepler Ilkay Altintas Lead, Scientific Workflow Automation Technologies.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
CSC Grid Activities Arto Teräs HIP Research Seminar February 18th 2005.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
Simo Niskala Teemu Pasanen
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center.
Developing Reusable Software Infrastructure – Middleware – for Multiscale Modeling Wilfred W. Li, Ph.D. National Biomedical Computation Resource Center.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
Grid Computing. What is a Grid? Many definitions exist in the literature Early definitions: Foster and Kesselman, 1998 –“A computational grid is a hardware.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
Nimrod/G GRID Resource Broker and Computational Economy David Abramson, Rajkumar Buyya, Jon Giddy School of Computer Science and Software Engineering Monash.
DISTRIBUTED COMPUTING
1 Swiss Grid Day 2009 Campus Grid Working Group Update Pascal Jermini.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
2005 Materials Computation Center External Board Meeting The Materials Computation Center Duane D. Johnson and Richard M. Martin (PIs) Funded by NSF DMR.
Topaz : A GridFTP extension to Firefox M. Taufer, R. Zamudio, D. Catarino, K. Bhatia, B. Stearn University of Texas at El Paso San Diego Supercomputer.
Jarek Nabrzyski, Ariel Oleksiak Comparison of Grid Middleware in European Grid Projects Jarek Nabrzyski, Ariel Oleksiak Poznań Supercomputing and Networking.
07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge
Crystal25 Hunter Valley, Australia, 11 April 2007 Crystal25 Hunter Valley, Australia, 11 April 2007 JAINIS (JCU and Indiana Instrument Services): A Grid.
Contact person: Prof. M. Niezgódka Prof. Piotr Bała ICM Interdisciplinary Centre for Mathematical and Computational Modelling Warsaw University,
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
GCRC Meeting 2004 Introduction to the Grid and Security Philip Papadopoulos.
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
Tools for collaboration How to share your duck tales…
Wrapping Scientific Applications As Web Services Using The Opal Toolkit Wrapping Scientific Applications As Web Services Using The Opal Toolkit Sriram.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
Commodity Grid Kits Gregor von Laszewski (ANL), Keith Jackson (LBL) Many state-of-the-art scientific applications, such as climate modeling, astrophysics,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GRID ARCHITECTURE Chintan O.Patel. CS 551 Fall 2002 Workshop 1 Software Architectures 2 What is Grid ? "...a flexible, secure, coordinated resource- sharing.
Authors: Ronnie Julio Cole David
1October 9, 2001 Sun in Scientific & Engineering Computing Grid Computing with Sun Wolfgang Gentzsch Director Grid Computing Cracow Grid Workshop, November.
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
GridLab Resource Management System (GRMS) Jarek Nabrzyski GridLab Project Coordinator Poznań Supercomputing and.
Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:
XML-Based Grid Data System for Bioinformatics Development Noppadon Khiripet, Ph.D Wasinee Rungsarityotin, MS Chularat Tanprasert, Ph.D Royol Chitradon.
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.
High Risk 1. Ensure productive use of GRID computing through participation of biologists to shape the development of the GRID. 2. Develop user-friendly.
GRIDSTART Brussels 20/9/02 1www.gridstart.org GRIDSTART and European activities Dr Francis Wray EPCC The University of Edinburgh.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
All Hands Meeting 2005 BIRN-CC: Building, Maintaining and Maturing a National Information Infrastructure to Enable and Advance Biomedical Research.
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Using iRODS with the EnginFrame Grid Portal into the GRIDA3 project Francesco Locunto Marco Piras Matteo Vocale.
Clouds , Grids and Clusters
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Grid Computing.
Distributed System Concepts and Architectures
Presentation transcript:

/ 1W. Sudholt, K. Baldridge Swiss Grid Day, Geneva Grid Computing for Computational Chemistry and Beyond Wibke Sudholt 1 and Kim Baldridge 1,2 1 Institute of Organic Chemistry, University of Zurich, Switzerland 2 San Diego Supercomputer Center, University of California, San Diego, USA

/ 2W. Sudholt, K. Baldridge Overview Why do we use Grid Computing to answer scientific questions? How are we involved in Grid Computing? What can we do to support users to apply Grid Computing? How does Grid Computing help us to solve real- world problems?

/ 3W. Sudholt, K. Baldridge Towards a Global Cyberinfrastructure Workstations and PCs Supercomputers and clusters Internet and grids Computing Storage Instruments Networking Collaboration Information

/ 4W. Sudholt, K. Baldridge Interdisciplinary Research Mathematics Physics Chemistry Biology Computer Science Computational Chemistry

/ 5W. Sudholt, K. Baldridge Bridging Scientific Gaps Atoms Molecules Proteins Cells Organs Organisms Nuclei m m m m m 10 0 m m Accuracy Complexity Quantum mechanics Classical mechanics

/ 6W. Sudholt, K. Baldridge Grid Computing “A computational grid is a hardware and software infrastructure that provides dependable, consistent, pervasive, and inexpensive access to high-end computational capabilities.” Foster/Kesselman, 1999 Grid types: -Computational Grids -Desktop Grids -Data Grids -Knowledge Grids Grid opportunities: -Performance -Throughput -Scalability -Fairness -Collaboration -Knowledge exchange and dissemination Grid challenges: -Heterogeneity -Network speed -Fault tolerance -Distribution algorithms -Job scheduling -Legacy codes -Policy issues

/ 7W. Sudholt, K. Baldridge Grid Infrastructure Layers Applications Upper-level middleware Resources User interfaces Web portals Resource brokers Workflow systems Lower-level middleware Security infrastructure Resource management Information services Data management Scientific or business software Scientific or business data Visualization Network Job managers Operating systems Hardware

/ 8W. Sudholt, K. Baldridge Baldridge Group Hardware Chempossible cluster at SDSC Individual resources Grid resources Y. Potier, M. Packard, W. Sudholt, UniZH, et al. Mac laptops Matterhorn cluster at UniZH

/ 9W. Sudholt, K. Baldridge Grid Middleware Experience Cluster management: -Rocks -SGE Open source or freeware: -Globus -Nimrod -ProActive -UNICORE -Condor -BOINC -GridPort -SRB -Web services Commercial products: -DataSynapse -United Devices Workflow infrastructures: -Kepler -Informnet Security: -CA -GAMA

/ 10W. Sudholt, K. Baldridge Virtual Organizations Swiss Grid Initiative: Swiss Bio Grid (SBG): Southern European Partnership for Advanced Computing (SEPAC): Pacific Rim Applications and Grid Middleware Assembly (PRAGMA): Chemomentum: I2CAM:

/ 11W. Sudholt, K. Baldridge Computational Chemistry Grid User Interfaces Molecular visualization and remote execution (K. Baldridge, J. Greenberg, SDSC): -QMView GridPort web portals (J. Greenberg, SDSC, et al.): -GAMESS -APBS -Euler -AMBER -CE Workflow and integrated infrastructure projects (UniZH/SDSC): -Resurgence -Gemstone

/ 12W. Sudholt, K. Baldridge The Resurgence Project RESearch sURGe ENabled by CyberinfrastructurE Description: -Workflow tool for computational chemistry -Allow researchers to easily combine existing computational chemistry tools in innovative ways -Exploit the possibilities of the growing web and grid infrastructure -Focus on high-throughput calculations -Based on and included in the collaborative Kepler scientific workflow system Interfaced programs: -GAMESS (quantum chemistry), Babel, Open Babel (file format conversion), QMView (molecular visualization) -In preparation: Nimrod/G (grid distribution) -Planned: APBS (biomolecular continuum electrostatics) Participants: -UniZH/ETHZ: W. Sudholt et al. -SDSC: I. Altintas et al. Status: -Project has ended -Many ideas to be taken over into the Gemstone framework

/ 13W. Sudholt, K. Baldridge The Gemstone Project Grid Enabled Molecular Science Through Online Networked Environments Goals: -Integrated framework for accessing grid resources -Support scientific exploration, workflow capture and replay, and a dynamic services oriented architecture -Provide researchers in the molecular sciences with a tool to discover and compose remote grid application services Components: -Dynamic rich-client desktop interface (Firefox extension, XUL, registry lookup) -Strongly typed data schemas (XML Schema, CML, GamessXML) -Molecular visualization tools (Flash, Garnet, interface to QMView) -Optional: Authenticated interaction (GAMA) -Planned: Workflow integration (Informnet) Application web services: -APBS, GAMESS, Autodock, SIESTA codes -MolPrep, Babel, PDB2PQR, Psize utilities Related and interfaced projects: -Opal: Web services wrapping toolkit -Topaz: GridFTP Firefox extension Status: -Ongoing NSF and NBCR-supported project -Version 1.0 released on Participants: -UniZH: K. Baldridge, C. Amoreira, A. Bowen, Y. Potier et al. -SDSC: K. Bhatia, J. Greenberg, S. Krishnan, S. Mock, B. Stearn et al.

/ 14W. Sudholt, K. Baldridge Example Computational Chemistry Grid Projects and Collaborations Parameterization of a Group Difference Pseudopotential for QM/MM calculations using GAMESS and the Nimrod distributed parametric modeling tool (W. Sudholt, UCSD/UniZH/ETHZ, D. Abramson, Monash, et al.) Coupling of the GAMESS quantum chemical code with the BOINC desktop grid platform (M. Taufer, UCSD/UTEP, et al.) Investigation of protein-ligand interactions based on a GAMESS and APBS pipeline using Nimrod and Gemstone on the PRAGMA testbed (C. Amoreira, UniZH, et al.) Implementation of the material science application SIESTA into the Gemstone framework (A. Garcia, UPV/ICMAB, Spain)

/ 15W. Sudholt, K. Baldridge Parameterization of a Group Difference Pseudopotential Challenge: -Parameterization of a pseudopotential for QM/MM calculations -Embarrassingly parallel parameter sweeps and optimizations Setup: -GAMESS quantum chemistry code (pre- deployed) -Globus and Nimrod grid middleware -PRAGMA testbed resources (mainly at the PRAGMA 4 and Supercomputing 2003 conferences) Results: -Up to about 60’000 jobs -More than 200 days of computing time in less than 48 hours real time -Parameterized group difference potential - personal/pubs.htmlhttp:// personal/pubs.html Participants: -UCSD/UniZH/ETHZ: W. Sudholt -Monash University, Australia: D. Abramson, C. Enticott, S. Garic

/ 16W. Sudholt, K. Baldridge

/ 17W. Sudholt, K. Baldridge Collaborative Research Project with Swiss Re NatCat application: -Probabilistic modeling of losses for insurance portfolios from natural catastrophes (earthquakes, tropical cyclones etc.) based on pre-simulated events at specific locations -Java sources, Oracle database, test cases Goals: -Distribution of main Rate process over a computational grid -Improvement of performance, scalability, stability, and fairness -Testing of the DataSynapse GridServer and INRIA ProActive grid middleware tools Results: -Distribution over a number of Linux machines by an event set-based algorithm -Performance considerably improved -Database access represents bottleneck -Some results already in production version -Currently working on improving the distribution algorithm Participants: -Swiss Re: M. Spühler, P. Pfister et al. -UniZH: W. Sudholt, M. Packard, H. Mahmood, M. Dänzer, M. Monroe, K. Baldridge

/ 18W. Sudholt, K. Baldridge Summary Conclusions: -Grid computing is important for our domain-specific as well as our computer science research and has helped us to establish new local and international collaborations. -Our group and coworkers now have a lot of experience in grid computing including project participation and organization, infrastructure setup, software development, and application to scientific problems. -By developing grid user interfaces, we try to make grids easier accessible for the domain scientists. -We are building a record of grid projects in computational chemistry and also reach out to new fields, concepts, and collaborations. -Grid computing still requires a lot of effort, but the future is bright if we learn from the successes and failures, are aware of the limits, have clearly defined needs and goals, and do not reinvent the wheel. Thanks for funding: -UniZH, UCSD, SDSC, NSF, DAAD, ETHZ, EU, Swiss Re and others Swiss Grid Initiative: -This is an important initiative, and we are interested in participating. -We could provide our open source software and expertise. -We would contribute personnel and hardware resources only for well-defined, collaborative, and financed projects. -We expect knowledge exchange and dissemination, new collaborations, access to resources and funding, and not much organizational overhead. -This has to be a win-win situation with mutual trust, clear goals, and freedom for research.