Grid Computing AEI Numerical Relativity Group has access to high-end resources in over ten centers in Europe/USA They want: Bigger simulations, more simulations.

Slides:



Advertisements
Similar presentations
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Advertisements

ASC Portal Design & Architecture A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
GridLab Enabling Applications on the Grid Jarek Nabrzyski et al. Poznań Supercomputing and Networking.
The Cactus Portal A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
Cactus Code and Grid Programming Here at GGF1: Gabrielle Allen, Gerd Lanfermann, Thomas Radke, Ed Seidel Max Planck Institute for Gravitational Physics,
Astrophysics, Biology, Climate, Combustion, Fusion, Nanoscience Working Group on Simulation-Driven Applications 10 CS, 10 Sim, 1 VR.
GridSphere for GridLab A Grid Application Server Development Framework By Michael Paul Russell Dept Computer Science University.
Cactus Tools for the Grid Gabrielle Allen Max Planck Institute for Gravitational Physics, (Albert Einstein Institute)
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
Remote OMNeT++ v2.0 Introduction What is Remote OMNeT++? Remote environment for OMNeT++ Remote simulation execution Remote data storage.
Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
The Cactus Code: A Parallel, Collaborative, Framework for Large Scale Computing Gabrielle Allen Max Planck Institute for Gravitational Physics, (Albert.
Grid Data Management A network of computers forming prototype grids currently operate across Britain and the rest of the world, working on the data challenges.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
GridChem-- User Support Kent Milfeld Supported by the NSF NMI Program under Award # Oct. 10, 2005.
The Astrophysics Simulation Collaboratory Portal Case Study of a Grid-Enabled Application Environment HPDC-10 San Francisco Michael Russell, Gabrielle.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
Cactus Project & Collaborative Working Gabrielle Allen Max Planck Institute for Gravitational Physics, (Albert Einstein Institute)
NeSC Apps Workshop July 20 th, 2002 Customizable command line tools for Grids Ian Kelley + Gabrielle Allen Max Planck Institute for Gravitational Physics.
Dynamic Grid Simulations for Science and Engineering Ed Seidel Max-Planck-Institut für Gravitationsphysik (Albert Einstein Institute) NCSA, U of Illinois.
1 Cactus in a nutshell... n Cactus facilitates parallel code design, it enables platform independent computations and encourages collaborative code development.
Applications for the Grid Here at GGF1: Gabrielle Allen, Thomas, Dramlitsch, Gerd Lanfermann, Thomas Radke, Ed Seidel Max Planck Institute for Gravitational.
National Computational Science National Center for Supercomputing Applications National Computational Science NCSA-IPG Collaboration Projects Overview.
April 1st, The ASC- GridLab Portal Edward Seidel, Michael Russell, Gabrielle Allen, and the rest of the team Max Plank Institut für Gravitationsphysik.
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The Cactus Code: A Problem Solving Environment for the Grid Gabrielle Allen, Gerd Lanfermann Max Planck Institute for Gravitational Physics.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.
Cactus/TIKSL/KDI/Portal Synch Day. Agenda n Main Goals:  Overview of Cactus, TIKSL, KDI, and Portal efforts  present plans for each project  make sure.
New and Cool The Cactus Team Albert Einstein Institute
Connections to Other Packages The Cactus Team Albert Einstein Institute
Timeshared Parallel Machines Need resource management Need resource management Shrink and expand individual jobs to available sets of processors Shrink.
WebFlow High-Level Programming Environment and Visual Authoring Toolkit for HPDC (desktop access to remote resources) Tomasz Haupt Northeast Parallel Architectures.
Cactus Grid Computing Gabrielle Allen Max Planck Institute for Gravitational Physics, (Albert Einstein Institute)
VisPortal Project developer’s experience C.E.Siegerist, J. Shalf, E.W. Bethel NERSC/LBNL Visualization Group T.J. Jankun-Kelley, O. Kreylos, K.L. Ma CIPIC/UC.
National Energy Research Scientific Computing Center (NERSC) Visportal : interface to grid enabled NERC resources Cristina Siegerist NERSC Center Division,
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
Albert-Einstein-Institut Exploring Distributed Computing Techniques with Ccactus and Globus Solving Einstein’s Equations, Black.
Dynamic Grid Computing: The Cactus Worm The Egrid Collaboration Represented by: Ed Seidel Albert Einstein Institute
New and Cool The Cactus Team Albert Einstein Institute
Cactus Workshop - NCSA Sep 27 - Oct Generic Cactus Workshop: Summary and Future Ed Seidel Albert Einstein Institute
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Cactus Project & Collaborative Working
Applied Operating System Concepts
Cactus Tools for the Grid
GridLab: Dynamic Grid Applications for Science and Engineering A story from the difficult to the ridiculous… Ed Seidel Max-Planck-Institut für Gravitationsphysik.
The Cactus Team Albert Einstein Institute
Collaborations and Interactions with other Projects
1st Generation of Grid portals
Enable computational and experimental  scientists to do “more” computational chemistry by providing capability  computing resources and services at their.
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Exploring Distributed Computing Techniques with Ccactus and Globus
Dynamic Grid Computing: The Cactus Worm
OGCE OGCE The Open Grid Computing Environments Collaboratory
DOE 2000 PI Retreat Breakout C-1
SDM workshop Strawman report History and Progress and Goal.
The XCAT Science Portal
Operating System Concepts
OGCE Portal Applications for Grid Computing
Gateway and Web Services
German Astrophysical Virtual Observatory
TeraGrid Identity Federation Testbed Update I2MM April 25, 2007
Gordon Erlebacher Florida State University
Operating System Concepts
Grid Computing Software Interface
Presentation transcript:

Grid Computing AEI Numerical Relativity Group has access to high-end resources in over ten centers in Europe/USA They want: Bigger simulations, more simulations and faster throughput Intuitive IO at local workstation No new systems/techniques to master!! How to make best use of these resources? Provide easier access … noone can remember ten usernames, passwords, batch systems, file systems, … great start!!! Combine resources for larger productions runs (more resolution badly needed!) Dynamic scenarios … automatically use what is available Many other reasons for Grid Computing for computer scientists, funding agencies, supercomputer centers ...

Grand Picture Viz of data from previous simulations in SF café Remote Viz in St Louis Remote steering and monitoring from airport Remote Viz and steering from Berlin DataGrid/DPSS Downsampling IsoSurfaces http HDF5 T3E: Garching Origin: NCSA Globus Simulations launched from Cactus Portal Grid enabled Cactus runs on distributed machines

Thorn HTTPD Thorn which allows simulation any to act as its own web server Connect to simulation from any browser anywhere Monitor run: parameters, basic visualization, ... Change steerable parameters See running example at www.CactusCode.org Wireless remote viz, monitoring and steering

Users View

User Portal Find resources Authentification Launch simulation automatically finds machines with a user allocation (group aware!) continuously monitor resources, network etc. Authentification single login, don’t need to remember lots of usernames/passwords Launch simulation automatically create executable on chosen machine write data to appropriate storage location negotiate local queue structures Monitor/steer simulations access remote visualization and steering while simulation is running collaborative … choose who else can look in and/or steer performance … how efficient is the simulation? Archiving store thorn lists, parameter files, output locations, configurations, …

Cactus Portal KDI ASC Project Technology: Globus, GSI, Java Beans, DHTML, Java CoG, MyProxy, GPDK, TomCat, Stronghold Allows submission of distributed runs Accesses the ASC Grid Testbed (SDSC, NCSA, Argonne, ZIB, AHPCC, WashU, AEI) Undergoing testing by users now! Main difficulty now is that it requires everything to work … But is going to revolutionise our use of computing resources

ASC: Astrophysics Simulation Collaboratory NSF Funded Knowledge and Distributed Intelligence project Institutes: WashU, Rutgers, Argonne, U. Chicago, NCSA Aim: Develop a collaboratory for the astrophysics community to provide the capability for massively parallel computation including AMR, interactive visualization and metacomputing. http://www.ASCPortal.org/ ASC Portal: General simulation portal interfacing to Cactus Globus, GSI, Java Beans, DHTML, Java CoG, MyProxy, GPDK, TomCat, Stronghold Version 1 included code assembly, compilation, job submission Version 2 now being developed, based on user feedback