NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.

Slides:



Advertisements
Similar presentations
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Advertisements

W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.
George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD PreNEESR.
1 Generic logging layer for the distributed computing by Gene Van Buren Valeri Fine Jerome Lauret.
High Volume Batch Submission System for Earthquake Engineering ( Batchsubmit ) By Anup Thomas Hacker Gregory Rodgers.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
Monitoring and performance measurement in Production Grid Environments David Wallom.
Simulation and Information Technologies Gregory L. Fenves, UC Berkeley PEER Summative Meeting – June 13, 2007.
1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Global Earth Observation Grid Workshop, Bangkok, Thailand, March Integration Platform.
Brian Rohler Rajesh Thyagarajan Hubbub 2012 IUPUI Conference Center, Indianapolis, IN September 25 th, 2012.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
Biology.sdsc.edu CIPRes in Kepler: An integrative workflow package for streamlining phylogenetic data analyses Zhijie Guan 1, Alex Borchers 1, Timothy.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
4 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
NEESgrid: Where Infrastructure Meets Cyberinfrastructure Kim Mish Presidential Professor of Structural Engineering Director, Donald G. Fears Structural.
CHAPTER FOUR COMPUTER SOFTWARE.
Introduction to Interactive Media Interactive Media Tools: Software.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
SAN DIEGO SUPERCOMPUTER CENTER NUCRI Advisory Board Meeting November 9, 2006 Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
OpenSees on NEEShub Frank McKenna UC Berkeley. Bell’s Law Bell's Law of Computer Class formation was discovered about It states that technology.
Page 1 Simulation in NEEShub NEES & MCEER Annual Meeting 2011 Session #11: High Performance Computing and Simulation Gregory P. Rodgers Ph.D. NEESComm.
Accelerating Scientific Exploration Using Workflow Automation Systems Terence Critchlow (LLNL) Ilkay Altintas (SDSC) Scott Klasky(ORNL) Mladen Vouk (NCSU)
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation GEON Speaker.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Alternative.
SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Analyzing.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Enabling.
The EDGeS project receives Community research funding 1 Porting Applications to the EDGeS Infrastructure A comparison of the available methods, APIs, and.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University.
Migrating Desktop Bartek Palak Bartek Palak Poznan Supercomputing and Networking Center The Graphical Framework.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Workflow repository, user.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
LSF Universus By Robert Stober Systems Engineer Platform Computing, Inc.
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
SHIWA: Is the Workflow Interoperability a Myth or Reality PUCOWO, June 2011, London Gabor Terstyanszky, Tamas Kiss, Tamas Kukla University of Westminster.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation An Online.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poznan, Poland EGEE’07, Budapest, Oct.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
PEER 2003 Meeting 03/08/031 Interdisciplinary Framework Major focus areas Structural Representation Fault Systems Earthquake Source Physics Ground Motions.
A Science Collaboration Environment for the Network for Earthquake Engineering Simulation (NEES) Choonhan Youn Chaitan Baru, Ahmed Elgamal,
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
CyVerse Workshop Discovery Environment Overview. Welcome to the Discovery Environment A Simple Interface to Hundreds of Bioinformatics Apps, Powerful.
Gateways security Aashish Sharma Security Engineer National Center for Supercomputing Applications (NCSA) University of Illinois at Urbana-Champaign.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Integrating Scientific Tools and Web Portals
Tamas Kiss University Of Westminster
Module 01 ETICS Overview ETICS Online Tutorials
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid Gateways: SimPortal & Job Submission Portlet Lelli Van Den Einde NEESit August 13, 2008 TeraGrid Science Gateways at UCSD SDSC Summer Seminar Series

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Overview  What is NEES?  Computational Simulation within NEES  SimPortal Gateway & Job Submission Portal  Current/Future Developments

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Overview  What is NEES?  Computational Simulation within NEES  SimPortal Gateway & Job Submission Portal  Current/Future Developments

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation The NEES Community

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES Equipment Sites

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation The Role of NEESit

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Overview  What is NEES?  Computational Simulation within NEES  SimPortal Gateway & Job Submission Portal  Current/Future Developments

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Applications for Earthquake Engineering  Available on TeraGrid:  Abaqus  Ansys  OpenSees*  LS-Dyna  Fluent  *P  Mathematica  Other Applications  SAP2000  LARSA  Ruamoko  Etc…

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid Allocation  NEES wide TeraGrid Allocation  Researchers can apply at:  245,000 SU Allocation Oct Sept 2008  Up from 200,000 su’s the year before  ~125,000 remaining (April 2008)  Usage up from 2006 Allocation:  P655:   P690: 669  1626  Ia64: 64  (first quarter 2007  2008)  Number of users  31 groups 76 users  Up from 30 groups 66 users the year before

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation What is OpenSees?  A software framework for developing sequential, parallel and grid-enabled finite element applications in earthquake engineering.  Written primarily in the object-oriented programming language C++.  C++ wrappers are provided so that legacy and new procedures (elements, materials, numerical routines) written in other languages C, Fortran can be used.  Funding for OpenSees has been provided by:  PEER (Pacific Earthquake Enginering Research Center)  NEES (George E. Brown, Jr. Network for Earthquake Engineering Simulation) through NEESit.  NSF (National Science Foundation) Open System for Earthquake Engineering Simulation

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Parallel OpenSees Interpreters  OpenSeesSP: An application for large models which will parse and execute the exact same script as the sequential application. The difference being the element state determination and equation solving are done in parallel.  OpenSeesMP: An application for BOTH large models and parameter studies.

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Example Usage: Humboldt Bay Bridge Model

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Overview  What is NEES?  Computational Simulation within NEES  SimPortal Gateway & Job Submission Portal  Current/Future Developments

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation TeraGrid Access  Secure Shell  A Protocol that allows data to be transferred securely over the network using public key encryption  Common programs  ssh for login  scp or sftp for file transfer  TeraGrid Job Submission portal  NEES SimPortal under development

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES Job Submission Portlet  Simple access to HPC resources through NEES Portal environment  Users can easily run standard OpenSees jobs on TeraGrid  Supports the creation, execution, sharing and reuse of simulations  Groups can share data, tools, and collaborate  Provides community with a central resources for computational simulation  Can reuse simulation code and data

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES Job Submission Portlet  Portal user can:  Execute simulations on TeraGrid  Monitor the status of their jobs  Share his/her own results with other users  Reuse existing OpenSees code  Download results to leverage elsewhere

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation SimPortal  Provides graphical computational simulation component for NEES currently as Grid Portal for OpenSees  Compose a simulation by acquiring all necessary OpenSees scripts from:  NEEScentral data repository  User desktop  Edit and verify correctness of scripts  For very complex simulations, the scripts are expected to be developed off- line and uploaded to the portal to be executed on high-performance platforms provided by NEESit.  Monitor the progress of the simulations, preview the results, and download them for a detailed analysis.  Share the scripts and simulation results with other users

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation SimPortal Repository Scripts and data (public and private) Job Submission Service Monitoring Service Access job status and simulation results Edit, verify, and visualize models Workspace OpenSees scripts and data organized into simulations TeraGrid Local File system

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Example SimPortal Interface

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Initial Screen

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Basic Usage Acquire Input File(s) Submit & Monitor Job Submit Results to Repository Customize & Modify Script Preview Results Download Results

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Acquiring Files Acquire Input File(s) Submit & Monitor Job Submit Results to Repository Customize & Modify Script Preview Results Files come from:  User scripts uploaded to portal  Generated from Portlet Text editor  From NEEScentral Repository (not implemented yet) Download Results

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Acquiring Files

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Acquiring Files

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Customizing Files Acquire Input File(s) Submit & Monitor Job Submit Results to Repository Customize & Modifying Script Preview Results Files Can Be Modified By:  Editing in Portlet Editor  Setting values of parameters Download Results

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Verifying Correctness of Syntax (Parse)

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Visualization of Input Files

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Submission and Monitoring Acquire Input File(s) Submit & Monitor Job Submit Results to Repository Customize & Modifying Script Preview Results  Selection of:  Machine  Estimated Run Time  Number of Processors  Submit Download Results

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Submission and Monitoring

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Preview Results Acquire Input File(s) Submit & Monitor Job Submit Results to Repository Customize & Modifying Script Preview Results  After Job has run results can be previewed in portlet (recorder and stderr results)  Job can be modified & resubmitted if error Download Results

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Download Results Acquire Input File(s) Submit & Monitor Job Submit Results to Repository Customize & Modifying Script Preview Results Download Results

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Preview and Download Results

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Publish Results Acquire Input File(s) Submit & Monitor Job Submit Results to Repository Customize & Modifying Script Preview Results Download Results Submit Results to Repository (current work)

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Before You Begin You Need

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation neesport/neesportlaunch.jsp

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Overview  What is NEES?  Computational Simulation within NEES  SimPortal Gateway & Job Submission Portal  Current/Future Developments

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Current/Future Work  SimPortal integration with TeraGrid  Currently SimPortal submits jobs to Rocks Cluster  Requires authentication/authorization (single sign-on) with NEES accounts  SimPortal integration with NEEScentral Data Repository  So input/output files can be archived in NEEScentral  Requires extension of NEEScentral Web Services  Eventually will extend SimPortal to support other earthquake engineering simulation packages

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Questions?