Integrating Scientific Tools and Web Portals

Slides:



Advertisements
Similar presentations
RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.
Advertisements

6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal.
MASPLAS ’02 Creating A Virtual Computing Facility Ravi Patchigolla Chris Clarke Lu Marino 8th Annual Mid-Atlantic Student Workshop On Programming Languages.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
DIRAC API DIRAC Project. Overview  DIRAC API  Why APIs are important?  Why advanced users prefer APIs?  How it is done?  What is local mode what.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Configuring Resources for the Grid Jerry Perez.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
DynamicBLAST on SURAgrid: Overview, Update, and Demo John-Paul Robinson Enis Afgan and Purushotham Bangalore University of Alabama at Birmingham SURAgrid.
DISTRIBUTED COMPUTING
Enabling Cloud and Grid Powered Image Phenotyping Nirav Merchant iPlant Collaborative
Company Overview for GDF Suez December 29, Enthought’s Business Enthought provides products and consulting services for scientific software solutions.
Carol Song Hubbub 2013 September 5, 2013 Power to the Masses.
MaterialsHub - A hub for computational materials science and tools.  MaterialsHub aims to provide an online platform for computational materials science.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Software Software consists of the instructions issued to the computer to perform specific tasks. –The software on a computer system refers to the programs.
INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.
Page 1 Simulation in NEEShub NEES & MCEER Annual Meeting 2011 Session #11: High Performance Computing and Simulation Gregory P. Rodgers Ph.D. NEESComm.

INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
CaliBayes and BASIS: e-Science applications for Systems Biology research Yuhui Chen Institute for Ageing and Health Centre for Integrated Systems Biology.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
6 February 2009 ©2009 Cesare Pautasso | 1 JOpera and XtremWeb-CH in the Virtual EZ-Grid Cesare Pautasso Faculty of Informatics University.
Having a Blast! on DiaGrid Carol Song Rosen Center for Advanced Computing December 9, 2011.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Korea Workshop May GAE CMS Analysis (Example) Michael Thomas (on behalf of the GAE group)
Tool Integration with Data and Computation Grid “Grid Wizard 2”
HUBbub 2013: Developing hub tools that submit HPC jobs Rob Campbell Purdue University Thursday, September 5, 2013.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
INFSO-RI JRA2 Test Management Tools Eva Takacs (4D SOFT) ETICS 2 Final Review Brussels - 11 May 2010.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 22 February 2006.
Building an European Research Community through Interoperable Workflow and Data Gabor Terstyanszky University of Westminster.
1 RIC 2009 Symbolic Nuclear Analysis Package - SNAP version 1.0: Features and Applications Chester Gingrich RES/DSA/CDB 3/12/09.
SoftUpdate New features and management technique.
Honolulu - Oct 31st, 2007 Using Glideins to Maximize Scientific Output 1 IEEE NSS 2007 Making Science in the Grid World - Using Glideins to Maximize Scientific.
HUBzero® Platform for Scientific Collaboration Copyright © 2012 HUBzero Foundation, LLC International Workshop on Science Gateways, ETH Zürich, June 3-5,
QA Process within OEM Services Ethan Chang QA Engineer OEM Service, Canonical
VisIt Project Overview
Operating System Concepts
Duncan MacMichael & Galen Deal CSS 534 – Autumn 2016
Using simulation workspaces to “submit” jobs and workflows
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Pipeline Execution Environment
Joseph JaJa, Mike Smorul, and Sangchul Song
Tools and Services Workshop Overview of Atmosphere
Spatial Analysis With Big Data
Recap: introduction to e-science
MaterialsHub - A hub for computational materials science and tools.
EIN 6133 Enterprise Engineering
NGS computation services: APIs and Parallel Jobs
PHP / MySQL Introduction
Introduction to Cloud Computing
XSEDE’s Campus Bridging Project
Polly Baker Division Director: Data, Mining, and Visualization
Collaborative Business Solutions
What’s New from Platform Computing
Module 01 ETICS Overview ETICS Online Tutorials
Lawson ProcessFlow Overview and Actual ProcessFlow Solutions
Chapter 7 –Implementation Issues
Building and running HPC apps in Windows Azure
Overview of Workflows: Why Use Them?
Gordon Erlebacher Florida State University
Frieda meets Pegasus-WMS
Presentation transcript:

Integrating Scientific Tools and Web Portals Kevin Chen chenk@tacc.utexas.edu

Overview What is DiaGrid? Supporting Science Tools Gromacsimum Interactive Parallelization Tool (IPT)

What Is DiaGrid ? R Java Data Science C++ To the users DiaGrid is… A HUBzero portal for collaboration and community building. Scientific Software-as-a-Service with easy access to a vast set of computing resources. A remotely accessible home for research. To the developers DiaGrid is… A federation of a vast set of computing resources. A pipeline for the whole development process. Managed deployment straight to users. A support platform for communicating directly with end users. Python Java Data Results R Science C++

The Hardware Large high-throughput and distributed network, available through HT Condor. Utilizes spare cycles from: Campus lab workstations Departmental desktop computers XSEDE Resources Community clusters at Purdue Coates, Rossmann, Hansen, & Carter Nearly 100 million jobs run to date!

Building Communities Users have access to a full inbox-style messaging system.

Supporting Science The true power of the HUBzero platform lies in transparently bridging the gap between the grid and the web.

Supporting Science DiaGrid applications execute within a VM. Imbedded Java applet/Html5 interfaces give users access from any web browser. No local installation of anything is required at user’s location.

Supporting Science Create Tool From creation to release, tool development has a full lifecycle managed by the DiaGrid site. Published version continues to live on site for users while next version is still in testing. Upload/Edit Sources Stage & Test Approve? Viewable to Devs Publicly Available Published!

Supporting Science DiaGrid.org The HUBzero team has created the “submit” shell command to abstract grid access for tool developers. Tools run a subprocess through “submit” to handle all their grid computation needs. Utilizes Pegasus engine for HT Condor on resources. Tool Session Tool Submit Pegasus HT Condor CPU CPU CPU CPU CPU

What is GROMACSIMUM ? GROMACSIMUM is a graphical user interface for popular molecular dynamics package, GROMACS. GROMACSIMUM’s combined accuracy and speed make possible long time molecular dynamics simulations. Seamlessly integrated with newly developed GUI interfaces, GROMACSIMUM provides comprehensive setup, simulation, analysis and job submission tools. With its highly visual, easy-to-use interface, GROMACSIMUM guides you through each stage of the MD simulation process; in guiding your project workflow, its user friendly environment directs you to a successful outcome. Users inexperienced in MD can work along prepared workflows, while experts may enjoy a significant relief from the tedium of typing and scripting.  

Easy-to-use, instantly interactive Newly incorporated workflow management system. A significant relief from tedium of typing and scripting Easy job submission mechanism. Dedicated HPC resources.  

Easy-to-use, instantly interactive

Easy-to-use, instantly interactive

Data analysis and decision making Plotting, editing, visual data mining and filtering to identify key interactions. Trajectory viewing and analysis. Free energy surfaces, Principal component, Clustering and Secondary structure analysis,. Seamless support for Xmgrace, VMD, PyMOL and other 3rd party software packages.

Usage: Overview

Interactive Parallelization Tool (IPT) 16

Interactive Parallelization Tool Interactive Parallelization Tool (IPT) is a semi-automatic tool that can be used by domain experts and students for transforming certain classes of existing applications into multiple parallel variants. The parallel programming paradigms that are currently supported by IPT are MPI,OpenMP, and CUDA. The supported base languages are C and C++. 

Interactive Parallelization Tool GUI to IPT Workspace on DiaGrid Hub showing the parallelization of the program named “circuit_serial.cpp”

Interactive Parallelization Tool

Looking to the Future… Any other future projects?

Questions? 21