PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.

Slides:



Advertisements
Similar presentations
PIONIER 2003, Poznan, , PROGRESS Grid Access Environment for SUN Computing Cluster Poznań Supercomputing and Networking Center Cezary Mazurek.
Advertisements

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Security Daniel Mallmann MWSG meeting Amsterdam December 2005.
Global Grid Access Cezary Mazurek, PSNC. Cezary Mazurek, PSNC, Enable access to global grid, Supercomputing 2003, Phoenix, AZ 2 Agenda Introduction PROGRESS.
PROGRESS: ICWS'2003 Web Services Communication within the PROGRESS Grid-Portal Environment Michał Kosiedowski.
Grid Programming Environment (GPE) Grid Summer School, July 28, 2004 Ralf Ratering Intel - Parallel and Distributed Solutions Division (PDSD)
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
Web Service Implementation Maitreya, Kishore, Jeff.
Enterprise Reporting with Reporting Services SQL Server 2005 Donald Farmer Group Program Manager Microsoft Corporation.
W w w. h p c - e u r o p a. o r g The HPC-Europa project and GridSphere Dawid Szejnfeld Poznan Supercomputing.
SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
National Computational Science National Center for Supercomputing Applications National Computational Science MyProxy: An Online Credential Repository.
GRAPPA Part of Active Notebook Science Portal project A “notebook” like GRAPPA consists of –Set of ordinary web pages, viewable from any browser –Editable.
Application Web Service Toolkit Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University July
CGW 2003 Institute of Computer Science AGH Proposal of Adaptation of Legacy C/C++ Software to Grid Services Bartosz Baliś, Marian Bubak, Michał Węgiel,
Integration of the Biological Databases into Grid-Portal Environments Michal Kosiedowski, Michal Malecki, Cezary Mazurek, Pawel Spychala, Marcin Wolski.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
PROGRESS – Computing Portal and Data Management in the Cluster of SUNs Michał Kosiedowski Sun HPC Consortium Heidelberg 2003.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
COMP3019 Coursework: Introduction to GridSAM Steve Crouch School of Electronics and Computer Science.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
© 2008 Open Grid Forum Independent Software Vendor (ISV) Remote Computing Primer Steven Newhouse.
GLOBAL GRID FORUM 10 Workflows in PROGRESS and GridLab environments Michał Kosiedowski.
Facilitating access to the scientific data service with the use of the Data Management System Cezary Mazurek
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Application portlets within the PROGRESS HPC Portal Michał Kosiedowski
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Interactive task invocation in the Virtual Laboratory M. Okoń, M. Lawenda, T. Rajtar, D. Stokłosa, D. Kaliszan, P. Mierzyński, N. Meyer, M. Stroiński 4.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
What is Triana?. GAPGAP Triana Distributed Work-flow Network Action Commands Workflow, e.g. BPEL4WS Triana Engine Triana Controlling Service (TCS) Triana.
TERENA 2003, May 21, Zagreb TERENA Networking Conference, 2003 MOBILE WORK ENVIRONMENT FOR GRID USERS. TESTBED Miroslaw Kupczyk Rafal.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
Terena conference, June 2004, Rhodes, Greece Norbert Meyer The effective integration of scientific instruments in the Grid.
Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking.
Application Software System Software.
CCCognos Connection RSReport Studio ASAnalysis Studio QSQuery Studio ESEvent Studio CSContent Store FWM Framework.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
SUPERCOMPUTING 2002, Baltimore, , SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
PEPC 2003, Geneva, , PROGRESS Computing Portal Poznań Supercomputing and Networking Center (PSNC) Poland Poland Cezary Mazurek.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
Application Web Service Toolkit Allow users to quickly add new applications GGF5 Edinburgh Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University.
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Workflow management tool for Earth science applications Ladislav Hluchy, Viet Tran Institute of Informatics.
Remote Api Tutorial How to call WS-PGRADE workflows from remote clients through the http protocol?
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
OGSA HPC cluster usecase for reference Model v.02
SuperComputing 2003 “The Great Academia / Industry Grid Debate” ?
Database System Concepts and Architecture
Data Bridge Solving diverse data access in scientific applications
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Creating and running applications on the NGS
MIK 2.1 DBNS - introduction to WS-PGRADE, 2013
Patrick Dreher Research Scientist & Associate Director
Knowledge Based Workflow Building Architecture
Production Manager Tools (New Architecture)
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski

PROGRESS: ICCS'2003 PROGRESS Duration: December 2001 – May 2003 (R&D) Budget: ~4,0 MEuro Project Partners –SUN Microsystems Poland –PSNC IBCh Poznań –Cyfronet AMM, Kraków –Technical University Łódź Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

PROGRESS: ICCS'2003 PROGRESS (2) Cluster of 80 processors Networked Storage of 1,3 TB Software: ORACLE, HPC Cluster Tools, Sun ONE, Sun Grid Engine

PROGRESS: ICCS'2003 PROGRESS - architecture

PROGRESS: ICCS'2003 PORTAL HPC RESOURCES GRID MANAGEMENT SYSTEM GRID SERVICE PROVIDER 4-tier new grid-portal environment Grid-Portal Environment PORTAL HPC RESOURCES GRID MANAGEMENT SYSTEM 3-tier classical grid-portal environment

PROGRESS: ICCS'2003 Grid Service Provider the use of the grid resources most comfortable to the end users allows for easy building of numerous portals and other user interfaces; users can switch from one to another and use the same GSP services various thematic scientific web portals sharing the same grid resources possibility of providing all clients (user interfaces) with computing resources belonging to two or more different grids

PROGRESS: ICCS'2003 Grid Service Provider (2) Necessary services to provide: –job submission service managing the creation of user jobs, their submission to the grid and the monitoring of their execution (typically through reverse reporting performed by the Grid Management System about events connected with the execution of jobs) –application management service storing information about applications available for running in the grid assisting application developers in adding new applications to the application factory –provider management service keeping up‑to‑date information on the services available within the provider

PROGRESS: ICCS'2003 GSP within PROGRESS Content Provider Webservice Session Bean Entity Beans

PROGRESS: ICCS'2003 Job submission service computing job building, submitting them to the grid for execution and viewing the results job description is prepared using the XRSL language and transferred to the grid resource broker for the execution of the job grid resource broker reverse reports on grid events connected with the job „ workflowed ” jobs: sequences and parallels

PROGRESS: ICCS'2003 Application management srv. application factory management application descriptor contains a reference to the application executable: a reference to a file stored in the DMS or a path to a binary on grid computing server filesystems also included in the application descriptor: available (required or optional) arguments, required environment variables and required input and output files applications in PROGRESS may be unconfigured or configured: one executable -> multiple configured applications virtual applications

PROGRESS: ICCS'2003 Grid job management Application addition Application configuration Application configuration Job submission Job submission Job execution Job completion Abstract state Ready state Built state Active state Ghost state

PROGRESS: ICCS'2003 Provider management service enables keeping up-to-date information on services available in the grid service provider a service descriptor contains information on the Web Service interface: URL at which the service is available, the service namespace reference (URN) and the service WSDL reference services may have multiple instances: informational services

PROGRESS: ICCS'2003 Informational services examples of instance enabled services intended for use by web portals PROGRESS example: short news service other: document directory, discussion forum (under development)

PROGRESS: ICCS'2003 Other PROGRESS modules user interfaces –web portal: grid job management, application management, provider management, short news reading and editing, DMS file system management –migrating desktop: grid job management and DMS file system management grid resource broker: enables the execution of PROGRESS grid jobs in a cluster of three Sun computers; uses XRSL language for grid job descriptions data management system: storing the input and output files, metadata, multiple media data containers

PROGRESS: ICCS'2003 Authorization within GSP Portal GRID SERVICE PROVIDER Identity server RAD based authorization system Logon Authentication Request Method invocation Token validation Resource access authorization

PROGRESS: ICCS'2003 PROGRESS HPC Portal

PROGRESS: ICCS'2003 SC2002 Demo

PROGRESS: ICCS'2003 PROGRESS Future Project: Research & Development finished; the test and deployment phase now We will continue the R&D on the tools, including the Grid Service Provider –cooperation with multiple grid brokers/grid management systems (e.g. the GRIDLAB one) –additional funcionality (e.g. OGSA interface, cooperation with virtual laboratories)

PROGRESS: ICCS'2003 PROGRESS