The Interactive European Grid Project Paul Heinzlreiter GUP, University Linz CoreGrid Summer School, Budapest, 7.9.2007.

Slides:



Advertisements
Similar presentations
Chapter 14 Intranets & Extranets. Awad –Electronic Commerce 1/e © 2002 Prentice Hall 2 OBJECTIVES Introduction Technical Infrastructure Planning an Intranet.
Advertisements

Distributed Systems Architectures
1 Towards an Open Service Framework for Cloud-based Knowledge Discovery Domenico Talia ICAR-CNR & UNIVERSITY OF CALABRIA, Italy Cloud.
CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
Visualization in Grid Environment Dieter Kranzlmüller GUP, Joh. Kepler Univ. Linz, Austria.
Enhanced Middleware Architecture for the Remote Instrumentation e-Infrastructure OGF28 Alexey Cheptsov High Performace Computing Center.
Experiences with GridWay on CRO NGI infrastructure / EGEE User Forum 2009 Experiences with GridWay on CRO NGI infrastructure Emir Imamagic, Srce EGEE User.
Challenges for Interactive Grids a point of view from Int.Eu.Grid project Remote Instrumentation Services in Grid Environment RISGE BoF Manchester 8th.
1 CEOS WGISS Meeting, May 8-12, 2006, Budapest MTA SZTAKI Computer and Automation Research Institute Hungarian Academy of Sciences
Overview of China Spatial Information Gird (SIG) Research Works Presentation to WGISS-16 Chiang Mai, Thailand September 15, 2003 Pro. Liu Dingsheng, Dr.
Designing Services for Grid-based Knowledge Discovery A. Congiusta, A. Pugliese, Domenico Talia, P. Trunfio DEIS University of Calabria ITALY
1 P-GRADE Portal and GEMLCA Legacy Code Architecture Peter Kacsuk MTA SZTAKI
Grid Checkpoining Architecture Radosław Januszewski CoreGrid Summer School 2007.
Jeopardy Q 1 Q 6 Q 11 Q 16 Q 21 Q 2 Q 7 Q 12 Q 17 Q 22 Q 3 Q 8 Q 13
Jeopardy Q 1 Q 6 Q 11 Q 16 Q 21 Q 2 Q 7 Q 12 Q 17 Q 22 Q 3 Q 8 Q 13
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
|epcc| NeSC Workshop Open Issues in Grid Scheduling Ali Anjomshoaa EPCC, University of Edinburgh Tuesday, 21 October 2003 Overview of a Grid Scheduling.
Copyright 2006 Digital Enterprise Research Institute. All rights reserved. MarcOnt Initiative Tools for collaborative ontology development.
NGS computation services: API's,
The National Grid Service and OGSA-DAI Mike Mineter
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
Introduction Lesson 1 Microsoft Office 2010 and the Internet
Practical Mechanisms for Managing Parallel and Interactive Jobs on Grid Environments Enol Fernández UAB.
Chapter 1 Data Communications and NM Overview 1-1 Chapter 1
ABC Technology Project
INTRODUCTION TO SIMULATION WITH OMNET++ José Daniel García Sánchez ARCOS Group – University Carlos III of Madrid.
Chapter 9: The Client/Server Database Environment
Global Analysis and Distributed Systems Software Architecture Lecture # 5-6.
GG Consulting, LLC I-SUITE. Source: TEA SHARS Frequently asked questions 2.
1 Project overview Presented at the Euforia KoM January, 2008 Marcin Płóciennik, PSNC, Poland.
EGEE 08, Istanbul, September 25th, Support for experimental science communities Istanbul, September 25th, 2008 Norbert Meyer, Marcin Płóciennik.
25 seconds left…...
EGC 2005, CrossGrid technical achievements, Amsterdam, Feb. 16th, 2005 WP2-3 New Generation Environment for Grid Interactive MPI Applications M igrating.
INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
We will resume in: 25 Minutes.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Int.eu.grid: A grid infrastructure for interactive applications Gonçalo Borges LIP on behalf of Int.EU.Grid Collaboration INGRID’08, Italy, April 2008.
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
EUFORIA FP7-INFRASTRUCTURES , Grant GridKa School 2008 Interactivity on the Grid Marcus Hardt SCC (The insitute formerly known as
OGF 25/EGEE User Forum Catania, March 2 nd 2009 Meta Scheduling and Advanced Application Support on the Spanish NGI Enol Fernández del Castillo (IFCA-CSIC)
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
Visualisation of Plasma in Fusion Devices Interactive European Grid 30 th May 2007.
DORII Joint Research Activities DORII Joint Research Activities Status and Progress 6 th All-Hands-Meeting (AHM) Alexey Cheptsov on.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
Migrating Desktop Marcin Płóciennik Marcin Płóciennik Kick-off Meeting, Santander, Graphical.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
BalticGrid-II Project The Second BalticGrid-II All-Hands Meeting, Riga, May, Joint Research Activity Enhanced Application Services on Sustainable.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
Kraków Kick-off meeting Migrating Desktop General concept Intuitive Grid-user’s work environment independent of a hardware.
Migrating Desktop Bartek Palak Bartek Palak Poznan Supercomputing and Networking Center The Graphical Framework.
Interactive European Grid Environment for HEP Application with Real Time Requirements Lukasz Dutka 1, Krzysztof Korcyl 2, Krzysztof Zielinski 1,3, Jacek.
Int.eu.grid: Experiences with Condor to Run Interactive and Parallel Applications on the Grid Elisa Heymann Department of Computer Architecture and Operating.
A step towards interoperability (between Int.EU.Grid and EGEE Grid infrastructures) Gonçalo Borges, Jorge Gomes LIP on behalf of Int.EU.Grid Collaboration.
EUFORIA FP7-INFRASTRUCTURES , Grant Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center.
Open Grid Services for Earth Observation Pedro Gonçalves.
Support to MPI and interactivity on gLite infrastructures EGEE’07 Budapest, 4th Oct 2007.
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poznan, Poland EGEE’07, Budapest, Oct.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poland EGEE’08 Conference, Istanbul, 24 Sep.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
User requirements for interactive controlling and monitoring of applications in grid environments Dr. Isabel Campos Plasencia Institute of Physics of Cantabria.
Interactive Videostreaming Visualization on Clusters and Grids
Support to MPI, Schedulers and Complex Workflows
I2G CrossBroker Enol Fernández UAB
PROCESS - H2020 Project Work Package WP6 JRA3
Presentation transcript:

The Interactive European Grid Project Paul Heinzlreiter GUP, University Linz CoreGrid Summer School, Budapest,

2 Outline General Project Overview Research Activities Infrastructure Applications

CoreGrid Summer School, Budapest, i2g Partners

CoreGrid Summer School, Budapest, i2g History Precursor: Crossgrid Project First Project to deliver Interactivity for Grids i2g improves: Key Components Integration Adaptation to new Middleware New applications

CoreGrid Summer School, Budapest, i2g Aims Timeframe: May 2006 – April 2008 Interactivity User-Friendliness MPI Support Support of Demanding Applications Integration of all Components Provision of a Good User Experience Interoperability (with EGEE / gLite)

CoreGrid Summer School, Budapest, i2g Joint Research Activity Interactivity & Visualization Resource Broker Interactive Connections Video Streaming CrossBroker Reduced Job Startup Times Graphical User Interface Job Control Data Handling Job Output MPI Support Intra-Site and Inter-Site Active Security

CoreGrid Summer School, Budapest, (i2)glogin Worker node Gatekeeper on the Grid Client glogin Point of Contact job submit glogin fork socket glogin fork inherited socket return return Problem: GASS cache interactive bidirectional connection traffic forwarding

CoreGrid Summer School, Budapest, GVid vtk App MP4 Encoder Event Decoder TCP Transport Socket Transport File Transport Pipe Transport remoteGlut Application GVid SDL Outputclient MP4 Decoder Event Encoder TCP Transport Socket Transport File Transport Pipe Transport Grid UI glogin GSS secured $ grid-proxy-init $ glogin -x –C altix1

CoreGrid Summer School, Budapest, GUI – Migrating Desktop User-Friendly Platform Independent Java Running Sequential & MPI Jobs Roaming Access Server interfaces with the UI Data Management Easily Extendable Plugin Mechnism for new Applications Extension for Interactive Remote Visualization

CoreGrid Summer School, Budapest, GUI – Migrating Desktop

CoreGrid Summer School, Budapest, Scheduling Agent Resource Searcher Application Launcher Condor-GDAGMan CE WN LCG CE WN gLite Migrating Desktop Information Index Replica Manager CrossBroker Interactive Job Broker Automatic Job Management for Parallel Applications Resource Searching Job Conditioning Launching, Monitoring, Retry Result Retrieval Workflows, Interactive & Batch Jobs, MPI Support JDL Extensions Compatible Best Effort Approach for Failures / Problems Improved Job Startup Time

CoreGrid Summer School, Budapest, MPI Support OpenMPI Joint Effort / OSS Best of FT-MPI, LA-MPI, LAM-MPI, PACX-MPI PACX-MPI Inter-Cluster / Site Supports Vendor-MPI MPI-Start Shell Scripts Abstraction Layer WMS / Schedulers and MPI-Implementations Flexibility (relocateable Shellscripts) PACX- MPI LAM/ MPI LA- MPI FT- MPI PACX-MPIMPI-START

CoreGrid Summer School, Budapest, Active Security Security measures for interactive framework Active Security Tools: Track Grid Interactions Respond to Unwanted Security Events Extended Security Monitoring & Tracking Coordination among Security Tools & Sites Architecture Divided in 2 Layers Monitoring & Control Layer Security Monitoring & Control Engine Analysis Layer Alert Analysis Alert Correlation Engine R-GMA Communication Layer

CoreGrid Summer School, Budapest, Integration Most Advanced: Fusion Application – Integrates Components from JRA MPI Support Crossbroker Visualization Videostreaming GUI Support Interactivity

CoreGrid Summer School, Budapest, Interactivity & Visualization i2glogin GVid CrossBroker Migrating Desktop Full Integration + MPI Support

CoreGrid Summer School, Budapest, Integration: Fusion Application Application is integrated in Migrating Desktop Communication Channel to MPI Master over the Roaming Access Server Communication MD – RAS can also go over TCP/IP

CoreGrid Summer School, Budapest, The i2g Infrastructure 12 Sites 430 CPU Cores 21 TB of Storage Multiple Architectures i2g Middleware Components available for Applications

CoreGrid Summer School, Budapest, The i2g Infrastructure (Production)

CoreGrid Summer School, Budapest, i2g Applications Plasma Fusion Simulation & Visualization First Images of the Universe Brain Diagnostic Control of Pollution …

CoreGrid Summer School, Budapest, Interactive Plasma Fusion Simulation Most Advanced Application MPI-Parallel Simulation Remote Visualization Full Interaction (GUI, Mouse) GUI Integration Distinguished as best Application Demo at OGF in Manchester

CoreGrid Summer School, Budapest, Fusion Application in MD

CoreGrid Summer School, Budapest, First Images of the Universe Simulation of the Measurements of the Planck Satellite to be launched in Model Validation Radiation Values should have Gaussian Distribution If not, Model Error Calculating Autocorrelations: Sky gets divided Simulations, 5 Minutes each Output gets visualized

CoreGrid Summer School, Budapest, Brain Diagnostic Developing and Testing new Diagnostic Methods for Brain Images Requires large Datasets DICOM Images Corresponding Brain Maps Final Diagnostic Map E.g. Perfusion Studies (Stroke Diagnosis) Visualization and Annotation

CoreGrid Summer School, Budapest, Control of Pollution Developing of a Model Suite to analyze the Evolution of Pollution Clouds. Compute Intensive Models Interaction enables steering of Simulation Parameters Impact Analysis MPI-Parallel Simulation

CoreGrid Summer School, Budapest, i2g Offer Support for external developers and users applications The Interactive European Grid project helps application developers in adapting their applications to work in a Grid environment as well as in parallelization of these applications. If you would like us to consider running your application in the int.eu.grid infrastructure or creating a new VO, please contact: Isabel Campos IFCA-CSIC*, Santander, Spain iscampos AT ifca.unican.es Grid infrastructure The Project helps to integrate new clusters to the int.eu.grid infrastructure as well as to establish agreements between research communities and infrastructure providers. If you would like to join the int.eu.grid infrastructure with your cluster, please contact: Project support team i2g.support AT lip.pt Education Tutorials: for Grid beginners, Grid site administrators, application developers; some tutorials on MPI and other Grid specific. If you would like to join the tutorial organized at our site or to organize our tutorial at your facilities, please contact: Celso Martínez Rivero IFCA-CSIC, Santander, Spain mrivero AT ifca.unican.es Seminars for groups of interested people or consultancy. If you need a consultancy or you are interested in taking part in a seminar on Grid technology, please contact: Project Office Santander, Spain inteugrid-office AT ifca.unican.es specifying the subject, product or problem. Disseminative materials General information about the Project – brochures, posters, etc. General int.eu.grid presentation. If you are interested in receiving them, please contact: Robert Pajak CYFRONET*, Kraków, Poland r.pajak AT cyfronet.krakow.pl

CoreGrid Summer School, Budapest, New Applications? Description of interactive tools Use our infrastructure for your application Online user questionaire grid.eu/how_to_use_grid/user_questionnaire/ grid.eu/how_to_use_grid/user_questionnaire/ User Data form Our offer (infrastructure, tools, …)

CoreGrid Summer School, Budapest, i2g Information & Contact Brochures, Posters, Information... Contact Persons: (New) Applications: Isabel Campos; (New) Infrastructure: Tutorials: Celso Martinez Rivero; Seminars: Project Office;