The Interactive European Grid Project Paul Heinzlreiter GUP, University Linz CoreGrid Summer School, Budapest,
2 Outline General Project Overview Research Activities Infrastructure Applications
CoreGrid Summer School, Budapest, i2g Partners
CoreGrid Summer School, Budapest, i2g History Precursor: Crossgrid Project First Project to deliver Interactivity for Grids i2g improves: Key Components Integration Adaptation to new Middleware New applications
CoreGrid Summer School, Budapest, i2g Aims Timeframe: May 2006 – April 2008 Interactivity User-Friendliness MPI Support Support of Demanding Applications Integration of all Components Provision of a Good User Experience Interoperability (with EGEE / gLite)
CoreGrid Summer School, Budapest, i2g Joint Research Activity Interactivity & Visualization Resource Broker Interactive Connections Video Streaming CrossBroker Reduced Job Startup Times Graphical User Interface Job Control Data Handling Job Output MPI Support Intra-Site and Inter-Site Active Security
CoreGrid Summer School, Budapest, (i2)glogin Worker node Gatekeeper on the Grid Client glogin Point of Contact job submit glogin fork socket glogin fork inherited socket return return Problem: GASS cache interactive bidirectional connection traffic forwarding
CoreGrid Summer School, Budapest, GVid vtk App MP4 Encoder Event Decoder TCP Transport Socket Transport File Transport Pipe Transport remoteGlut Application GVid SDL Outputclient MP4 Decoder Event Encoder TCP Transport Socket Transport File Transport Pipe Transport Grid UI glogin GSS secured $ grid-proxy-init $ glogin -x –C altix1
CoreGrid Summer School, Budapest, GUI – Migrating Desktop User-Friendly Platform Independent Java Running Sequential & MPI Jobs Roaming Access Server interfaces with the UI Data Management Easily Extendable Plugin Mechnism for new Applications Extension for Interactive Remote Visualization
CoreGrid Summer School, Budapest, GUI – Migrating Desktop
CoreGrid Summer School, Budapest, Scheduling Agent Resource Searcher Application Launcher Condor-GDAGMan CE WN LCG CE WN gLite Migrating Desktop Information Index Replica Manager CrossBroker Interactive Job Broker Automatic Job Management for Parallel Applications Resource Searching Job Conditioning Launching, Monitoring, Retry Result Retrieval Workflows, Interactive & Batch Jobs, MPI Support JDL Extensions Compatible Best Effort Approach for Failures / Problems Improved Job Startup Time
CoreGrid Summer School, Budapest, MPI Support OpenMPI Joint Effort / OSS Best of FT-MPI, LA-MPI, LAM-MPI, PACX-MPI PACX-MPI Inter-Cluster / Site Supports Vendor-MPI MPI-Start Shell Scripts Abstraction Layer WMS / Schedulers and MPI-Implementations Flexibility (relocateable Shellscripts) PACX- MPI LAM/ MPI LA- MPI FT- MPI PACX-MPIMPI-START
CoreGrid Summer School, Budapest, Active Security Security measures for interactive framework Active Security Tools: Track Grid Interactions Respond to Unwanted Security Events Extended Security Monitoring & Tracking Coordination among Security Tools & Sites Architecture Divided in 2 Layers Monitoring & Control Layer Security Monitoring & Control Engine Analysis Layer Alert Analysis Alert Correlation Engine R-GMA Communication Layer
CoreGrid Summer School, Budapest, Integration Most Advanced: Fusion Application – Integrates Components from JRA MPI Support Crossbroker Visualization Videostreaming GUI Support Interactivity
CoreGrid Summer School, Budapest, Interactivity & Visualization i2glogin GVid CrossBroker Migrating Desktop Full Integration + MPI Support
CoreGrid Summer School, Budapest, Integration: Fusion Application Application is integrated in Migrating Desktop Communication Channel to MPI Master over the Roaming Access Server Communication MD – RAS can also go over TCP/IP
CoreGrid Summer School, Budapest, The i2g Infrastructure 12 Sites 430 CPU Cores 21 TB of Storage Multiple Architectures i2g Middleware Components available for Applications
CoreGrid Summer School, Budapest, The i2g Infrastructure (Production)
CoreGrid Summer School, Budapest, i2g Applications Plasma Fusion Simulation & Visualization First Images of the Universe Brain Diagnostic Control of Pollution …
CoreGrid Summer School, Budapest, Interactive Plasma Fusion Simulation Most Advanced Application MPI-Parallel Simulation Remote Visualization Full Interaction (GUI, Mouse) GUI Integration Distinguished as best Application Demo at OGF in Manchester
CoreGrid Summer School, Budapest, Fusion Application in MD
CoreGrid Summer School, Budapest, First Images of the Universe Simulation of the Measurements of the Planck Satellite to be launched in Model Validation Radiation Values should have Gaussian Distribution If not, Model Error Calculating Autocorrelations: Sky gets divided Simulations, 5 Minutes each Output gets visualized
CoreGrid Summer School, Budapest, Brain Diagnostic Developing and Testing new Diagnostic Methods for Brain Images Requires large Datasets DICOM Images Corresponding Brain Maps Final Diagnostic Map E.g. Perfusion Studies (Stroke Diagnosis) Visualization and Annotation
CoreGrid Summer School, Budapest, Control of Pollution Developing of a Model Suite to analyze the Evolution of Pollution Clouds. Compute Intensive Models Interaction enables steering of Simulation Parameters Impact Analysis MPI-Parallel Simulation
CoreGrid Summer School, Budapest, i2g Offer Support for external developers and users applications The Interactive European Grid project helps application developers in adapting their applications to work in a Grid environment as well as in parallelization of these applications. If you would like us to consider running your application in the int.eu.grid infrastructure or creating a new VO, please contact: Isabel Campos IFCA-CSIC*, Santander, Spain iscampos AT ifca.unican.es Grid infrastructure The Project helps to integrate new clusters to the int.eu.grid infrastructure as well as to establish agreements between research communities and infrastructure providers. If you would like to join the int.eu.grid infrastructure with your cluster, please contact: Project support team i2g.support AT lip.pt Education Tutorials: for Grid beginners, Grid site administrators, application developers; some tutorials on MPI and other Grid specific. If you would like to join the tutorial organized at our site or to organize our tutorial at your facilities, please contact: Celso Martínez Rivero IFCA-CSIC, Santander, Spain mrivero AT ifca.unican.es Seminars for groups of interested people or consultancy. If you need a consultancy or you are interested in taking part in a seminar on Grid technology, please contact: Project Office Santander, Spain inteugrid-office AT ifca.unican.es specifying the subject, product or problem. Disseminative materials General information about the Project – brochures, posters, etc. General int.eu.grid presentation. If you are interested in receiving them, please contact: Robert Pajak CYFRONET*, Kraków, Poland r.pajak AT cyfronet.krakow.pl
CoreGrid Summer School, Budapest, New Applications? Description of interactive tools Use our infrastructure for your application Online user questionaire grid.eu/how_to_use_grid/user_questionnaire/ grid.eu/how_to_use_grid/user_questionnaire/ User Data form Our offer (infrastructure, tools, …)
CoreGrid Summer School, Budapest, i2g Information & Contact Brochures, Posters, Information... Contact Persons: (New) Applications: Isabel Campos; (New) Infrastructure: Tutorials: Celso Martinez Rivero; Seminars: Project Office;