Grid and SCIEnce Semeniouk Igor LLR, Ecole Polytechnique Atelier de projet I3 SCIEnce.

Slides:



Advertisements
Similar presentations
CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.
Advertisements

CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
INFSO-RI Enabling Grids for E-sciencE EGEE and gLite Slides by: Erwin Laure EGEE Deputy Middleware Manager.
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
Generic MPI Job Submission by the P-GRADE Grid Portal Zoltán Farkas MTA SZTAKI.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
E-science grid facility for Europe and Latin America gLite Overview Vanessa Hamar Universidad de Los Andes.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Workload Management Massimo Sgaravatto INFN Padova.
Globus 4 Guy Warner NeSC Training.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.
CERN, BalticGrid Project Rolandas Naujikas [rolandas nawyeekas] CERN IT/GD Vilnius University Lithuania.
Job Submission Condor, Globus, Java CoG Kit Young Suk Moon.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
OGF 25/EGEE User Forum Catania, March 2 nd 2009 Meta Scheduling and Advanced Application Support on the Spanish NGI Enol Fernández del Castillo (IFCA-CSIC)
Computational grids and grids projects DSS,
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
GRAM5 - A sustainable, scalable, reliable GRAM service Stuart Martin - UC/ANL.
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
L ABORATÓRIO DE INSTRUMENTAÇÃO EM FÍSICA EXPERIMENTAL DE PARTÍCULAS Enabling Grids for E-sciencE Grid Computing: Running your Jobs around the World.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories Wolfgang Ziegler, Oliver Wäldrich Fraunhofer Institute SCAI.
Tools for collaboration How to share your duck tales…
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
The Grid the united computing power Jian He Amit Karnik.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
13th EELA Tutorial, La Antigua, 18-19, October E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.
II EGEE conference Den Haag November, ROC-CIC status in Italy
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Bob Jones EGEE Technical Director
Grid Computing: Running your Jobs around the World
Peter Kacsuk – Sipos Gergely MTA SZTAKI
Grid2Win: Porting of gLite middleware to Windows XP platform
The GENIUS portal and the GILDA t-Infrastructure
Status of Grids for HEP and HENP
gLite The EGEE Middleware Distribution
Installation/Configuration
Presentation transcript:

Grid and SCIEnce Semeniouk Igor LLR, Ecole Polytechnique Atelier de projet I3 SCIEnce

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR1 Why Grid Early Grid pioneers found that too hard to keep track of authentication data (ID/password) across institutions too hard to monitor system and application status across institutions too easy to leave "dangling" resources lying around, reducing system robustness too many ways to submit jobs too many ways to store, access, and ultimately manage distributed data.

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR2 Grid Architecture in a Nutshell

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR3 Middleware and GRIDS Middleware –Globus Toolkit, Xgrid, Sun Grid, … –CORBA, Condor, RPC, … –User Identification Certificate, password, Kerberos, … GRIDs –LCG, EGEE, NorthGrid, …

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR4 Globus Toolkit GT-4 Certificates for User and Services Tools for job submission Web Services Data moving and data location Service discovery Monitoring VO Support Resource Broker Data replication UI CA CE IS

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR5 Globus Toolkit UI CA CE SI wn SE

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR6 Distributed Programming Frameworks NetSolve/GridSolve - NetSolve/GridSolve is an RPC- based library for executing solver code on Grid resources.NetSolve/GridSolve Ninf-G - Ninf-G allows existing programming libraries to be used in a distributed fashion on a Grid using the RPC framework.Ninf-G MPICH-G2 - MPICH-G2 is a Grid-enabled implementation of the popular MPI (Message Passing Interface) frameworkMPICH-G2 Condor-G, DAGman - Condor-G and DAGman can be used to execute complex workflows (consisting of multiple independent or related jobs) using Grid compute resources via GRAM or Condor.Condor-G, DAGman

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR7 Globus Evolution Globus Toolkits Web Services WS-Resources Framework ( Grid via Web )

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR8 LCG and gLite software UI wn SE wn SE wn SE UI RB BDII MON FTS VOMS

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR9 EGEE Monitoring

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR10 EGEE and LCG components Virtual Organization VO Support VO Software Installation Users Role VO Services VO Specific Grid Services Monitoring Application Information LCG & gLite Application Information Resource Broker Monitoring Data replication VO Support Globus Toolkit Security, Job Submission I/O Handling Information Services Monitoring and accounting WEB Services Local Farm LSF,PBS,CONDOR

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR11 SCIE GRA1 Symbolic Computing on the Grid JRA1.1 –Access to Symbolic Grid Services –Service Discovery JRA1.2 –Access/Provide Grid Services –Security polices JRA1.3 –UI for SymGrid –Orchestration of Grid Components JRA1.4 –Adaptive scheduler –Dynamic resources negotiator JRA1.5 –Compilation use cases –Templates for common tasks JRA1.6 –Symbolic Grid Applications JRA1.7 –Evaluation

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR12 SCIE and EGEE JRA1.1 –Access to Symbolic Grid Services - Web Services –Service Discovery - gLite Services discovery, Information Index JRA1.2 –Access/Provide Grid Services - WS-Resources Framework –Security polices - Globus Security Framefork JRA1.3 –UI for SymGrid - WSRF –Orchestration of Grid Components - MPICH-G, CONDOR-G JRA1.4 –Adaptive scheduler - RB –Dynamic resources negotiator - CONDOR-G

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR13 Infrastructure EGEE / VO EGEE (Avril 2004) –Financé par lUE (32M) –Deux ans EGEE-II (Avril 2006) –Proposé à lUE (~30M) –Transition en cours –Deux ans. JRA: Recherche commune SA: Services SA1: Exploitation, support et management de la grille SA2: Approvisionnement ressources réseau SA3: Intégration du middleware, Test et Certification NA: Application Réseau NA1: Management NA2: Dissémination NA3: Formation NA4: Applications et support NA5: Politique et coopération internationale JRA1: Ingénierie logicielle JRA2: Qualité JRA3: Sécurité JRA4: Développement réseau A spect of Organisation in avarege

10 Jan 2007Atelier de projet I3 SCIEnce Semeniouk Igor, LLR14 Projet EGEE Perspectives EGO: European Grid Organization ?