CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Advertisements

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
JSAGA2 Overview job desc. gLite plug-ins Globus plug-ins JSAGA hidemiddlewareheterogeneity (e.g. gLite, Globus, Unicore) JDLRSL.
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
CNES intranet Grid prototype based on gLite Joel COURQUET - Project Manager CS SI DESIGNER, INTEGRATOR & OPERATOR OF MISSION CRITICALSYSTEMS.
1 GRID Workshop – Toulouse IAS – October 20th Ground segment & products Department Globus TK4 experiment for image data processing : security architecture,
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
INFSO-RI Enabling Grids for E-sciencE Comparison of LCG-2 and gLite Author E.Slabospitskaya Location IHEP.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Computational grids and grids projects DSS,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
FP6−2004−Infrastructures−6-SSA IPv6 and Grid Middleware: the EUChinaGRID experience Gabriella Paolini – GARR Valentino.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Grid2Win: Porting of gLite middleware to.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
SAMPLE IMAGE gLite on the Market – Why and How ir Works 4 th EGEE User Forum Thursday, 05 March 2009 Le Ciminiere, Catania, Sicily, Italy Gaël Youinou.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
User Interface UI TP: UI User Interface installation & configuration.
The Institute of High Energy of Physics, Chinese Academy of Sciences Sharing LCG files across different platforms Cheng Yaodong, Wang Lu, Liu Aigui, Chen.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CNES GRID EXPERIENCES AND PLANS FOR SPACE.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Mario Reale – GARR NetJobs: Network Monitoring Using Grid Jobs.
INFSOM-RI ETICS: E-infrastructure for Testing, Integration and Configuration of Software Alberto Di Meglio Project Manager.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.
II EGEE conference Den Haag November, ROC-CIC status in Italy
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
JRA1 Middleware re-engineering
Gri2Win: Porting gLite to run under Windows XP Platform
Status & Strategy for gLite multi-platform Support
DESIGNER, INTEGRATOR & OPERATOR OF MISSION CRITICALSYSTEMS
Andreas Unterkircher CERN Grid Deployment
Comparison of LCG-2 and gLite v1.0
Brief overview on GridICE and Ticketing System
Grid2Win: Porting of gLite middleware to Windows XP platform
Testbed Software Test Plan Status
Short update on the latest gLite status
Gri2Win: Porting gLite to run under Windows XP Platform
Installation/Configuration
Presentation transcript:

CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May

2 Activities achieved in 2005 (1/3) ■ Specific security requirement analysis  Derived from CNES high level security requirements  Applicable to a CNES designed system defined on a distributed architecture allowing users from different organizations : to work according to a collaborative schema to share resources.  Has delivered a “security requirement document” applicable for CNES-like organizations (with restricted accesses) :  Needs issued from « Virtual Organization » : –Protection of their resources (user data and software), –Availability of the grid infrastructure hosting their resources (for user request processing).  Needs issued from providers of grid resources : –Grid resource under full control of local administrators, –Security of resources which are not provided for grids => need to isolate these resources regarding grid ones.

CEOS WGISS-21 – Budapest – 2006, 8-12 May 3 Activities achieved in 2005 (2/3) ■Chistera-Grid deployment over Globus TK4  Chistera application has been “gridified” by :  splitting input images,  applying Chistera processing on each worker nodes,  gathering resulting image and assembly the final product.  Chistera-Grid experiments - monitoring using :  GRAM commands  Web Services (WSRF).  Based on Chistera deployment :  Experiment Globus TK4 across a firewall and consequences on performances.  Analyze traffic characteristics for Globus TK4

CEOS WGISS-21 – Budapest – 2006, 8-12 May 4 A Chistera processing demonstration (3/3) CHISTERA Processing Synoptic of High Resolution Processing High resolution product Intermediate product ■Integrated into the Spot 5 user ground segment

CEOS WGISS-21 – Budapest – 2006, 8-12 May 5 Activities planned in 2006 ■CNES decided to be involved in the EGEE II project (April 2006 – March 2008) as a CERN partner. ■Objectives in 2006 :  Explore and experiment the Grid technology implemented in EGEE (gLite middleware and high level services),  For that :  CNES is setting up a gLite infrastructure as a local grid in the computer centre in order to deploy experiments,  CNES shall demonstrate that this technology can provide a reliable and secure computing infrastructure for data processing (in conformance with the objectives of EGEE II project).  Re-use this technology in data processing centres with huge requirements in term of CPU load and storage. The GAIA astronomy mission should be a precursor for requirement analysis and selection of high level services (job submission, monitoring, data management).

CEOS WGISS-21 – Budapest – 2006, 8-12 May 6 Test bed configuration : a gLite “local” grid at Cnes computer centre Glite1 Glite2 Glite3 Glite4 Glite5 Glite6 ■Machine « Glite 1 »  VOMS (VO Management System)  UI (User Interface)  RGMA Server (Relational Grid Monitoring Architecture) ■Machine « Glite 2 »  WMS (Worload Management System)  LB (Logging & Bookkeeping) ■Machine « Glite 3 »  CE (Computing Element)  SC (Service Catalog)  SRM (Storage Resource Manager) + DPM (Disk Pool Manager) ■Machine « Glite 4 »  1 WN (Worker Node) ■Machine « Glite 5 »  WN ■Machine « Glite 6 »  WN

CEOS WGISS-21 – Budapest – 2006, 8-12 May 7 Use cases identification ■Use Case 1 : demonstrate that it is possible to expand a local grid based on gLite technology with heterogeneous worker nodes in case of strong CPU load. ■Use Case 2 : demonstrate the reliability and robustness of some high level services which can be useful in our data processing centres.  Job monitoring services and data management services should be examined at first and tested through experiment deployments,  Security management in EGEE (VOMS tools) should be examined with regard to our security requirement document. ■Use Case 3 : analyse the opportunity for CNES to expand a local grid with external partners (case of Gaia partners which could be involved in experimentation).

CEOS WGISS-21 – Budapest – 2006, 8-12 May 8 Tasks planned in 2006/2007 (1/2) ■Task 1 : setup g-Lite components (1.5) and some grid services according to the GAIA data processing requirements (g-Lite WMS, R-GMA, …) on a very limited configuration based on recycled PC (Scientific Linux). Cnes will deliver feedbacks on setting up, installation guide and user support to the EGEE II project. ■Task 2 : analyse the security model of g-Lite and compliance with the very strict security rules required by Cnes. Cnes will deliver its security requirement document and a report on security analysis. ■Task 3 : assess the compliance of g-Lite with heterogeneous worker nodes. In this case, Cnes will prove that the experimental grid can be extended to cluster of PC (under Linux Red Hat ES 4 and Torque resource manager). Cnes will deliver a report on this experiment – cause gLite today is only certified for Scientific Linux OS.

CEOS WGISS-21 – Budapest – 2006, 8-12 May 9 Tasks planned in 2006/2007 (2/2) ■Task 4 : assess some hight level services by deploying on the experimental grid, the Chistera application which has been gridified over Globus TK4. Cnes will deliver experience feedbacks on performance measurement, functional interests, reliability and efforts to translate this application over gLite (1.5). ■Task 5 : experiment gLite UI (in DMZ) to submit test jobs over EGEEII grid – the context has to be defined by end of 2006 and according to the GAIA project requirements. Some options to be examined :  Opportunity to use Gilda tools at first,  Opportunity to create a new VO with GAIA partners – that supposes abilities to implement a gLite configuration into their computer centre,  Opportunity to participate in an existing VO.

CEOS WGISS-21 – Budapest – 2006, 8-12 May 10 Conclusion Thank you Paul for your contribution and my apologies for not attending the meeting. For any question, feel free to send me an