EGI-InSPIRE RI-261323 EGI-InSPIRE EGI-InSPIRE RI-261323 1 EGI IPv6 Report for HEPiX CERN October 5, 2012 CERN 1

Slides:



Advertisements
Similar presentations
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI The EGI Software Vulnerability Group and EMI Dr Linda Cornwall, STFC, Rutherford.
Advertisements

EGI-Engage Recent Experiences in Operational Security: Incident prevention and incident handling in the EGI and WLCG infrastructure.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Unified Middleware Distribution (UMD): SW provisioning to EGI Mario David.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
FP6−2004−Infrastructures−6-SSA IPv6 and Grid Middleware: the EUChinaGRID experience Gabriella Paolini – GARR Valentino.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite IPv6 compliance project tests Further.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Federated Cloud F2F Security Issues in the cloud Introduction Linda Cornwall,
The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks General relationships with EGEE JRA1 SA3.
EMI 1 Release The EMI 1 (Kebnekaise) release features for the first time a complete and consolidated set of middleware components from ARC, dCache, gLite.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Report Mario Reale NGI IT / GARR HEPiX f2f meeting.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IPv6 test methodology Mathieu Goutelle (CNRS.
1 User Analysis Workgroup Discussion  Understand and document analysis models  Best in a way that allows to compare them easily.
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
HEPiX IPv6 Working Group David Kelsey GDB, CERN 11 Jan 2012.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Monitoring of the LHC Computing Activities Key Results from the Services.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Evolution of AAI for e- infrastructures Peter Solagna Senior Operations Manager.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI-InSPIRE APEL for Accounting John Gordon, Stuart Pullinger STFC.
EMI Inter-component and Large Scale Testing Infrastructure Danilo Dongiovanni INFN-CNAF.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Requirements Status EGI.eu UCB
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Mario Reale – GARR NetJobs: Network Monitoring Using Grid Jobs.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI UMD Roadmap Steven Newhouse 14/09/2010.
EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)
HEPiX IPv6 Working Group David Kelsey david DOT kelsey AT stfc DOT ac DOT uk (STFC-RAL) HEPiX, Vancouver 26 Oct 2011.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI IPv6 Report for HEPiX March 16, 2012 HEPiX IPv6 WG Meeting n.14 CERN.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Network Support Workshop Mario Reale / IGI - GARR EGI Network Support.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GLUE 2: Deployment and Validation Stephen Burke egi.eu EGI OMB March 26 th.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Update on Service Availability Monitoring (SAM) Marian Babik, David Collados,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Software Repository Progress Report Kostas Koumantaros et al, GRNET 7/3/2016.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Simone Campana (CERN) Job Priorities: status.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.
EGI-InSPIRE RI EGI-InSPIRE RI EGI-InSPIRE Software provisioning and HTC Solution Peter Solagna Senior Operations Manager.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regional Helpdesk GRNET Example Gkamas Vasileios NGI_GRNET User Support Team.
CREAM Status and plans Massimo Sgaravatto – INFN Padova
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Middleware-related EGI and WLCG activities.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Current status of ARC integration within monitoring, accounting, and EGI.
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Middleware updates Peter Solagna – EGI.eu OMB – 16/07/ /3/
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting task force T. Ferrari/EGI.eu Accounting task force/TCB meeting.
EMI is partially funded by the European Commission under Grant Agreement RI EMI Status And Plans Laurence Field, CERN Towards an Integrated Information.
Argus EMI Authorization Integration
WLCG IPv6 deployment strategy
EMI and GISELA Collaboration
gLite->EMI2/UMD2 transition
Ian Bird GDB Meeting CERN 9 September 2003
EMI Interoperability Activities
Accounting at the T1/T2 Sites of the Italian Grid
Supporting Services for Campus Identity Providers Plans
Towards an Integrated Information system: the EMI view
Short update on the latest gLite status
EMI: dal Produttore al Consumatore
Interoperability & Standards
Monitoring of the infrastructure from the VO perspective
IPv6 transition Vincenzo Spinoso EGI Operations.
Steven Newhouse, EGI.eu EGI-InSPIRE Project Director
New Types of Accounting Beyond CPU
Introduction slides Peter Solagna – EGI.eu
Presentation transcript:

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI IPv6 Report for HEPiX CERN October 5, 2012 CERN 1

EGI-InSPIRE RI Outline 1.EGI goals w.r.t. IPv6 2.Current stand of Testbed Infrastructure 3.Preliminary Testing Results 4.Plans for next weeks/months 2

EGI-InSPIRE RI EGI goals for IPv6

EGI-InSPIRE RI Goals for EGI w.r.t. IPv6 Obviously, IPv4-only nodes cannot talk to IPv6-only nodes without protocol translation at some level Wherever possible, Dual Stack should be pursued So far, protocol translation mechanisms have not been taken into consideration No solution provided for the integration of IPv6-only resources in an IPv4 Grid Therefore our goals so far are: –1. Ensure switching on IPv6 does not break functionality provided using IPv4 in a Dual Stack approach (IPv4 to IPv4 in the presence of also the IPv6 stack) –2. Demonstrate we can use the Grid using IPv6 using EMI/UMD middleware IPv6-only grid clients can connect to IPv6-only grid servers The same grid middleware could then be used in an IPv4 environment and in an IPv6 environment

EGI-InSPIRE RI Goals translated in practice Assess the overall IPv6 status w.r.t. IPv6 compliance of –The grid middleware –The required operational services and tools –Report all sources of problems to EGI and Technology providers –I.e. measure how far are we from IPv6-compliant middleware –For all EGI-related middleware families ( Globus IGE, ARC, gLite, UNICORE, dCache) UMD released components Check/ Verify that switching on IPv6 does not break IPv4 provided functionality –This is however less than half of our goals: we still need IPv4 addresses/nodes Test EMI / UMD middleware components and verify that –They can be deployed ( installed and configured OK ) –They work using IPv4-only, IPv6-only and Dual Stack

EGI-InSPIRE RI IPv6-only resources Integrate IPv4-only resources and IPv6-only resources in a unique functional pool ? Not really. Including IPv6-only resources in the EGI Grid (mostly IPv4) would imply protocol translation –To merge IPv6 and IPv4 resources, there are IPv4 / IPv6 translation mechanisms available and possible gateway approaches, but the majority of them –Introduce an overhead w.r.t. grid functionality to be provided –Often represent a single point of failure in a Grid distributed architecture –Do not scale easily Realistically achievable (at least to start with) is to be able to have a network- agnostic middleware, external dependencies and operational tools enabling us to implement an IPv4-infrastructure and an IPv6-infrastructure  Being able to provide 2 separate Grid pillars / resource-sets Functional IPv4-IPv6 integration out of our scope so far However, we should not be far at all from an IPv6-compliant middleware –however no one has certified what is being provided w.r.t. IPv6 compliance – various spreads problems are likely to be there

EGI-InSPIRE RI IPv6 assessment strategy EGI strategy for assessing IPv6 compliance very down-to- earth We plan to produce –Detailed Test reports where CLI commands are tested in 4 network config for Client and Server –A Summary Matrix reporting “OK”, or “Not working” for 4 network configurations: A) Client and Server both in Dual Stack B) Client in IPv6-only, Server in Dual Stack C) Server in IPv6-only. Client in Dual Stack D) Client and Server both in IPv6-only –An overall initial IPv6 assessment table for services summarizing also possible issues related to installation, configuration, smoke tests, basic functional tests, for each Grid service

EGI-InSPIRE RI Goals of EGI IPv6 testbed 1.Allow general purpose testing of UMD components using the IPv6 protocol 2.Enable specific IPv6 test campaigns on selected UMD components or required external dependencies 3.Provide an hands-on IPv6 testbed for possible IPv6 tutorials for the EGI site administrators community, both on IPv6 in general and IPv6 Security 4.Enable IPv6 testing of specific applications relevant to the EGI UCB / User Community 5.Allow the IPv6 testing of EGI-Inspire JRA1 Operational Tools components 6.Provide support and exploit synergies for the EGI Federated Clouds task force w.r.t. IPv6 ( to be defined, just started) 7.Complement the work done by the HEPiX IPv6 WG, focusing on the middleware

EGI-InSPIRE RI Current Status of testbed and recent achievements

EGI-InSPIRE RI IPv6 Testbed Resources Many new Grid services installed at GARR, ARNES, FZU, GRNET Overall, ~ 15 servers deploying ARC and gLite services

EGI-InSPIRE RI Current Strategy We decided to start focusing on Site Computing and InfoSys resources –To be complementary to HEPiX First full cycles of installation / configuration / smoke testing will be reported by single test reports Detailed test reports being produced: ARC CE, CREAM CE, DPM-SE Wiki based reporting and documenting : Refer to Test reports on

EGI-InSPIRE RI Already identified issues Certification Authorities related files are not reachable ( CA-files, CRLs..) –How do I set up the Grid nodes and the User/Sites/Grid Security Infrastructure ? Some external dependencies are not IPv6 compliant or compiled without the required options We do not have a 100 % clear picture of what should be the expected degree of IPv6 compliance of all UMD middleware families and components –Would help guiding us to verify things Sites are a bit reluctant to enable IPv6 (if not really needed) given lower level of security control / LAN protection expertise

EGI-InSPIRE RI How we decided to report Global IPv6 assessment table including installation, configuration, smoke test for each services – includes logs/references Specific Client/Server summary table for 4 Network Configuration Detailed Test Teports for each service : log of command outcomes (in the 4 configurations)

EGI-InSPIRE RI Client/Server IPvX stack: Test Categories A) Dual Stack on Client and Server B) IPv6-only Client; Dual Stack Server C) IPv6-only Server, Dual Stack Client D) IPv6-only on both Client and Server 14

EGI-InSPIRE RI Preliminary Testing results 15

EGI-InSPIRE RI CREAM CE test Torque CREAM CE installed and configured –IPv6-only installation OK Test to be finalized IPv6-only client : OK Issues with Torque : job stuck in the queue Preliminary outcome on

EGI-InSPIRE RI DPM SE test DPM-SE installed at GARR –IPv6-only installation to be tested still Basic tests for some initial functionality carried out Upgraded MySQL : 5.1  5.5 Tests be finalized Preliminary results on 17

EGI-InSPIRE RI ARC ARC CE tests –See slides from Barbara Krasovec / ARNES at EGI Technical Forum

EGI-InSPIRE RI Other m/w products UNICORE tests started at KIT –Limited feedback received so far dCache – positive feedback got today –Start actual testing ? IGE Globus – just basic contacts –Not aware of any actual progress 19

EGI-InSPIRE RI Plans for next weeks

EGI-InSPIRE RI Next steps Complete tests of CREAM CE, DPM SE Torque/MAUI requires digging into the issue –Start assessing all issues related to LRMS systems Move on for UNICORE, IGE Globus and d-Cache Start collaboration with EGI-Inspire JRA1 on operations tools Pursue functional integration of testbed services with EMI and HEPiX –Provide support information for sites to deploy site BDII / site EMIR

EGI-InSPIRE RI Towards a global IPv6 testbed ? First required steps to build a global, extended, cross-initiative IPv6 testbed have been carried out Top BDII in place –Top BDII condfig file: BDII condfig file: Support for 3 Vos available on many services –net.egi.eu –ipv6.hepix.org –testers.eu-emi.eu

EGI-InSPIRE RI References EGI Network Support coordination: ( ) EGI IPv6 IPv4 address report Contact: