1. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) GÉANT2 Services & Architectures 3 rd EVN-NREN PoC Meeting 28 th January 2005, Schiphol Airport Michael Enrico Network Engineering & Planning, DANTE

2. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) P2P (“Lightpath”) Services Various projects have been using pt-to-pt L2 connections (mostly GEth) –Some single domain (just across GÉANT) –Many across multiple domains (GÉANT & NRENs & regionals) Approach has been to use L2 VPNs (using MPLS) for GÉANT part –Initially using vendor-proprietary techniques (Juniper CCC) –More recently IETF (Martini-style) Hard work in multi-domain environment –All hand-crafted (control plane based on SMTP & SS7!) –Can take a few weeks to commission & troubleshoot

3. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) CESCA (Ethernet) CA*net4 (TDM) GE 10G GE STS-24 GÉANT (IP/MPLS) NY Madrid CRC (Ottawa) UPC (Barcelona) RedIRIS (IP/MPLS) VLAN LSPs “stitched” together L2-VPN/LSP Example: UPC-CRC GE “Lightpath” Barcelona Madrid NY

4. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Overall Service Aspirations Versatility to better facilitate E2E services Continue to provide quality IP transit services Tune existing IP service platform –Optimise platform (link delays, sort out Frankfurt, etc) –Enhance resilience –Offload DWS where possible Offer “Enhanced MBS” [or “lightpath” service] –“Wavelength” services for big users –Sub-wavelength services as well –Develop automated (“on demand”) provisioning and advance scheduling –Up to 10G Endeavour to be prepared to implement 40G services

5. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) JIVE GÉANT Today 10G 2.5G NREN ANREN CNREN B GE SURFnet NxGE Mk V primary backup primary backup

6. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) GÉANT2 10G 2.5G NREN ANREN C primary backup primary backup DF DWDM OXC and/or L2 switch Nx10G NREN B SURFnet

7. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) 1 or 2 x E3 to STM-64/10GE To NREN WS Leased “lambdas” (2.5 or 10G) or SDH circuits (STM-1 or STM-4) to neighbouring POPs Reminder: GÉANT POP ISDN/PSTN OOB Access Via ISDN and/or PSTN to terminal server (serial & LAN) … Primary IP access (POS) Backup IP / “project” access (POS or 10GE) GE

8. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) GÉANT2 POP Switch n  lambda to neighbouring POP n  lambda to neighbouring POP To NREN n  10 Gbps 10 Gbps Provision of regular IP services Provision of new “lightpath” services Probably continue with separate transmission for IP network A GÉANT2 Hybrid POP IP Router (POP LAN not shown)

9. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) GÉANT2 POP A IP Router Switch n  lambda to neighbouring POP GÉANT2 POP B To NREN n  10 Gbps 10 Gbps n  lambda to neighbouring POP Primary IP Peering Backup IP Peering IP Service Resilience Options

10. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Dark Fibre N x 10G 10G WDM N x 10G GÉANT2 POP to NREN A GÉANT2 Large Hybrid POP

11. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) to NREN to other GÉANT2 POP to other GÉANT2 POP single GÉANT2 POP A GÉANT2 Small Hybrid POP

12. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Equipment

13. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Next Gen means: –Flexible reach (regional, LH & ULH application) –Versatile transponders Tunability Multi-rate Software switchable for LAN/WAN at 10G Muxponders available –“Plug and play” operation Automatic channel power balancing –Upgrade path to support wavelength switching ROADMs available within next 1-2 years Control plane development Next Gen DWDM

14. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Next Gen OXCs Features XPNDR TDM Fabric STM-n Fundamentally SONET/SDH cross-connects (up to 640G) GE All have GE client interfaces 10GE 10GE being developed (most appear during 2005) Support “recent” enhancements: - GFP-F / VCAT / LCAS L2 Fabric GE 10GE L2 switching capability being added (typically during 2005) STM-n Coloured interfaces on some CONTROL PLANE G.ASON/GMPLS control planes

15. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Next Gen L2 Switches Features L2 Fabric Large Ethernet switches STM-n Some noises about support for GFP-F encapsulated Ethernet on “POS” interfaces Highly QoS capable 10GE 10GE (LAN) available now 10GE (WAN) available on some 10GE GE All have high-density GE client interfaces GE Often have L3 awareness (+ layer-3)

16. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Mk V JIVE Multi-domain Lightpaths 10G 2.5G NREN ANREN C primary backup primary backup DF DWDM Nx10G SURFnet Mk V NREN B Mk V

17. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Questions

18. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Extra slides

19. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Scenario 1: P2P GEth GÉANT Border GÉANT Border Interconnects: N x physical GEth GÉANT2 Physical GEth GEth (NREN transport) GEth (GÉANT2 transport) (GÉANT borders: physical GEth – physical GEth) NREN A NREN B

20. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Scenario 2: P2P GEth GÉANT Border GÉANT Border Interconnect: N x physical GEth GÉANT2 (GÉANT borders: physical GEth – STM-16 or 64) Interconnect: N x STM-16 or 64 Eth/GFP/SDH Physical GEth GEth (NREN transport) GEth (GÉANT2 transport) NREN A NREN B

21. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Scenario 3: P2P GEth GÉANT Border GÉANT Border Interconnect: N x physical GEth GÉANT2 (GÉANT borders: physical GEth – physical 10GEth) Interconnect: N x 10GEth VLAN/10GEth Physical GEth GEth (NREN transport) GEth (GÉANT2 transport) NREN A NREN B

22. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Scenario 4: P2P GEth GÉANT Border GÉANT Border GÉANT2 (GÉANT borders: physical 10GEth – STM-16 or 64) Interconnect: N x 10GEth Interconnect: N x STM-16 or 64 VLAN/10GEth GEth (NREN transport) GEth (GÉANT2 transport) Eth/GFP/SDH NREN A NREN B

23. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Scenario 5: P2P 10GEth GÉANT Border GÉANT Border GÉANT2 (GÉANT borders: physical 10GEth – physical 10GEth) Interconnects: N x 10GEth Physical 10GEth (LAN or WAN) 10GEth (NREN transport) 10GEth (GÉANT2 transport) NREN A NREN B Implies underlying SDH

24. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Scenario 6: P2P 10GEth GÉANT Border GÉANT Border GÉANT2 10GEth/GFP/SDH (GÉANT borders: physical 10GEth – STM-64) Interconnect: N x 10GEth Interconnect: N x STM-64 Physical GEth 10GEth (NREN transport) 10GEth (GÉANT2 transport) NREN A NREN B

25. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Scenario 7: P2P STM-n GÉANT Border GÉANT Border GÉANT2 SDH (GÉANT borders: STM-16/64 – STM-16/64) Interconnects: N x STM-16 or 64 NREN A NREN B

26. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) IP Service Tuning: Overall Offload DWS: –Reduce commodity transit Add more in-county gateways Move shared gateways closer to largest users –Possibly separate DWS from R&E traffic altogether Will aid in enforcing subscription limitations, stats gathering, etc Possible using switching infrastructure –Free up IP backbone for true R&E traffic Aim to eliminate non-optimal transmission links where possible, e.g. –CH (Geneva)  AT (Vienna) [currently goes via Stuttgart!] –FR (Paris)  BE (Brussels) [currently goes via London!] Fix bottlenecks (notably): –Frankfurt (DE1  DE2) –NY (NY1  Abilene)

27. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) Fix Frankfurt DFN DE1 DE2 NL FR IT AT SE CZ DFN FR AT IT CZ PL NL

28. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) PROs Allows use of managed wavelength services –Especially 2.5G “wavelengths” More deterministic transmission performance Less QoS complexity Better compatibility with GLIF –Support for GFP-encapsulated Ethernet services More flexible interop with Internet2 –Nortel HDXc being installed in MANLAN (NY) –US-funded 10G transatlantic wavelength will land on HDXc at NY end More “intelligent” control plane features CONs More costly than L2-only switches Often large monolithic “telco-style” management systems Steep learning curve anticipated (especially for NOC staff) Enhanced L2 awareness emerging but slowly Pros & Cons of next-gen OXCs

29. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) PROs More efficient utilisation of capacity through statistical multiplexing Lower costs than OXCs More familiar management paradigm (CLIs) CONs No STM services Difficult to use 2.5G “lambdas” in L2 mode Less mature graphical EMS/NMS’s Little control plane intelligence BW guarantees implemented using “DiffServ-like” techniques Pros & Cons of next-gen L2 switches

30. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) PROs Ultimate transparency 40G ready More “intelligent” control plane features (depending on vendor) CONs Cannot access sub- wavelength signals Largely remains an untried technology Pros & Cons of OOO switches

31. 3 rd EVN-NREN Meeting,28 th January 2005, Amsterdam – Michael Enrico (michael.enrico@dante.org.uk) End of extra slides