1 Provider Bridging design for UNM Campus - CPBN

2 Outline of Topics Introduction Obstacles Fiber? Now What? Wavelength Division Multiplexing Ethernet-based Connections QinQ 802.1Q multi-tagging now 802.1ad How UNM and ABQG used to do it. How UNM and ABQG are doing it Now Design considerations CPBN Design Open for Discussion

3 Introduction Edward May Network Engineer with the University of New Mexico and ABQG (Albuquerque Gigapop)

4 Obstacles Acquiring Fiber In no way does this presentation presume to inform anyone on how to get more fiber, or any at all for that matter. One of the biggest obstacles can be getting access to, or acquiring any fiber at all. Often you just can’t get new fiber installed Equipment cost versus Fiber cost Virtual resource versus physical resource.

5 Fiber? Now What? Growing Bandwidth Needs. And everyone will say it is a NEED. Ethernet – almost all of our connections are Ethernet these days. 1g or 10g Link Aggregation – use multiple fiber pairs using Ethernet and bond them together for additional bandwidth WDM – Wave Division Multiplexing 802.1Q – Provider Bridging

6 Wave Division Multiplexing Multiple carrier signals on the same pair of fiber DWDM – Dense – narrower wavelengths CWDM – Coarse – wider wavelengths Allows for expanding capacity without additional fiber installation. Color (light frequency) is used for the individual signals. Stealth.net

7 Wave Division Multiplexing CWDM Transponders can be lower cost ~4-16 waves some might have limitations DWDM Some systems up to 160 different signals each capable of 10gb/s 100gb/s on the way for some equipment

BTI Systems example 8

9 Ethernet-based Connections Ethernet is the Standard No Token Ring, FDDI, Firewire Twisted Pair or Fiber, No 10base5 or 10base2 anymore CenturyLink/Zayo/TWTC are offering Metro Optical Ethernet or Ethernet services, in much of their service area Low-cost interfaces, cables and connectors for copper

10 QinQ 802.1Q multi-tagging The Ethernet standard was amended to allow for vlans within vlans. Now called 802.1ad This adds a 12-bit Vlan ID field to packets.

11 How we used to do it

12 How we used to do it DWDM Point to point system, with transponders only. Redundancy Path Router Port Transponder Capable – OC, Ethernet, FC, Outside wavelengths(or alien)

13 How we do it now

14 How we do it now DWDM Point to point system, with transponders and QinQ for gigE services. Redundancy Path Router Port(if we wish) Transponder Ethernet Capable – OC, Ethernet, FC, Outside wavelengths(or alien), Also Ethernet “circuits” can be protected.

15 Good and Bad Easy configuration Rate limiting (tested it works) Ethernet standards plus Provider bridging. Monitoring capabilities still lagging the capabilities.

Campus Connectivity Now 16

Design Considerations Monitoring service – costly to monitor a fiber pair Private circuits Redundancy – sfp’s, fiber pairs, fiber path, hardware Training costs/Hardware costs Reliability Maintenance and Operability – Distance limitations/optical power loss 17

UNM Network Re-Design Move away from older and slower large distributed routers Faster distributed switching for on- campus communications Capability of additional service redundancy to buildings – sfp, fiber pair, port Upgrade from 20Gbps backbone to 40Gbps with 100Gbps for campus and Research networks 18

Designs Considered MPLS to the building More expensive hardware/routing platform, distributed routing Distributed Routing/current model More expensive hardware, still distributed Provider Bridging Proven between ABQG and UNM, More centralized routing and services capable, manage circuits 19

20

Migration in Process Hardware deployed to Fiber Zones 40Gbps up between FZ’s 80Gbps up to new Core routers 100Gbps up to new Core from ABQG for campus and Research Local connections made to FZ routers Securing new Hardware, and configuration in process, Migration of buildings begins soon 21

Migration from Current 22

100G for UNM 23

CBPN and Research Network 24

25 Open for Discussion Edward May

26 References: ad QinQ: and BTI Systems: Albuquerque Gigapop website: Wikipedia is your friend. QinQ, WDM, etc: http://en.wikipedia.org/wiki/IEEE_802.1ad- 2005