1. Migrating Your Network to Avaya Fabric Connect
Clint Berger
Senior CSE / Network Solutions Architect
Avaya

2. Avaya Fabric Connect Campus Network Architecture
Campus Core/Distribution Virtualization using Shortest Path Bridging (SPB)
Server Access
Data Center 1 Core
Server
Campus Core
Distribution (optional)
Server
Server Access
Data Center 2 Core
Server
Virtual Services Fabric
Server
Avaya ERS 8800
SPB L2/L3 VSNs v7.1
R/RS/8800 modules
SPB Multicast v7.2
Avaya VSP 9000
Lossless v3.2
SPB L2/L3 VSNs v3.3
SPB Multicast v3.4
Virtual Services Fabric = Shortest Path Bridging (SPB)
IEEE 802.1aq SPBM
Uses IS-IS as the control plane
IS-IS adapted to support Layer 2, Layer 3, and Multicast Virtualization
Layer 2 Virtual Services Networks (VSNs)
Layer 3 Virtual Services Networks with VRF Extensions
Native IP Routing
Dual-homing into Fabric (SMLT – SPB)
Multicast over SPB
Campus Core/Distribution using Switch Clustering (SMLT)
2010 Avaya Inc. All rights reserved.

3. Ethernet Evolution – A Brief History
Nortel Corporate Presentation
Ethernet Evolution – A Brief History
Payload
Payload
Payload
Payload
Ethertype
Ethertype
C-VID
C-VID
Ethertype
Ethertype
Ethertype
VID
S-VID
S-VID
Ethertype
Ethertype
Ethertype
Ethertype SA SA SA SA DA DA DA DA
802.1
Service ID
802.1q
802.1ad
Provider
Bridges
(Q-in-Q)
I-SID
B-DA
B-SA
B-VID
Ethertype
SA = Source MAC address
DA = Destination MAC address
Regular Ethernet header
VID = VLAN ID
C-VID = Customer VID
S-VID = Service VID
I-SID = Service ID
B-VID = Backbone VID
B-DA = Backbone DA
B-SA = Backbone SA
802.1ah
Provider
Backbone
Bridges
(PBB or MAC-in-MAC)
© 2007 Nortel

4. Virtualization in Action
Backbone Edge Bridge
Backbone Core Bridge
Payload
C-VID | X | Y
Payload
C-VID | X | Y A B C D E
Host X
Host Y X Y
Payload
C-VID | X | Y
ISID | B-VID | A | E
Payload
PBB Header
Edge VLAN ID (C-VID) mapped to ISID and PBB encapsulation added
PBB encapsulation removed and original packet forwarded out
Network Edge
Network Core
Network Edge
Backbone Core Bridges have no awareness of Edge MAC Addresses

5. Connectivity Fault Management (IEEE 802.1ag)
Nortel Corporate Presentation
Connectivity Fault Management (IEEE 802.1ag)
Edge
Switch
Transit
NNI
Link
UNI
Link OAM
Trunk OAM
Service OAM (SID)
customer
demarcs
Functionality not previously available in Ethernet networks:
Fault Detection (failures) - Continuity Check Messages (CCM)*
Fault Verification (misconfigurations) - Loopback Messages (L2 Ping)
Fault Isolation (troubleshooting) - Link Trace Messages (L2 Traceroute)
Fault Notification (SNMP traps)
Hierarchy of Operational/Maintenance domains
Service layer : I-SID, Client (C-VLAN)
Trunk layer : B-VLAN, Port
© 2007 Nortel

6. Considerations when Migrating from SMLT to SPB
Switch Clustering (SMLT)
IP Routing – Global Routing Table
In-band Network Management using Global Routing Table
End-to-end Layer 2 VLANs
IPVPN-Lite
Minimizing network disruption during migration

7. Migrating from SMLT to SPB
Typical Inception design uses
SMLT/RSMLT with:
End-to-end L2 VLANs
IP Routing
IPVPN-Lite (VRF)
Target design uses SPB and must migrate:
L2 VSNs
Native IP shortcuts
IPVPN-Lite over SPB
or ideally
SPB L3 VSNs

8. Switch Clustering (SMLT)
8800D
IST
Tester
SMLT
8800A
8800B
Inception:
Network Core
Network Edge
8800C
8800G
8800D
MLT
IST
Tester
SMLT
8800A
8800B
Target:
Edge SMLT stays
IS-IS (SPB)
Core SMLT Cluster (8800G-8800D) is decommissioned

9. IP Routing - Global Routing Table
Inception:
4/1
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/30
3/29
4/29
Tester
SMLT
8800A
8800B
3/1
3/2
3/3
3/11
3/12
4/11
4/12
MLT1
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
/24 VLAN 1002
/24
VLAN 1001
RSMLT + OSPF in Core
Target:
8800C
8800G
8800D
IST
Tester
SMLT
8800A
8800B
MLT1
/24 VLAN 1002
/24
IS-IS (SPB)
VLAN 1001
Native IP Shortcuts over IS-IS

10. In-band Network Management – Using IP GRT
Inception:
/32
CLIPs
/32
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/30
3/29
4/29
Tester
8800A
8800B
3/1
3/2
3/3
3/11
3/12
4/11
4/12
MLT1
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
CLIP /32
/24 VLAN 90
CLIPs
/32
/32
ERS 8800 Routers managed via Circuitless IP (CLIP) in GRT
L2 Edge switches managed via edge Mgmt VLANs

11. In-band Network Management – Using IP GRT
Target:
/32
CLIPs
/32
8800C
8800G
8800D
MLT32
IST
3/30
Tester
8800A
8800B
3/1
CLIP /32
/24 VLAN 90
IS-IS (SPB)
CLIPs
/32
/32
ERS 8800 Routers still managed via Circuitless IP (CLIP) in GRT
L2 Edge switches still managed via edge Mgmt VLANs
8800G & 8800D only have single CLIP in GRT

12. Extending L2 VLANs Inception: Target: I-SID 129010 8800C 8800G 8800D
IST
Tester
8800A
8800B
SMLT
VLAN 10
Inception:
Core has to do MAC learning and flooding
No end-point provisioning
I-SID
Target:
8800C
8800G
8800D
MLT32
IST
Tester
8800A
8800B
SMLT
VLAN 10
VLAN 10
SPB L2VSN

13. iBGP for IPVPN-Lite Inception:
CLIP /32
Inception:
IBGP Peering
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/29
4/29
Tester
8800A
8800B
3/2
3/3
3/11
3/12
4/11
4/12
SMLT
MLT1
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
CLIP /32
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
/24 VLAN 90
IBGP Peering
CLIP /32
iBGP peerings run between CLIP interfaces over the GRT
CLIP reachability ensured by OSPF

14. iBGP for IPVPN-Lite Target:
CLIP /32
IBGP Peering
8800C
8800G
8800D
MLT
IST
3/30
Tester
8800A
8800B
3/1
CLIP /32
/24 VLAN 90
IS-IS (SPB)
IBGP Peering
CLIP /32
iBGP peering still runs between CLIP interfaces over the GRT
There is no real change for BGP (and IPVPN-Lite) other than CLIP reachability which is now over IS-IS instead of OSPF

15. Extending VRFs with IPVPN-Lite
BGP IPVPN
4/1
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/29
4/29
Tester
SMLT
8800A
8800B
3/2
3/3
3/11
3/12
4/11
MLT1
Inception:
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
Two Core OSPF Vlans: Vlan /24 Vlan /24
RSMLT
/24
/24
VLAN 101
VLAN 102
IPVPN-Lite over SMLT
BGP IPVPN
4/1
8800C
8800G
8800D
MLT32
3/29
Tester
8800A
8800B
3/12
SMLT
Target 1:
IS-IS (SPB)
/24
/24
VLAN 101
VLAN 102
IPVPN-Lite over SPB

16. Extending VRFs with SPB L3VSNs
BGP IPVPN
4/1
8800C
8800G
8800D
MLT32
Tester
8800A
8800B
SMLT
Target 1:
IS-IS (SPB)
/24
/24
VLAN 101
VLAN 102
IPVPN-Lite over SPB
I-SID
4/1
4/30
3/21
8800C
8800G
8800D
3/22
4/20
MLT32
3/29
Tester
8800A
8800B
3/3
3/12
4/11
SMLT
Target 2:
IS-IS (SPB)
/24
/24
VLAN 101
VLAN 102
SPB L3VSN; BGP is removed

17. Migration Without Disruption

18. Migration Without Disruption
Deploy SPB infrastructure in parallel
Verify SPB/IS-IS operation
Migrate Layer 2 VLANs to SPB Layer 2 VSNs
Migrate Global Routing Table IP Routing to SPB Native IP Shortcuts
Decommission OSPF, RSMLT, Core-SMLT

19. IS-IS/SPB – Global Configuraton
4/1
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/30
3/29
4/29
Tester
SMLT
8800A
8800B
3/1
3/2
3/3
3/11
3/12
4/11
4/12
MLT30
MLT1
Split-BEB Primary
IS-IS Area
spbm enable
isis spbm 1 create
isis spbm 1 nick-name f.00.13
isis spbm 1 add-b-vid primary 4001
vlan 4001 create spbm-bvlan name "B-VLAN-1"
vlan 4002 create spbm-bvlan name "B-VLAN-2"
isis manual-area add
isis sys-name 8800C
isis enable
Split-BEB Secondary
spbm enable
isis spbm 1 create
isis spbm 1 nick-name f.00.12
isis spbm 1 add-b-vid primary 4001
isis spbm 1 smlt peer-bmac 00:e0:7b:b4:b3:df
isis spbm 1 smlt split-beb secondary
vlan 4001 create spbm-bvlan name "B-VLAN-1"
vlan 4002 create spbm-bvlan name "B-VLAN-2"
isis manual-area add
isis sys-name 8800B
isis enable
spbm enable
isis spbm 1 create
isis spbm 1 nick-name f.00.10
isis spbm 1 add-b-vid primary 4001
isis spbm 1 smlt peer-bmac 00:14:0d:a0:13:df
isis spbm 1 smlt split-beb primary
vlan 4001 create spbm-bvlan name "B-VLAN-1"
vlan 4002 create spbm-bvlan name "B-VLAN-2"
isis manual-area add
isis sys-name 8800G
isis enable
spbm enable
isis spbm 1 create
isis spbm 1 nick-name f.00.14
isis spbm 1 add-b-vid primary 4001
isis spbm 1 smlt peer-bmac 00:0e:62:25:a3:df
isis spbm 1 smlt split-beb secondary
vlan 4001 create spbm-bvlan name "B-VLAN-1"
vlan 4002 create spbm-bvlan name "B-VLAN-2"
isis manual-area add
isis sys-name 8800D
isis enable
spbm enable
isis spbm 1 create
isis spbm 1 nick-name f.00.11
isis spbm 1 add-b-vid primary 4001
isis spbm 1 smlt peer-bmac 00:0f:cd:57:e3:df
isis spbm 1 smlt split-beb primary
vlan 4001 create spbm-bvlan name "B-VLAN-1"
vlan 4002 create spbm-bvlan name "B-VLAN-2"
isis manual-area add
isis sys-name 8800A
isis enable
SPBM SMLT is not needed on this cluster but has to be configured to enable ISIS because an IST exists; this will be redundant later on once the IST is deleted

20. IS-IS/SPB – Interface Configuration
4/1
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/30
3/29
4/29
Tester
SMLT
8800A
8800B
3/1
3/2
3/3
3/11
3/12
4/11
4/12
MLT30
MLT1
ethernet 4/29,4/30 isis create
ethernet 4/29,4/30 isis spbm 1 state enable
ethernet 4/29,4/30 isis enable
ethernet 3/2,3/3 isis create
ethernet 3/2,3/3 isis spbm 1 state enable
ethernet 3/2,3/3 isis enable
mlt 32 isis create
mlt 32 isis spbm 1 state enable
mlt 32 isis enable
ethernet 3/5,3/11,3/12 isis create
ethernet 3/5,3/11,3/12 isis spbm 1 state enable
ethernet 3/5,3/11,3/12 isis enable
mlt 32 isis create
mlt 32 isis spbm 1 state enable
mlt 32 isis enable
ethernet 3/2,3/3 isis create
ethernet 3/2,3/3 isis spbm 1 state enable
ethernet 3/2,3/3 isis enable
mlt 32 isis create
mlt 32 isis spbm 1 state enable
mlt 32 isis enable
ethernet 4/11,4/12,4/29 isis create
ethernet 4/11,4/12,4/29 isis spbm 1 state enable
ethernet 4/11,4/12,4/29 isis enable
mlt 32 isis create
mlt 32 isis spbm 1 state enable
mlt 32 isis enable

21. Connectivity Fault Management Configuration
4/1
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/30
3/29
4/29
Tester
SMLT
8800A
8800B
3/1
3/2
3/3
3/11
3/12
4/11
4/12
MLT30
MLT1
cfm md "spbm" create index 1
cfm md "spbm" ma "bvid" create index 1
cfm md "spbm" ma "bvid" mep 1 create state enable
cfm md "spbm" ma "bvid" mep 2 create state enable
vlan 4001 add-nodal-mep spbm.bvid.1
vlan 4001 add-nodal-mip-level 4
vlan 4002 add-nodal-mep spbm.bvid.2
vlan 4002 add-nodal-mip-level 4
cfm md "spbm" create index 1
cfm md "spbm" ma "bvid" create index 1
cfm md "spbm" ma "bvid" mep 1 create state enable
cfm md "spbm" ma "bvid" mep 2 create state enable
vlan 4001 add-nodal-mep spbm.bvid.1
vlan 4001 add-nodal-mip-level 4
vlan 4002 add-nodal-mep spbm.bvid.2
vlan 4002 add-nodal-mip-level 4
cfm md "spbm" create index 1
cfm md "spbm" ma "bvid" create index 1
cfm md "spbm" ma "bvid" mep 1 create state enable
cfm md "spbm" ma "bvid" mep 2 create state enable
vlan 4001 add-nodal-mep spbm.bvid.1
vlan 4001 add-nodal-mip-level 4
vlan 4002 add-nodal-mep spbm.bvid.2
vlan 4002 add-nodal-mip-level 4
cfm md "spbm" create index 1
cfm md "spbm" ma "bvid" create index 1
cfm md "spbm" ma "bvid" mep 1 create state enable
cfm md "spbm" ma "bvid" mep 2 create state enable
vlan 4001 add-nodal-mep spbm.bvid.1
vlan 4001 add-nodal-mip-level 4
vlan 4002 add-nodal-mep spbm.bvid.2
vlan 4002 add-nodal-mip-level 4
cfm md "spbm" create index 1
cfm md "spbm" ma "bvid" create index 1
cfm md "spbm" ma "bvid" mep 1 create state enable
cfm md "spbm" ma "bvid" mep 2 create state enable
vlan 4001 add-nodal-mep spbm.bvid.1
vlan 4001 add-nodal-mip-level 4
vlan 4002 add-nodal-mep spbm.bvid.2
vlan 4002 add-nodal-mip-level 4
..or..
cfm spbm ena
cfm cmac ena

22. Migration Without Disruption
Deploy SPB infrastructure in parallel
Verify SPB/IS-IS operation
Migrate Layer 2 VLANs to SPB Layer 2 VSNs
Migrate Global Routing Table IP Routing to SPB Native IP Shortcuts
Decommission OSPF, RSMLT, Core-SMLT

23. CFM – Checking Operation
4/1
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/30
3/29
4/29
Tester
SMLT
8800A
8800B
3/1
3/2
3/3
3/11
3/12
4/11
4/12
MLT30
MLT1
8800C:5# l2 ping vlan 4001 node 8800A
Please wait for l2ping to complete or press any key to abort
----00:e0:7b:b4:b3:df L2 PING Statistics (68) bytes of data
1 packets transmitted, 1 packets received, % packet loss
round-trip (us) min/max/ave/stdv = 545/545/545.00/ 0.00
8800C:5# l2 ping vlan 4002 node 8800A
round-trip (us) min/max/ave/stdv = 547/547/547.00/ 0.00
8800C:5# l2 ping vlan 4001 node 8800B
----00:0f:cd:57:e3:df L2 PING Statistics (68) bytes of data
round-trip (us) min/max/ave/stdv = 558/558/558.00/ 0.00
8800C:5# l2 ping vlan 4002 node 8800B
round-trip (us) min/max/ave/stdv = 517/517/517.00/ 0.00

24. Migration Without Disruption
Deploy SPB infrastructure in parallel
Verify SPB/IS-IS operation
Migrate Layer 2 VLANs to SPB Layer 2 VSNs
Migrate Global Routing Table IP Routing to SPB Native IP Shortcuts
Decommission OSPF, RSMLT, Core-SMLT

25. Avoiding Migration Loops !!!
SMLT Core
VLAN 10
I-SID
Broadcast
Edge VLAN 10
Edge VLAN 10
SPB Core
There is no Spanning Tree over SMLT
There is no Spanning Tree over SPB L2VSNs
It would be quite easy to create a loop between old and new transport
To prevent this from happening ERS 8800 enforces a consistency check:
An ISID cannot be assigned to a VLAN if that VLAN exists on ISIS interfaces

26. Migrating Extended VLAN 10 Step 1
SMLT Core
VLAN 10
I-SID
Edge VLAN 10
Edge VLAN 10
SPB Core
First delete VLAN 10 on uplinks to Core
Traffic on VLAN 10 will be interrupted

27. Migrating Extended VLAN 10 Step 2
SMLT Core
VLAN 10
I-SID
Edge VLAN 10
Edge VLAN 10
SPB Core
Re-configure VLAN 10 at the Edge to use SPB L2 VSN
vlan 10 i-sid
Traffic on VLAN 10 will now resume almost immediately

28. Migrating Extended VLAN 10 Step 3
SMLT Core
VLAN 10
I-SID
Edge VLAN 10
Edge VLAN 10
SPB Core
VLAN 10 in the SMLT Core is no longer needed
Verify that no more traffic is using it
Then delete it

29. Migration Without Disruption
Deploy SPB infrastructure in parallel
Verify SPB/IS-IS operation
Migrate Layer 2 VLANs to SPB Layer 2 VSNs
Migrate Global Routing Table IP Routing to SPB Native IP Shortcuts
Decommission OSPF, RSMLT, Core-SMLT

30. Migrating GRT IP Routing from OSPF to IS-IS
OSPF + RSMLT
/24
/24
IS-IS
There is no risk of loops here
There is no traffic interruption during migration
Simply enable SPB Native IP shortcuts
IS-IS routes, by default, have a higher pref (7) than OSPF routes (20)
The default IS-IS pref must be temporarily increased beyond OSPF to ensure that IP routes are correctly learned by IS-IS before actually switching over to IS-IS
Once satisfied that IS-IS routes are good, then restore IS-IS default pref to switch over to IS-IS

31. Migration Without Disruption
Deploy SPB infrastructure in parallel
Verify SPB/IS-IS operation
Migrate Layer 2 VLANs to SPB Layer 2 VSNs
Migrate Global Routing Table IP Routing to SPB Native IP Shortcuts
Decommission OSPF, RSMLT, Core-SMLT

32. Decommissioning OSPF & RSMLT
/24
/24
IS-IS
OSPF (and RSMLT) no longer needed
Disable OSPF
Delete Core OSPF VLANs

33. Decommissioning OSPF & RSMLT
4/1
4/30
3/5
3/21
8800C
8800G
8800D
3/22
4/20
IST
3/30
3/29
4/29
Tester
SMLT
8800A
8800B
3/1
3/2
3/3
3/11
3/12
4/11
4/12
MLT30
MLT1
IS-IS (SPBM)
/24 VLAN 1002
/24
VLAN 1001
ip ospf disable
vlan 921 delete
vlan 922 delete
ip ospf disable
vlan 911 delete
vlan 912 delete
vlan 921 delete
vlan 922 delete
ip ospf disable
vlan 911 delete
vlan 912 delete
vlan 921 delete
vlan 922 delete
ip ospf disable
vlan 911 delete
vlan 912 delete
ip ospf disable
vlan 911 delete
vlan 912 delete
There are no more OSPF routes in the IP routing table
Hence deleting OSPF has no impact on traffic

34. Decommissioning Core-SMLT
/24
/24
IS-IS
At this point there should be no more VLANs running on the Core SMLT Cluster
After verifying this
Decommission SMLT and the IST on the Core nodes
The Core MLT instances can also be deleted

35. Avaya Fabric Connect Campus Network Architecture
Server Access
Data Center 1 Core
Server
Campus Core
Distribution (optional)
Server
Server Access
Data Center 2 Core
Server
Avaya ERS 4800
Virtual Services Fabric
Server
L2 VSN’s (v5.7)
Avaya VSP 4850
Avaya VSP 7000
Full Suite
Avaya VSP 9000
Lossless - 3.2
SPB L2/L3 VSNs - 3.3
SPB Multicast - 3.4
Avaya ERS 8800
Layer 2 Virtual Services Networks (VSNs)
Layer 3 Virtual Services Networks with VRF Extensions
Native IP Routing
Dual-homing into Fabric (SMLT – SPB)
Multicast over SPB
SPB10.2 (Q3 12)
Layer 2 VSNs
10.3 adds SMLT/Full Stacking/mcast
SPB L2/L3 VSNs - 7.1
R/RS/8800 modules
SPB Multicast - 7.2
2010 Avaya Inc. All rights reserved.

36. Thank You!
Clint Berger
Avaya Network Solutions

37. Be sure to tweet your feedback on this presentation
BEST OF ATF SPEAKER AND TEAM AWARD
Be sure to tweet your feedback on this presentation
#AvayaATF
Winners will be announced at closing of event

38. © 2014 Avaya Inc. Avaya – Confidential & Proprietary
Do not duplicate, publish or distribute further without the express written permission of Avaya.