1. Cisco Live 2013
4/24/2017

2. Evolved Programmable Network and Unified MPLS
Cisco Live 2013
4/24/2017
Evolved Programmable Network and Unified MPLS

3. A long time ago…. IP … Subscribers Access Aggregation IP Edge SDH ATM
VPN
ISDN/POTS IP
VPN NT
NAS PE
SDH
VPN NT
Bus. Internet NT
LER NT
DSL
ATM
BRAS
HSI NT ..
LER NT
HSI
Initially sparse customer take rates
Faster roll-out in coverage
Subnetting and IP address pool utilization
Reuse of SDH infrastructure
Internet Access “Star Aggregation” traffic dominance
Similar to centralized dial paradigm
Conservative growth assumptions
Availability of IP Operations Expertise NT
Bus. Internet … … PE NT
DSL
VPN NT
ATM ..
ATM
ATM NT NT
ATM DSL service
High-speed Internet (residential)
Business Internet
L3 VPN (Business) 3

4. Typical architecture Portal Monitoring Billing Subscriber Database
Address Mgmt
Policy
Definition
Identity
Policy Control Plane (per subscriber)
Subscriber
Access
Aggregation
L2 / Simple L3
Edge
Core
Content Farms
VOD TV
SIP
Ethernet
Residential
DSLAM
BNG
Aggregation Network
MPLS/IP
Core Network
MPLS /IP
OLT
Business
Corporate
CMTS
MSE 4

5. Service Delivery with MPLS Ethernet
Access
Aggregation / Edge
Edge
Core
IP/MPLS
Services
Q-in-Q
(802.1ad)
Ethernet
MST /LAG
Pseudowire
Ethernet
IP or IP-VPN
Residential: IPTV, VoD, VoIP, IA
Pseudowire
Ethernet
IP or IP-VPN
Business: IP and IP-VPN
Centralized
Service Edge
Pseudowire
Pseudowire
Ethernet VPN: E-Line
Pseudowire
VPLS
Ethernet VPN: E-LAN/E-Tree
IP or IP-VPN
Residential: IPTV, VoD, VoIP, IA
IP or IP-VPN
Business: IP and IP-VPN
Distributed
Service Edge
Pseudowire
Ethernet VPN: E-Line
VPLS
Ethernet VPN: E-LAN/E-Tree
Access Aggregation
Boundary
Aggregation Edge
Boundary
IP Routing
L2 Switching 5 5

6. Evolved Programmable Network (EPN) a vision for Service Provider Network evolution to keep the SP business healthy and relevant
CAPEX tools
Network De-layering, IP+Optical
Silicon Innovations (ride the Moore’s law)
Traffic
Problem
OPEX tools
Stop making networks more complicated!
SDN with End-to-End Orchestration
Revenue
Monetization tools
Agility (faster deployment) – Overlays and NfV
Virtualization – Virtual Private Clouds and IaaS

7. Realizing the Evolved Programmable Network Multi-Phase Roadmap
We are here.
IP + Optical Convergence
and Network De-Layering to
Reduce CapEx
Convergence
IP Next Generation Network (IP NGN)
Consolidation of Mobile, Business, and Consumer Networks
Evolved Programmable Network (EPN)
Driven by Need for Increased Bandwidth plus Embedded Intelligence
Programmability and Control
via SDN with End-to-End Orchestration
Enables Simplification to Reduce OpEx
Simplification
Virtualized Software
for Dynamic Service Delivery and Scale
to Enable Faster Time to Revenue Growth
Virtualization
IP Everywhere
Evolved Programmable Network: Built for Internet of Everything (IoE)

8. Carrier Ethernet Architecture Evolution
Access
Aggregation
Edge
Core
Zero Touch & Auto service provisioning
Programmable (SDN, NfV) & L0-L7 Efficiency
Cisco Strategy: Accelerate investment to further break away E V O L U T I N
Zero-touch
Programmable MPLS
Multi-layer PCE w/ SDN
nV/AN
Vision
Unified MPLS
MPLS/VPN, VPLS  PBB-VPLS  PBB-EVPN
Auto-IP, rLFA
Trend
E2E service convergence & easy service provisioning
Access network complexity (Need Cisco innovative solutions)
Cisco Strategy: Drive customers towards this direction L2
MPLS
MPLS/VPN, VPLS  PBB-VPLS  PBB-EVPN
REP, G.8032
Popular
Simple but
No E2E service convergence
Cisco Strategy: Close final L2 gaps to gain footprint L2
802.1q  802.1ad  802.1ah
STP
Legacy
Simple but
No service convergence & Poor network resilience
Cisco Strategy: no further investment

9. EPN Transport System: Cisco Solution Unique Value Proposition
Innovation #3:
Auto-IP Ring: simplify operation with plug & play node insertion
Innovation #1:
Hierarchical LSP: auto scale, plug&play BGP based routing with VRF’s
Innovation #4:
PW-HE converges PE’s and enables rich services on any access device any time with operation simplicity (reduce CAPEX & OPEX) ?
How to build an MPLS access network of 1,000’s nodes with operation simplicity?
PW-HE ?
How to roll out cost-effective rich services on any access device any time?
Innovation #2:
LFA/rLFA: simplify sub 50ms resiliency design
Innovation #5:
PBB-EVPN: active/active L2VPN attachment, common BGP control plane, SDN- compliant L2 switching

10. PWHE Reference Topology
CE-PE VLAN over PW (L2 or L3)
Pseudowire
L2 PW
PWHE virtual interface
Internet Peering
Access PE (A-PE)
Pseudowire CE
Service PE (S-PE)
L2 (port or vlan)
Aggregation LDP domain
Business L3
VPNs
LDP Core / Internet Core
L3PE CE
interface pw-ether
encapsulation dot1q 123
vrf vpn-red
ipv4 address /24
service-policy input pw_parent_in
service-policy output pw_parent_out
ipv4 access-group p-in-filter in
ipv4 access-group p-out-filter out
l2vpn
xconnect group pwhe
p2p pwhe-red
interface pw-ether 100
neighbor pw-id 1
Unified MPLS end-to-end transport architecture
Flexible service edge placement with virtual PWHE interface
L3 main interface
L2 sub-interface (EVC/EFP in 5.1.1) – 20K per system
L3 sub-interface (IP/VRF in and BNG in 5.2.0) – 8K per system
CE-PE routing is over MPLS transport network. It doesn’t need direct L3 link any more
CE-PE virtual link is protected by the MPLS transport network

11. Automate Device Deployment Up to 70% OPEX savings
Simplicity
EPN with Plug&Play
nV Satellite
EPN with Autonomic Network and Auto-IP
Config
Config
Weeks
Minutes
One Virtual System
Downtime
Error Free
Complex
Plug&Play
Auto-Discovery, Auto-Provisioning and Auto-resiliency
Auto-Discovery, Automatic Addressing and Secure Communication Channel
Manual
Automated

12. MPLS L2VPN Evolution: PBB-EVPN Powering DCI and L2VPN
Control-plane address advertisement / learning over Core (B-MAC)
Simplified Operation: common data and control plane, MPLS + BGP
Better Resource Utilization:
All-active Redundancy and Load Balancing
Optimal Path selection
Always on: Fast Convergence
High Scalability: MAC, VLAN, PW
Data-plane address learning from Core
PE1
CE1
PE2
PE3
CE3
PE4
Data-plane address learning from Access
B-MAC:
B-M1
B-M2
B-MAC:
B-M1
B-M2
BGP MAC adv. Route

13. Typical National SP Backbone
Legacy Architecture  Modernism
BRAS
N-PE PE P P PE
IGW
U-PE
Cell Site
MPLS Backbone
ISP
RAN
BRAS
IGW
Edge Node
Distributed BNG
Core Node
Router Hardware Innovations
(multi-core, 55/45/40/28nm ASIC’s, CMOS…)
Cell Site
Touch-less DWDM Layer: IPoDWDM
Passive WDM: Terastream
Active WDM: ROADM, WSON, GMPLS
RAN
Virtualized Control Functions (SDN)
Virtualized Network Functions (NfV)
Cloud Data Center

14. “A high-end user's connection speed grows by 50% per year”
CRS/NCS:
2004: 130nm NPU, 40Gbps (~11W/Gbps)
2010: 65nm NPU, 140Gbps (~5W/Gbps)
2013: 40nm NPU, 400Gbps (~2W/Gbps)
2015: 20nm…
Nielsen's Law of Internet Bandwidth, Dr. Jakob Nielsen, 1998http://
“The number of transistors on integrated circuits doubles approximately every 18 months”
ASR9000:
2009: 90nm NPU, 120Gbps per slot
2010: 55nm NPU, 360Gbps per slot
2014: 28nm NPU, 800Gbps per slot …
Moore’s Law, Gordon E. Moore,
Low Cost
Interconnect
100GE DWDM Satellite
GE/10G Satellite/Breakout
Cisco nV:
ASR9K, CRS/NCS
NOTE: Moore’s Law works with Silicon Chips.
- not Optics (Optics is fundamentally an analog problem, subject to Shannon’s limit)
- not Materials (eg. RJ-45 Ethernet port is same size since 1976)

15. ASR 9000: Ahead of the “Nielsen’s Law” Curve
“A high-end user's connection speed grows by 50% per year”
Nielsen's Law of Internet Bandwidth; Dr. Jakob Nielsen
2Tbps linecard
1.2Tbps (12x100GE)
800Gbps (8x100GE)
360Gbps (36x10GE)
240Gbps (24x10GE)
120Gbps (16x10GE)
80Gbps (8x10GE)
FCS w/ 60Gbps
8x10GE OS

16. Separate IP and Optical Networks
Legacy Architecture:
Separate IP and Optical Networks
IP Layer Management
Optical Layer Management
Transponders converting short reach to c-band l
Metro Network
Core
Router
Metro Network
Electrical switching – OEO conversions
P2P DWDM
Electrical XC
Manual patching of 10G connections 16

17. Cisco nLight Architecture: Integrated IP+Optical
Common Network Management and Control
IPoDWDM
– OTN encapsulation, FEC
– integrated transponder
Metro Network
Core
Router
Metro Network
Photonic Switching
– no OEO conversion
– touch-less ROADM
– WSON control plane
Mesh
ROADM
ROADM 17

18. Realizing the Evolved Programmable Network A Multi-Phase Roadmap
We are here.
IP + Optical Convergence
and Network De-Layering to
Reduce CapEx
Convergence
IP Next Generation Network (IP NGN)
Consolidation of Mobile, Business, and Consumer Networks
Evolved Programmable Network (EPN)
Driven by Need for Increased Bandwidth plus Embedded Intelligence
Programmability and Control
via SDN with End-to-End Orchestration
Enables Simplification to Reduce OpEx
Simplification
Virtualized Software
for Dynamic Service Delivery and Scale
to Enable Faster Time to Revenue Growth
Virtualization
IP Everywhere
Evolved Programmable Network: Built for Internet of Everything (IoE)

19. Hybrid SDN for Core Optimization How about unloaded links?
Cloud Data Center
VM’s
Cloud Data Center
Edge Node
VM’s
Core Node
Core Node
Core/IGW
IGW
5% load A B C D
full load
Internet W X Y Z
PROBLEM:
How to find optimal topology?
What if capacity degrades (failures)?
SPF = too many empty links (wasted resources)
CarrierE Aggregation
MPLS Core
Internet Core
Access
Regional PoP
Main PoP
Transit

20. Hybrid SDN for Core Optimization Centralized Traffic Engineering
1. Service Request
2Gbps request between AZ Data Centers
NB API
Cloud Data Center
Cisco Quantum
WAVE
VM’s
Tunnel AZ onto <C,Y, Z>
OpenFlow or FlowSpec: select traffic
PCEP: program the label stack
Collector
Program
Cloud Data Center
Edge
BGP-LS
Netflow
SNMP
VM’s
Core
Core Node
Core/IGW
IGW
25% load
5% load A B C D
full load
Internet W X Y Z
Realtime Centralized Traffic Engineering
Capacity Management, Visibility Engine
“What-if” risk analysis
“Autopilot” traffic optimization
CarrierE Aggregation
MPLS Core
Internet Core
Access
Regional PoP
Main PoP
Transit

21. Cisco Quantum WAVE: The Only Predictive SDN “what-if” capabilities, multi-layer visibility
What will happen next?
What if failure/traffic trend happen?
What is the best case?
Deducing Traffic
Risk Analysis
What is the best? Optimization
Before
After
Examine Traffic Demand
Examine Node Failure
LSP Optimization
Determine in near real time the end to end demand matrix using measured data from the network
When placing demands, examine what the impact will be, and potential failures that may affect the demand or cause congestion on the network
Tactical optimization tools to relieve local congestion, strategic optimization tools to relieve chronic congestion issues network-wide

22. Role of MPLS End to End Services
1. Essential technology for FMC (Fixed & Mobile Convergence)
Unified MPLS (end-to-end LSP) with IPv4 and IPv6
Seamless integration with IP RAN and EPC
2. Essential technology for Traffic Engineering and Protection
Non-trivial topologies – need for non-SPF explicit paths (<50ms FRR, optimization)
Simplification of MPLS (no RSVP, no LDP)  Segment Routing
End to End LSP (Label Switched Path) – L2 pseudowires, E-VPN’s, IP-VPN’s
IGW
Edge Node
Distributed BNG
Core Node
Cell Site
RAN
Virtualized Control Functions (SDN)
Virtualized Network Functions (NfV)
Cloud Data Center

23. Netconf/Yang: A Programmable SDN OSS Programmatic API-driven Configuration with Customer Self-Selection
Service Designer
Environment
Customer “à la carte” Menu Portal
L3 VPN any-2-any
L3 VPN any-2-any
Service Models
(YANG)
L3 VPN hub-n-spoke
L3 VPN hub-n-spoke
L2 P-2-MP
L2 P-2-MP
Operator
designs new service profiles in service designer environment
Building Block Service (e.g: L2 backhaul, L3-VPN, NFVs)
End-to-end Services assembled from building block services
Customer
Picks from available service profiles or service building blocks
Request Service Instantiation
Secure VPN Access (IPSec)
Secure VPN Access (IPSec)
Secure VPN Internet + NFV Firewall
Secure VPN Internet + NFV Firewall
SLAs
SLAs
Network Service Controller & Orchestration
Service Catalog
Workflow Manager (micro) …
Provisioning
Access Control
QoS Control
Topology
Inventory …
Network APIs

24. Realizing the Evolved Programmable Network A Multi-Phase Roadmap
We are here.
IP + Optical Convergence
and Network De-Layering to
Reduce CapEx
Convergence
IP Next Generation Network (IP NGN)
Consolidation of Mobile, Business, and Consumer Networks
Evolved Programmable Network (EPN)
Driven by Need for Increased Bandwidth plus Embedded Intelligence
Programmability and Control
via SDN with End-to-End Orchestration
Enables Simplification to Reduce OpEx
Simplification
Virtualized Software
for Dynamic Service Delivery and Scale
to Enable Faster Time to Revenue Growth
Virtualization
IP Everywhere
Evolved Programmable Network: Built for Internet of Everything (IoE)

25. NfV (Network Function Virtualization) SP-driven Initiative  ETSI architecture
Announced at SDN World Congress, Oct 2012
AT&T, BT, CenturyLink, China Mobile, Colt, Deutsche Telekom, KDDI, NTT, Orange, Telecom Italia, Telstra, Verizon
Enablers
Hypervisor and cloud computing technology
Improving x86 h/w performance
Optimised packet processing and coding techniques
Network industry standardising on Ethernet
SDN based orchestration
Value Proposition
Shorter innovation cycle
Improved service agility
Match capacity with actual demand
NB : may reduce CAPEX / OPEX
NfV = Transition of network infrastructure services to run on virtualised compute platforms – typically x86
Orchestration
Host & Network
Overlays
Appliances – Physical
Networking Functions
VNF’s – Virtual
Networking Functions

26. Value of Host Overlay: Aglity Traditional Multi-Tenant DC VPN Solution
Tenant 1 VM
Provider Edge
DC Edge
MP x-BGP
Tenant 1 VM
MP x-BGP
BGP RR
VRF1
VLAN’s, multi-VRF’s,…
VRF2
VRF1
IP NGN
MPLS-VPN
VRF2
Data Center Network
Tenant 1 VM
VRF3
VRF3
Tenant 2 VM
Tenant 2 VM
Tenant 3 VM
Server guys ask Network guys for the virtual network
Complex, it takes days/weeks to provision
Limited scale (only 4K vlans, etc.)

27. Cisco ESP (Evolved Services Platform) Virtual PE: MPLS-based Overlay SDN for Orchestrating NfV
MP x-BGP (vpnv4 +VPN Label + nexthop)
Tenant 1 VM
Provider Edge
MP x-BGP
MP x-BGP
DC Edge
Tenant 1 VM
BGP RR
ESP = Virtual Elastic PE
VRF1
VRF2
VRF1
VRF1
IP NGN
MPLS-VPN
VRF2
Data Center Network
VRF2
Tenant 1 VM
VRF3
VRF3
VRF3
Overlay (MPLS LSP)
Tenant 2 VM
Tenant 2 VM
Tenant 3 VM
Fast Tenant provisioning (minutes) – benefits over DYI
Ability to provide SLA (bandwidth, delay, jitter, loss) – key benefit over OTT
Easy – End-to-end MPLS for seamless integration of DC and MPLS VPN
Scalable – BGP between DC and Network (clear responsibility border)

28. Cisco ESP (Evolved Services Platform) Virtual PE: Controller and Data-Plane
Multi-Tenant Data Center
Evolved Services
Platform
ESP
Controller
Server / VM Provisioning
YANG-API
MP x-BGP (vpnv4 +VPN Label + nexthop)
Server
vPE Forwarder 1
CLI/XML (VRF, GRE Provisioning, Static Label etc)
Tenant 1 VM
VRF1
Provider Edge
MP x-BGP
Tenant 1 VM
MP x-BGP
DC Edge
BGP RR
VRF1
Server
vPE Forwarder 2
VRF2
VRF1
Virtual
Private
Clouds
IP NGN
MPLS-VPN
VRF2
Data Center Network
VRF1
Tenant 1 VM
VRF3
VRF3
VRF2
Tenant 2 VM
Server
vPE Forwarder 3
VRF2
Tenant 2 VM
GRE encapsulated LSP’s
VRF3
Tenant 3 VM
IPv4 Header
IP Payload
IGP Label 10
BGP VPN Label 100
IP Payload
GRE Header
Provisioned VPN Label 100
IP Payload
VPN Label
pop/push
IP look up in VRF
VPN Label
pop/push

29. Cisco ESP (Evolved Services Platform) Virtual PE: Controller and Data-Plane
Multi-Tenant Data Center
Evolved Services
Platform
ESP
Controller
Server / VM Provisioning
YANG-API
MP x-BGP (vpnv4 +VPN Label + nexthop)
Server
vPE Forwarder 1
CLI/XML (VRF, GRE Provisioning, Static Label etc)
Function 1
VRF1
Provider Edge
MP x-BGP
MP x-BGP
DC Edge
BGP RR
VRF1
Server
vPE Forwarder 2
VRF2
VRF1
NfV
Services
Chaining
IP NGN
MPLS-VPN
VRF2
Data Center Network
VRF1
VRF3
VRF3
VRF2
Function 2
Server
vPE Forwarder 3
VRF2
GRE encapsulated LSP’s
VRF3
Function 3
IPv4 Header
IP Payload
IGP Label 10
BGP VPN Label 100
IP Payload
GRE Header
Provisioned VPN Label 100
IP Payload
VPN Label
pop/push
IP look up in VRF
VPN Label
pop/push

30. Putting it all together: Physical + Virtual Networking Connecting Subscribers to NfV Services: End to End Architecture
ESP
Cloud Datacenter
Neutron/VXLAN
OVS/OF
WAVE
RESTful API
Virtual Private Cloud
Restconf/YANG
Openstack
vCPE
vCPE
PCEP/BGP-LS/OnePk
OF/OpenDaylight
Netconf/XML/YANG
vCPE
vCPE
Enterprise NfV Services
CPE
IP/MPLS FW
NAM
IPS
DC Fabric
DPI
CGN
IPSEC
VPN PE
GI-LAN | Consumer
DCI
CPE DC
EPN FW
CDN
IPS
DPI
CGN
WWW
Guaranteed Network SLA
Cloud SLA
Service Chaining

31. Realizing the Evolved Programmable Network A Multi-Phase Roadmap
We are here.
IP + Optical Convergence
and Network De-Layering to
Reduce CapEx
Convergence
IP Next Generation Network (IP NGN)
Consolidation of Mobile, Business, and Consumer Networks
Evolved Programmable Network (EPN)
Driven by Need for Increased Bandwidth plus Embedded Intelligence
Programmability and Control
via SDN with End-to-End Orchestration
Enables Simplification to Reduce OpEx
Simplification
Virtualized Software
for Dynamic Service Delivery and Scale
to Enable Faster Time to Revenue Growth
Virtualization
IP Everywhere
Evolved Programmable Network: Built for Internet of Everything (IoE)

32. Cisco EPN Solution Evolution Evolved Programmable Network
EPN is the evolution of NGN; the fusion of network and cloud through programmable interfaces to deliver a platform for service provider innovation and differentiation.
IPNGN and CarrierE
CE 1.0 and 2.0
UMMT/FMC
1.0 and 2.0
Past Solution Framework
EPN 3.0 Residential Services
IPoE, PPPoE
VoIP, IPTV
EPN 3.0 Business
Services
L2VPN vpws/vpls
L3VPN uni-/multi-cast
EPN 3.0 Transport Services
MEF CE2.0 – E-Line, E-LAN, E-Access
MBH – S1 and X2 traffic, eMBMS, u-Wave, Clocking
EPN 3.0 Transport Infrastructure
(MPLS, L2, nV)
EPN represents a continuation of the CE/FMC program, with expanded coverage for Carrier Ethernet access technologies (MPLS, L2, nV)
EPN connects with NfV to deliver E2E virtual managed services

33. Evolved Programmable Network: Built for Internet of Everything (IoE)
EPN: Summary
We are here.
IP + Optical Convergence
and Network De-Layering to
Reduce CapEx
Convergence
IP Next Generation Network (IP NGN)
Consolidation of Mobile, Business, and Consumer Networks
Evolved Programmable Network (EPN)
Driven by Need for Increased Bandwidth plus Embedded Intelligence
Programmability and Control
via SDN with End-to-End Orchestration
Enables Simplification to Reduce OpEx
Simplification
Virtualized Software
for Dynamic Service Delivery and Scale
to Enable Faster Time to Revenue Growth
Virtualization
IP Everywhere
Evolved Programmable Network: Built for Internet of Everything (IoE)

34. Cisco Live 2013
4/24/2017