1. MPLS-Based Hierarchical SDN for Hyper-Scale DC/Cloud draft-fang-mpls-hsdn-for-hsdc-02 IETF 92, MPLS WG, March 27, 2014 Luyuan Fang lufang@microsoft.comlufang@microsoft.com Vijay Gill vgill@microsoft.comvgill@microsoft.com Deppak Bansal dbansal@microsoft.comdbansal@microsoft.com Fabio Chiussi fchiussi@cisco.comfchiussi@cisco.com Chandra Ramachandran csekar@juniper.netcsekar@juniper.net Shahram Davaridavari@broadcom.comdavari@broadcom.com Linda Dunbarlinda.dunbar@huawei.comlinda.dunbar@huawei.com Barak Gafnigbarak@mellanox.comgbarak@mellanox.com Andrew Qu andrew.qu@mediatek.com andrew.qu@mediatek.com Jeff Tantsurajeff.tantsura@ericsson.comjeff.tantsura@ericsson.com Yakov Rekhter Ebben Ariesexa@fb.com Daniel Voyerdaniel.voyer@bell.ca Wen Wangwen.wang@centurylink.com Himanshu Shahhshah@ciena.com Ramki Krishnan

2. Changes from 00 version

3. Refresh: MPLS-Based HSDN Design Requirements

4. HSDN – One Fundamental Abstraction for Both Forwarding and Control HIERARCHICAL UNDERLAY PARTITION (UP)HIERARCHICAL CONTROL UP-0 HSDN-C UP-0 HSDN-C UP-1 HSDN-C UP-2 HSDN-C UP-2 HSDN-C UP-2 HSDN-C UP-1 HSDN-C UP-2 HSDN-C UP-2 HSDN-C UP-2 HSDN-C UP-1 HSDN-C UP-2 HSDN-C UP-2 HSDN-C UP-2 Forwarding Plane Control Plane One Consistent Abstraction Paradigm  “Infinite” Horizontal Scaling One Consistent Abstraction Paradigm  “Infinite” Horizontal Scaling Divide and conquer Keep all domains balanced and small Locally minimize network state UP-1 UP-2 UP-1 UP-2 UP-1 UP-2

5. 5 HSDN achieves massive scale using surprisingly small forwarding tables while supporting both ECMP load balancing and any-to-any end-to-end TE

6. UP-0 UP-1,4 UP-2,4,28 UP-2,4,M UP-1,N UP-2,N,1UP-2,N,M 6 IP Lookup, Push PL0, Push PL1, Push PL2, Push VL TOR PL2 PL0 PL1 VL UPBN 2,4,M Server Hyper-V VRT VM Server Hyper-V VRT VM Server Hyper-V VRT VM UPBN 2,N,1 UPBN 2,N,M UPBN 1,N Server Hyper-V VRT VM Server Hyper-V VRT VM Server Hyper-V VRT VM PayloadIP Payload UPBN 1,4 UPBN 2,4,28 PL2PL0PL1VL HSDN Label Stack 3 Path Labels © 2015 Microsoft – All Rights Reserved PayloadIP2841437PayloadIP281437PayloadIP281437PayloadIP2841437PayloadIP14PayloadIP2841437PayloadIP1437PayloadIP1437

7. Outer Label UP0 Destination ID (DID) UP0 Path ID (PID) MSBLSBd 0 bits 20-d 0 bits UP1 Destination ID (DID) UP1 Path ID (PID) MSBLSBd 1 bits 20-d 1 bits UP2 Destination ID (DID) UP2 Path ID (PID) MSBLSBd 2 bits20-d 2 bits Path Label 0 (PL0) Path Label 1 (PL1)Path Label 2 (PL2)VN Label (VL0)

8. HSDN Control Plane

9. HSDN scales to tens of millions of underlay network endpoints with small LFIBs Number of Server endpointsMax LFIB size ECMP only (No TE) Max LFIB size ECMP and TE Concurrently 3 M~ 1K< 14K 10 M< 2K< 24K 40 M< 3K< 36K

10. Next Steps