1. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Circuit-switched High-speed End-to-End Transport arcHitecture (CHEETAH) Cisco MSPP 15454 Connection to primary 10/100M NIC Connection to secondary GbE NIC for uplink Connection to third 10/100M NIC for downlink Internet OC-48c links CHEETAH circuit Cisco 12000 series router Cisco MSPP 15454 Cisco 12000 series router SONET network cloud

2. CUNY (NSF Planing Meeting, 11/12/03, Virginia) The Router Disconnect Experiment Objectives: Efficient utilization of the optical circuit –In default mode, the circuit is used for TCP/IP traffic. –In CHEETAH mode, part of the bandwidth is dynamically setup and released upon request for large file transfers. Avoid TCP/IP traffic loss –During mode transfer from default to CHEETAH, we need to avoid loss of TCP/IP packets. –Maintain connectivity between routers for TCP/IP traffic and CHEETAH signaling.

3. CUNY (NSF Planing Meeting, 11/12/03, Virginia) The Router Disconnect Experiment Possible solutions Disable one of the router interface cards. –Waiting for OSPF to update the routing table leads to TCP/IP packet loss. Link bundling –Avoids Loss of TCP/IP packets.

4. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link bundling (1) What is link bundling Grouping multiple point-to-point links together into one logical link to provide higher bandwidth (a bigger pipe), redundancy, and load sharing between two routers.

5. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link bundling (2) Cisco 12000 Series Internet Routers support the following types of link bundling : Gigabit EtherChannel is used to bundle multiple Gigabit Ethernet (GE) interfaces. POS Channel is used to bundle multiple Packet-over-SONET (POS) interfaces.

6. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link bundling (3) Benefits Flexible, incremental bandwidth Transparency to network applications Load balancing (equal cost) across all active links on the bundle Out-of-service support: a Gigabit EtherChannel or POS Channel is brought down if the minimum number of GE or POS links are not up. Bandwidth propagation support: bandwidth changes in a Gigabit EtherChannel or POS Channel can be (optionally) propagated to the upper-layer protocols until the amount of bandwidth required in the link bundle exceeds a specified threshold.

7. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link bundling (4) How it works A Gigabit EtherChannel or POS Channel link bundle is created on a line card or across multiple line cards. An adjacency representing the new bundle is created in the forwarding information base (FIB) table on the gigabit route processor (GRP) and is forwarded to all the line cards. This adjacency represents a virtual link and has pointers to individual links in the bundle. As incoming data packets are received by the router, the line card recognizes the virtual adjacency, and properly routes and load balances the packets across the sub- adjacencies represented by the virtual adjacency. Packets are properly routed and load balanced towards the bundle, and then properly transmitted across the bundle.

8. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link Bundling in CHEETAH Cisco MSPP 15454 Internet SONET network cloud HostCisco 12404 GbE card Control card Second BbE NIC Third 10/100M NIC 8-port fast Ethernet card Route processor card 4-port OC-12 POS line card 4-port OC-12 card 10/100M Ethernet card Link bundle Primary 10/100M NIC OC48ELR ITU optics card

9. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link Bundling in CHEETAH (continuous) The four OC-12 links between Cisco 12000 series router and MSPP can be bundled together as one logical link. Before the mode transfer from default to CHEETAH, upon receiving the signaling message,3 out of the 4 member links can be removed, the router automatically route the TCP/IP packet to the left member links. No TCP/IP packets are lost. The removed member links are used for CHEETAH circuit setup and can be restored for TCP/IP after the CHEETAH circuit is released.

10. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link Bundling Configuration Example 1. Create bundled link logical Interface -- pos-channel interface, then assign an IP address Router1# configure terminal (Start configuring bundled link) Router1(config)# interface pos-channel 1 (Create a logical port-channel interface, for Gigabit etherChannel, replace ‘pos-channel 1’ with ‘port-channel 1’) Router1(config-if)# ip address 41.1.0.1 255.255.0.0 (Assign an IP address and subnet mask to the logical port-channel)

11. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link Bundling Configuration Example (continuous) 2. Assign a Packet-over-SONET interfaces to the pos- channel interface. Router1(config)# interface pos2/0 (Create or modify an existing Packet-over-SONET interface and enter interface configuration mode. For Gigabit etherChannel, replace ‘pos2/0’ with ‘gigabitethernet2/0’). Router(config-if)# channel-group 1 (Assign the POS interface to the POS Channel associated with the specified channel number). Continue? [yes]: yes ((Optional) Enter yes at the command prompt to configure the Packet-over-SONET interface as a member of the pos-channel group. The interface’s IP address and loopback configuration are deleted). Router1(config-if)# exit (Exits interface configuration mode. Repeat Step 1 through Step 4 to add up to eight POS interfaces to the POS Channel bundle).

12. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Link Bundling Configuration Example (continuous) 3. Remove one of packet-over-SONET interfaces from a link bundle Router1(config)# interface pos2/0 (Specify a Packet-over-SONET interface and enter interface configuration mode, for Gigabit Ethernet interface, replace ‘pos’ with ‘gigabitethernet’). Router1(config)# no channel-group 1 (Remove the GE or POS interface from a Gigabit EtherChannel or POS Channel). Router1(config-if)# end (Exit interface configuration mode).

13. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Project Implementation People Involved –Prof. Ibrahim Habib –Ph.D. candidate Qiang Song –Ph.D. Candidate (TBD) Equipment to be purchased –Cisco 12000 series router –Two high performance PCs –2 Gigabit Ethernet cards

14. CUNY (NSF Planing Meeting, 11/12/03, Virginia) Year 1 Work Plan 1.Configuring, and experimenting with the Cisco 12000 router (1 st Quarter)- Emulate the operation of two routers. 2.Link Bundling configuration, testing, and verification (2 nd Quarter). 3.Documentations and delivery of results (4 th Quarter).