1. Internet2 Network of the Future
By Steve Corbató
Director, Backbone Network Infrastructure
Presented by Ana Preston
Program Manager, International Relations
CUDI Reunión de Otoño
Guadalajara
13 November 2001
This is a general overview presentation about Internet2. Internet2 is a consortium, led by US universities, which is recreating the partnership among academia, industry and government that fostered today’s Internet in its infancy.

2. Internet2 Network of the Future
Current state of Abilene
Evolution of optical networking
Next phase of Abilene
Outline of talk today; recap of where Abilene is today, some background on the evolution of opt. Networking and the next phase for Abilene
1/16/2019

3. Abilene background & milestones
Abilene is a UCAID project in partnership with
Qwest Communications
Nortel Networks
Cisco Systems
Indiana University
ITECs in North Carolina and Ohio
Timeline
Apr 1998: Project announced at White House
Jan 1999: Production status for network
Oct 1999: IP version of HDTV (215 Mbps) over Abilene
Apr 2001: First state education network added
Jun 2001: Participation reaches all 50 states & D.C.
Nov 2001: Raw HDTV/IP (1.5 Gbps) over Abilene
Partnerships are the foundation of how the Internet developed and they are also a part of the foundation of Internet2.
1/16/2019

4. Abilene focus
Enabling innovative applications and services not possible over the commercial Internet
Advanced service efforts
Multicast
IPv6
QoS
Measurement
Security
DDoS detection efforts (Arbor Networks & Asta Networks)
1/16/2019

5. Abilene status – November, 2001
IP-over-SONET (OC-48c) backbone
54 direct connections
3 OC-48c (2.5 Gbps) connections
22 will connect via at least OC-12c (622 Mbps) by year end
200+ primary participants
All 50 states, District of Columbia, & now Puerto Rico
15 regional GigaPoPs support ~70% of participants
37 sponsored participants
15 state education networks (SEGPs)
Collaboration of sponsoring member universities and Abilene connectors
1/16/2019

6. - also note that recently added POP in Chicago.
RED DOTS indicate GigaPOPS where international peering is taking place. Currently 8 out of 12 are.
- also note that recently added POP in Chicago.
1/16/2019

7. Over 200 participants. Covering pretty much all US universities and research centers. Landprint also involves all 50 states, including Hawaii and Alaska. Plus Puerto Rico
1/16/2019

8. International peering
Transoceanic R&E bandwidths growing!
Key international exchange points facilitated by Internet2 membership and the U.S. scientific community
STARTAP  STAR LIGHT – Chicago
Pacific Wave – Seattle
AMPATH – Miami
New York City – EP under development
CUDI - CENIC and Univ. of Texas at El Paso
International transit service
-- Pacific WAVE : new name for Pacific Northwest GigaPOP international services: providing Gigabit transport services for those entering into the US.
EP: Exchange Point
1/16/2019

9. StarLight (UIC/Northwestern/Argonne)
StarLight is an advanced optical infrastructure and
proving ground for network services optimized for
high-performance applications
-- Point out: Major investment (major facility) made by UIC, Northwestern University and Argonne National Laboratory.
-- Important international peering: NORDUnet, SURFnet, and many more. CAnet4 coming up very shortly
710 N. Lake Shore Drive, Chicago
Abbott Hall, Northwestern University
Chicago view from 710
Source: Tom DeFanti, UIC
1/16/2019

10. Measurement and DDoS Traffic characterization (Ohio ITEC)
Network utilization by SEGPs and Abilene ITN
Abilene Scavenger Service policing
GigaPoP pair hotspot identification
Passive measurement
Planned for Indy router backbone links
Collaboration with SDSC
Distributed Denial of Service detection
Strong IU Global NOC interest
Asta Networks (UCSD/U of Washington roots)
Arbor Networks (U of Michigan/Merit roots)
Data privacy and anonymity policy
Important concerns to us/Abilene:
-- Scavenger: less-than-best effort “labeling” qos
Re. Data Privacy and anonymity: sensitive to this.
1/16/2019

11. Network of the Future: Context for the next backbone
Computational science as an emerging interdisciplinary field
Bandwidth and distributed sensing capability as the next critical parameters
Complement CPU, memory & storage
Increasingly distributed data collection and storage
NSF Distributed Terascale Facility solicitation
Emergence of optical technologies
Dense Wave Division Multiplexing (DWDM)
Important distinction: optical transport vs. switching
Much new transcontinental conduit and fiber in place; a lot of business plans abandoned…
Glut of fiber & conduit – but not bandwidth
Drivers: - Science and science becoming more “digitized” and distributed. Eg. Distributing sensors, instruments. The network taking more relevant .
DTF: see next slide
Amplifying challenges over long gistances. Glut of fiber and conduit – lots of fiber on the ground but lighting it more costly, particularly at national – long distance – scale.
1/16/2019

12. TeraGrid Wide Area Network - NCSA, ANL, SDSC, Caltech
StarLight
International Optical Peering Point
(see
Abilene
Chicago
DTF Backplane (4x: 40 Gbps)
Indianapolis
Urbana
Los Angeles
DTF: project funded by US NSF. To connect four key research centers/sites: SDSC, CalTech, Argonne Nat. Lab, and NCSA via 4 lambas adding to a total capacity of 40 Gbps (provisioning for this) Dedicated bandwidth for specific high performance applications.
Explanation of dashed lines:
St. Louis: State of Illinois fiber between St. Louis and Chicago will be connected to I-WIRE by November This fiber will terminate at 900 Walnut Street-- the Switch Data Services carrier collocation facility in St. Louis (location of St. Louis Gigapop). In Chicago the State of Illinois fiber will connect both directly to Argonne (which will serve as one of the State’s repeater/opto-electronic equipment hubs) and to the James R. Thompson Center downtown. I-WIRE fiber connects the James R. Thompson Center to the Starlight hub via the Qwest POP.
Indianapolis: We are working with Indiana University to obtain fiber either to Urbana or Chicago. We have preliminary pricing and expect at least a pair of fiber to be available by Summer 2002 if not before.
Starlight / NW Univ
San Diego
UIC
I-WIRE
Multiple Carrier Hubs
Ill Inst of Tech
OC-48 (2.5 Gb/s, Abilene)
ANL
Multiple 10 GbE (Qwest)
Univ of Chicago
Indianapolis (Abilene NOC)
Multiple 10 GbE (I-WIRE Dark Fiber)
NCSA/UIUC
Solid lines in place and/or available by October 2001
Dashed I-WIRE lines planned for summer 2002
Source: Charlie Catlett, Argonne
1/16/2019

13. DWDM system components
Multiplexing terminals
’s per fiber pair
Amplifiers
All optical (OO)
Needed every ~100 km
Regenerators
OEO – electronic signal processing
Long haul (LH): needed every ~500 km
Ultra long haul (ULH): needed only every ~2500+ km
Organizational scale correspondence (LH)
Metro (campus): no amplifiers
Regional (GigaPoP): no regenerators
National (backbone): regenerators or ULH needed
Ren
explain DWDM
3 important components: 1) multiplexing terminals (at the ends/edges). 2) amplifiers: needed every 100 km or so. More tightly spaced. 3) regenerators: needed every 500 km. ULH: every 2500 km (new systems – from transoceanic links) cost still coming down
Organizational correspondence: campus (can do dark fiber) metro area, no amplifiers needed. Region: could be a state, need amplifiers but may not need regenerators. Larger/national: need regenerators. Bigger ultrahaul needed.
1/16/2019

14. Current state of optical networking
Dense Wave Division Multiplexing (DWDM)
Current systems can support > Gbps ’s (1.6 Tbps!)
Optical growth can overwhelm Moore’s Law (routers)
Costs scale dramatically with distance
Three possible scenarios for the future
Enhanced IP transport (higher BW and circuit multiplicity)
Fine-grained traffic engineering
p2p links between campuses, HPC centers, & Gigapops
Physical manifestation of switched circuits (a la ATM SVCs)
Evolution of optical switching will be critical
Leading international efforts in R&E exploration
The Netherlands, Canada, STAR LIGHT (Chicago)
Optical gain over electronics gain.
Longer you go, more it costs
Where is it going: 3 possible scenarios: 1) just upgrading/enhancing IP transport 2) combination of ip and dedicated capacity (lamba provisioning) for specific purposes. Requires traffic engineering 3) a la ATM (a few years ago) with switched virtual circuits. Still can’t happen until cost goes down on optical switches.
1/16/2019

15. National optical networking options
1 - Incremental wavelengths
Provision 10-Gbps ’s from provider(s) in the same way that SONET circuits are done for Abilene now
Exploit smaller incremental cost of additional ’s
2 - Dim Fiber
Acquisition of fiber IRU and subsequent O&M agreement for inter-PoP services (amps, regens, DWDMs?)
National footprint of 1-2 fiber pairs
IRU would cost $10-20M
Most likely awaits the development of lower-cost optical transmission equipment
1/16/2019

16. Future of Abilene Original UCAID/Qwest MoU amended on October 1, 2001
Extension of Qwest’s original commitment to Abilene for another 5 years – 10/01/2006
Originally expired March, 2003
Upgrade of Abilene backbone to optical transport capability - ’s
x4 increase in the core backbone bandwidth
OC-48c SONET (2.5 Gbps) to 10-Gbps DWDM
Capability for flexible provisioning of ’s to support future point-to-point experimentation & other projects
1/16/2019

17. Key aspects of the next backbone
IPv6
Running natively concurrently with IPv4
Replicate multicast deployment strategy
Motivations
Resolving IPv4 address exhaustion issues
Preservation of the original End-to-End Architecture
International collaboration
Router and host capabilities
Close collaboration with Internet2 IPv6 Working Group
Network resiliency
MPLS/TE fast reroute or IP-based IGP fast convergence
Opportunity for new measurement capabilities
Support of End-to-End Performance Initiative
1/16/2019

18. Next generation network deployment
October, 2001: Detailed technical design starts
February, 2002: PoP upgrades start
deployment in three phases
April, 2002 – Phase 1
October, 2002 – Phase 2
April, 2003 – Phase 3
October Completion of 10-Gbps upgrade
1/16/2019

19. Detailed technical design process
Qwest  service characterization
Interface selection: OC-192c POS likely
10GE WAN/LAN PHY interesting alternatives
Next generation router selection
10-Gbps interface selection
Native v6 routing and high-performance forwarding
Existing features: high-performance v4, ASM/SSM multicast & flow characterization
IPv6 coordination & planning
1/16/2019

20. Network design overview
Overall next generation topology is expected to be very similar to current design
Previous iterations to router locations
Washington DC, Chicago, Sunnyvale, Houston
Some differences expected due to Qwest DWDM deployment
Expect same number of backbone routers
1/16/2019

21. Optical fanout
Next generation architecture: Regional & state based optical networking projects are critical
Three-level hierarchy: backbone, GigaPoPs, campuses
CENIC ONI, I-WIRE, SURA Crossroads, Indiana, Ohio
Collaboration with the Quilt
Regional Optical Networking project
Carrier DWDM access is now not nearly as widespread as with SONET circa 1998
1/16/2019

22. The Quilt
A UCAID project support regional advanced networking initiatives
15 charter GigaPoPs
EDUCAUSE and SURA
Quilt GigaPoPs support over 70% of Abilene participants
Initial projects
Commodity Internet Services
Regional Optical Networking
Measurement
Led by Wendy Huntoon (Pittsburgh SC)
1/16/2019

23. Conclusions Abilene partnership with Qwest extended through 2006
Backbone to be upgraded to 10-Gbps in three phases by late 2003
Capability for flexible  provisioning in support of future experimentation in optical networking
Overall approach to the new technical design and business plan is for an incremental, non-disruptive transition
1/16/2019

24. For more information
Web:
1/16/2019