1. Low Cost, Long Haul Gigabit Ethernet Alan Cowie AARNet Pty Ltd January 2004

2. Outline ● Opportunity ● Geography/Building Blocks ● Proof of Concept ● Design ● Resource Requirements ● Outcome ● References/URLs

3. Opportunity ● The main campus of the University of New England (UNE) is located in Armidale, Northern NSW. ● UNE required a replacement for their expensive, ATM based tail link (8Mbps on E3) to the AARNet hub in Sydney. ● Transgrid offered UNE some surplus bandwidth on existing Transgrid infrastructure. ● AARNet wanted to explore low cost, long haul opportunities.

4. Geography

5. 330kV Tower

6. The Transgrid Network

7. Concept ● Transgrid has long run fibre. ● AARNet is a Carrier and has network building and operating experience. ● AARNet and Transgrid formed a partnership to provide bandwidth to UNE. ● Excess capacity could be sold to other customers. ● UNE wanted a cost effective IP/ethernet service from Sydney to Armidale.

8. Building Blocks ● TG had installed fibre in the Overhead Earth wire on some sections of their 330kV network. ● The fibre is brought to the ground and terminated only at substations and powerstations. ● The Armidale to Sydney section had some long fibre runs (>80km). ● AARNet was already using Cisco CWDM equipment with very good optical properties.

9. Building Blocks 2 ● The CWDM GBICS support 1.25-Gbps full- duplex links with an Optical link budget of better than 30 dB. ● Cisco 3550-12T Gigabit ethernet Switches. Each supports 10 GBIC interfaces and two copper 10/100/1000 ports.

10. Available Fibre A endB endKMAttn dB ArmidaleTamworth10624.18 TamworthMuswellbrook13029.3 MuswellbrookLiddell194.96 LiddellNewcastle10422.69 NewcastleEraring225 EraringVales Point327.6 Vales PointMunmorah82.29 MunmorahSydney North8017.8 Sydney NorthSydney West389.04

11. Proof of Concept ● The Tamworth to Muswellbrook leg was the longest at 130km with a 29.3dB optical loss. ● The PoC was tested on this leg using 1470nm and 1490nm CWDM GBICs in borrowed Cisco switches. ● When tested, the 130km link came up straight away and ran without error for the duration of the test. Power meter readings showed ample signal. ● The 1550nm GBIC were expected to perform better than the 1470 & 1490nm test optics.

12. Design ● Each switch is a OEO signal regenerator and a breakout node. ● Each switch can support 5 north/south GE paths. ● No provision for OOB management ● Customer separation by QinQ VLAN stacking ● Radio last leg until Broadway substation completed

13. Multiplex Design ● Initial design supports only 1 GigE path due to MUX losses ● Shorter runs can support CWDM mux ● Longer runs will need amplification to support CWDM mux

14. Resource Requirements ● >500kms of fibre ● 6 x Cisco 3550-12T Gigabit ethernet switches ● 12 x Cisco 1000BASE-CWDM GBIC 1550 nm ● A few UPSs ● Patch leads ● Fibre tails from the TG sites to the end users ● Clue

15. Outcomes ● Lit up >500km fibre run with Gigabit Ethernet. ● Six potential customer breakout/access nodes. ● Total cost for all active/optical gear less than cost of one SDH node. ● Potential for up to 8 GE paths.

16. References/URLs ● http://www.aarnet.edu.au/ ● http://www.une.edu.au/ ● http://www.transgrid.com.au/about_us/inset.html ●http://www.cisco.com/warp/public/cc/so/neso/olso/nesocdwm/cgbic_ov.htm ● http://mangrove.nswrno.net.au/dist/public/tgune/unetgnet2_frame.htm ● http://xl.nswrno.net.au/tgune/ ● Alan Cowie – AARNet Sydney alan.cowie@aarnet.edu.au