1. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network1 Lada Altmannová Stanislav Šíma

2. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network2 Towards optical NRENs In some cases, optical network must be implemented in several consecutive phases, in which parts of an existing network are being replaced. This is the CESNET2 case. In this presentation, attention is paid mostly to information and experience, which can be useful for constructions of optical NRENs in other countries, and to problems, for which we would like to gain more experience from abroad.

3. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network3 First step: gigabit speed A relatively simple solution is to purchase SDH services operating at 2.5 Gb/s (STM-16 or OC-48) or 10 Gb/s (STM-64 or OC-192). These services are offered by telecommunication operators using fibre optics. However, this solution is rather expensive for NRENs, and from technical point of view it is quite complex for the given purpose. CESNET has different approach.

4. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network4 We expect, that the wavelength lease will be preferred especially for long-distance connections (e.g., for fibre length over 400 km, which usually means an air distance of end points of about 200 - 350 km, considering curves of the path and its terrain profile). However, as WDM is just emerging as a new service, providers now try to include as much of the price of the installed WDM equipment as possible in the price of the wavelength lease. This can surprisingly make the wavelength lease more expensive than the fibre lease even for fibre length over 400 km.

5. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network5 TEN-34 CZ as initial network CESNET2, a national gigabit optical network for research and education in the Czech Republic, is gradually constructed by converting the TEN-34 CZ and subsequently TEN-155 CZ network, which used SDH lines (up to 34 Mb/s, and later up to 155 Mb/s)

6. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network6 Steps before: special solution June 1997: 34 Mb/s wireless backbone leased from Czech Radio Communication company July 1998: 34 Mb/s optical backbone with wireless first mile leased from Aliatel company (fiber is conducted in a ground cable on the top of high-voltage poles) June 1999: 155 Mb/s SDH Praha-Brno optical line with wireless first mile leased from Aliatel

7. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network7 First gigabit: leased fibre Line Praha - Brno was launched in January 2000. 323 km along oil distribution pipeline. Cisco 12008 routers with 2.5 Gb/s (OC-48/STM-16) adapters were installed on both ends. Transmitters used in the adapters had the range of 80 - 100 km. Three bidirectional regenerators Cisco ONS 15104 were also used on this line, located on provider premises along the line. ONS 15104 use the same optical transmitters and receivers as these adapters. This intercity gigabit line was one of the first in Europe to be entirely used for production IP traffic.

8. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network8

9. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network9 Building Gigabit Core Tender was announced in the second half of the year 2000 Candidates could offer a fibre lease, a wavelength lease or an SDH service. We have chosen 7 lines from 6 different suppliers. All circuits were put in service in the first half of the year 2001: 4 leased fibre lines from 3 companies (Sloane, Selfservis, CEZtel) used for STM-16 transfer, 4 lambda services used for STM-16 transfer from CT, CRa and Aliatel.

10. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network10 Gigabit Lines of CESNET2 Network (June 2001) Nodes are equipped with CISCO 12016 routers with OC-48 adapters. ONS 15104 is bidirectional optoelectric OC-48/STM-16 regenerator.

11. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network11 The number of installed regenerators depends also on possibilities for their placing along the line. E.g. the line Praha - Liberec is divided into three sections - 40 km, 80 km and 40 km - and it is not possible to place a regenerator in the 80 km section (fibre on the top of high-voltage poles). In one case, the regenerators were leased by the supplier of the line. In other cases, the regenerators belong to CESNET. Regenerator management: Local assistance is provided by the supplier of the line and CESNET can configure this regenerators remotely.

12. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network12

13. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network13 Changing topology Based on the acquired experience, a tender was announced in the second half of the year 2001 for additional fibre or wavelength lease. We requested preliminary offers to find out which lines could be provided by individual suppliers for comparatively low prices. This depended on the topology of their fibre infrastructure, which was not fully announced before. We try to use Gigabit Ethernet (and 10-Gigabit Ethernet, if possible) for new long distance lines.

14. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network14 General conclusion for year 2002 STM-16 lambda service price decreased - to be comparable with leased fibre prices. Gigabit or 10-Gigabit Ethernet is less expensive solution for gigabit lines over long distances. Constant budget allows further leased fibres or lambdas – backbone topology change is feasible. Is possible to lease fibre along railway, along oil, gas or heat distribution pipelines and from electric power distribution or cable TV companies (but highway or road fibre leasing is not possible yet). Big problem is fibre for first mile of intercity lines.

15. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network15 First Optical Mile for intercity lines A.Supplier of an intercity line pays for the installation of the necessary first optical mile B.Member of the CESNET association pays for the installation of optical connection to its nodes. The alternative A is convenient for the supplier in locations with a sufficient demand for services. The alternative B remains necessary in peripheral locations, where providers do not want to invest into a new cable. Usually, more subjects interested in high- quality (that is optical) Internet access build their own "local optical network of fiber owners" in a joint-effort.

16. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network16 Prices for research - CZ 2002 We use microwave 34 M lines with FastEthernet interface

17. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network17

18. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network18 CESNET2 development: 2002 Dual connection to GigaPoPs on backbone (higher reliability, circuit testing with real traffic). GE, FE or Eth lines to other cities (better service for remote users, more traffic for backbone). 149 km GE fibre line Ostrava – Olomouc with regenerator is operating since January 7, 2002 189 km GE fibre line Praha – Pardubice without in-line amplification or regeneration is operating since May 17, 2002 176 km 10 GE fibre line Praha - Plzen is prepared

19. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network19 Ostrava – Olomouc ( Long distance GE line since January 7, 2002 ) 149 km leased fiber, in-line L2 switch used as regenerator Traffic statistics: http://www.cesnet.cz/provoz/zatizeni/ Line cards: GE for GSR with GBIC-ZX Catalyst 3512 XL with GBIC-ZX GBIC-ZX: Pin: 0 to 4,77dBm, Pout: -23 to 0dBm, power budget: 23dB

20. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network20 Hardware cost savings Capital cost savings are achieved in the CESNET2 network by gradually deploying Gigabit Ethernet instead of STM-16 over optical fibre. Optical fibres are connected to GSR 12016 routers. Costs depend on price of GSR interface ports mainly: ~ 27.000 Euro for GE port instead of 88.000 Euro for STM-16 port, ~ 15.000 Euro for GE regeneration instead of 30.000 Euro for STM-16 regeneration. (this example is from end of year 2000, relations are relatively stable despite of price decreasing) Capital savings are around 66 % for one fibre line with one regeneration point (approximately 160 km long line).

21. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network21 Praha-Pardubice (Long distance GE line since May 17, 2002) 189 km leased fibre G.652, attenuation 44.65dB, without in-line equipment Traffic statistics: http://www.cesnet.cz/provoz/zatizeni/ Line cards: GE for GSR with GBIC-ZX Optical amplifier: Keopsys KPS-BT-C-21-Bo-FA 21dBm booster, C-band single channel Optical attenuator: 5dB (for optical amplifier input)

22. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network22

23. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network23

24. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network24 Gigabit lines deployment (June 2002) ONS 15104: bidirectional STM-16 regenerator, C3512: switch used as regenerator, * without in-line regeneration or amplification, single colour optical post-amplifier (booster) 21dBm in both end points

25. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network25 Line upgrade without provider BIP - Bandwidth Independent Price (e.g. fibre leasing) NIL – Nothing In-Line (without in-line housing, pre- and post-amplification is possible): lower installation and operational costs UU – User Upgradeable (possibility of line upgrade by user ) = without provider assistance and without additional payment (up to physical limits) UU = BIP + NIL

26. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network26 UU possibility UU – Upgrade by User, NIL – Nothing In-Line, BIP – Bandwidth Independent Price

27. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network27

28. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network28

29. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network29 Possibilities for international fibre connection of NRENs Praha-Műnchen (525 km) Praha-Frankfurt a. M. (1022 km) Praha-Bratislava-Wien (682 km) Praha- Poznaň (1010 km) Praha-Warszava (1080 km)

30. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network30 Prices for research: international example

31. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network31

32. CESNET a.l.e. Czech Educational and Scientific Network www.cesnet.cz June 4, 2002Development of the CESNET2 Optical Network32 Acknowledgments The authors are particularly grateful to Jan Gruntorád, Václav Novák, Jan Radil, Martin Míchal, Václav Fanta, Pavel Vachek, Sven Ubik, Jana Peroutíková and other colleagues from CESNET for their cooperation.