1 SX TransPORT - the infrastructure to support e-science George McLaughlin Director, International Developments, AARNet APAN January 2005 Bangkok

2 SXTransPORT Southern Cross Trans Pacific Optical Research Testbed AARNet and Southern Cross Cable Network (SX) worked together to connect Australia’s research community at unprecedented speed to the global cyberinfrastructure The Southern Cross Trans-Pacific Optical Research Testbed (SXTransPORT) partnership was announced on 11 th December 2003 with support from the Australian Government Dual 10Gbps circuits between Australia and US West Coast AARNet interconnects SXTransPORT at Pacific Wave to other global research networks, and in Sydney to AARNet3 (Australia’s multi-path 10Gbps trans-continental research network based on Nextgen fibre)

3 SXTransPORT Southern Cross Trans Pacific Optical Research Testbed Acceptable Use Policy applies on the 10Gbps circuits – R&E institutions only, no commodity or commercial transit (separate 622Mbps circuits are used for commodity to PAIX and Telehouse America, LA) Provides affordable (subscription-based) high throughput allowing Australia to effectively participate in global e- science initiatives Strengthens the case for locating major international infrastructure (like the Square Kilometre Array) in Australia

4 SXTransPORT dual 10Gbps circuits

5 Uncompressed HDTV interactive multimedia (1.4Gbps) At the exhibition floor of the Pittsburgh SC 2004 conference, AARNet and ResearchChannel demonstrated high definition real-time video interaction between Canberra Australia, Seattle and Pittsburgh ~2million pixels per frame; 60 frames per second interleaved; using 1.4Gbps for each stream; video quality amazing During the 30 hours of demonstration, 20 Terabytes of data were transmitted in each direction No custom equipment involved, all off-the-shelf components A compressed HDTV demonstration (cf the uncompressed version described above) was demonstrated at the Pacific Telecommunications Council (PTC) 2005 conference in Hawaii The compressed version runs at (only?) 270Mbps. The capacity limitations at the venue (1Gbps) prevented use of uncompressed

6 Uncompressed HDTV interactive video (1.4Gbps) Remember this is a single application, seven streams of uncompressed HDTV would saturate a 10Gbps link! The paths used for the Pittsburgh demo were –Canberra to Sydney on AARNet3 (10Gbps) –Sydney to Hillsboro on SXTransPORT (10Gbps) –Hillsboro to Portland to Seattle on NLR (10Gbps) –Seattle to Pittsburgh on NLR (10Gbps) The first three paths were used for the PTC demo, but with an additional ‘drop’ at Kahe Point, Oahu to Honolulu

7 SC2004 images

8

9

10 Futures for research networking - Hybrid Optical Packet Networks Routed networks still good for most users Some users have special needs –massive data transfers –use protocols that could impact others, or others impact them Best to remove them to their own lambdas, to contain them in a way that satisfies their needs without detrimental impact on others (and vice-versa)

11 Global Lambda Infrastructure Facility (GLIF) A facility to support the real-time transfer of massive amounts of data to facilitate emerging e-research initiatives Lambda infrastructure owners “pool” circuits not in use for their own requirements to make available to other members on an agreed basis To be based on interconnect or access agreements Register will be maintained with conditions as basis of scheduling Lightweight governance structure

12 Meshing SXTransPORT into GLIF Hybrid Optical Packet approach Retain the “northern” circuit (to Oahu and Seattle) as 10Gbps layer 3 Deploy the “southern circuit” (to Spencer Beach (and Mauna Kea) as switched lightpath (possibly 8 x 1 Gbps) Use several of the 1 Gbps circuits for circuit swapping (eg with CANARIE or SURFnet) or for the GLIF pool

13 Global Lambda Integrated Facility Predicted Bandwidth for Scheduled Experiments, March

14 Global Lambda Integrated Facility Predicted Bandwidth for Scheduled Experiments, March 2005 Predicted international Research & Education Network bandwidth, to be made available for scheduled application and middleware research experiments by December 2004.

15 Huygens Space Probe lands on Titan - monitored by 17 telescopes in Australia, Japan, China and the US In October 1997, the Cassini spacecraft left Earth to travel to Saturn On Christmas day 2004, the Huygens probe separated from Cassini and on 14 January 2005 started it’s descent through the dense (methane, nitrogen) atmosphere of Titan (speculated to be similar to that of Earth billions of years ago) The signals sent back from Huygens to Cassini were monitored by 17 telescopes in Australia, China, Japan and the US to accurately position the probe to within a kilometre (Titan is ~1.5 billion kilometres from Earth)

16 Australian eVLBI data sent over high speed links to the Netherlands The data from two of the Australian telescopes were transferred to the Netherlands over high-speed links and were the first to be received by JIVE The data was transferred at an average rate of 400Mbps (a rate that would fill a CD every 13 seconds!) The data from these two telescopes were reformatted and correlated within hours of the end of the landing This early correlation allowed early calibration of the data processor at JIVE, ready for the data from other telescopes to be added Significant international collaborative effort

17 Global Collaboration The data on IDE disks was flown from Parkes (The Dish) and Coonabarabran (Mopra) to Marsfield in Sydney (CSIRO Australia Telescope National Facility, Au) This data was transferred to AARNet’s UTS International GigaPoP using a dedicated GbE path provided by CeNTIE, one of Australia’s Advanced Network Program (ANP) initiatives Backhaul to the Southern Cross landing station in Sydney was provided on a 10Gbps circuit on AARNet’s fibre from UTS) Transit to Pacific Wave (US) was engineered on a path of the northern 10Gbps circuit of SXTransPORT, a joint initiative of Southern Cross Cable Networks (SCCN,NZ/BM) and AARNet

18 Global Collaboration AARNet’s 8812 Procket at Pacific Wave was connected to a CANARIE (CA) switch and a User Controlled LightPath (UCLP) set up at 1GbE to the Joint Institution for VLBI in Europe (JIVE, NL) The Physical path for the UCLP involved the use of CAnet4 (CA) from Pacific Wave to the ManLan (US) facility in New York; the Internet Educational Equal Access Foundation’s (IEEAF, US) trans-Atlantic capacity to the SURFnet, NL GigaPoP in Amsterdam; and one of six GbE paths from the SURFnet GigaPoP to the JIVE facility at Dwingeloo The possibility of this was discussed after Guido Aben’s (SURFnet) participation in the Australian Middleware forum in mid-December and the whole arrangement, including concept, coordination, set-up, testing and the experiment itself was accomplished in a little over three weeks.

19 Those involved AARNet, AU CANARIE/CAnet4, CA CeNTIE, AU CSIRO Australia Telescope National Facility (ATNF), AU IEEAF, US JIVE, NL ManLan, NY, US Pacific Wave (north), US Southern Cross Cable Networks, NZ/BM SURFnet, NL

20 Where next for e-astronomy? – in Australia AARNet working with members of the Australian Astronomy community to take fibre/wavelengths all the way to the telescopes and working with our overseas colleagues to facilitate new joint e-astronomy initiatives

21 Overlay networks

22 Where next for e-astronomy? – Global Astronomy initiative – Mauna Kea, Hawaii UH 0.6 UH 0.6-m telescope 0.6m University of Hawaii UH 2.2m UH 2.2-m telescope 2.2m University of Hawaii IRTF NASA Infrared Telescope Facility 3.0m NASA CFHT Canada-France-Hawaii Telescope 3.6m Canada/France/UH UKIRT United Kingdom Infrared Telescope 3.8m United Kingdom Keck I W. M. Keck Observatory 10m Caltech/University of California Keck II W. M. Keck Observatory 10m Caltech/University of California Subaru Subaru Telescope 8.3m Japan Gemini Gemini Northern Telescope 8.1m USA/UK/ Canada/Argentina/ Australia/Brazil/Chile Submillimeter CSO Caltech Submillimeter Observatory 10.4m Caltech/NSF JCMT James Clerk Maxwell Telescope 15m UK/Canada/Netherlands SMA Submillimeter Array 8x6m Smithsonian Astrophysical Observatory/Taiwan Radio VLBA Very Long Optical/Infrared UH 0.6m UH 0.6-m telescope 0.6m University of Hawaii UH Baseline Array 25m NRAO/AUI/NSF

23 Mauna Kea Observatories

24 SXTransPORT - global astronomy initiative SCCN OC-192 SCCN OC-192 Big Island Spencer Beach Los Osos (Morro Bay) Spencer Beach to Waimea Fiber IRU & optics to Cal Poly SLO Hilo to MKOCN (Summit) Waimea to Hilo Optics to carry new OC192 lambda over CENIC from SLO to LA Pwave South (LA)

25 Where next for e-astronomy? – Global Astronomy initiative – Mauna Kea, Hawaii Next week Bill St Arnaud, David Lassner, John Silvester, AARNet, and astronomers from the Canada France Hawaii Telescope (CFHT) will meet at Weimea to progress options for high capacity connections on the big island to the Mauna Kea summit and the base stations at Hilo and Weimea A number of challenges (monopoly telco, volcanic rock, native land rights) Significant interest by other telescope owners

26 In conclusion Recent demonstrators have shown an unprecedented willingness to collaborate globally for the collective good An exciting array of new opportunities is emerging – we need the will and determination to bring these to reality