The Emerging Global e-Science Cyberinfrastructure Invited Talk North American IPv6 Summit Santa Monica, CA June 17, 2004 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

Data Intensive e-Science Will Require Common Cross-Agency Cyberinfrastructure

e-Infrastructure (Grids empowered) e-Infrastructure (Grids empowered) security mobility semantic web. automatic management broadband e-Learning e-Business aeronautics genomics environment astronomy e-Health e-Science Grid EU Vision: Create an Application Neutral e-Infrastructure Source: Luis Rodríguez-Roselló, EU Opportunity: Convergence of e-Science and e-Business Middleware

e-Science Global Cyberinfrastructure MUST be IPv6 Compatible "The value of IPv6 can be realized only if the deployment effort is broadly based on a global scale. --Vint Cerf

SLAC 7206 LBL Sunnyvale Albuquerque Atlanta New York Chicago 6BONE Distributed 6TAP PAIX StarLight 7206 El Paso SLAC LBNL ESnet BNL 18 peers 9peers 7peers 7206 DC TWC Abilene ANLFNAL IPv6 only IPv4/IPv6 IPv4 only The US Dept. of Energy IPv6 ESnet Backbone Source: Bill Johnson, DOE

Canadas Ca*net 4 is Completely Native IPv6 Enabled Since July 2002 With Dual Stack Network General inquiries : / Technical inquiries : Copyright© CANARIE · 3 x 10Gbps Wavelengths Source: Bill St. Arnaud, CANARIE

Europes 6net Large-Scale International IPv6 Pilot Network

First Beams: April 2007 Physics Runs: from Summer 2007 TOTEM LHCb: B-physics ALICE : HI pp s =14 TeV L=10 34 cm -2 s km Tunnel in Switzerland & France ATLAS Large Hadron Collider (LHC) e-Science Driving IPv6 Source: Harvey Newman, Caltech CMS

LHC Data Grid Hierarchy: A Richly Structured, Global Dynamic System Tier 1 Tier2 Center Online System CERN Center PBs of Disk; Tape Robot FNAL Center IN2P3 Center INFN Center RAL Center Institute Workstations ~ MBytes/sec Gbps 0.1 to 10 Gbps Tens of Petabytes by An Exabyte ~5-7 Years later. Physics data cache ~PByte/sec ~ Gbps Tier2 Center ~ Gbps Tier 0 +1 Tier 3 Tier 4 Tier2 Center Tier 2 Experiment CERN/Outside Resource Ratio ~1:2 Tier0/( Tier1)/( Tier2) ~1:1:1 Source: Harvey Newman, Caltech

TCP/IPv6 single stream Land Speed Record Average speed (over 20 minutes): 4.00 Gbps Data transferred: 560 Gbytes Distance: km Data Transfer from CERN, Geneva to the Caltech booth, Supercomputing 03 in Phoenix, through the LHCnet/DataTag, Abilene and SciNet backbones, using a single TCP/IPv6 stream Source: Harvey Newman, Caltech November 18, 2003

Global Telescience Infrastructure e-Science IPv6 Driver Remote Controls Features Native IPv6 for: –Digital Video and HDTV –Control Systems –Grid-Enabled Data transfer (IPv6 GridFTP) Control Imaging Collaboration Video System Other OGSA Grid-based Services: Data Grid, Computation, Logging services, etc OGSA Compliant Instrumentation Services Session Service Internet Telescience Portal

Collaborate Internationally Using Networked Testbeds: Amsterdam to Japan Using Native IPv6 Network Juniper M40 SDSC 6tap/StarLight TransPAC APAN OC3 R Osaka University UHVEM (Osaka, Japan) oc3 Tokyo XP ATM SW ATM SW SDSC V6 services Gb Ether ESnet Native IPv6 oc12 peer SURFnet R IGRID 2002 (Amsterdam, Sept 2002) SURFnet Juniper T640 Supercomputing 2002 Baltimore, Nov 2002 VBNS WIDE network IPv6 via JGN Gb Ether oc192 Abilene NCMIR (San Diego) Source: UCSDs Tom Hutton, SDSC & David Lee, NCMIR Mark Ellisman

High Energy and Nuclear Physics Major Links: Bandwidth Roadmap (Scenario) in Gbps Continuing the Trend: ~1000 Times Bandwidth Growth Per Decade; We are Rapidly Learning to Use Multi-Gbps Networks Dynamically

National Lambda Rail (NLR) Will Create a Dedicated Optical Network in the US National Lambda Rail Partnership Serves Very High-End Experimental and Research Applications 4 x 10Gb Wavelengths Initially Capable of 40 x 10Gb wavelengths at Buildout

Global Lambda Integrated Facility (GLIF) Created in Reykjavik, Iceland 2003 DWDM SURFnet 10 Gbit/s SURFnet 10 Gbit/s SURFnet 10 Gbit/s IEEAF 10 Gbit/s Dwingeloo ASTRON/JIVE Dwingeloo ASTRON/JIVE Prague CzechLight Prague CzechLight 2.5 Gbit/s NSF 10 Gbit/s Stockholm NorthernLight Stockholm NorthernLight CA*net4 2.5 Gbit/s New York MANLAN New York MANLAN Tokyo WIDE Tokyo WIDE 10 Gbit/s IEEAF 10 Gbit/s 2.5 Gbit/s Tokyo APAN Tokyo APAN Amsterdam NetherLight Amsterdam NetherLight Geneva CERN Geneva CERN London UKLight London UKLight Chicago StarLight Chicago StarLight Source: Kees Neggers, SURFnet

OptIPuter: Alternate Protocols Over Lambdas Can Sustain Enormous Bandwidth File Transfers Gbps out of 20 Over Two Dedicated 10 GE NCSA to SDSC Reliable Blast UDP

NASA is Jump-Starting a Dedicated Optical Network by Collaboration with NSF and National Lamba Rail NASA Goddard IT Pathfinder Working Group Earth and Climate Scientists- Creating a Virtual Collaboratory Between Goddard and SIO (UCSD) Coupling NASA Centers to NSF OptIPuter

Cyberinfrastructure in Design Phase-- Fiber Optic Cables Satellite Wireless Future OptIPuter Driver: Gigabit Fibers on the Ocean Floor ORION-Ocean Research Interactive Ocean Network