OptIPuter Networks Overview of Initial Stages to Include OptIPuter Nodes OptIPuter Networks OptIPuter Expansion OPtIPuter All Hands Meeting February 6-7 UCSD

Compute + Data + Viz Grid: Building Block Generic OptIPuter node is one or more of: –Cluster: 16 – 128 nodes (160GF – 1.2 TF) –Storage: 0.5TB – 10 TB –Visualization: Desktop, Wall, Immersive –Specialized data source/sink instruments Connected to other nodes via the OptIPuter Network Commodity GigE Switch

switch Cluster – Disk Disk – Disk Viz – Disk DB – Cluster Cluster – Cluster School of Med Chemistry, Preuss, 6 th College, Engineering, Arts SDSC SIO, SDSU High-endDB Server switch Chiaro Router Nodes Connected by Optical Routers or Switches UCSD OptIPuter

Integration into CalIT2 Infrastructure Tightly Coupled Optically-Connected OptIPuter Core Wireless Sensor Nets, Endpoints Loosely Coupled Peer-to-Peer Networks Routers

½ Mile Initial UCSD OptIPuter Deployment SIO SDSC CRCA Phys. Sci - Keck SOM JSOE Preuss 6 th College Phase I, Fall/Winter Phase II, 2003 SDSC Annex To Other OptIPuter Sites Central hub/router Node M

UCSD OptIPuter Fiber and Nodes

UCSD OptIPuter Deployment Schedule Phase I, Fall/Winter –Scripps Institute of Oceanography (SIO) –San Diego Supercomputer Center (SDSC) –SDSC Annex –School of Medicine (SOM) Phase II, during 2003 –Center for Research in Computing and the Arts (CRCA) –Jacobs School of Engineering (EBU1) –Physical Sciences - Keck Centers –Preuss School –6 th College December 2004 –Cal(IT) 2 Building switch

UCSD OptIPuter Network Expansions Initial anticipated network deployments (Fall 2002, Winter 2003) –4 GigE connections (using 4 fiber pairs) to high performance nodes –1 GigE connections (using 1 fiber pair) to other nodes –Each node's OPPP (OptIPuter Point of Presence) is initially a local GigE switch with 4 bondable GigE (GBIC) uplinks –Above nodes uplinks connected to a central GigE aggregate switch –Above is a separate research network (not connected to campus network) During 2003, upgrade OptIPuter network as required … –N x 10 GigE (over existing fiber pairs?, N could be up to 4)... and/or –Add lambda gear to conserve fiber (supporting 1 or 10 GigE x N lambdas) –Add management to support dynamic lambda allocation –Add edge (of OptIPuter) router for connecting to campus or remote OptIPuter sites Late 2003 and 2004 –Interconnect multiple OptIPuter sites (NU, EVL, USC/ISI, UCI, …) –Expand network/lambda management to span sites

[Inter]-National OptIPuter Expansion

UCSD Node Fiber Paths

UCSD OptIPuter Fiber Paths

CalREN Optical Networks CalREN-DC (Digital California) –IP based network: minimum OC-48 backbone –Serves 140 Higher Ed institutions, 8,000+ Elementary, Secondary and High Schools –8.0 million+ student, faculty & staff users –Internet2 connectivity and commodity ISP services CalREN-HPR (High Performance Research) –IP based network, 10Gb Ethernet backbone –50+ Research institutions, National Laboratories and San Diego Super Computing Center –California component of Internet2 with 10G and OC-12 connections –Serves hundreds of researchers CalREN-XD (Experimental Development) –10Gb wavelengths (OC-192c or 10G LANPHY) and dark fiber –Point-Point, Point-MultiPoint 1G Ethernet possible –Serves network researchers in California Research institutions –Four UC Institutes, USC/ISI, Stanford and CalTech

CalREN Fiber Paths

CalREN Northern California Paths

CalREN Southern California Paths

Calren/DC/HPR/XD POP Architecture Long Haul OC48/OC192/10GigE DWDM Gig E 10 Gig E or OC192 CalRen DC HPR XD Campus or Metro Interconnect CalREN/DC HPR XD

15808 Terminal, Regen or OADM site (OpAmp sites not shown) Fiber route PIT POR FRE RAL WAL NAS PHO OLG ATL CHI CLE KAN OGD SAC BOS NYC WDC STR DAL DEN LAX SVL SEA SDG NLR Footprint and Layer 1 Topology

New OptIPuter Participate and Nodes Research requirements –Contribute to existing OptIPuter goals as defined in –OptIPuter Proposal – NSF Statement of Work –Involve collaboration with existing OptIPuter PI and Co-PIs –Expand OptIPuter project to address new areas of research –Supported by new proposals and resources –Providing new application drivers –Providing integration with new infrastructure –Expanding the optical network testbed Technical and operational requirements –Network connectivity –Dedicated research fiber/lambda path to OptIPuter network –Appropriate network electronics to support connectivity –Ability to work within experimental network environment Financial requirements –Impose no financial burden on existing grant –Develop support for –hardware –manpower – connectivity to OptIPuter network