1. OptIPuter Infrastructure Team

2. Year 5 General Milestones and Goals: What were the highlights of SC’06? –OptIPortals in multiple booths (all), –Optical Multicast (Mambretti), –NDL Demonstration (de Laat), –Token-based GMPLS cross domain (de Laat), –StarPlane with W-S Switches (de Laat), –Layer 2 Stream Duplication (Mambretti) –Other infrastructure highlights?

4. NDL http://trafficlight.uva.netherlight.nl/NDL-demo/NDL-Generator.html ﾊﾊﾊ ﾊ ﾊ Optiputer ﾊ 30N ﾊ 120W ﾊ ﾊ cisco ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ 1201E1200 ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ 1101E1200 ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ cisco:Tengig2/4 ﾊ ﾊ 10Gbps ﾊ ﾊ cisco:Tengig1/4 ﾊ ﾊ 10Gbps ﾊ ﾊ cisco:Tengig1/3 ﾊ ﾊ 10Gbps ﾊ ﾊ cisco:Tengig2/1 ﾊ ﾊ 10Gbps ﾊ ﾊ cisco:Tengig2/3 ﾊ ﾊ 10Gbps ﾊ ﾊ cisco:Tengig1/1 ﾊ ﾊ 10Gbps ﾊ ﾊ cisco:Gig4/1 ﾊ ﾊ 1Gbps ﾊ ﾊ cisco:Gig4/2 ﾊ ﾊ 1Gbps ﾊ ﾊ cisco:Gig4/3 ﾊ ﾊ 1Gbps ﾊ ﾊ cisco:Gig4/4 ﾊ ﾊ 1 Gbps ﾊ ﾊ cisco:Gig 4/5 ﾊ ﾊ 1 Gbps ﾊ ﾊ cisco:Gig4/6 ﾊ ﾊ 1Gbps ﾊ ﾊ cisco:Gig4/7 ﾊ ﾊ 1Gbps ﾊ ﾊ 1201E1200:Tengig0/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig0/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig0/2 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig0/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig1/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig1/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig1/2 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig1/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig2/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig2/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig2/2 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig2/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengigg3/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig3/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig3/2 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig3/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig4/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig 4/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig 4/2 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig4/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig5/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1201E1200:Tengig5/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig0/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig0/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig0/2 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig0/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig1/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig1/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig1/2 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig1/3 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig5/0 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig5/1 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig5/14 ﾊ ﾊ 10Gbps ﾊ ﾊ 1101E1200:Tengig5/15 ﾊ ﾊ 10Gbps ﾊ

5. Year 5 Infrastructure Milestones and Goals: What is the OptIPortal? –OptIPortals are Termination devices Rocks Vizroll builds them Standardized hardware to order: –Nvidia, –PCs with RedHat Linux (but not Windows & Macs) –Switches (SMC 8748, 650x, F10) –Displays are whatever you want that Nvidia can drive…frame order is spreadsheet driven –Need to standardize audio –Harder to build: CAVEs and Varriers

6. Year 5 Infrastructure Milestones and Goals: What is the Gold Standard OptIPuter (GSOP)? Distributed architecture Easy-to-add nodes Network parameters (definition of the path, characteristics)

7. Year 5 Infrastructure Milestones and Goals: 2006/2007 PPP: Infrastructure: by the conclusion of this award, the goal is to transport traffic over multiple user planes using a variable switching model, bring lambdas to endpoints, and achieve a 1:1 international bisection bandwidth ratio Answer: For a persistent structure source data at full line rate: –Currently 20 pcs/10GE; fits with GSOP; done but not persistent –Multiple 10GEs and persistence--Year 5 Challenge –PCs with 10GE nics--Year 5 Challenge (EVL)(UvA)(CRC-Ottawa)(NU)(UCSD)(StarLight)(NCSA)(Others?) OptiThumper will drive 10GE from disks out to network –Multiple 10GEs are becoming available Locally: UCSD, Chicago, Netherlands Internationally: CAVEwave, Cisco/CineGrid, IRNC/JGN2-IEEAF/SURFnet/CA*net4 Control Plane and Management plane (working with GLIF)

8. Year 5 Infrastructure Milestones and Goals: Can we quantitatively assess the data acquisition and collaboration capabilities afforded by the emerging OptIPuter technologies in national-scale geoscience and bioscience projects? Answer: –It’s an Application issue (both quantitative and qualitative) –Do people adopt and use the tech? Do they complain? –Traffic stats are available for vlans (can do more) –Need information from Myricom/Infiniband switches –Resource discovery and allocation (known and knowable b/w) (NDL)

9. Year 5 Infrastructure Milestones and Goals: Do we have “5-layer” application solutions (control planes, protocols, middleware, toolkits, applications)? Yes! Components everywhere…last year asked for a person to integrate, but… Integration has not been achieved in lowest level networking Integration has been achieved with GSOP Termination points: OptIPortals (Rocks, SAGE, network switch and computer/display components) Maintenance over time dependent on new projects and grants (e.g., Rocks VizRoll will continue for some years) Collaboration is getting there…audio needed

10. Year 5 Infrastructure Milestones and Goals: Are we deploying and documenting the OptIPuter’s design for the broader e-Science community? What application scientists outside the initial cohort of project investigators are using the OptIPuter? Yes! Original: Telescience/Earthscope/RIDGE/Roadnet Yes! New: –CAMERA –CineGrid (including audio) San Diego, Chicago, Amsterdam, Urbana-Champaign, Toronto, Tokyo, Skywalker, SFSU Other digital media –LOOKING/ORION –CICESE Ocean Science –Dutch Climate Institute (KNMI/IMAU) –GIS at SDSU/SDSC –NU Nanotech Center virtual instrumentation (early prototype) –Carleton University: Eucalyptus (Architectural 3D modeling) –Brain Observatory Jacopo Annese at UCSD –UCSD/UCI Michael Berns Biomedical Imaging Laboratories –Rincon Research Corp (Tucson)

11. Year 5 Infrastructure Milestones and Goals: More New: –Metagenomics lab at SDSU (Forest Rohwer) –Life sciences department at UvA Global –Cyberbridges (FIU/Heidi Alvarez) –Rescue (UCSD/UCI) NUTS –Nortel Labs –GFSC –USGS –Maurizio Seracini –AIST Geo –KISTI –UW Genomics (Ginger Armbrust) –EU Phosphorus Project –JGI LANL (Thomas Brettin) Genomics –Osaka –U Michigan –Others?

12. Year 5 Infrastructure Milestones and Goals: How are we moving to parallel lambdas? –Provisioning--CAVEwave plus I-WIRE, SURFnet, IRNC, IEEAF, PacificWave/CENIC, CiscoCineGrid waves, etc… –AS# allows routing but does not demand routing (private networks with cut-throughs) –Control plane work ongoing w/GLIF –Need persistent GLIF repository –Drive with high-performance PERSISTENT testbeds (e.g. 8K-18K OptIPortals/CAVEs, CAMERA software releases, other)

13. OptIPuter Layer 2 Details High performance access switches were standardized at all UCSD Optiputer locations. Performance across these switches was tested and achieved up to 8 Gbps across the 10 Gbps uplinks for both UDP and TCP. Many more Layer 2 connections were established across more exchanges, telecom providers, and corporations including Pacific Wave, Canarie, Reliance, JGN2, WIDE, NTT, Lucasfilm. Layer 2 performance with and without Jumbo frames was tested in a local environment. Layer 2 performance was tested using new tools including NUTTCP. Much more sensitive (0 buffer) UDP testing was performed across the NLR. Fast UDP file transfers across the Cavewave/NLR were performed using a modified IPERF and RDUDP. The Layer 2 performance asymmetry with UCI was corrected. Aggregate L2 Bandwidth across Core at SunLight is approximately 400 Gbps Infiniband connections are being tested on the CAMERA cluster.

14. Year 5 Infrastructure Milestones and Goals: Stereo OptIPortals: –Varrier (45Megapixels/eye) –5KAVE: 30 Megapixels/eye Onward: 500 megapixels?

15. Year 5 Infrastructure Milestones and Goals: What technology transfer efforts need to be put in place to deploy OptIPortals now and after the end of Year 5? –Need complete cookbook put on www.optiputer.net –http://central-i386.optiputer.net/misc/dot-graph.php?size=65,65 for a starthttp://central-i386.optiputer.net/misc/dot-graph.php?size=65,65 –Add viz/audio capability with other packages besides SAGE (e.g. COVISE, Electro, Jack (UCSD), TOPS(SARA), others) –Find someone to build and maintain OptIPortals for fun & profit

16. Come October 1, 2007 How does OptIPuter infrastructure remain persistent? –Which major grants/activities/sites? CAMERA: SDSU, Venter, MIT, McGill, UCSD CineGrid: Keio,Calit2, StarLight/EVL, Ryerson, UvA, SFSU, NCSA, Uwash, Umich, more Optical Fiber Ocean Observatories Other adopters…will they support us back? –Larry says: Align with the groups that need OptIPuter

17.  The Optiputer Core at UCSD is meshed for redundancy.  OSPF ensure the routes to any destination are available on every core Multilayer Switch.  An IPSec VPN will provide remote access, and a Firewall will screen external connections.

18. Optiputer – Optical Switching Experiment over Cavewave

19.  SMC Layer2 access switches (lower right) are present at all non-core locations.  These switches are then connected to the Core (far left) via a 10 Gbps uplink (green line.)  The connection is then switched (Layer 2 or 3) at the core.

20. Rocks Viz Roll Includes SAGE and more than 30 other viz SW packages Download and build just like any other cluster

21. The concept User Authority Service RSVP TE PATH Message with Token In RFC2750 Policy Data Object Service Request Secure Token with ID tag. GMPLS Network Key to recognize Token with ID tag Key to generate Token with ID tag

22. Hybrid networks research Two flagship projects at the UvA: NDL - Network Description Language www.science.uva.nl/research/sne/ndl A semantic web approach to network topology description, exchange and discovery in multi-domain setups StarPlane application-controlled photonic networks www.starplane.org Applications directly manage photonic networks to create and configure optimal paths among clusters. NDL adopted in the GLIF and demo-ed at SC|06. Working on multi-layer extensions. DAS-3 clusters installed and under test. First APIs to application under development.