1. The OptIPuter – From SuperComputers to SuperNetworks Vanguard NextGens Conference Coronado, CA November 19, 2002 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

2. California Has Initiated Four New Institutes for Science and Innovation UCSB UCLA California NanoSystems Institute UCSF UCB California Institute for Bioengineering, Biotechnology, and Quantitative Biomedical Research UCI UCSD California Institute for Telecommunications and Information Technology Center for Information Technology Research in the Interest of Society UCSC UCD UCM www.ucop.edu/california-institutes

3. Cal-(IT) 2 An Integrated Approach to the Future Internet www.calit2.net 220 UC San Diego & UC Irvine Faculty Working in Multidisciplinary Teams With Students, Industry, and the Community The States $100 M Creates Unique Buildings, Equipment, and Laboratories

4. Over Fifty Industrial Sponsors From a Broad Range of Industries Akamai Technologies Inc. AMCC Ampersand Ventures Arch Ventures Avalon Ventures The Boeing Company Broadcom Corporation CAIMIS, Inc. Chiaro Networks Conexant Systems, Inc. Connexion by Boeing Cox Communications Diamondhead Ventures Dupont Emulex Corporation Network Systems Enosys Markets Enterprise Partners Entropia, Inc. Ericsson ESRI Extreme Networks Global Photon Systems Graviton IBM Computers Communications Software Sensors Biomedical Startups Venture Capital Newport Corporation Oracle Orincon Industries Panoram Technologies Printronix QUALCOMM Quantum The R.W. Johnson Pharmaceutical Research Institute SAIC Samueli, Henry (Broadcom) SciFrame, Inc. Seagate Storage Products SGI Silicon Wave Sony STMicroelectronics, Inc. Sun Microsystems TeraBurst Networks Texas Instruments Time Domain UCSD Healthcare WebEx IdeaEdge Ventures The Irvine Company Intersil Corporation Irvine Sensors Corporation JMI, Inc. Leap Wireless International Link, William J. (Versant Ventures) Litton Industries, Inc. MedExpert International Merck Microsoft Corporation Mission Ventures NCR $140 Million in Industrial Matching

5. Closing in on the Dream Using satellite technology…to demo what It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations. Al Gore, Senator Chair, US Senate Subcommittee on Science, Technology and Space What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers. Larry Smarr, Director National Center for Supercomputing Applications, UIUC SIGGRAPH 89 Science by Satellite Source: Maxine Brown, EVL, UIC Boston Illinois

6. The Move to Data-Intensive Science & Engineering- e-Science Community Resources ATLAS Sloan Digital Sky Survey LHC ALMA

7. Four Large Hadron Collider Experiments: The Petabyte to Exabyte Challenge ATLAS, CMS, ALICE, LHCB Higgs + New particles; Quark-Gluon Plasma; CP Violation Data stored ~40,000 Terabytes/Year and UP Data stored ~40,000 Terabytes/Year and UP Source: Harvey Newman, Caltech

8. NIH is Funding a Brain Imaging Federated Repository National Partnership for Advanced Computational Infrastructure Part of the UCSD CRBS Center for Research on Biological Structure Biomedical Informatics Research Network (BIRN) NIH Plans to Expand to Other Organs and Many Laboratories

9. NSFs EarthScope Rollout Over 14 Years Starting With Existing Broadband Stations

10. The Grid is the Emerging Distributed Cyberinfrastructure Middleware Applications and Capabilities Toolkits/Workbenches and Portals Distributed Computing Collaboration Visualizatio n Data Mining Instrument s / Sensors Problem Solving Environment s GRID Services (Middleware) Authenticatio n / Authorization Resource Discovery Schedulin g / Allocation Fault Detection / Recovery Event Services Information Infrastructur e GRID Fabric (Resources) QoS / Diffserv Directory Services Informatio n Mgmt / Storage Public Key Infrastructure Site accounting / scheduling Operating Systems Open Grid Services Architecture (OGSA) Integrates Globus with Web Services

11. Grid Computing is Becoming Mainstream

12. Why Optical Networks Are Emerging as the 21 st Century Driver for the Grid Scientific American, January 2001

13. The Crossing Exponentials Requires a Rethinking of Grid Architecture A global economy designed to waste transistors, power, and silicon area -and conserve bandwidth above all- is breaking apart and reorganizing itself to waste bandwidth and conserve power, silicon area, and transistors." George Gilder Telecosm (2000)

14. The Rapid Increase in Bandwidth is Driven by Parallel Lambdas On Single Optical Fibers (WDM) Parallel Lambdas Will Drive This Decade The Way Parallel Processors Drove the 1990s

15. CONTROLPLANECONTROLPLANE Clusters Dynamically Allocated Lightpaths Switch Fabrics Physical Monitoring Apps Middleware A LambdaGrid Will Be the Backbone for an e-Science Network Source: Joe Mambretti, NU

16. The Next S-Curves of Networking Exponential Technology Growth 0% 100% Research Experimental/ Early Adopters Production/ Mass Market Time Technology S-Curve Gigabit Testbeds Connections Program Internet2 Abilene DWDM Experimental Networks Lambda Grids ~1990s 2000 2010 Networking Technology S-Curves Technology Penetration

17. Data Intensive Scientific Applications Require Experimental Optical Networks Large Data Challenges in Neuro and Earth Sciences –Each Data Object is 3D and Gigabytes –Data are Generated and Stored in Distributed Archives –Research is Carried Out on Federated Repository Requirements –Computing Requirements PC Clusters –Communications Dedicated Lambdas Over Fiber –Data Large Peer-to-Peer Lambda Attached Storage –Visualization Collaborative Volume Algorithms Response –OptIPuter Research Project

18. UIUC/NCSA Starlight (NU-Chicago) Argonne UChicago IIT UIC Illinois Century Network James R. Thompson Ctr City Hall State of IL Bldg 4 pair 12 pair 4 pair 2 pair 4 pair 18 pair 410 pair 12 pair 2 pair Level(3) 111 N. Canal McLeodUSA 151/155 N. Michigan Doral Plaza Qwest 455 N. Cityfront UC Gleacher 450 N. Cityfront Illinois I-WIRE The First State Dark Fiber Experimental Network Source: Charlie Catlett 12/2001

19. Fifteen Countries/Locations Proposing 28 Demonstrations: Canada, CERN, France, Germany, Greece, Italy, Japan, The Netherlands, Singapore, Spain, Sweden, Taiwan, United Kingdom, United States Applications Demonstrated: Art, Bioinformatics, Chemistry, Cosmology, Cultural Heritage, Education, High-Definition Media Streaming, Manufacturing, Medicine, Neuroscience, Physics, Tele-science Grid Technologies: Grid Middleware, Data Management/ Replication Grids, Visualization Grids, Computational Grids, Access Grids, Grid Portal iGrid 2002 September 24-26, 2002, Amsterdam, The Netherlands www.startap.net/igrid2002 UIC Sponsors: HP, IBM, Cisco, Philips, Level (3), Glimmerglass, etc.

20. iGrid 2002 Was Sustaining 1-3 Gigabits/s Total Available Bandwidth Between Chicago and Amsterdam Was 30 Gigabit/s

21. The NSF TeraGrid A LambdaGrid of Linux SuperClusters NCSA 8 TF 4 TB Memory 240 TB disk Caltech 0.5 TF 0.4 TB Memory 86 TB disk Argonne 1 TF 0.25 TB Memory 25 TB disk TeraGrid Backbone (40 Gbps) SDSC 4.1 TF 2 TB Memory 250 TB disk This will Become the National Backbone to Support Multiple Large Scale Science and Engineering Projects Data Compute Visualization Applications Intel, IBM, Qwest Myricom, Sun, Oracle $53Million from NSF

22. From SuperComputers to SuperNetworks-- Changing the Grid Design Point The TeraGrid is Optimized for Computing –1024 IA-64 Nodes Linux Cluster –Assume 1 GigE per Node = 1 Terabit/s I/O –Grid Optical Connection 4x10Gig Lambdas = 40 Gigabit/s –Optical Connections are Only 4% Bisection Bandwidth The OptIPuter is Optimized for Bandwidth –32 IA-64 Node Linux Cluster –Assume 1 GigE per Processor = 32 gigabit/s I/O –Grid Optical Connection 4x10GigE = 40 Gigabit/s –Optical Connections are Over 100% Bisection Bandwidth

23. The OptIPuter is an Experimental Network Research Project Driven by Large Neuroscience and Earth Science Data Multiple Lambdas Linking Clusters and Storage –LambdaGrid Software Stack –Integration with PC Clusters –Interactive Collaborative Volume Visualization –Lambda Peer to Peer Storage With Optimized Storewidth –Enhance Security Mechanisms –Rethink TCP/IP Protocols NSF Large Information Technology Research Proposal –UCSD and UIC Lead CampusesLarry Smarr PI –USC, UCI, SDSU, NW Partnering Campuses –Industrial Partners: IBM, Telcordia/SAIC, Chiaro Networks –$13.5 Million Over Five Years

24. The OptIPuter is an Experimental Network Research Project Driven by Large Neuroscience and Earth Science Data Multiple Lambdas Linking Clusters and Storage –LambdaGrid Software Stack –Integration with PC Clusters –Interactive Collaborative Volume Visualization –Lambda Peer to Peer Storage With Optimized Storewidth –Enhance Security Mechanisms –Rethink TCP/IP Protocols NSF Large Information Technology Research Proposal –UCSD and UIC Lead CampusesLarry Smarr PI –USC, UCI, SDSU, NW Partnering Campuses –Industrial Partners: IBM, Telcordia/SAIC, Chiaro Networks –$13.5 Million Over Five Years

25. Metro Optically Linked Visualization Walls with Industrial Partners Set Stage for Federal Grant Driven by SensorNets Data –Real Time Seismic –Environmental Monitoring –Distributed Collaboration –Emergency Response Linked UCSD and SDSU –Dedication March 4, 2002 Linking Control Rooms Cox, Panoram, SAIC, SGI, IBM, TeraBurst Networks SD Telecom Council UCSD SDSU 44 Miles of Cox Fiber

26. OptIPuter NSF Proposal Partnered with National Experts and Infrastructure Vancouver Seattle Portland San Francisco Los Angeles San Diego (SDSC) NCSA SURFnet CERN CA* net4 Asia Pacific Asia Pacific AMPATH PSC Atlanta CA*net4 Source: Tom DeFanti and Maxine Brown, UIC NYC TeraGrid DTFnet CENIC Pacific Light Rail Chicago UIC NU USC UCSD, SDSU UCI

27. switch Cluster – Disk Disk – Disk Viz – Disk DB – Cluster Cluster – Cluster Medical Imaging and Microscopy Chemistry, Engineering, Arts San Diego Supercomputer Center Scripps Institution of Oceanography Chiaro Enstara OptIPuter LambdaGrid Enabled by Chiaro Networking Router www.calit2.net/news/2002/11-18-chiaro.html

28. ½ Mile The UCSD OptIPuter Deployment SIO SDSC CRCA Phys. Sci - Keck SOM JSOE Preuss 6 th College Phase I, Fall 02 Phase II, 2003 SDSC Annex To Other OptIPuter Sites Collocation point Node M The UCSD OptIPuter LambdaGrid Testbed Earth Sciences SDSC Arts Chemistry Medicine Engineering High School Undergrad College Phase I, Fall 02 Phase II, 2003 SDSC Annex To Other OptIPuter Sites Collocation point Collocation

29. Fast polygon and volume rendering with stereographics GeoWall Earth Science GeoFusion GeoMatrix Toolkit Underground Earth Science Rob Mellors and Eric Frost, SDSU SDSC Volume Explorer Dave Nadeau, SDSC, BIRN SDSC Volume Explorer Neuroscience Anatomy Visible Human Project NLM, Brooks AFB, SDSC Volume Explorer 3D APPLICATIONS: + = OptIPuter Transforms Individual Laboratory Visualization, Computation, & Analysis Facilities The Preuss School UCSD OptIPuter Facility