1. Results of Prior NSF RI Grant: TITAN
David E. Culler
Computer Science Division
U.C. Berkeley
NSF Site Visit
March 2, 1998

2. Titan Agenda
Develop a new type of system which harnesses breakthrough communications technology to integrate a large collection of commodity computers into a powerful resource pool that can be accessed directly through its constituent nodes or through inexpensive media stations.
SW architecture for global operating system
programming language support
advanced applications
multimedia application development
March 2, 1998
Previous NSF RI

3. Results
Constructed three prototypes, culminating in 100 processor UltraSparc NOW
GLUnix global operating system layer
Active Messages providing fast, general purpose user-level communication
xFS cluster file system
Fast sockets, MPI, and SVM
Titanium and Split-C parallel languages
ScaLapack libraries
Heavily used in dept. and external research
=> instrumental in establishing clusters as a viable approach to large scale computing
=> transitioning to an NPACI experimental resource
March 2, 1998
Previous NSF RI

4. Highly Leveraged Project
Large industrial contribution
HP media stations
Sun compute stations
Sun SMPs
Intel media stations
Bay networks ATM, ethernet
Enabled several federal grants
NOW
Titanium
Daedalus
Castle
Berkeley Multimedia Research Center
March 2, 1998
Previous NSF RI

5. Software Warehouse
Coherent software environment throughout the research program
Billions bytes of code
Mirrored externally
New SWW-NT
March 2, 1998
Previous NSF RI

6. Novel Systems Design Virtual networks Implicit Co-scheduling
integrate communication events into virtual memory system
Implicit Co-scheduling
cause local schedulers to co-schedule parallel computations using a two-phase spin-block and observing round-trip
Co-operative caching
access remote caches, rather than local disk, and enlarge global cache coverage by simple cooperation
Network virtual memory, fast sockets
Large-scale Storage Clusters
ISAAC “active” security
Internet Server Architecture
TACC Proxy architecture
March 2, 1998
Previous NSF RI

7. Novel Cluster Design Tertiary Disk Pleiades Clusters CLUMPS
very low cost massive storage
hosts archive of Museum of Fine Arts
Pleiades Clusters
functionally specialized storage and information servers
constant back-up and restore at large scale
NOW tore apart traditional AUSPEX servers
CLUMPS
cluster of SMPs with multiple NICs per node
March 2, 1998
Previous NSF RI

8. Multi-Tier Networking Infrastructure
Myrinet Cluster Interconnect
ATM backbone
Switched Ethernet
Wireless
March 2, 1998
Previous NSF RI

9. Applications Inktomi Search Engine World Record Disk-to_Disk store
RSA 40-bit key
IRAM simulations, Turbulence, AMR, Lin. Alg.
Parallel image processing
Protocol verification, Tempest, Bio, . . .
Services that utilize NOW on demand
TACC (transcoding) Proxy
Transcend
Wingman
MBONE media gateway
March 2, 1998
Previous NSF RI

10. Sample of 98 Degrees from Titan
Amin Vahdat: WebOS
Steven Lumetta: Multiprotocol Communication
Wendy Heffner: Multicast Communication Protocols
Doug Ghormley: Global OS
Andrea Dusseau: Implicit Co-scheduling
Armando Fox: TACC Proxy Architecture
John Byers: Fast, Reliable Bulk Communication
Elan Amir: Media Gateway
David Bacon: Compiler Optimization
Kristen Wright: Scalable web cast
Jeanna Neefe: xFS
Steven Gribble: Web caching
Ian Goldberg: Wingman
Eshwar Balani: WebOS security
March 2, 1998
Previous NSF RI

11. Demo before Tour
March 2, 1998
Previous NSF RI

12. UCB CSCW Class Sigh… no multicast, no bandwidth, no CSCW class...
Problem
Enable heterogeneous sets of participants to
seamlessly join MBone sessions.
March 2, 1998
Previous NSF RI

13. A Solution: Media Gateways
Software agents that enable local processing (e.g. transcoding) and forwarding of source streams.
Offer the isolation of a local rate-controller for each source stream.
Controlling bandwidth allocation and format conversion to each source prevents link saturation and accommodates heterogeneity. GW GW
March 2, 1998
Previous NSF RI

14. A Solution: Media Gateways
Sigh…
no multicast,
no bandwidth,
no MBone...
AHA!
MBone
Media GW
March 2, 1998
Previous NSF RI