Cal-(IT) 2 Francine Berman UCSD Interfaces and Software Layer Leader The Cal-IT2 Software Challenge

Cal-(IT) 2 Software and Cal-IT2 Cal-IT2 will develop “living laboratories” which prototype future work, play and Internet environments Software will provide the critical “glue” which –enables system components to work together –enables applications to achieve performance The Cal-IT2 SW Environment Will … –Be completely decentralized –Target –an extraordinary diversity of HW and SW (sensors, agents, PDAs, servers, wireless and wireline networks, control rooms, …) –continuous streams of data from millions of sensors –Require “guerrilla infrastructure” which self- assembles from the bottom up –Be “Use at your own risk” –Pave the way for commercial deployment

Cal-(IT) 2 Cal-IT2 Applications Cal-IT2 Applications will push the envelope –Applications will process data from massive number of throwaway endpoints –E.g. traffic management, disaster response Entropia –Applications will compute based on emergent behavior of millions of self-organizing components –Think Distributed Interactive Simulation … –Applications will compute on wide variety of heterogeneous resources simultaneously –PCs, PDAs, Servers, Supercomputers, remote instruments –High-capacity networks, storage and computational resources will enable previously “big iron” applications to transition efficiently to the Grid –Grid-enabled CFD,

Cal-(IT) 2 Cal-IT2 Software Challenges New application paradigms –Self-organization, emergent behavior, megacomputing –Statistical approach in which some fraction of devices always non-functional New models for design, prototyping, simulation Security –Authentication of people and devices, integrity of sensor data, distributed intrusion detection, … Data –New approaches to collecting, storing, accessing and analysis of huge amounts of sensor data Scalable Grid computing –Development of large-scale campus-wide distributed testbeds –Megacomputing: Grid computing with millions of throw-away end-devices Agent-based technology –Adaptive computing, mobile agents Interfaces –Large screen “control rooms” for disaster response, ultimately a prototype for “smart offices” –Access to real-time analysis of very large datasets, visualization, multi-scale information

Cal-(IT) 2 The Grid: An Initial Model for Cal-IT2 SW Science Portals & Workbenches, User-level Middleware Twenty-First Century Applications Computational Services PerformancePerformance Networking, Devices and Systems Grid Services (resource independent ) Grid Fabric (resource dependent) Access Services & Technology Access Grid Computational Grid Edited by Ian Foster and Carl Kesselman “A source book for the history of the future” - - Vint Cerf SW focus on Services Component Integration De-centralization System and User-level Middleware

Cal-(IT) 2 MegaComputing – Taking the the Grid to the Extreme -- sustains over 2 teraflops in production use Entropia’s Great Mersenne (2^p –1) Prime Search – found the first million digit prime -- bringing “big iron” applications into Grid environments Megacomputing Applications will be structured – for “throwaway” end devices – for continuous execution – to achieve performance and computational goals in highly dynamic, “unfriendly” envts. GTAAG A T A C C G 10123

Cal-(IT) 2 The Software Challenge is immense … First Steps –SensornetSim [Voelker] –Simulator for sensor arrays which can support the development of prototypes of sensor infrastructure and SW components for Cal-IT2 –Expansion of Sanctuary Security System to wireless [Yee] –Extend UCSD Sanctuary secure mobile agent system as a wireless application security platform –Development of applications which use mobile code for latency hiding –Prototype “smart campus” MUDD for 6 th College [Griswold, Voelker, Wienhausen/6 th, etc.] –First year: centralized MUDD for 6 th college courses, location sensing for students with PDAs –Plan for “21 st Century UCSD” course at 6 th College

Cal-(IT) 2 The Software Challenge is immense … First Steps –Genomics Applications –Development of assembler for sequencing large genomes [Pevzner] –Detection of protein structure from sequences using Protein centroids [Rosen/CSE, Bourne/SDSC] –Coupled Oceanographic Modeling Simulation [Baden/CSE, Stammer/SIO] –Assimilation of satellite data into running oceanographic simulations –Content-Based Web Crawling [Elkan, Belew, Cottrell] –Webclopedia extends Internet-accessible information to include billions of Web pages through their content –Seeks to develop a “Web of Knowledge” that functions as a multilingual encyclopedia to answer simple questions

Cal-(IT) 2 Cal-IT2 Interfaces and SW Layer To fulfill the Cal-IT2 vision, we will focus on fundamental research in –Middleware –Security –Networking –Modeling and simulation –Grid Computing, Megacomputing –Mobile agents –Database technology and Data-mining –… Over 37 faculty involved from UCSD CSE and UCI CIS We are already getting started …