1. Revolution & Kids: Building the Future of the Net & Understanding the Structures of the World Bruce R. Schatz CANIS - Community Systems Laboratory University of Illinois at Urbana-Champaign schatz@canis.uiuc.edu, http://canis.uiuc.edu Special Holiday Lecture sponsored by IRIS-CISE National Science Foundation, Dec 16, 1997

2. Building the Future of the Net Grand Challenge The Grand Challenge is Semantic Federation across a Billion Community Repositories

3. Evolution of the Net The Present: Access –The Net fetches documents The Future: Organization –The Net searches repositories The Millennium: Analysis –The Net correlates information From the Internet (data transmission) to the Interspace (information manipulation)

4. 1965 1975 1985 1995 2000 2010 ARPANETInternet Interspace The Third Wave of Net Evolution PROTOCOLSIPFTP HTTP CORBACP SERVICES Distributed Files Global Hypermedia Distributed Objects Global Semantics FUNCTIONAccessOrganization Analysis UNITSPacketsFilesLinksObjectsConcepts Distributed Paths Categories SMP

5. System Model Timeline 1984 Telesophy proposed at Bellcore – revolutionary system prototype developed 1989 Schatz systems advisor at NCSA –20th Anniversary ARPANET Symposium 1994 NCSA Mosaic gains many users –Mosaic 1M, Netscape 50M, Explorer 100M 1999 Web achieves Telesophy functionality –browsing & sharing multimedia documents

6. Telesophy

7. Publishing Cycle USERrequest LIBRARYreference INDEXERclassify PUBLISHERquality AUTHORgenerate users are authors, computers are publishers Every person & machine performs Every role

8. Community System browse and share all the knowledge of a community data results (database management)(electronic mail) literature news (information retrieval) (bulletin boards ) knowledge (hypertext annotations) Formal Informal

9. Worm Community System WCS Information: Literature Biosis, Medline, newsletter, meetings Data Genes, Maps, Sequences, strains, people WCS Functionality Browsingsearch, navigation Filteringselection, analysis Sharinglinking, publishing WCS: 250 users at 50 labs across the Internet

10. Worm Community System (WCS)

11. World of a Billion Repositories Every community has its own repository –objects and pointers in information space Local collections but global solutions –peer-peer architecture for infrastructure Net must support semantic correlation –vocabulary switching in concept spaces

12. Levels of Indexes

13. Community Repositories repository is an organized collection DLI establishing large repositories for major publishers WCS integrated large formal (journals) and small informal (bulletins) need semantic retrieval for across publishers need semantic indexing for small publishers

14. Semantic Retrieval automatic indexing of concepts –find context of terms (phrases) within documents –generates concept space from co-occurrence frequency useful for interactive searching –given a term, can suggest other terms –merging concept spaces supports vocabulary switching concept spaces require supercomputing –space for Inspec (400K) took 1 day on SGI Challenge –600 spaces for Compendex (4M) took 3.5 days on HP Convex Exemplar

15. Vocabulary Switching Grand Challenge of Digital Libraries –semantic interoperability across subject domains –vocabulary switching to suggest across domains Generating 1000 community repositories –600 categories across engineering (38 top-level) –150 categories across EE, CS, physics –3M raw abstracts, about 10M in community spaces large-scale supercomputer simulation –7 days of dedicated computation (10 days overall) –have space navigation; need space intersection

18. Interspace Prototype semantic retrieval concept spaces semantic interoperability vocabulary switching semantic indexing object categorization semantic clustering category maps information spaceflight region visualization analysis environment path correlations

19. Analysis Enviroments Concept Spaces for interactive suggestion Category Maps for semantic clustering Information Spaceflight for navigation examples from DLI Research http://csl.ncsa.uiuc.edu/interspace.html

20. Understanding the Structures of the World Grand Challenge The Grand Challenge is Point-of-View Spaceflight across a Billion Community Repositories

21. Global Cultural Memory Enable Everyone to understand –How They Have Lived and –How They Will Live The Structures of Everyday Life –recorded over space and time –correlated in a global information space Appreciate the Past and Predict the Future

22. Evolutionary System Model Getty project using commercial technology Museum-style Web collection curators to classify from big sources Champaign County Historical information county-level community repository 5000 Historical Societies in US

24. Revolutionary System Model A planet for every kid’s local environment Federating the planets into a universe Ordering all planets from kid’s POV Flying through the Kids Universe Finding similar kids from different POVs Connecting historically through museums

27. Category Map (2D)

28. Information Spaceflight (3D)

29. Research Issues Community Repositories [sovereign individual] –indexing all the knowledge of small groups Semantic Federation [transient centralization] –creating virtual libraries from distributed repositories Information Analysis [think globally, act locally] –correlating across repositories to solve problems The World of a Billion Repositories: The Interspace of the 21st Century http://dli.grainger.uiuc.edu/_ppt/vanguard/vanguard1/index.htm

30. Societal Implications Sovereign Individual –community repositories for custom indexing Transient Centralization –community curators as relationship bonders Think Globally, Act Locally –vocabulary switches for correlation infrastructure Situational Analysis –dynamic categorization for problem solving Zen of the Net –at one with the knowledge of the world (mushin)