Presentation is loading. Please wait.

Presentation is loading. Please wait.

Pervasive Pixels Henning Schulzrinne (PI) Steven K. Feiner Gail Kaiser John Kender Kathleen McKeown Department of Computer Science Columbia University.

Similar presentations


Presentation on theme: "Pervasive Pixels Henning Schulzrinne (PI) Steven K. Feiner Gail Kaiser John Kender Kathleen McKeown Department of Computer Science Columbia University."— Presentation transcript:

1 Pervasive Pixels Henning Schulzrinne (PI) Steven K. Feiner Gail Kaiser John Kender Kathleen McKeown Department of Computer Science Columbia University

2

3

4 Proposed Research Goal: seamless mobile multimedia collaboration across distance ä Integrate advances across fields ä Collaborative work ä Graphical and visual interfaces ä Spoken language understanding and generation ä Vision sensing and understanding ä Networking and security

5 Contributions ä Contextual information management ä use workflow to determine display content ä multimedia summaries of past and present sessions ä Harmonizing physical and virtual environments ä map changing virtual information onto physical displays ä map layout of physical environment onto virtual space ä Network services ä clear, flexible interface to common services ä authentication and privacy support ä operating system infrastructure for large displays

6 Features of Research Infrastructure ä Large, instrumented multi-display workspaces ä Networked mobile devices of various capabilities ä Transparent and automatic adaptability to changes of place, platform or group ä Support for a wide range of hardware and software, from commercial to novel

7 Pervasive Pixels Teams Harmonizing Physical and Virtual Environments Network Services Project Leader Schulzrinne Contextualized Information Management Enabling communications Schulzrinne Database Ross Summarization Kender, McKeown Environment Management Feiner Capture and Display Nayar, Kender 3D Modeling Allen Workflow Kaiser Virtual Display Nieh Access and Privacy Keromytis

8 Pervasive Pixels Teams Harmonizing Physical and Virtual Environments Network Services Project Leader Schulzrinne Contextualized Information Management Enabling communications Schulzrinne Database Ross Summarization Kender, McKeown Environment Management Feiner Capture and Display Nayar, Kender 3D Modeling Allen Workflow Kaiser Virtual Display Nieh Access and Privacy Keromytis

9 Pervasive Pixels Teams Harmonizing Physical and Virtual Environments Network Services Project Leader Schulzrinne Contextualized Information Management Enabling communications Schulzrinne Database Ross Summarization Kender, McKeown Environment Management Feiner Capture and Display Nayar, Kender 3D Modeling Allen Workflow Kaiser Virtual Display Nieh Access and Privacy Keromytis

10 Pervasive Pixels Teams Harmonizing Physical and Virtual Environments Network Services Project Leader Schulzrinne Contextualized Information Management Enabling communications Schulzrinne Database Ross Summarization Kender, McKeown Environment Management Feiner Capture and Display Nayar, Kender 3D Modeling Allen Workflow Kaiser Virtual Display Nieh Access and Privacy Keromytis

11 Pervasive Pixels Teams Harmonizing Physical and Virtual Environments Network Services Project Leader Schulzrinne Contextualized Information Management Enabling communications Schulzrinne Database Ross Summarization Kender, McKeown Environment Management Feiner Capture and Display Nayar, Kender 3D Modeling Allen Workflow Kaiser Virtual Display Nieh Access and Privacy Keromytis

12 The Department of Computer Science ä A growing faculty ä 5 new assistant professors (pictures and areas here) ä 1 new full professor: Peter Belhumeur ä 1 new full professor 9/02: Julia Hirschberg ä A large student population ä 80 PhDs ä 155 MS ä 380 undergraduate majors ä Internal, fluid collaboration ä Interdisciplinary connections

13 Building Critical Mass ä Networking ä Schulzrinne, Misra, Yemini ä links to EE ä Vision ä Allen, Belhumeur, Kender, Nayar ä links to computer graphics ä Human Computer Interaction ä graphical and visual user interfaces: Feiner, Kender ä spoken and written language: Hirschberg, McKeown ä links to speech and multimedia in EE

14 Areas of Growth ä Security and systems ä Computer engineering ä Computer graphics ä Theory ä Sofware systems (e.g., programming languages)

15 Administrative Support ä Institutional cost share on this proposal: $1 million in total ä $100,000/year for 5 years (Provost) ä $100,000/year for 5 years (Dean) ä Support for growth: slots, space ä Financial support ä return in revenue (e.g., Columbia Video Network) ä Technical transfer support ä dedication of Columbia Innovative Enterprise services

16 Current Departmental Facilities ä Shared infrastructure of over 20 Sun and Pentium servers ä Two teaching laboratories ä 40 seat student lab (CLIC) of Intel Pentium PCs, dual projection capability, wireless microphone, video mixer and multiple cameras ä 30 seat Microsoft Research Lab ä Nortel Meridian telephone switch ä Research infrastructure of > 500 nodes plus servers ä Staffed by 4 professional system administrators

17 Research Infrastructure ä User-based personalization: user location ä magnetic card readers ä active badge system ä triangulation on mobile devices ä visual tracking ä Stationary setups ä Seminar room ä 3 meeting rooms ä 12 faculty offices ä 5 public areas ä portable units

18 Seminar room ä High-resolution DV video camera, 2 pan-tilt speaker cameras, Omnicam omnidrectional audience camera, video switcher, 16 ceiling mounted microphones, electronic whiteboard, 3 XGA high- brightness video projectors

19 Meeting Room ä 2 remote- controlled pan-tilt video cameras, Omnicam, conference table PZM boundary microphones, automatic audio mixer, ceiling speakers, 3 high- lumen XGA video projectors

20 Faculty Office ä Mimio electronic whiteboard, XGA video projector, Ethernet speaker phone, wal-mounted pan-tilt video camera, PocketPCs

21 Public areas ä Walk-by stations and laboratories ä XGA video projector, steerable ceiling-mounted dome video camera, embedded ceiling mounted netowrked Pentium computer, celing speaker, Andrea DA-400 array microphone, Microtouch IBID 600 whiteboard. ä Picture here

22 Design for walk-by collaboration ä Figure 1 here

23 Functionalities ä Conferencing ä Internet conferencing server to mis IP and PSTN audio streams ä Interconnection with analog phone ä Digital hybrid connects digital or analog sound to existing telephone system in classroom ä Netowrk voice-over-IP interface attached to Nortel Meridian PBX for 20 simultaneous conversations ä Multi-processor servers and IA64 compute and database server, plus others ä File storage ä Face, speaker and fingerprint recognition ä 2 printers and tape library system in year 4 for backup

24 Remaining Agenda ä Research Overview ä Contextualized Information Management (Kaiser) ä Harmonizing Physical and Virtual (Feiner) ä Network Services (Schulzrinne) ä Genomics testbed (Noble) ä Responding to reviews (Kender) ä Telephony demo (Schulzrinne) ä Lunch ä Demos ä Visit with administrators ä Demos ä Small group meetings


Download ppt "Pervasive Pixels Henning Schulzrinne (PI) Steven K. Feiner Gail Kaiser John Kender Kathleen McKeown Department of Computer Science Columbia University."

Similar presentations


Ads by Google