Research Value of Smart Space

Outline Smart Space Smart Classroom Application

Ideal of Pervasive Computing Trying to conceive a new way of thinking about computers in the world, one that takes into account the natural human environment and allows the computers themselves to vanish into the background Living Space Cyber Space Sensor Network, NGI/NGN (Networking) Pervasive Software Infrastructure (Computing) Rich Media Natural HCI (Interaction) Smart Spaces & Mobile Devices (Device)

Key characteristics of Percomp systems Physical integration Involve some integration between computing nodes and the physical world Ubicomp takes place in discrete environment A boundary specify the environment’s scope

Physical integration Spontaneous interoperation Components must spontaneously interoperate in changing the environment Key characteristics of Percomp systems

Smart Space as research testbed Smart Space are work environments with embedded computers, information appliances, and multi-modal sensors allowing people to perform tasks efficiently by offering unprecedented levels of access to information and assistance from computers Typical system with the characteristics of pervasive computing Scalable: Room 、 Building 、 Community 、 City

Smart Space as research testbed

Typical system with the characteristics of pervasive computing Testbed for Percomp researches on: New paradigm of HCI  Natural UI based on context-awareness Software Infrastructure  Computing service for interoperation

Natural Untethered User Experience Voice Communication via MAPen/Touch Interaction Laser Pointer Interaction Context-aware Interaction

Spontaneous Interoperation

Outline Smart Space Smart Classroom Application

Smart Classroom Experience Record of the classroom Realtime Distributed Multimedia Communication Telepresence of Remote Students The Smart Classroom Project an augmented classroom where a teacher can instruct remote and local students at the same time and in a similar fashion.

Tele-presence Interface of Remote Clients Student Board in the Classroom Smart Cameraman Overview Showing a Model Writing on the Board

Invisibility: Natural UI Pen-based writing Highlight remote student by laser pointer and voice command Your Name, Please. I am Weikai Virtual Assistant A camera for Face- Recognition is installed behind the mirror Speech-capable virtual assistant Biometrics-based login Go ahead The remote student's image is highlighted as the teacher aims the laser pointer at it

Experience Capture Auto-record the synchronized multiple data streams –Lecture on Mediaboard and its presentation progress –Writing and pointing on the borad –Live Audio/Video –Interaction with remote students Post-edit Playback 记录的板书 播放控制界面 记录的视频 记录的讲义 记录的事 件的时间 轴显示 记录的视频 记录的讲义 记录的事 件的属性 编辑框 记录的板书

Hardware Infrastructure for Smart Classroom PC 主机共享器 100M 以太网 鼠标 键盘 IEEE 无线 AP VGA 信号 线 连到每台主机的 VGA 口 / 键盘口 / 鼠标 口 StudentBoard 投影机 MediaBoard 投影机 SmartBoard 设备 S m a r t B o a r d 接 口 线 （ 串 口 ） 教室现场视频 摄像头组 教室事件 / 状态 识别摄像头组 所有连接摄像头的 主机上安装有视频 采集卡 无线 MIC 接收器 音频分配器 手持设备 教师用 无线 MIC 学生用 无线 MIC 混音器 连到主机的 音频输出口 连到主机的 音频输入口 扬声器

Smart Platform: s oftware infrastructure for smart space  Loose coupling: Publish-Subscribe inter-module coordination model  Extensible: a multi-agent system abstraction model  Distinguishing two classes of communications with different QoS requirements, the message-oriented and the stream-oriented  Support for heterogeneous platforms and programming languages: wire protocol  Lightweight

Outline Smart Space Smart Classroom Application

学习 规划 学习 规划 质量 管理 质量 管理 教学跟踪 教学资源 课件 评估 资源库 网上教室 作业 BBS Chat 个人学习 小组讨论 网上实验室 数字图书馆 注册 登记 注册 登记 学业 证书 学业 证书 管理工作流 教学工作流 eLearning Platform

deployed in Tsinghua Continuing Education School ( regularly used by more than 20 thousand of users all over China 300+ online curriculum, ranging from Mathematics, Computer Technology, English to Law, Art Design and Economics Smart Classroom providing real time online collaboration over Internet

Application A remote Students chat Medianoard App manager Classroom video Course: Ergonomics

Application Course: Sign Design

Conclusion Experiments show the Smart Classroom system can facilitate teacher and students understanding and communicating with each other in a classroom, as well as distantly via Internet. Pervasive computing will be a fertile source of challenging research problems in computer systems for many years to come.