1. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Proposed Collaboration on Access Grid / Ubiquitous Computing JongWon Kim and Juwon Park The Temporary Genkai-Hyeonhae Meeting Feb. 27 th, 2003 Networked Media Laboratory Dept. of Information & Communications Kwang-Ju Institute of Science & Technology (K-JIST) jongwon@kjist.ac.kr http://netmedia.kjist.ac.kr

2. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Contents Collaboration on Access Grid Collaboration on Ubiquitous Computing

3. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Collaboration on Access Grid

4. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Access Grid Access GRID oSupport group-to-group interaction across the Grid Components of an AG Node Digital Video Digital Audio NETWORK Mixer Control Computer NTSC Video RGB Video Analog Audio Video Capture Computer Display Computer Audio Capture Computer Echo Canceller

5. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Usage Areas The Academic and Research, Government, Private Sectors Making Remote Collaborations Work across Boundaries Check Multi-Sector Collaboration over the Access Grid by J. T. von Hoffman (Boston Univ)

6. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Collaboration Issue for H-G Joint Projects Access Grid (#4) Status 2 Contact: Koji Okamura (Kyushu Univ.) JongWon Kim (K-JIST) Participants Kyushu Nat`l Univ, AIST KISTI, K-JIST, Chonnam U, HYU Description (to be revised) The Access Grid, as a communication channel for users from remote sites, can give researchers and scientists in both Korea and Japan a seamless and immersive collaboration environment. With this project, we want to explore the potential of Access Grid in supporting collaborative research between two countries. To realize it, we will collaborate to research ways to build low-cost Access Grid system (e.g. mini-AG or PIG) and to promote its deployment. Also, we will conduct a joint research to improve current AG systems to better support enhanced video/audio quality, interaction, security, and inter-operablity. Expected Results (to be revised) - Provide a seamless colloaboration channel for researchers and scientists. - Promote the adoption of multicast technology over H-G link. Required bandwidth - Dependent on the number of site, camera per site, video rates (normally full access node requires bandwidth around 1.5Mbps) - Multicast support

7. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Relation with AG and other projects

8. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST N*Grid Project lead by KISTI APEC APGrid APAN APGrid GGF Grid Euro APGrid ANL/NCSA Grid Tech-centerGNOC N BT Grid N NT Grid N CT Grid N ET Grid N IT Grid N ST Grid N Supercmpt Grid N Clusters Grid N Appls. Grid Access Grid VR Grid Security Resource Mngt. Data Mngt. Inf. Service National Grid Infra Grid StandardGrid Middleware ResearchGFK N*Grid KISTI(2002~2006)

9. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST KISTI AG First AG in Korea (2002) KISTIs Access Grid Node Network enabled IP multicast Network Audio Capture Computer Display Computer Video Capture Computer Mixer Echo Canceller NTSC Video Analog Audio Digital Video Digital Audio Shared App. Control Computer RS232 Serial RGB Video Int. AG Community

10. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST K-JIST Mini AG Personal Interface to Access Grid (PIG) (Oct. 2002) With AG 1.2 release (note that PIG software is still very delicate) PIG @ K-JIST AG Node @ KISTI KISTI K-JIST KIST KIST-KISTI-K-JIST AG demo (2002.10.30) 1 st AG Node in KOREA 1 st PIG Node In KOREA

11. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Towards Enhanced Access Grid: e-AG An experimental, on-going trial to enhance the functionalities of Access Grid by augmenting improved support for immersive 3D Display, Human Computer Interaction, and Networking. With e-AG, we hope support oAll functionalities of Access Grid oStereo video delivery and display oCollaborative use of 3D computer graphics.

12. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Immersiveness Enhancement for Access Grid via Stereo Video Delivery For providing the immersiveness, we include the stereo video delivery functionality to EAG Developing 3D video delivery module enables the reliable and real-time The developed system supports oReliable networking of real-time media with reliable transport via ARQ, FEC, and their hybrid oVersatile display of stereo video in Left, Interlaced, Left & Right, and Above & Below views.

13. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Immersiveness Enhancement for Access Grid via Computer Graphics For the graphics side of 3D, EAG is being enhanced by supporting CG-based sharing in various communication architectures. Combination of push repository in server memory and file repository method is implemented to support multi-user collaborative environment. UIC EVLs QUANTA is adopted as a baseline networking and data management module VR software tools such as CAVELib or VR Juggler are also selected and utilized to build immersive 3D display. Shared Memory Server Client A (VR Juggler) 3D Display Input Networking (Shared Memory Client) Client B (VR Juggler) 3D Display Input Networking (Shared Memory Client) Client C (CAVELib) 3D DisplayInput Networking (Shared Memory Client) Network CMD, ID, Coord.

14. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Collaboration Issue for H-G Joint Projects On-line Joint Technical Conference on Access Grid Joint Project (Long-term) oJoint participation in AG 2.0 and beyond Ohmuta Kurume Nogata Iizuka Tagawa Fukuok a Kitakyushu Kitakyushu City High-speed LAN QGPOP (ISIT) To Tokyo Research Network in Korea Korean Partner Carrier KJCN Japanese Partner Carriers Fukuoka Gigabit Highway GENKAI Project QGPOP part KJCN Korea Busan KISTI KIST GENKAI/Hyeonhae Project APAN Internet2 GbE 2.4Gbps 150Mbps Shimonoseki Univ. of Fishery FGH AP Japan Submarine cable landing station Network equipment (Routers etc.) 250 km Repeaterles s KJIST Gwangju

15. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Collaboration on Ubiquitous Computing - Seamless Mobile Service? -

16. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST What s UbiComp? What s Ubiquitous Computing (UbiComp)? Distributed Systems Distributed Systems Mobile Computing Mobile Computing Ubiquitous Computing Ubiquitous Computing + + + + Mobile networking: mobile IP, ad hoc protocol, etc. Mobile information access: BW-adaptive, data consistency, etc. Energy-aware systems: process scheduling, memory management, etc. Location-sensitive systems: location sensing, location-based services, etc. Smart space: context-aware Invisible: smart agent Localized scalability: physical distance-based Uneven condition: heterogeneous infrastructure Remote communication Fault tolerance High availability Remote info access Courtesy of K-JIST U-VR Lab

17. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST UbiComp Challenges: ubiquitous Networking Infrastructure: ubi-networking oBeyond desktops/servers oConnected to networks Networked appliances Sensors Historical sites & other locations Embedded Mobile Interactive Wearable Active badge Location Sensor Flight Simulator Network

18. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Collaboration Issue for H-G Joint Projects Ubiquitous (Wireline/wireless) Computing (#18) Status 2 Contact: Morioka (hmorioka@isit.or.jp) JW Kim (jongwon@netmedia.kjist.ac.kr) Participants ISIT KJIST Description We are planning to build a prototype version of ubiquitous environment utilizing Mobile IP and IEEE 802.11a/b (and other L2 media) connecting Fukuoka, JAPAN and Gwangju, KOREA. On top of the built ubiquitous environment we will explore example applications such as user tracking and IP mobile video streaming. Expected Result In our joint effort, instead of trying to build hot spots, we will focus on building real ubiquitous environement with mobility and security support. We hope to let people in both countries to better locate each other and communicate ubiquitously. Bandwidth Peak 100 Mbps / Average 10 Mbps

19. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Project Scope & Objective Mobile Media Delivery via Wireless Multicast and Network Adaptation Wireless Network Adaptation Wireless Aware Media Application Advanced Streaming (Wireless + Multicast) GroupCommunication (1-to-N, M-to-N) Mobile IP / WirelessMulticast Reliability : Better Quality Efficiency: Better Bandwidth Utilization ReliableMulticast

20. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Project Scope & Objective (Cont.) For Streaming Media Applications over Wired/Wireless Integrated Networks oReal-time streaming of stored contents only (but can include on-line streaming) to enable buffering (up to 3sec) oMaybe extended to conferencing (limited scope) at later phase of project Will address the challenges such as oMobility: How to track users movement and sustain seamless streaming? oMulticasting: How to enable sharing of wireless channel efficiently? oEnd-to-end QoS: How to maintain the quality of media streaming over highly fluctuating wireless network? Anticipated Duration: 2002. 12 ~ 2006.12 (4 years)

21. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Implementation Phase I (2003): One-to-one Streaming Environment oMobile IPv4 oIEEE 802.11b oServer: Darwin or Helix Server oClient – Notebook oMPEG-2/4 streaming Objectives oImplement the streaming server/client that provides seamless streaming (i.e., no service disruption during handoff). FA Media Server Adaptive streaming client

22. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Implementation Phase II (2004): One-to-many Streaming Environment oMobile IPv6 oIEEE 802.11b or 802.11a oClient Extension to PDA? oMPEG-2/4 streaming oSource Specific Multicast (SSM) Objectives oImplement the streaming server/client providing that provides seamless multicast streaming. FA Media Server Adaptive streaming client Multicast

23. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Mobility Challenge: Mobile IP Smooth and Fast Handoff ? 6 7 5 FA old CN FA new 2 3 4 Output buffer Handoff 2 3 4 Forwarding buffer to FA new 2 3 4 Bind forwarding

24. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Mobility Challenge: Handoff-aware Streaming Client Adaptive buffer control oTo reduce the discontinuity of streaming oIncreasing the buffer level of client before handoff Question oWhat is a proper buffer level? oWhat is a handoff duration? Handoff is initiated Handoff is completed Buffer Level time No playback Handoff is initiated Handoff is completed Buffer Level time

25. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Mobility Challenge: Handoff-aware Streaming Client (Cont.) Estimation of handoff duration by adopting K-JISTs Transient Time Analysis oSource traffic rate oHandoff load oBackground traffic load oBeacon time period (router advertisement) Buffer level control oUsing the handoff duration (HTP) to calculate the proper buffer level. oMinimizing the buffer level oProviding no media discontinuity No service disruption during handoff Collecting parameters Calculating HTP Estimating Buffer Level Bc<Bt Increase Buffer Decrease Buffer Bc: Current Buffer Level Bt: Target Buffer Level

26. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST K-JIST Transient Time Analysis: How long time does Handoff take? Handoff Transient Time Case 2 Case 3 Case 1 New streamOld stream STP UTP STP UTP Handoff Initialization HTP Source Traffic Turning Point Old RouterNew Router toto tntn tftf UTP=Unstable Time Period STP=Silence Time Period HTP=Handoff Time Period HTP may be a good reference to the buffer level. New stream Old stream

27. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Timing Analysis UTP = max(0,T last_of_old - T first_of_new ) = max(0, (t o - t n ) + q o + t f ) STP = min (T first_of_old, T first_of_new ) HTP = UTP +STP + |T first_of_new – T first_of_old | Queueing Model K-JIST Transient Time Analysis: Handoff Period Time (HTP) qoqo (a) Before handoff (b) After handoff

28. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST K-JIST Transient Time Analysis: A nalysis Result

29. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Seamless Streaming Aid by Adaptive Playout? Role of Clients for Adaptive Playback Merits of Client Adaptation Can prevent excessive buffer overflow and underflow Can reduce discontinuous playback time Can maintain small buffer size. Buffer level

30. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Network Feedback Layered Video Encoding Network Adaptation Layered Encoding R-D Analysis Video pre- processing Source Rate/ Error Resilience Delivery With Network Adaptation (Rate, Delay, Loss) Network Monitoring & Feedback Handling Inform Bandwidth & App. feedback Quality Control Frame Complexity Video packet Stream Receiver adaptation End-to-End Feedback Application Feedback Wireless Network R-D / Corruption Model Layered RPI Seamless Streaming : Network Adaptation Robust/Scalable Media for Wireless Media Delivery and Associated Network Adaptation

31. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST End-to-end QoS Challenge: Wireless LAN Relative Differentiated Services and the Proportional Differentiation Model for IEEE 802.11x WLAN oService Differentiation : Upstream Different IFS (Inter Frame Space) Different Back-off Time Different Frame Size oService Differentiation : Downstream Scheduler in Access Point –q i : Performance measure for class I –c 1 < c 2 <….< c N : Quality differentiation parameter Proportional Delay Differentiation Model Proportional Loss Differentiation Model AP q1q1 q2q2 q3q3 Scheduler Classifier

32. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Collaboration Issue for H-G Joint Projects With H. Morioka@ISIT, Fukuoka, Japan How to combine ISITs Fast and Secure Handoff Idea ? (Short- term) oWith implementation: Deploy ISITs handoff at K-JIST and test its performance for seamless streaming oMISP (mobile Internet Service Protocol) for Authentication, Address Assignment, and Encryption Joint Project (Long-term) oBuild ubiquitous computing environment ? Mobile Node WLAN Interfaces Access Point Communication Scanning & Connection Access Point

33. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST ISIT: Handover with 2 Interfaces (1)

34. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST ISIT: Handover with 2 Interfaces (2)

35. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST ISIT: Handover with 2 Interfaces (3)

36. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST ISIT: Fukuoka Mobile Broadband (FMBB)

37. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Thank You!

38. N ETWORKed M EDIA L AB. D EPT. OF I NFO. & C OMM., K-JIST Ohmuta Kurume Nogata Iizuka Tagawa Fukuoka Kitakyushu Kitakyushu City High-speed LAN QGPOP (ISIT) To Tokyo Research Network in Korea Korean Partner Carrier KJCN Japanese Partner Carriers Fukuoka Gigabit Highway GENKAI Project QGPOP part KJCN Korea Busan KISTI KIST GENKAI/Hyeonhae Project APAN Internet2 GbE 2.4Gbps 150Mbps Shimonoseki Univ. of Fishery FGH AP Japan Submarine cable landing station Network equipment (Routers etc.) 250 km Repeaterless KJIST Gwangju