Presentation is loading. Please wait.

Presentation is loading. Please wait.

国立大学法人 奈良先端科学技術大学院大学 QoS Adaptation for Realizing Interaction between Virtual and Real Worlds in Pervasive Network Environment Shinya.

Similar presentations


Presentation on theme: "国立大学法人 奈良先端科学技術大学院大学 QoS Adaptation for Realizing Interaction between Virtual and Real Worlds in Pervasive Network Environment Shinya."— Presentation transcript:

1 国立大学法人 奈良先端科学技術大学院大学 QoS Adaptation for Realizing Interaction between Virtual and Real Worlds in Pervasive Network Environment Shinya Yamamoto , Yoshihiro Murata , Naoki Shibata * , Keiichi Yasumoto and Minoru Ito Shinya Yamamoto , Yoshihiro Murata , Naoki Shibata * , Keiichi Yasumoto and Minoru Ito Nara Institute of Science and Technology * Shiga University

2 2007/06/05NOSSDAV Overview Objective Enabling “space sharing” between virtual and real world users using ordinary devices and networks We propose a framework FAIRVIEW Reflects changes in real space to virtual space, and vice versa Enables realistic 3D information sharing for CSCW usage Only requires ordinary devices/networks

3 2007/06/05NOSSDAV Outline 1.Background 2. Assumptions and ideas 3. Proposed method 4. Experiment 5. Conclusion

4 2007/06/05NOSSDAV Related work Many studies for sharing virtual objects, as if they were in front of users –Mixed Reality (MR)/Augmented Reality (AR) –Computer Supported Cooperative Work (CSCW) These techniques require –Expensive and special devices –Dedicated networks and servers We want to realize similar object sharing at low cost Create virtual building Grasset/

5 2007/06/05NOSSDAV Related work Networked Virtual Environments (NVE) Users operate their avatars system works on Internet most NVEs handle only virtual spaces We want to handle both virtual and real space Second Life © Linden Lab

6 2007/06/05NOSSDAV Target environment Realizing a framework for large number of real and virtual users to share information via network –Applications: such as concert, shopping, exhibition, sports, game, etc… We propose FAIRVIEW △ is trade-off Sharing objects between real and virtual worlds can be realized using Mixed Reality techniques. MR allows real world users to view virtual objects at high quality by overlapping them to their views. MR also allows virtual world users to view real objects by measuring and reflecting shape/orientation.

7 2007/06/05NOSSDAV Target environment Realizing a framework for large number of real and virtual users to share information via network –Applications: such as concert, shopping, exhibition, sports, game, etc… We propose FAIRVIEW △ is trade-off NVEs enable virtual object sharing scalably and at low cost. There is a trade-off between object quality and scalability/cost. Most NVEs do not support real object sharing.

8 2007/06/05NOSSDAV Target environment Realizing a framework for large number of real and virtual users to share information via network –Applications: such as concert, shopping, exhibition, sports, game, etc… We propose FAIRVIEW △ is trade-off FAIRVIEW satisfies all of these criteria.

9 2007/06/05NOSSDAV Outline 1.Background 2. Assumptions and ideas 3. Proposed method 4. Experiment 5. Conclusion

10 2007/06/05NOSSDAV User equipment PDA 3D sensors HMD Web Cam Real userVirtual user PC, Display Wireless Network Ordinary internet connection

11 2007/06/05NOSSDAV Application example Paintball war game 1.Avatars, guns and targets are shared 2.Each user sees other real and virtual users 3.Virtual characters like dinosaur can be introduced FAIRVIEW has necessary functions to realize this kind of application

12 2007/06/05NOSSDAV Functionalities of FAIRVIEW Real user (mobile user) Virtual user (PC user) shared space

13 2007/06/05NOSSDAV Functionalities of FAIRVIEW Real user (mobile user) Virtual user (PC user) shared space Sharing Objects Challenge1:sharing objects among real/virtual users Problem: How to make users observe the shared objects? Our approach: prepare 3D geometry data of objects beforehand and draw the object at user terminals. Even when we want to share a new object, real-time modeling method [6] can be used.

14 2007/06/05NOSSDAV Functionalities of FAIRVIEW Real user (mobile user) Virtual user (PC user) Sharing Objects Challenge2: allowing users to observe moving objects Problem: How to capture movement of real objects? Our approach: measure position (x, y, z) and direction (angleH, angleV) continuously using positioning sensors, e.g., GPS, Wii Controller(6-axis sensor), etc… or using web camera and ARtoolkit [18] shared space

15 2007/06/05NOSSDAV Functionalities of FAIRVIEW Real user (mobile user) Virtual user (PC user) Moving virtual objects Challenge3: allowing users to make action to objects (i.e., push) note that users can make action only to virtual objects. Problem: How to reproduce realistic reaction? Our approach: use physics simulation of each virtual object. shared space

16 2007/06/05NOSSDAV Our target problems A lot of objects and users can exist at the same time. Positions and directions of objects have to be delivered in real time. Mobile terminals do not have much computation power. All functionalities have to be realized with ordinary devices. Solving these problems is the main contribution of this research.

17 2007/06/05NOSSDAV Outline 1.Background 2. Assumptions and ideas 3. Proposed method 4. Experiment 5. Conclusion

18 2007/06/05NOSSDAV …… How to distribute load for event delivery Central server Direct communication among user We introduce a typical load distribution technique used in MMOG. costly

19 2007/06/05NOSSDAV Load distribution on event delivery [15] Some of the user nodes are used as servers –One server (area node) is assigned to each sub-area Area node collects events, process and send the events back to user nodes Communication load is reduced using a load balancing tree Some powerful user nodes act as servers (area nodes) Load balancing tree

20 2007/06/05NOSSDAV Communication architecture for FAIRVIEW real user nodes Wireless AP virtual user nodes there are real user nodes and virtual user nodes. There are real user nodes and virtual user nodes. There is a wireless access point for real user nodes. internet

21 2007/06/05NOSSDAV Communication architecture for FAIRVIEW area node real user nodes virtual user nodes Introduce area nodes. Area nodes process events (change of position/direction of object, action to object) of corresponding sub-area. Wireless AP Area node

22 2007/06/05NOSSDAV Physics simulation for reaction of v-objects To realistically display virtual objects Reproduce movements of objects by physics simulation Physics simulation takes too much power on mobile terminals. We introduce nodes to manage each object, which we call the object management node.

23 2007/06/05NOSSDAV Introducing object management node area node real user nodes om-nodes virtual user nodes AP (for wireless users) Introduce object management nodes (om-nodes are assigned to powerful user nodes)

24 2007/06/05NOSSDAV Congestion in communication architecture area node real user nodes om-nodes virtual user nodes AP (for wireless users) As the number of objects increases, traffic amount may exceed network bandwidth capacity.

25 2007/06/05NOSSDAV Introducing bandwidth control node area node bwc-nodes real user nodes om-nodes virtual user nodes Introduce bwc- nodes, which reduce traffic amount within the available bandwidth to user nodes (We will explain how to drop packets, later) AP (for wireless users)

26 2007/06/05NOSSDAV A = 64 B = 16 C = 4 D = 2 E = 1 F = 0 Differentiation based on object class When the traffic exceeds available bandwidth, if we uniformly reduce quality (framerate) of all objects, satisfaction of this user will be low. Differentiate quality of objects based on object class User specifies importance value for each object. Bwc-node assigns bandwidth for each object according to importance value –we automatically decide importance value of each object according to the distance and direction as shown below –Update frequency of each object is changed according to assigned bandwidth

27 2007/06/05NOSSDAV Example for QoS adaptation Importance value of each object is decided by relative position. U O1O1 O3O3 O2O2 A = 64 B = 16 C = 4 D = 2 E = 1 F = 0 O 1 ’s importance is 64 (zone A) O 2 ’s importance is 1 (zone E) O 3 ’s importance is 16 (zone B)

28 2007/06/05NOSSDAV Example for QoS adaptation When user’s available bandwidth is 1 Mbps and each of three objects takes 0.5Mbps for position/direction updates, the sum will be 1.5Mbps. area node bwc-nodes om-nodes user nodes U O1O1 O3O3 O2O2 O1O1 O3O3 O2O2 Users importance Imp(O 1 ) = 5 Imp(O 2 ) = 2 Imp(O 3 ) = 3 Bandwidth control node dropping packets according to importance value.

29 2007/06/05NOSSDAV Collection and delivery of events area node bwc-nodes real user nodes om-nodes virtual user nodes AP (for wireless users) When a user generates an event, the event is sent to area node

30 2007/06/05NOSSDAV Collection and delivery of events area node bwc-nodes real user nodes om-nodes virtual user nodes Events regarding to objects are sent to corresponding om-nodes AP (for wireless users)

31 2007/06/05NOSSDAV Collection and delivery of events area node bwc-nodes real user nodes om-nodes virtual user nodes AP (for wireless users) Events are sent to bwc- nodes at regular intervals.

32 2007/06/05NOSSDAV Collection and delivery of events area node bwc-nodes real user nodes om-nodes virtual user nodes AP (for wireless users) Bwc-nodes reduce traffic by dropping packets.

33 2007/06/05NOSSDAV Collection and delivery of events area node bwc-nodes real user nodes om-nodes virtual user nodes AP (for wireless users) Bwc-nodes reduce traffic by dropping packets.

34 2007/06/05NOSSDAV Collection and delivery of events area node bwc-nodes real user nodes om-nodes virtual user nodes AP (for wireless users) Bwc-nodes limit traffic within the amount available for users

35 2007/06/05NOSSDAV Outline 1.Background 2. Assumptions and ideas 3. Proposed method 4. Experiment 5. Conclusion

36 2007/06/05NOSSDAV Traffic and update frequency Purpose of this experiment is to know how the proposed method regulates the traffic required for position/direction updates within the available bandwidth how much satisfaction users obtain when observing moving objects Configuration: Real user :100 (random placement) Virtual user :100 (random placement) Real object :50 ~ 2500 (random placement) Virtual object :50 ~ 2500 (random placement) Importance of object :64 , 16 , 4 , 2 , 1 , 0 Real user bandwidth (share) :10 Mbps Virtual user bandwidth :5 Mbps

37 2007/06/05NOSSDAV Required traffic When QoS adaptation is used, traffic is kept below the available bandwidth. RU = Real User VU = Virtual User avail -able BW When the number of objects exceed 500, the required traffic amount exceeds the available bandwidth.

38 2007/06/05NOSSDAV Achieved quality in frames/sec (virtual user) Virtual user keeps higher FPS in A and B, than uniform. ABCDEFABCDEF Virtual users see important objects on zone A with significantly higher quality even when the number of objects is large.

39 2007/06/05NOSSDAV Achieved quality in FPS (real user) Real user keeps higher FPS in zone A than uniform. ABCDEFABCDEF bwc-nodes real user nodes AP The impact of QoS adaptation is smaller than virtual users, since available b/w between real user nodes and AP is shared.

40 2007/06/05NOSSDAV Subjective evaluation of QoS adaptation Purpose of this experiment: To check subjective satisfaction of object quality by QoS adaptation Test procedure: Testees see composite movies with resolution and update frequency calculated by our QoS adaptation method The movies show a person gesturing one of the following shapes – 〇,△,▽, □ ,◇, etc. We asked 6 testees to answer several questions. ABCDEFABCDEF A B C

41 2007/06/05NOSSDAV Result of questionnaire A B C This table shows that the testees recognized the important object more accurately and quickly with our QoS adaptation method.

42 2007/06/05NOSSDAV Conclusion We proposed FAIRVIEW. Enables object sharing for CSCW usage P2P-based event delivery mechanism QoS adaptation mechanism Future work Improving QoS adaptation in wireless LAN Testing QoS adaptation by prototype system Implementing as a middleware Implementing application

43 2007/06/05NOSSDAV Thank you. Any questions?


Download ppt "国立大学法人 奈良先端科学技術大学院大学 QoS Adaptation for Realizing Interaction between Virtual and Real Worlds in Pervasive Network Environment Shinya."

Similar presentations


Ads by Google