Presentation is loading. Please wait.

Presentation is loading. Please wait.

Department of Computer Science & Engineering The Chinese University of Hong Kong Constructing Robust and Resilient Framework for Cooperative Video Streaming.

Published by Modified over 8 years ago

Similar presentations

Presentation on theme: "Department of Computer Science & Engineering The Chinese University of Hong Kong Constructing Robust and Resilient Framework for Cooperative Video Streaming."— Presentation transcript:

1 Department of Computer Science & Engineering The Chinese University of Hong Kong Constructing Robust and Resilient Framework for Cooperative Video Streaming Louis Shi Lu, Microsoft Shanghai Michael R. Lyu, The Chinese University of Hong Kong Presented by: Jiangchuan Liu, Simon Fraser University 2006 International Conference on Multimedia & Expo July 9-12, 2006 Toronto, Ontario, Canada

2 Department of Computer Science & Engineering The Chinese University of Hong Kong Outline Introduction Motivation Related work Challenges The p2p streaming framework Overview Peer control overlay Data transfer protocol Peer local optimization Topology optimization Experiments Empirical experience in CUHK Experiments on PlanetLab Conclusion

3 Department of Computer Science & Engineering The Chinese University of Hong Kong Motivation Video over Internet is pervasive today New challenge: on-line TV broadcasting fails on traditional client-server architecture  500Kbps, theoretical limitation for a 100Mbps Server is 200 concurrent users Is there any efficient way to support video broadcasting to a large group of network users?

4 Department of Computer Science & Engineering The Chinese University of Hong Kong Why Client/Server fail Traditional client/server solution is not scalable 3 bottlenecks  Server load The server bandwidth is the major bottleneck  Edge capacity One connection to one client The connection may degrade  End to end bandwidth Scalability?

5 Department of Computer Science & Engineering The Chinese University of Hong Kong Related work Peer-to-Peer file sharing system  BitTorrent, eMule, DC++  Peer collaborate with each other  Without (or with very little) needs to dictated resources Why not suitable for video broadcasting  Without in-bound rate requirement  Without real-time requirement

6 Department of Computer Science & Engineering The Chinese University of Hong Kong Related work Content Distribution Network (CDN)  Install a lot of dictated servers on the edge of the Internet  Requests are directed to the best servers  Very high cost on purchasing servers Tree-based overlay  Coopnet, NICE  Rigid structure, not robust to node-failures and network condition changes Other Mesh-based systems  CoolStreaming, pplive, ppStream

7 Department of Computer Science & Engineering The Chinese University of Hong Kong Challenges Bandwidth  In-bound data bandwidth is not less than the video rate  In-bound bandwidth should not have large fluctuations Network dynamics  Network bandwidth and latency may change  Peer nodes may leave and join at any time  Peer nodes may fail or shut down Real-time requirement  All media packets must be fetched before its playback deadline

8 Department of Computer Science & Engineering The Chinese University of Hong Kong Goals For each peer:  Provide satisfying in-bound bandwidth  Assign its traffic in a balanced and fair manner For the whole network:  Keep it as one-piece while peer may fail/leave  Keep the shape of the overlay from degrading  Keep the radius small

9 Department of Computer Science & Engineering The Chinese University of Hong Kong P2P based solution: Overview Collaboration between client peers Source server alleviated Better scalability Better reliability

10 Department of Computer Science & Engineering The Chinese University of Hong Kong Infrastructure Video source  Windows media encoder, RealProducer …  Source peer Takes content from the video streaming server and feed it to the p2p network Wrap packets, add seq no. Look-up service (tracker)  Track the peers viewing each channel  Help new peers to join the broadcast Client peers (organized into a random graph)  Schedule and dispatch the video packets  Adapt to the network condition  Optimize the performance  Support the local video player

11 Department of Computer Science & Engineering The Chinese University of Hong Kong Peer join Peer join: Obtain a peer list Establish connections  Neighborhood selection Random IP matching Peer depth Peer performance Register its own service

12 Department of Computer Science & Engineering The Chinese University of Hong Kong The connection pool “ No one is reliable ”  A peer tries its best for better performance  A peer maintains a pool of active connections to peers  A peer keeps trying new peers when the incoming bandwidth is not reached  A peer keeps trying new connections after that, but in a slower manner  Update peer list  Others may establish new connections

13 Department of Computer Science & Engineering The Chinese University of Hong Kong Connection pool maintenance For each connection, define connection utility  Recent bandwidth (I/O)  Recent latency  Peer depth  Peer recent progress When connections are more than  Drop several bad connections Out-rate bound Peer depth (distance to source)

14 Department of Computer Science & Engineering The Chinese University of Hong Kong The peer control overlay Random-graph shape  Evolving with time  Radius: will not degrade since all peers are trying to minimize its depth  Integrity: will not be broken into pieces Data transfer  The data transfer path is determined from the control overlay  Each data packet is transferred along a tree  Determined just-in-time from the control overlay

15 Department of Computer Science & Engineering The Chinese University of Hong Kong Data transfer protocol Receiver driven  While exchanging data, data availability information is also exchanged  The data receiver determine which block from which neighbor Driven by data distribution information  Peer knows where the missing data is  Peer issues data request Peer synchronization  Content fetching progress

16 Department of Computer Science & Engineering The Chinese University of Hong Kong Data transfer protocol Data transfer load scheduling Several factors:  Latency  Bandwidth  Data availability Connection status (busy, free)  Data request issued (->busy)  Data arrived (->free) Scheduling time: on data arrival  Get a packet that is recent available  Estimate the latency  The playback deadline is before the expected latency

17 Department of Computer Science & Engineering The Chinese University of Hong Kong Data transfer protocol Connection status Busy standby Data request issued data arrived When data arrive:  Measure the latency of the previous packet  Get a weighted delay  Find if the packet whose playback deadline is ok for that delay  Issue request (  busy) Critical block

18 Department of Computer Science & Engineering The Chinese University of Hong Kong Data transfer protocol Multicast tree  Each data packet would not go by a peer twice  For each data packet, a multicast tree is constructed  The tree is built just-in-time To adapt to the transient properties of the network links  Each data packet may have different trees

19 Department of Computer Science & Engineering The Chinese University of Hong Kong Neighborhood management Performance monitoring:  Measured every once an interval (e.g. 10 sec.)  Avg. in-bound data rate  Avg. out-bound data rate  Avg. data packet latency Neighborhood goodness Neighborhood number  Lower bound of Nb  Upper bound of Nb

20 Department of Computer Science & Engineering The Chinese University of Hong Kong Peer control protocol Consideration: Data distribution and performance  While in-bound data rate is not enough  While neighbor number is lower than lower bound Establish new connections  While neighbor number is higher than upper bound Discard the worst connection The benefit is two-fold: both sides release something bad.

21 Department of Computer Science & Engineering The Chinese University of Hong Kong Overlay integrity Peers may leave or fail The overlay shall not be broken into pieces Maintain the connectivity of the overlay Solution: Peers try to connect to neighbors with lower depth Since each peer tries to lower its depth, the probability for (articulation) critical points to occur becomes small …… Source peer, depth = 0

22 Department of Computer Science & Engineering The Chinese University of Hong Kong Overlay integrity Playback progress difference:  Higher depth difference  higher playback progress difference  The attempt to reduce local peer depth may reduce that progress difference

23 Department of Computer Science & Engineering The Chinese University of Hong Kong Experiments Planet-Lab  300+ nodes deployed worldwide Performance test  Data smoothness The ratio of the data packets that can be fetched before its playback deadline  Dynamic experiment Peer sojourn time is exponential distributed (unstable) A. All peers are unstable B. A potion of the peers are unstable  Overlay size  Peer local buffer size

24 Department of Computer Science & Engineering The Chinese University of Hong Kong Static performance The impact of overlay size and peer buffer size

25 Department of Computer Science & Engineering The Chinese University of Hong Kong Dynamic performance The impact of peer stability The peers ’ sojourn time is exponential distributed The longer the mean, the more stable the peers are

26 Department of Computer Science & Engineering The Chinese University of Hong Kong Observations More users, better performance Resilient in dynamic network environment Robust to peer join-leave More stable, better performance Bigger buffer increases coherence

27 Department of Computer Science & Engineering The Chinese University of Hong Kong Benefits Low cost:  Without any extra hardware expenditure  Purely software solution Scalable: can support theoretically infinite users Reliable and resilient to user join/leave  Multiple connections  Intelligent content scheduling between peers  Quick adapt to the change of network conditions Solution for:  Low-cost large scale live broadcast

28 Department of Computer Science & Engineering The Chinese University of Hong Kong Conclusions In this presentation, we have:  Introduced the challenges in the p2p streaming system  Defined several goals that a p2p system to support real- time video broadcast  Proposed a solution for large-scale p2p video streaming service Future work  Distributed look-up service  Content copyright protection (Identity authentication, data encryption)  Overlay topology control (Traffic localization)  Possible VOD system based on this infrastructure

Download ppt "Department of Computer Science & Engineering The Chinese University of Hong Kong Constructing Robust and Resilient Framework for Cooperative Video Streaming."

Similar presentations

Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,

Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,
Building Cloud-ready Video Transcoding System for Content Delivery Networks(CDNs) Zhenyun Zhuang and Chun Guo Speaker: 饒展榕.

Building Cloud-ready Video Transcoding System for Content Delivery Networks(CDNs) Zhenyun Zhuang and Chun Guo Speaker: 饒展榕.
Clayton Sullivan PEER-TO-PEER NETWORKS. INTRODUCTION What is a Peer-To-Peer Network A Peer Application Overlay Network Network Architecture and System.

Clayton Sullivan PEER-TO-PEER NETWORKS. INTRODUCTION What is a Peer-To-Peer Network A Peer Application Overlay Network Network Architecture and System.
Cooperative Overlay Networking for Streaming Media Content Feng Wang 1, Jiangchuan Liu 1, Kui Wu 2 1 School of Computing Science, Simon Fraser University.

Cooperative Overlay Networking for Streaming Media Content Feng Wang 1, Jiangchuan Liu 1, Kui Wu 2 1 School of Computing Science, Simon Fraser University.
Lava: A Reality Check of Network Coding in Peer-to-Peer Live Streaming Mea Wang, Baochun Li Department of Electrical and Computer Engineering University.

Lava: A Reality Check of Network Coding in Peer-to-Peer Live Streaming Mea Wang, Baochun Li Department of Electrical and Computer Engineering University.
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli University of Calif, Berkeley and Lawrence Berkeley National Laboratory SIGCOMM.

Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli University of Calif, Berkeley and Lawrence Berkeley National Laboratory SIGCOMM.
Distributed Multimedia Systems

Distributed Multimedia Systems
Network Coding in Peer-to-Peer Networks Presented by Chu Chun Ngai 1008624233.

Network Coding in Peer-to-Peer Networks Presented by Chu Chun Ngai
Suphakit Awiphan, Takeshi Muto, Yu Wang, Zhou Su, Jiro Katto

Suphakit Awiphan, Takeshi Muto, Yu Wang, Zhou Su, Jiro Katto
CompSci 356: Computer Network Architectures Lecture 21: Content Distribution Chapter 9.4 Xiaowei Yang

CompSci 356: Computer Network Architectures Lecture 21: Content Distribution Chapter 9.4 Xiaowei Yang
PROMISE: Peer-to-Peer Media Streaming Using CollectCast Mohamed Hafeeda, Ahsan Habib et al. Presented By: Abhishek Gupta.

PROMISE: Peer-to-Peer Media Streaming Using CollectCast Mohamed Hafeeda, Ahsan Habib et al. Presented By: Abhishek Gupta.
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.

Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada ISP-Friendly Peer Matching without ISP Collaboration Mohamed Hefeeda (Joint.

Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada ISP-Friendly Peer Matching without ISP Collaboration Mohamed Hefeeda (Joint.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.

Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
ZIGZAG A Peer-to-Peer Architecture for Media Streaming By Duc A. Tran, Kien A. Hua and Tai T. Do Appear on “Journal On Selected Areas in Communications,

ZIGZAG A Peer-to-Peer Architecture for Media Streaming By Duc A. Tran, Kien A. Hua and Tai T. Do Appear on “Journal On Selected Areas in Communications,
Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast J. Liu, S. G. Rao, B. Li and H. Zhang Proc. of The IEEE, 2008 Presented by: Yan Ding.

Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast J. Liu, S. G. Rao, B. Li and H. Zhang Proc. of The IEEE, 2008 Presented by: Yan Ding.
Peer-to-peer Multimedia Streaming and Caching Service Jie WEI, Zhen MA May. 29.

Peer-to-peer Multimedia Streaming and Caching Service Jie WEI, Zhen MA May. 29.
Secure Multicast Xun Kang. Content Why need secure Multicast? Secure Group Communications Using Key Graphs Batch Update of Key Trees Reliable Group Rekeying.

Secure Multicast Xun Kang. Content Why need secure Multicast? Secure Group Communications Using Key Graphs Batch Update of Key Trees Reliable Group Rekeying.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.

Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
1 A Framework for Lazy Replication in P2P VoD Bin Cheng 1, Lex Stein 2, Hai Jin 1, Zheng Zhang 2 1 Huazhong University of Science & Technology (HUST) 2.

1 A Framework for Lazy Replication in P2P VoD Bin Cheng 1, Lex Stein 2, Hai Jin 1, Zheng Zhang 2 1 Huazhong University of Science & Technology (HUST) 2.

Similar presentations

Ads by Google