Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,

Slides:



Advertisements
Similar presentations
All rights reserved © 2006, Alcatel Grid Standardization & ETSI (May 2006) B. Berde, Alcatel R & I.
Advertisements

EC-GIN Europe-China Grid InterNetworking. Enriched with customised network mechanisms Original Internet technology Overview of Project Traditional Internet.
1 From Grids to Service-Oriented Knowledge Utilities research challenges Thierry Priol.
All rights reserved © 2005, Alcatel Grid services over IP Multimedia Subsystem  Antoine Pichot, Olivier Audouin, Alcatel  GridNets ’06.
Energy-efficient Task Scheduling in Heterogeneous Environment 2013/10/25.
Doc.: IEEE /0578r0 Submission 2008 May Jarkko Kneckt, NokiaSlide 1 Forwarding in mesh containing MPs in power save Date: Authors:
Efficient Event-based Resource Discovery Wei Yan*, Songlin Hu*, Vinod Muthusamy +, Hans-Arno Jacobsen +, Li Zha* * Chinese Academy of Sciences, Beijing.
© 2006 Cisco Systems, Inc. All rights reserved. MPLS v2.2—8-1 MPLS TE Overview Introducing the TE Concept.
Contents Shortcomings of QoS in the Current Internet About OpenFlow
A Centralized Scheduling Algorithm based on Multi-path Routing in WiMax Mesh Network Yang Cao, Zhimin Liu and Yi Yang International Conference on Wireless.
SLA-Oriented Resource Provisioning for Cloud Computing
Ningning HuCarnegie Mellon University1 Optimizing Network Performance In Replicated Hosting Peter Steenkiste (CMU) with Ningning Hu (CMU), Oliver Spatscheck.
Clayton Sullivan PEER-TO-PEER NETWORKS. INTRODUCTION What is a Peer-To-Peer Network A Peer Application Overlay Network Network Architecture and System.
Peer-to-Peer Networks as a Distribution and Publishing Model Jorn De Boever (june 14, 2007)
Technical Architectures
Chien-Hao Chien, Shun-Yun Hu, Jehn-Ruey Jiang Adaptive Computing and Networking (ACN) Laboratory Department of Computer Science and Information Engineering.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada Multimedia Streaming in Dynamic Peer-to-Peer Systems and Mobile Wireless.
© 2009 Pearson Education Inc., Upper Saddle River, NJ. All rights reserved.1 Computer Networks and Internets, 5e By Douglas E. Comer Lecture PowerPoints.
Rheeve: A Plug-n-Play Peer- to-Peer Computing Platform Wang-kee Poon and Jiannong Cao Department of Computing, The Hong Kong Polytechnic University ICDCSW.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
Resource Management – a Solution for Providing QoS over IP Tudor Dumitraş, Frances Jen-Fung Ning and Humayun Latif.
A Grid Resource Broker Supporting Advance Reservations and Benchmark- Based Resource Selection Erik Elmroth and Johan Tordsson Reporter : S.Y.Chen.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Introduction to Web Database Processing
1IMIC, 8/30/99 Constraint-Based Unicast and Multicast: Practical Issues Bala Rajagopalan NEC C&C Research Labs Princeton, NJ
1© Copyright 2015 EMC Corporation. All rights reserved. SDN INTELLIGENT NETWORKING IMPLICATIONS FOR END-TO-END INTERNETWORKING Simone Mangiante Senior.
Draft-li-rtgwg-cc-igp-arch-00IETF 88 RTGWG1 An Architecture of Central Controlled Interior Gateway Protocol (IGP) draft-li-rtgwg-cc-igp-arch-00 Zhenbin.
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
Internet Traffic Management Prafull Suryawanshi Roll No - 04IT6008.
Introducing EC-GIN: Europe-China Grid InterNetworking Europe-China Grid InterNetworking European Sixth Framework STREP FP IST Michael Welzl,
Connect. Communicate. Collaborate The Technological Landscape of GÉANT2 Roberto Sabatino, DANTE
COnvergence of fixed and Mobile BrOadband access/aggregation networks Work programme topic: ICT Future Networks Type of project: Large scale integrating.
AIMS’99 Workshop Heidelberg, May 1999 Ko / CP 4/99 Linkage between Internet Service Architectures and ATM
End-to-end QoE Optimization Through Overlay Network Deployment Bart De Vleeschauwer, Filip De Turck, Bart Dhoedt and Piet Demeester Ghent University -
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
SpaceWire-RT Steve Parkes, Albert Ferrer-Florit
National Chi Nan University Performance Evaluation of Transport Protocols in Smart Meter Networks Speaker: Chia-Wen Lu Advisor: Dr. Quincy Wu Date: 2012/07/23.
TeraPaths TeraPaths: establishing end-to-end QoS paths - the user perspective Presented by Presented by Dimitrios Katramatos, BNL Dimitrios Katramatos,
1 High-Level Carrier Requirements for Cross Layer Optimization Dave McDysan Verizon.
EmNet: Satisfying The Individual User Through Empathic Home Networks J. Scott Miller, John R. Lange & Peter A. Dinda Department of Electrical Engineering.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Muhammad Mahmudul Islam Ronald Pose Carlo Kopp School of Computer Science & Software Engineering Monash University, Australia.
Vic Liu Liang Xia Zu Qiang Speaker: Vic Liu China Mobile Network as a Service Architecture draft-liu-nvo3-naas-arch-01.
1 BRUSSELS - 14 July 2003 Full Security Support in a heterogeneous mobile GRID testbed for wireless extensions to the.
Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication.
A Utility-based Approach to Scheduling Multimedia Streams in P2P Systems Fang Chen Computer Science Dept. University of California, Riverside
PROP: A Scalable and Reliable P2P Assisted Proxy Streaming System Computer Science Department College of William and Mary Lei Guo, Songqing Chen, and Xiaodong.
A P2P-Based Architecture for Secure Software Delivery Using Volunteer Assistance Purvi Shah, Jehan-François Pâris, Jeffrey Morgan and John Schettino IEEE.
Vehicular Cloud Networking: Architecture and Design Principles
Uni Innsbruck Informatik - 1 Network Support for Grid Computing... a new research direction! Michael Welzl DPS NSG Team
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
INSIGNIA : A QOS ARCHITECTURAL FRAMEWORK FOR MANETS Course:-Software Architecture & Design Team Members 1.Sameer Agrawal 2.Vivek Shankar Ram.R.
1 | © 2015 Infinera Open SDN in Metro P-OTS Networks Sten Nordell CTO Metro Business Group
Interconnect Networks Basics. Generic parallel/distributed system architecture On-chip interconnects (manycore processor) Off-chip interconnects (clusters.
Application Level QoS in Multimedia Peer-to-Peer (P2P) Networks Alireza Goudarzi Nematiy and Makoto Takizawa¤ Tokyo Denki University
1 Revision to DOE proposal Resource Optimization in Hybrid Core Networks with 100G Links Original submission: April 30, 2009 Date: May 4, 2009 PI: Malathi.
1 Traffic Engineering By Kavitha Ganapa. 2 Introduction Traffic engineering is concerned with the issue of performance evaluation and optimization of.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Efficient Opportunistic Sensing using Mobile Collaborative Platform MOSDEN.
BDTS and Its Evaluation on IGTMD link C. Chen, S. Soudan, M. Pasin, B. Chen, D. Divakaran, P. Primet CC-IN2P3, LIP ENS-Lyon
Introducing EC-GIN: Europe-China Grid InterNetworking Sven Hessler Institute of Computer Science, NSG team University of Innsbruck, Austria
Mobile IP THE 12 TH MEETING. Mobile IP  Incorporation of mobile users in the network.  Cellular system (e.g., GSM) started with mobility in mind. 
The Concept of Universal Service
Accelerating Peer-to-Peer Networks for Video Streaming
Grid Optical Burst Switched Networks
Self Healing and Dynamic Construction Framework:
Computer Networks and Internets, 5e By Douglas E. Comer
Cluster Resource Management: A Scalable Approach
ExaO: Software Defined Data Distribution for Exascale Sciences
Presentation transcript:

Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff, Canada

Outline Introduction Network Resource Broker Testbed Scenario and Validation Conclusion and Future Work

Introduction The evolution from Grid Computing to Cloud computing has introduced a very important add-on value service that is on- demand resource provisioning The Cloud computing is to use data centre that surely requires QoS provision to network services. The valuable functions of Cloud may bring technical challenges to the existing networks: Network extensibility and scalability due to service composition How will it impact the network in terms of customibility Can we reuse some of the existing Grid-Network enhancements Challenges and opportunities on network reliability and security

EC-GIN Project EC-GIN project was founded by the EU committee to tackle some of these questions with focus on the impact to the existing networks. Its objective is, based on a number of properties that make Grids unique from the network perspective, to aims at developing a tailored network technology in dedicated support of Grid applications. It is to supplement with a secure and incentive-based Grid Services network traffic management system, which will balance the conflicting performance demand and the economic use of resources in the network and within the Grid Although the research is carried out for Grid computing, we found it also applies to the Cloud computing with helps to provide customized QoS in networks with efficient network resource utility.

Resource Broker for Cloud Although the research is carried out for Grid computing, we found it also applies to the Cloud computing with helps to provide customized QoS in networks with efficient network resource utility. The resource management system plays a critical function in cloud in terms resources discovery for users and allocations of the best resources to the users tasks Many researches efforts have been put on the resource broker, each of which has targeted applications resource allocations for different applications have various criteria No general approach Network resource broker proposed here is for data shifting applications

Network Resource Broker The Network resource broker is designed For data shifting applications To provide optimized date transmission path in networks To use network bandwidth efficiently, and to satisfy uses timing requests (QoS) The application could be pure file transmission or real time multimedia streaming The main functions of the resource broker includes: Interpreting the requirements of users Obtaining correct resource availability information Acquire and process network topology information Calculate optimized paths for data transmission using overlay routing concept for bandwidth utility efficiency and task timing requests Coordinate with bandwidth reservation function unit for bandwidth reservation on the optimized paths Coordinate with data transfer function unit for data transmission

Broker Architecture The resource broker has 6 interfaces: Two interfaces between users and the broker for inputting users jobs and outputting job execution confirmation One interface between the resource brokers data resource discovery function and the data resource index service unit for data resource availability and location enquiry and feedback One interface connects the brokers network interpreter function and the network topology matrix which provide bandwidth information for every link between each pair of hosts One interface between the transmission path optimizer and the bandwidth reservation unit reserved bandwidth on the optimized paths The last interface connects the Transmission Scheduler and Executer function and the file transfer function unit

Testbed The proposed design has been implemented on a testbed The testbed is formed by 7 Linux boxes with Ubundu 8.10 installed 3 routers connecting 4 end users Router 1, 2 and 3 are connected with each other by 100Mb Ethernet interfaces forming a triangle End users Host B connected to Router 2, Host A to Router 1 and Host C and D both to Router 3 by 100 Mb Ethernet interfaces. every end user is in a different sub-net The designed network resource broker is installed in Host B

Testbed layout Host A Host D Host B Host C Router 1Router 3 Router 2 Video_S Video_B Default and optimized path for Video_S Optimized path for Video_B Default path for Video_B

Network resource broker in IPTV Scenario The test scenario is designed for potential user cases for IPTV big streaming file splitting for multiple path transmission, and the current simplified case for content synchronization An IPTV provider have several content servers located in different places to cover large area for better streaming quality on the Internet, which are need be synchronized a specified time with limit length so the impact to the service can be minimized, such as the early morning every day. Network resource broker can be used for fast and efficient content shifting among servers

Validation Host B is acting as one of the server that is trying to synchronize itself with other servers Host C and Host D A large video file from D A smaller video file from C Done in the same time Link between Router 3 and Router 2 doesnt have enough bandwidth for both the transmission in time. The bandwidth between Router 3 and 1 and between Router 1 and 2 are even smaller that can not finish the downloading of the large video in time The user request is processed by the network resource broker that Queried the resource index file to discover that Video_B is on Host D and Video_S is on Host C process the path on which these two files should be downloaded that can satisfy the timing requested by the user using the network topology matrix as an input

Results a) Optimized path for large video file b) Optimized path for small video file Results shows that the large video file should go through the link between Router 2 and Router 3, and The small video file should go through the link between Router 3 and Router 1 to Host A first and then be forwarded by Host A to Host B through the link between Router 1 and 2 The path optimization satisfied the users timing request by using overlay routing through Host A The result showed that both files were successfully received by Host B on time with variation of several ms

Conclusion and Future Work A network resource broker as one of the central functions of the resource management system for Cloud computing is presented It can choose data transmission path for Cloud computing tasks in the network to satisfy the users timing requests with QoS guarantee while using the network bandwidth more efficiently by applying overlay routing concept to the path processing The proposed resource broker has been implemented in Java and validated in an IPTV scenario on a testbed It successfully scheduled two video files transmissions and optimized the downloading paths so the bandwidth bottleneck is avoided and two transmissions were finished on the same time as requested by a user We are trying to use the Large File Transfer (LFT) mechanism developed in the EC-GIN project to replace netcat as the data shifting tool the peer awareness mechanism developed in the same project will be used to provide dynamic network topology matrix as an alternative for the static approach we are currently using

Thanks