Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication.

Slides:



Advertisements
Similar presentations
February 20, Spatio-Temporal Bandwidth Reuse: A Centralized Scheduling Mechanism for Wireless Mesh Networks Mahbub Alam Prof. Choong Seon Hong.
Advertisements

Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,
All rights reserved © 2006, Alcatel Grid Standardization & ETSI (May 2006) B. Berde, Alcatel R & I.
School of Computing FACULTY OF ENGINEERING Grids and QoS Grid Computing has emerged in the last two decades, initially as a model for large-scale, resource-intensive.
All rights reserved © 2005, Alcatel Grid services over IP Multimedia Subsystem  Antoine Pichot, Olivier Audouin, Alcatel  GridNets ’06.
Energy-efficient Task Scheduling in Heterogeneous Environment 2013/10/25.
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
SLA-Oriented Resource Provisioning for Cloud Computing
Grant agreement n° SDN architectures for orchestration of mobile cloud services with converged control of wireless access and optical transport network.
All Hands Meeting, 2006 Title: Grid Workflow Scheduling in WOSE (Workflow Optimisation Services for e- Science Applications) Authors: Yash Patel, Andrew.
Distributed Process Scheduling Summery Distributed Process Scheduling Summery BY:-Yonatan Negash.
Workshop on HPC in India Grid Middleware for High Performance Computing Sathish Vadhiyar Grid Applications Research Lab (GARL) Supercomputer Education.
Adaptive Scheduling with QoS Satisfaction in Hybrid Cloud Environment 研究生:李羿慷 指導老師:張玉山 老師.
SoRTGrid: A Framework compliant with Soft Real Time requirements A. Merlo 1, V. Gianuzzi 1, A. Corana 2, A. Clematis 3, D. D’Agostino 3, A Quarati 3 1.
Resource Management of Grid Computing
A Quality-Driven Decision Engine for Live Video Transmission under Service-Oriented Architecture DALEI WU, SONG CI, HAIYAN LUO, UNIVERSITY OF NEBRASKA-LINCOLN.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
Tians Scheduling: Using Partial Processing in Best-Effort Applications Yuxiong He *, Sameh Elnikety *, Hongyang Sun + * Microsoft Research + Nanyang Technological.
WPDRTS ’05 1 Workshop on Parallel and Distributed Real-Time Systems 2005 April 4th and 5th, 2005, Denver, Colorado Challenge Problem Session Detection.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Embedded Systems Exercise 3: Scheduling Real-Time Periodic and Mixed Task Sets 18. May 2005 Alexander Maxiaguine.
Resource Manager for Grid with global job queue and with planning based on local schedules V.N.Kovalenko, E.I.Kovalenko, D.A.Koryagin, E.Z.Ljubimskii,
ICPCA 2008 Research of architecture for digital campus LBS in Pervasive Computing Environment 1.
Diffusion scheduling in multiagent computing system MotivationArchitectureAlgorithmsExamplesDynamics Robert Schaefer, AGH University of Science and Technology,
Emerging Research Dimensions in IT Security Dr. Salar H. Naqvi Senior Member IEEE Research Fellow, CoreGRID Network of Excellence European.
1 A Cooperative Game Framework for QoS Guided Job Allocation Schemes in Grids Riky Subrata, Member, IEEE, Albert Y. Zomaya, Fellow, IEEE, and Bjorn Landfeldt,
New Challenges in Cloud Datacenter Monitoring and Management
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
Self-Organizing Agents for Grid Load Balancing Junwei Cao Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04)
Word Wide Cache Distributed Caching for the Distributed Enterprise.
A Budget Constrained Scheduling of Workflow Applications on Utility Grids using Genetic Algorithms Jia Yu and Rajkumar Buyya Grid Computing and Distributed.
QoS-Aware In-Network Processing for Mission-Critical Wireless Cyber-Physical Systems Qiao Xiang Advisor: Hongwei Zhang Department of Computer Science Wayne.
Tufts Wireless Laboratory School Of Engineering Tufts University “Network QoS Management in Cyber-Physical Systems” Nicole Ng 9/16/20151 by Feng Xia, Longhua.
DISTRIBUTED COMPUTING
1 520 Student Presentation GridSim – Grid Modeling and Simulation Toolkit.
GRID’2012 Dubna July 19, 2012 Dependable Job-flow Dispatching and Scheduling in Virtual Organizations of Distributed Computing Environments Victor Toporkov.
The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/ ) under grant agreement.
Scientific Workflow Scheduling in Computational Grids Report: Wei-Cheng Lee 8th Grid Computing Conference IEEE 2007 – Planning, Reservation,
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
The Application of The Improved Hybrid Ant Colony Algorithm in Vehicle Routing Optimization Problem International Conference on Future Computer and Communication,
Advanced Spectrum Management in Multicell OFDMA Networks enabling Cognitive Radio Usage F. Bernardo, J. Pérez-Romero, O. Sallent, R. Agustí Radio Communications.
Performance Evaluation of a SNAP-based Community Resource Broker Mohammed H. Haji, Peter Dew, Karim Djemame and Iain Gourlay.
Net-Centric Software and Systems I/UCRC A Framework for QoS and Power Management for Mobile Devices in Service Clouds Project Lead: I-Ling Yen, Farokh.
Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.
NGMAST 2008 A Proactive and Distributed QoS Negotiation Approach for Heterogeneous environments Anis Zouari, Lucian Suciu, Jean Marie Bonnin, and Karine.
Cracow Grid Workshop ‘06 17 October 2006 Execution Management and SLA Enforcement in Akogrimo Antonios Litke Antonios Litke, Kleopatra Konstanteli, Vassiliki.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
Project Portfolio Management Business Priorities Presentation.
AN SLA-BASED RESOURCE VIRTUALIZATION APPROACH FOR ON-DEMAND SERVICE PROVISION Gabor Kecskemeti MTA SZTAKI International Workshop on Virtualization Technologies.
V. Fodor and Gy. Dan, KTH - Marholmen 2002 End-to-end control for audio-visual communication Viktoria Fodor and György Dán Laboratory for Communication.
Group member: Kai Hu Weili Yin Xingyu Wu Yinhao Nie Xiaoxue Liu Date:2015/10/
Trust and Security for Next Generation Grids, Securing Grid-Based Supply Chains Marco Di Girolamo HP Italy Innovation Center, Italy On.
Economic and On Demand Brain Activity Analysis on Global Grids A case study.
Dzmitry Kliazovich University of Luxembourg, Luxembourg
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Status & Challenges Interoperability and global integration of communication infrastructure & service platform Fixed-mobile convergence to achieve a future.
DIRAC Pilot Jobs A. Casajus, R. Graciani, A. Tsaregorodtsev for the LHCb DIRAC team Pilot Framework and the DIRAC WMS DIRAC Workload Management System.
Author Utility-Based Scheduling for Bulk Data Transfers between Distributed Computing Facilities Xin Wang, Wei Tang, Raj Kettimuthu,
Data Consolidation: A Task Scheduling and Data Migration Technique for Grid Networks Author: P. Kokkinos, K. Christodoulopoulos, A. Kretsis, and E. Varvarigos.
Zeta: Scheduling Interactive Services with Partial Execution Yuxiong He, Sameh Elnikety, James Larus, Chenyu Yan Microsoft Research and Microsoft Bing.
Net-Centric Software and Systems I/UCRC A Framework for QoS and Power Management for Mobile Devices in Service Clouds Project Lead: I-Ling Yen, Farokh.
Agent-Based Grid Load-Balancing Daniel P. Spooner University of Warwick, UK Junwei Cao NEC Europe Ltd., Germany.
Admela Jukan jukan at uiuc.edu March 15, 2005 GGF 13, Seoul Issues of Network Control Plane Interactions with Grid Applications.
BDTS and Its Evaluation on IGTMD link C. Chen, S. Soudan, M. Pasin, B. Chen, D. Divakaran, P. Primet CC-IN2P3, LIP ENS-Lyon
Spark on Entropy : A Reliable & Efficient Scheduler for Low-latency Parallel Jobs in Heterogeneous Cloud Huankai Chen PhD Student at University of Kent.
Agent-Based Grid Load-Balancing
Grid Computing.
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication systems research University of Surrey Guildford, United Kingdom

Grid Computing What is Grid Computing? A type of parallel and distributed system that enables the sharing, selection, and aggregation of geographically distributed resources depending on their availability, capability, cost, and user Quality of Service requirements for solving large-scale problems/applications. Challenges of Grid Computing To deliver quality of service: The grid system performance efficiency depend on the how good QoS is provided for different user’s different requirement based on the factor of functions, cost, deadline, budget etc. Enhance real-time & QoS capability in grid middleware to meet the demand of scientific applications. Coordinate resources: It is necessary to have a resource scheduling that provides matching users’ need and resource availability.

Problems of Grid QoS How to provide guaranteed bulk data transmission for user’s QoS requirement. The existing grid computing solution does not consider networks as a key resource to provide efficient services for grid apps.

Grid QoS Problem Solution Propose an end-to-end QoS framework to satisfy grid user’s QoS requirements. Introduce a service-oriented resource broker which can provide guaranteed QoS for grid application over large-scale grid network and optimal resource selection for resource sharing. Implement cost-based resource selection algorithm which can effectively utilize potential combined resources and achieve high user request success rate in dynamic service-oriented Grid.

End-to-End QoS Framework User submit application request Display all resources Grid User access resources data Broker makes resource reservation

Interaction Diagram

Broker architecture

Cost-based Resource Selection Algorithm Job requirement received: If have a job Then List_Static combined resource If no resource available Then Send_the job back If find the available combined static resources, pass step to discovery dynamic resource. On Update If combined resource has been selected Then Update_dynamic combined resource information These combined resource information has been update for selection. On Insert If have available combined resource Then Select_combined resource When the best resource has been selected, then these resources have to be reserved by broker for job execution. On Reservation If combined resource has been selected Then Reservation_combined resource On insert If combined resource has been reserved Then job execution Resource failed On delete_resource If resource not available Then resent the job

Simulation Network Topology

Simulation Result (1/2) ‏

Simulation Result (2/2) ‏

Conclusion End-to-End QoS framework has been defined Fully utilize combined resource to support user’s requirements Implement cost-based resource selection algorithm in Grid Resource Broker Discussion of Simulation Result The higher number of the task, the more processing time saved. The broker reservation scheduling has reduced the total processing time by 15-30% and reduced the average cost of processing by 4% when compared to non broker reservation scheduling.

Q&A