AN SLA-BASED RESOURCE VIRTUALIZATION APPROACH FOR ON-DEMAND SERVICE PROVISION Gabor Kecskemeti MTA SZTAKI International Workshop on Virtualization Technologies.

Slides:



Advertisements
Similar presentations
A Lightweight Platform for Integration of Mobile Devices into Pervasive Grids Stavros Isaiadis, Vladimir Getov University of Westminster, London {s.isaiadis,
Advertisements

Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
School of Computing FACULTY OF ENGINEERING Richard Kavanagh Research Group: Collaborative Systems and Performance, Supervisors: Karim Djemame and Natasha.
Performance Testing - Kanwalpreet Singh.
Policy based Cloud Services on a VCL platform Karuna P Joshi, Yelena Yesha, Tim Finin, Anupam Joshi University of Maryland, Baltimore County.
ARGUGRID Use Case using Instrumentation Mary Grammatikou National Technical University of Athens OGF 2009, Catania.
ACTS Programme M obile I ntelligent A gents for M anaging the Information I nfrastructure ACTS Programme AC338.
SLA-Oriented Resource Provisioning for Cloud Computing
GridRPC Sources / Credits: IRISA/IFSIC IRISA/INRIA Thierry Priol et. al papers.
SPECIFYING AND MONITORING GUARANTEES IN COMMERCIAL GRIDS THROUGH SLA Sven Graupner Vijay MachirajuAad van Moorsel IEEE/ACM International Symposium on Clustering.
Advanced QoS Methods for Grid Workflows Based on Meta-Negotiations and SLA-Mappings Ivona Brandic 1, Dejan Music 1, Schahram Dustdar 1, Srikumar Venugopal.
SmartER Semantic Cloud Sevices Karuna P Joshi University of Maryland, Baltimore County Advisors: Dr. Tim Finin, Dr. Yelena Yesha.
28.2 Functionality Application Software Provides Applications supply the high-level services that user access, and determine how users perceive the capabilities.
September 25, 2004SKM Using Facets of Security within a Knowledge-based Framework to Broker and Manage Semantic Web Services Randy Howard, Larry.
Variability Oriented Programming – A programming abstraction for adaptive service orientation Prof. Umesh Bellur Dept. of Computer Science & Engg, IIT.
A Service Platform for On-Line Games DebanJan Saha, Dambit Sahu, Anees Shaikh (IBM TJ Watson Research Center, NY) Presented by Gary Huang March 17, 2004.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
Cloud Computing Architecture Adam Balla Wa Chiu Siu.
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
Špindlerův Mlýn, Czech Republic, SOFSEM Semantically-aided Data-aware Service Workflow Composition Ondrej Habala, Marek Paralič,
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
CGW 2003 Institute of Computer Science AGH Proposal of Adaptation of Legacy C/C++ Software to Grid Services Bartosz Baliś, Marian Bubak, Michał Węgiel,
Differentiated Access to Virtual Resources in Cloud Environments M. Fazio and A. Puliafito Euro-TM Workshop.
DISTRIBUTED COMPUTING
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
ASG - Towards the Adaptive Semantic Services Enterprise Harald Meyer WWW Service Composition with Semantic Web Services
Object Oriented Design Jerry KotubaSYST Object Oriented Methodologies1.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
© 2008 Open Grid Forum Independent Software Vendor (ISV) Remote Computing Primer Steven Newhouse.
The ACGT Workflow Editing & Enactment Environment Giorgos Zacharioudakis Institute of Computer Science, Foundation for Research & Technology – Hellas (ICS-FORTH)
A Flexible Access Control Model for Web Services Elisa Bertino CERIAS and CS Department, Purdue University Joint work with Anna C. Squicciarini – University.
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
Issues in (Financial) High Performance Computing John Darlington Director Imperial College Internet Centre Fast Financial Algorithms and Computing 4th.
An Ontological Framework for Web Service Processes By Claus Pahl and Ronan Barrett.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Performance evaluation of component-based software systems Seminar of Component Engineering course Rofideh hadighi 7 Jan 2010.
Performance Evaluation of a SNAP-based Community Resource Broker Mohammed H. Haji, Peter Dew, Karim Djemame and Iain Gourlay.
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
1 Taverna CISTIB Ernesto Coto Taverna Open Workshop, October 2014.
Cracow Grid Workshop ‘06 17 October 2006 Execution Management and SLA Enforcement in Akogrimo Antonios Litke Antonios Litke, Kleopatra Konstanteli, Vassiliki.
Scheduling in HPC Resource Management System: Queuing vs. Planning Matthias Hovestadt, Odej Kao, Alex Keller, and Achim Streit 2003 Job Scheduling Strategies.
Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication.
DAME: A Distributed Diagnostics Environment for Maintenance Dr Tom Jackson University of York.
Website: Answering Continuous Queries Using Views Over Data Streams Alasdair J G Gray Werner.
16/11/ Semantic Web Services Language Requirements Presenter: Emilia Cimpian
Course: COMS-E6125 Professor: Gail E. Kaiser Student: Shanghao Li (sl2967)
7. Grid Computing Systems and Resource Management
Diego R. Lopez, RedIRIS JRES2005, Marseille On eduGAIN and the Coming GÉANT Middleware Infrastructure.
06/08/10 P-GRADE Portal and MIMOS P-GRADE portal developments in the framework of the MIMOS-SZTAKI joint project Mohd Sidek Salleh MIMOS Berhad Zoltán.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
Reliable Web Service Execution and Deployment in Dynamic Environments * Markus Keidl, Stefan Seltzsam, and Alfons Kemper Universität Passau Passau,
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
A service Oriented Architecture & Web Service Technology.
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
Autonomic Resource Virtualization in Cloud-like Environments A
Interaction between Scheduling Instances
Grid Computing.
Basic Grid Projects – Condor (Part I)
Resource and Service Management on the Grid
On the Use of Service Level Agreements in AssessGrid
Introduction to OGF Standards
Chained Negotiation for Distributed Notification Services
Presentation transcript:

AN SLA-BASED RESOURCE VIRTUALIZATION APPROACH FOR ON-DEMAND SERVICE PROVISION Gabor Kecskemeti MTA SZTAKI International Workshop on Virtualization Technologies in Distributed Computing 2009 Attila Kertesz MTA SZTAKI Presented by: Yun Liaw Ivona Brandic TU Vienna

Outline  Introduction  SLA-Based Resource Virtualization (SRV) Architecture  Requirements and Solutions to Realize SRV  Agreement Negotiation – Meta Negotiation  Service Brokering – Meta Brokering  Service Deployment and Virtualization  Case Study  Related Works  Conclusions and Comments 2015/12/4 2

Introduction  This paper provides an architecture for SLA-based resource virtualization that provides an solution for executing user applications in Clouds  To combine SLA-based resource negotiations with virtualized resource in terms of on-demand service provision  Most related works focus on either virtualization approaches without considering SLA management, or concentrates on SLA management neglecting the resource virtualization 2015/12/4 3

Introduction  This paper’s focus:  Agreement negotiation  Service brokering  Deployment using virtualization technology  Contributions of this paper  Presentation of a architecture for the SLA-based resource virtualization and on-demand service provision  Description of the architecture including meta-negotiation, meta-brokering, brokering and automatic service deployment (ASD)  Demonstration of the presented approach based on a case study 2015/12/4 4

SLA-based resource Virtualization Architecture  MN: Meta-Negotiator  MB: Meta-Broker  B: Broker  ASD: Automatic Service Deployment unit  S: Service  R: Resource 2015/12/4 5

SLA-based resource Virtualization Architecture  User: a person who wants to user a service  MN – Meta-Negotiator: mediates between user and meta- broker that selecting appropriate protocols for agreements; negotiates SLA creation, handles fulfillment and violation  MB – Meta-Broker: to select a broker that is capable of deploying a service with the user needs  B – Broker: interacts with resources and ASD  ASD – Automatic Service Deployment: installs the required service on the selected resource on demand  S – Service: the service that users want to deploy and execute  R – Resource: physical machines, on which virtual machines can be deployed 6

7 Interactions of SRV Components  SLA Negotiation:  Step 1: User starts a negotiation for executing a service with certain QoS requirements (specified in a Service Description (SD) with an SLA)  Step 2: MN asks MB, if it could execute the service with the requirement  Step 3: MB matches the requirements to the properties of the available brokers and replies with an acceptance or a different offer for renegotiation  Step 4: MN replies with the answer of MB, step 1-4 may continue for renegotiation until both sides achieve an agreement :MN Service request with QoS requirements Reply :User If MB could execute the service? :MB Do_Match Accept or other offerings

8 Interactions of SRV Components  Service Initiation:  Step 5: User calls the service with the SD and SLA  Step 6: MN passes the SD and the possibly transformed SLA (to the protocol that selected broker understands)  Step 7: MB calls the selected Broker with SLA and a possibly translated SD (to the language of Broker)  Step 8: Broker executes the service with respect to the term of SD and SLA :MN Service call Reply :User Service call :MB Reply Broker Service Execution Service call Reply Resource

9 Interactions of SRV Components  Automatic Service Deployment (ASD)  ASD monitors the states of the virtual resources and deployed services  ASD reports service availability and properties to its Broker  All Brokers report available service properties to the MB

Agreement Negotiation – Meta Negotiation  Meta-Negotiation documents includes:  The pre-requisites to be satisfied for a negotiation Example: authentication method, terms that participants want to negotiate on  The negotiation protocols and document languages for the specification of SLAs  Conditions for the establishment of an agreement Example: a required third-party arbitrator  Meta-Negotiation documents are published into a searchable registry through which participants can discover suitable partners for conducting negotiations 2015/12/4 10

Agreement Negotiation – Meta Negotiation  Meta-Negotiation Example 2015/12/4 11

2015/12/4 12 Meta-Negotiation Infrastructure Meta-Negotiation Middleware: 1.Facilitates the publishing of meta- negotiation document 2.Integrates with existing service infrastructure 3.Delivers information for negotiation

Service Brokering  Meta-Broker (MB) acts as a mediator between users or higher level tools and environment-specific resource managers (i.e., brokers)  To gather broker properties (availability, provided services, etc.)  To interact with MN to create agreements for service calls  To schedule service calls to lower level brokers  To forward service calls to the brokers 2015/12/4 13

14 Meta-Broker Architecture  Translator: responsible for translating the resource specification defined by the user to the language of the appropriate resource broker  Information Collector (IC): Stores the data of the reachable brokers and the historical data of the previous submissions  BPDL: Broker Property Description Language

15 Service Brokering Architecture  IS Agent: A component that regularly checks the load of underlying resources of each connected broker and the ASD (to estimate the service invocation time). The data would be stored into IC  MatchMaker (MM): Lists a group of brokers that can provide the service, and rank them based on IC’s data

Interactions of the Components of Meta-Broker during Utilization 2015/12/4 16 :MB_Core Service call :MN :MatchMaker :InfColl :Parser Parse doMatch :Invoker :Broker getInfo Service call Selected Broker

Service Deployment and Virtualization - ASD  Automatic Service Deployment (ASD):  A component that can install the required service on the selected resource on demand  Built on a repository where all master copies (virtual appliance, VA) of deployable services are stored  Allows broker to check if the service is deployed and available. If not, it checks whether any of the resource can deliver the service taking into account of the deployment cost  Monitors the states of the virtual resources and deployed services, and report to the brokers  Workspace Service (WS): to offer virtualization capabilities 2015/12/4 17

Service Deployment and Virtualization - ASD 2015/12/4 18

Case Study – Maxillo Facial Surgery Simulation (MFSS)  MFSS application facilitates the work of medical practitioners and provides the pre-operative virtual planning of maxilla-facial surgery  Steps of MFSS 1. Mesh generation: is used for generating meshes necessary for the finite element method simulation 2. Mesh manipulation: defines the initial and boundary conditions for the simulation 3. Finite element method (FEM): a fully parallel numeric technique application usually running on a remote HPC cluster 2015/12/4 19

Case Study – Maxillo Facial Surgery Simulation (MFSS) 1. Transform the meta-negotiation document into XML-based document 2. The document is passed to meta-broker 3. Meta-broker receives service description (SD) and SLA 1. Matchmaking to select the broker 2. Selected broker receives SD and calls the ASD to deploy the service, or chooses an already deployed, but idle computing service 4. The job is executed and the result are returned to the workflow enactor 5. ASD decommission the service 20

Related Work  SLA handling – negotiation, brokering and deployment – in web services and Grid services  Brokering that aims on supporting Grid applications with resources located in different domains  Service deployment solutions that focus on Grid applications 2015/12/4 21

Conclusions & Comments  Conclusion:  An architecture of SLA-based resource virtualization with on-demand service deployment is introduced Meta-negotiation for generic SLA management Meta-brokering for diverse broker management ASD for resource virtualization in the Cloud  Comments:  An architecture-wise paper that does not touch deeper issues, especially in service deployment section 2015/12/4 22