Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.

Slides:



Advertisements
Similar presentations
Pricing for Utility-driven Resource Management and Allocation in Clusters Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS)
Advertisements

Hadi Goudarzi and Massoud Pedram
SLA-Oriented Resource Provisioning for Cloud Computing
1 Advancing Supercomputer Performance Through Interconnection Topology Synthesis Yi Zhu, Michael Taylor, Scott B. Baden and Chung-Kuan Cheng Department.
Software Quality Ranking: Bringing Order to Software Modules in Testing Fei Xing Michael R. Lyu Ping Guo.
Efficient Autoscaling in the Cloud using Predictive Models for Workload Forecasting Roy, N., A. Dubey, and A. Gokhale 4th IEEE International Conference.
Adaptive Scheduling with QoS Satisfaction in Hybrid Cloud Environment 研究生:李羿慷 指導老師:張玉山 老師.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
A Grid Resource Broker Supporting Advance Reservations and Benchmark- Based Resource Selection Erik Elmroth and Johan Tordsson Reporter : S.Y.Chen.
Quality of Service in IN-home digital networks Alina Albu 23 October 2003.
On Fairness, Optimizing Replica Selection in Data Grids Husni Hamad E. AL-Mistarihi and Chan Huah Yong IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,
Measuring zSeries System Performance Dr. Chu J. Jong School of Information Technology Illinois State University 06/11/2012 Sponsored in part by Deer &
HeteroPar 2013 Optimization of a Cloud Resource Management Problem from a Consumer Perspective Rafaelli de C. Coutinho, Lucia M. A. Drummond and Yuri Frota.
Ekrem Kocaguneli 11/29/2010. Introduction CLISSPE and its background Application to be Modeled Steps of the Model Assessment of Performance Interpretation.
Self-Organizing Agents for Grid Load Balancing Junwei Cao Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04)
COGNITIVE RADIO FOR NEXT-GENERATION WIRELESS NETWORKS: AN APPROACH TO OPPORTUNISTIC CHANNEL SELECTION IN IEEE BASED WIRELESS MESH Dusit Niyato,
Operating systems CHAPTER 7.
COLLABORATIVE EXECUTION ENVIRONMENT FOR HETEROGENEOUS PARALLEL SYSTEMS Aleksandar Ili´c, Leonel Sousa 2010 IEEE International Symposium on Parallel & Distributed.
Bargaining Towards Maximized Resource Utilization in Video Streaming Datacenters Yuan Feng 1, Baochun Li 1, and Bo Li 2 1 Department of Electrical and.
Location-aware MapReduce in Virtual Cloud 2011 IEEE computer society International Conference on Parallel Processing Yifeng Geng1,2, Shimin Chen3, YongWei.
Network Aware Resource Allocation in Distributed Clouds.
CS 1308 Computer Literacy and the Internet. Introduction  Von Neumann computer  “Naked machine”  Hardware without any helpful user-oriented features.
November , 2009SERVICE COMPUTATION 2009 Analysis of Energy Efficiency in Clouds H. AbdelSalamK. Maly R. MukkamalaM. Zubair Department.
Cloud Computing Energy efficient cloud computing Keke Chen.
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
Software Pipelining for Stream Programs on Resource Constrained Multi-core Architectures IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEM 2012 Authors:
Frascati, October 9th, Accounting in DataGrid Initial Architecture Albert Werbrouck Frascati, October 9, 2001.
A performance evaluation approach openModeller: A Framework for species distribution Modelling.
Operating System Concepts Chapter One: Introduction What is an operating system? Simple Batch Systems Multiprogramming Systems Time-Sharing Systems Personal-Computer.
Invitation to Computer Science 5 th Edition Chapter 6 An Introduction to System Software and Virtual Machine s.
Scientific Workflow Scheduling in Computational Grids Report: Wei-Cheng Lee 8th Grid Computing Conference IEEE 2007 – Planning, Reservation,
INVITATION TO COMPUTER SCIENCE, JAVA VERSION, THIRD EDITION Chapter 6: An Introduction to System Software and Virtual Machines.
Dynamic Resource Monitoring and Allocation in a virtualized environment.
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
Dominant Resource Fairness: Fair Allocation of Multiple Resource Types Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, Ion.
Euro-Par, A Resource Allocation Approach for Supporting Time-Critical Applications in Grid Environments Qian Zhu and Gagan Agrawal Department of.
Swapping to Remote Memory over InfiniBand: An Approach using a High Performance Network Block Device Shuang LiangRanjit NoronhaDhabaleswar K. Panda IEEE.
The Owner Share scheduler for a distributed system 2009 International Conference on Parallel Processing Workshops Reporter: 李長霖.
BOF: Megajobs Gracie: Grid Resource Virtualization and Customization Infrastructure How to execute hundreds of thousands tasks concurrently on distributed.
Advanced Spectrum Management in Multicell OFDMA Networks enabling Cognitive Radio Usage F. Bernardo, J. Pérez-Romero, O. Sallent, R. Agustí Radio Communications.
Silberschatz and Galvin  Operating System Concepts Module 1: Introduction What is an operating system? Simple Batch Systems Multiprogramming.
Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication.
1 Iterative Integer Programming Formulation for Robust Resource Allocation in Dynamic Real-Time Systems Sethavidh Gertphol and Viktor K. Prasanna University.
Exploiting Group Recommendation Functions for Flexible Preferences.
CPSC 171 Introduction to Computer Science System Software and Virtual Machines.
June 30 - July 2, 2009AIMS 2009 Towards Energy Efficient Change Management in A Cloud Computing Environment: A Pro-Active Approach H. AbdelSalamK. Maly.
Modeling Virtualized Environments in Simalytic ® Models by Computing Missing Service Demand Parameters CMG2009 Paper 9103, December 11, 2009 Dr. Tim R.
AI & Machine Learning Libraries By Logan Kearsley.
Economic and On Demand Brain Activity Analysis on Global Grids A case study.
Efficient Load Balancing Algorithm for Cloud Computing Network Che-Lun Hung 1, Hsiao-hsi Wang 2 and Yu-Chen Hu 2 1 Dept. of Computer Science & Communication.
Efficient Resource Allocation for Wireless Multicast De-Nian Yang, Member, IEEE Ming-Syan Chen, Fellow, IEEE IEEE Transactions on Mobile Computing, April.
1.1 Sandeep TayalCSE Department MAIT 1: Introduction What is an operating system? Simple Batch Systems Multiprogramming Batched Systems Time-Sharing Systems.
1 Architecture and Behavioral Model for Future Cognitive Heterogeneous Networks Advisor: Wei-Yeh Chen Student: Long-Chong Hung G. Chen, Y. Zhang, M. Song,
A stochastic scheduling algorithm for precedence constrained tasks on Grid Future Generation Computer Systems (2011) Xiaoyong Tang, Kenli Li, Guiping Liao,
Euro-Par, HASTE: An Adaptive Middleware for Supporting Time-Critical Event Handling in Distributed Environments ICAC 2008 Conference June 2 nd,
A New Generation of Artificial Neural Networks.  Support Vector Machines (SVM) appeared in the early nineties in the COLT92 ACM Conference.  SVM have.
Embedded Real-Time Systems Processing interrupts Lecturer Department University.
1 Performance Impact of Resource Provisioning on Workflows Gurmeet Singh, Carl Kesselman and Ewa Deelman Information Science Institute University of Southern.
Spark on Entropy : A Reliable & Efficient Scheduler for Low-latency Parallel Jobs in Heterogeneous Cloud Huankai Chen PhD Student at University of Kent.
Talal H. Noor, Quan Z. Sheng, Lina Yao,
Authors: Jiang Xie, Ian F. Akyildiz
Edinburgh Napier University
The Improvement of PaaS Platform ZENG Shu-Qing, Xu Jie-Bin 2010 First International Conference on Networking and Distributed Computing SQUARE.
Smita Vijayakumar Qian Zhu Gagan Agrawal
An Improved Neural Network Algorithm for Classifying the Transmission Line Faults Slavko Vasilic Dr Mladen Kezunovic Texas A&M University.
Department of Electrical Engineering
Market-based Dynamic Task Allocation in Mobile Surveillance Systems
Resource and Service Management on the Grid
Presented By: Darlene Banta
Kostas Kolomvatsos, Christos Anagnostopoulos
Presentation transcript:

Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251 Shang-Chi Wu

Outline Introduction Berger model Job scheduling algorithm based on Berger model Experiment Conclusions and questions 2013/1/25 2

Cloud computing It is a new pattern User-oriented design which provides varied services to meet the needs of different users 2013/1/25 3

Cloud computing The basic mechanism of cloud computing is to dispatch the computing tasks to resource pooling A variety of applications gain computing power, storage and a variety of software services according to their needs 2013/1/25 4

Cloud computing 2013/1/25 5 Task

Cloud computing The commercialization and the virtualization technology adopted by cloud computing has poured into new features for cloud architecture. Cloud computing needs pay more attention to the fairness of resources allocation 2013/1/25 6

Relation The relations between resource supply and demand are similarities with commodity economy model The resources provider->commodity supplier The resources users ->commodity buyers 2013/1/25 7

Relation The resources allocation in cloud computing has a very good fit with the distribution theory of social wealth 2013/1/25 8

Berger model The Berger model of distributive justice is based on expectation states Expectation states –Actor how to generate expectations of itself and other individuals –Expectations how to affect the behavior of actor 2013/1/25 9

Berger model Characteristic C is any aspect of a person A goal-object, GO, is any object that an actor might want, namely expectation 2013/1/25 10

Berger model Definition of distributive justice evaluation function in Berger model AR (Actual Reward) –actor obtains actually JR (Just Reward) –actor comparison of the justice distribution of other ordinary person 2013/1/25 11

Job scheduling algorithm based on Berger model Map the theory of distributive justice in Berger model to resource allocation model in cloud computing 2013/1/25 12

Task classification based on QoS In cloud computing, QoS is a metrics of user satisfaction with cloud services –Completion time: For real-time demand higher users –Bandwidth: User requests need higher communication bandwidth 2013/1/25 13

Fairness constraint C x user tasks E x expectation resources go x actual allocation resources C x is the QoS characteristics GO X is the general expectation 2013/1/25 14

Justice Task Justice –The justice evaluation function of task System Justice –Task set:T={T 1,T 2,…, T n } –Justice function set:J={J 1,J 2,…,J n } 2013/1/25 15

Description of tasks and resources Resource characteristics set of the virtual machine VM i C i = { C i1, C i2, C ir }, r = 1, 2, 3 The performance vector of Vm i VM i = [ EC i1, EC i2, EC i3 ] 2013/1/25 16 CPU memory bandwidth

The general expectations function The general expectations vector of the type e i = [ e i1, e i2, e i3 ] When the task has multiple expectations preference –mathematical expectation 2013/1/25 17 weight for CPU weight for memory weight for bandwidth

Completion time For Task T i Total number of virtual machine VM = { VM 1, …, VM m } Produce a candidate collection VM i = { VM 1, …, VM t }, t<m Select a virtual machine from Vm i according to the general expectation 2013/1/25 18

Completion time general expectations 2013/1/25 19

The normalized value 2013/1/25 20

Euclidean distance The minimum distance means the similarity of the two is best Vector X = [X 1, …, X n ] Vector Y = [Y 1, …, Y n ] 2013/1/25 21

Pseduo code 2013/1/25 22

the general expectations function 2013/1/25 23 Justice evaluation function When |J i | > 1, the system automatically adjusts the vector of general expectations

Bandwidth For Task T i Total number of virtual machine VM = { VM 1, …, VM m } Produce a candidate collection VM i = { VM 1, …, VM t }, t<m Select a virtual machine from Vm i according to the general expectation 2013/1/25 24

When |J i | > 1, the system automatically adjusts the vector of general expectations Justice evaluation function 2013/1/25 25 Justice evaluation function

Algorithm description 2013/1/25 26

The first type: e 1 = [0.7, 0.1, 0.2] The second type: e 2 = [0.3, 0.2, 0.5] Algorithm 1: job scheduling algorithm based on Berger model Algorithm 2: job scheduling algorithm based on the optimal completion time Experiment 2013/1/25 27

Experimental data 2013/1/25 28

Execution efficiency of algorithm 1’s slightly worse than algorithm 2’s Algorithm 1’s completion time is better than algorithm 2’s in task 0-3 Analysis of experimental results 2013/1/25 29

Algorithm 1 is able to better meet user expectations Analysis of experimental results 2013/1/25 30

Algorithm 1 enables task 0–3 to obtain good computing power with better fairness Analysis of experimental results 2013/1/25 31

Algorithm 1 can better meet the task preferences with better fairness Analysis of experimental results 2013/1/25 32

Conclusions and questions 2013/1/25 33 Berger model theory on distributive justice in the field of social distribution was first introduced into the job scheduling The proposed algorithm in this paper is effective implementation of user tasks, and with better fairness

Conclusions and questions 2013/1/25 34 The initial value of general expectation vector is empirical value Build a fuzzy neural network