Presentation on theme: "FACULTY OF ENGINEERING & INFORMATION TECHNOLOGIES A Pareto Frontier for Optimizing Data Transfer vs. Job Execution in Grids Albert Y. Zomaya | Professor."— Presentation transcript:
FACULTY OF ENGINEERING & INFORMATION TECHNOLOGIES A Pareto Frontier for Optimizing Data Transfer vs. Job Execution in Grids Albert Y. Zomaya | Professor and Director Centre for Distributed and High Performance Computing School of Information Technologies The University of Sydney, Sydney, Australia Javid Taheri | Postdoctoral Research Fellow
›Introduction to Grid Computing ›Problem Statement: Data-Aware Job Scheduling ›GA-ParFnt -Pareto Frontier -Genetic Algorithm (GA) ›Simulation and Analysis of Results ›Conclusion 2
Problem Statement ›Data Aware Job Scheduling (DAJS) -(1) the overall execution time of a batch of jobs (NP-Complete) -(2) transfer time of all datafiles to their dependent jobs (NP-Complete) 4 Storage Nodes Storage Nodes Computation Nodes Computation Nodes Job 1 Job 2 Job 3 Job N... File 1 File 2 File 3... File M
Discussion and Analysis ›The shape of Pareto Front 9 Test-Grid-8-4
Discussion and Analysis ›Scheduling Algorithms 10
Conclusion ›GA-ParFnt was effective in finding the Pareto Front of executing jobs vs Transfer time of Datafiles in Grids ›Such Pareto Front could be estimated by exponential funcitons ›Many scheduling algorithms are not optimal, despite their claim. 11
Your consent to our cookies if you continue to use this website.