A Maiden Analysis of Longest Wait First Jeff Edmonds York University Kirk Pruhs University of Pittsburgh.

Slides:



Advertisements
Similar presentations
Class-constrained Packing Problems with Application to Storage Management in Multimedia Systems Tami Tamir Department of Computer Science The Technion.
Advertisements

Scheduling Criteria CPU utilization – keep the CPU as busy as possible (from 0% to 100%) Throughput – # of processes that complete their execution per.
An Optimal Lower Bound for Buffer Management in Multi-Queue Switches Marcin Bieńkowski.
1 Better Scalable Algorithms for Broadcast Scheduling Ravishankar Krishnaswamy Carnegie Mellon University Joint work with Nikhil Bansal and Viswanath Nagarajan.
Maryam Elahi Fairness in Speed Scaling Design Joint work with: Carey Williamson and Philipp Woelfel.
Dynamic Internet Congestion with Bursts Stefan Schmid Roger Wattenhofer Distributed Computing Group, ETH Zurich 13th International Conference On High Performance.
Chapter 8 – Processor Scheduling Outline 8.1 Introduction 8.2Scheduling Levels 8.3Preemptive vs. Nonpreemptive Scheduling 8.4Priorities 8.5Scheduling Objectives.
Data Broadcast in Asymmetric Wireless Environments Nitin H. Vaidya Sohail Hameed.
Institute of Computer Science University of Wroclaw Page Migration in Dynamic Networks Marcin Bieńkowski Joint work with: Jarek Byrka (Centrum voor Wiskunde.
Tians Scheduling: Using Partial Processing in Best-Effort Applications Yuxiong He *, Sameh Elnikety *, Hongyang Sun + * Microsoft Research + Nanyang Technological.
Mixed Criteria Packet Scheduling Chad R. Meiners Eric Torng.
Energy-Efficient Rate Scheduling in Wireless Links A Geometric Approach Yashar Ganjali High Performance Networking Group Stanford University
CS 268: Lecture 8 (Router Support for Congestion Control) Ion Stoica February 19, 2002.
CS 584 Lecture 11 l Assignment? l Paper Schedule –10 Students –5 Days –Look at the schedule and me your preference. Quickly.
CSE 421 Algorithms Richard Anderson Lecture 6 Greedy Algorithms.
1 Scheduling on Heterogeneous Machines: Minimize Total Energy + Flowtime Ravishankar Krishnaswamy Carnegie Mellon University Joint work with Anupam Gupta.
CS 104 Introduction to Computer Science and Graphics Problems Operating Systems (2) Process Management 10/03/2008 Yang Song (Prepared by Yang Song and.
1 Scheduling Jobs with Varying Parallelizability Ravishankar Krishnaswamy Carnegie Mellon University.
Recap Priorities task-level static job-level static dynamic Migration task-level fixed job-level fixed migratory Baker/ Oh (RTS98) Pfair scheduling This.
Lecture 5: Congestion Control l Challenge: how do we efficiently share network resources among billions of hosts? n Last time: TCP n This time: Alternative.
Scheduling On-demand Broadcasts: New Metrics and Algorithms Swarup Acharya Information Sciences Research Center Bell Laboratories, Lucent Technologies.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 34 – Media Server (Part 3) Klara Nahrstedt Spring 2012.
Minimizing Flow Time on Multiple Machines Nikhil Bansal IBM Research, T.J. Watson.
Online Function Tracking with Generalized Penalties Marcin Bieńkowski Institute of Computer Science, University of Wrocław, Poland Stefan Schmid Deutsche.
Paging for Multi-Core Shared Caches Alejandro López-Ortiz, Alejandro Salinger ITCS, January 8 th, 2012.
Energy, Energy, Energy  Worldwide efforts to reduce energy consumption  People can conserve. Large percentage savings possible, but each individual has.
Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.
Efficient Scheduling of Heterogeneous Continuous Queries Mohamed A. Sharaf Panos K. Chrysanthis Alexandros Labrinidis Kirk Pruhs Advanced Data Management.
Speed Scaling To Manage Temperature Nikhil Bansal IBM T.J. Watson Kirk Pruhs University of Pittsburgh.
CPU Scheduling Chapter 6 Chapter 6.
OPERATING SYSTEMS CPU SCHEDULING.  Introduction to CPU scheduling Introduction to CPU scheduling  Dispatcher Dispatcher  Terms used in CPU scheduling.
Bold Stroke January 13, 2003 Advanced Algorithms CS 539/441 OR In Search Of Efficient General Solutions Joe Hoffert
Speed Scaling to Manage Energy and Temperature Nikhil Bansal (IBM Research) Tracy Kimbrel (IBM) and Kirk Pruhs (Univ. of Pittsburgh)
Parallel Access For Mirror Sites in the Internet Yu Cai.
An Efficient Approach for Content Delivery in Overlay Networks Mohammad Malli Chadi Barakat, Walid Dabbous Planete Project To appear in proceedings of.
1 Pruhs, Woeginger, Uthaisombut 2004  Qos Objective: Minimize total flow time  Flow time f i of a job i is completion time C i – r i  Power Objective:
Quantifying the Sub-optimality of Non-preemptive Real-time Scheduling Abhilash Thekkilakattil, Radu Dobrin and Sasikumar Punnekkat.
1 Server Scheduling in the L p norm Nikhil Bansal (CMU) Kirk Pruhs (Univ. of Pittsburgh)
Department of Computer Science Stanley P. Y. Fung Online Preemptive Scheduling with Immediate Decision or Notification and Penalties.
Minimizing Cache Usage in Paging Alejandro López-Ortiz, Alejandro Salinger University of Waterloo.
Static Process Scheduling Section 5.2 CSc 8320 Alex De Ruiter
Rassul Ayani 1 Performance of parallel and distributed systems  What is the purpose of measurement?  To evaluate a system (or an architecture)  To compare.
Operational Research & ManagementOperations Scheduling Economic Lot Scheduling 1.Summary Machine Scheduling 2.ELSP (one item, multiple items) 3.Arbitrary.
Frequency Capping in Online Advertising Moran Feldman Technion Joint work with: Niv Buchbinder,The Open University of Israel Arpita Ghosh,Yahoo! Research.
Data Scheduling for Multi-item and transactional Requests in On-demand Broadcast Nitin Pabhu Vijay Kumar MDM 2005.
Minimizing Response time in Broadcast Scheduling Nikhil Bansal Don Coppersmith and Maxim Sviridenko.
Non-Preemptive Buffer Management for Latency Sensitive Packets Moran Feldman Technion Seffi Naor Technion.
Multicast Pull Scheduling Kirk Pruhs. The Big Problem Movie Distribution Database Replication via Internet Harry Potter Book Download Software Download.
Ben Moseley Sungjin Im Goals of Talk  Make you aware of/interested in broadcast sched  Highlight known results, key open questions, some recent results.
Determining Optimal Processor Speeds for Periodic Real-Time Tasks with Different Power Characteristics H. Aydın, R. Melhem, D. Mossé, P.M. Alvarez University.
Univ. of TehranIntroduction to Computer Network1 An Introduction Computer Networks An Introduction to Computer Networks University of Tehran Dept. of EE.
Scheduling Parallel DAG Jobs to Minimize the Average Flow Time K. Agrawal, J. Li, K. Lu, B. Moseley.
Lecture 12 Scheduling Models for Computer Networks Dr. Adil Yousif.
Lecture 5 Scheduling. Today CPSC Tyson Kendon Updates Assignment 1 Assignment 2 Concept Review Scheduling Processes Concepts Algorithms.
Scheduling.
1 Design and Implementation of a High-Performance Distributed Web Crawler Polytechnic University Vladislav Shkapenyuk, Torsten Suel 06/13/2006 석사 2 학기.
Networks and Operating Systems: Exercise Session 2
Deadline Scheduling and Heavy tail distributionS
Chapter 8 – Processor Scheduling
On Scheduling in Map-Reduce and Flow-Shops
Chapter 6: CPU Scheduling
EE 122: Router Support for Congestion Control: RED and Fair Queueing
Quality of Service For Traffic Aggregates
Process Scheduling B.Ramamurthy 11/18/2018.
New Scheduling Algorithms: Improving Fairness and Quality of Service
University of Pittsburgh
University of Pittsburgh
Parallel Speedup.
Non-clairvoyant Precedence Constrained Scheduling
An Optimal Lower Bound for Buffer Management in Multi-Queue Switches
Presentation transcript:

A Maiden Analysis of Longest Wait First Jeff Edmonds York University Kirk Pruhs University of Pittsburgh

Client-Server System Clients Server Requests for page transmission “pull”

Client-Server System Clients Server Transmit page Server scheduling problem: How does the server decide which requests to respond to first?

The Big Problem Movie Distribution Database Replication via Internet Harry Potter Book Download Software Download Olympics Pay-Per-View Movies Today’s Internet Audience Size Content Richness

The 1-1 communication is not scalable

Broadcast Common Pages From Newsweek magazine From

Time Requests Pages:

Time to minimize total “wait” (flow) time Scheduling Problem: NP-complete [EH, 2002] Given requests deciding when to broadcast

O(1)-Approximate Algorithms Online: ? Future Optimal: All Knowing All Powerful Time Requests Online Time Requests Optimal

O(1)-Approximate Algorithms Online: ? Future Optimal: All Knowing All Powerful no online O(1)-comp. Alg. [KPV ‘00, EP ‘02]

O(1)-Approximate Algorithms Online: ? Future Optimal: All Knowing All Powerful Time Requests Online Time Requests Optimal

Resource Augmentation Analysis Algorithm is s-speed c-competitive if max I Online s (I)/Opt 1 (I) < c Time Requests Time Requests Online Optimal

Classic Server QoS Curves Average response time Low load High load Fast processor Slow Processor Online Optimal Not O(1)-competitive O(1)-speed O(1)-competitive

Scheduling Algorithms 2-speed 2-competitive [KPV ‘01, EH ‘02, GKKW ‘02, GKPS ‘02] Difficult Off-line Linear Programming Algorithms

Time Requests Scheduling Algorithms First In First Out (FIFO) 2-competitive for Max-Wait but bad for Total-Wait.

Time Requests Most Requests First (MRF) Scheduling Algorithms not O(1)-speed O(1)-competitive. [KPV ‘00]

Time Requests Scheduling Algorithms Not 2-speed O(1)-competitive. (4+e)-speed O(1)-competitive for any page lengths [EP 2002] B-Equipoise Proportional to number of requests

Time Requests Scheduling Algorithms (8+e)-speed O(1)-competitive for unit sized files [EP 2002] B-Equipoise-EDF Non-preemptive ~ number of requests

Time Requests Longest Wait First(LWF) Scheduling Algorithms Best Experimentally [AM] Not 1.6-speed O(1)-competitive. New 6-speed O(1)-competitive. New Was hoped to be (1+  )-speed O(1)-competitive. Efficient implementation, [KTT ‘01]

LWF is not 1.6-speed O(1)-competitive.

With s=1.6 LWF catches up. LWF is competitive.

LWF is not 1.6-speed O(1)-competitive. 



LWF 6 (I) < Opt 1 (I) x c Time Requests Time Requests LWF Optimal xc LWF is 6-speed O(1)-competitive.

Time Requests Time Requests LWF Optimal LWF is 6-speed O(1)-competitive. xc LWF 6 (I) < Opt 1 (I) x c

LWF Optimal LWF is 6-speed O(1)-competitive.

LWF Optimal LWF is 6-speed O(1)-competitive. =

LWF Optimal LWF is 6-speed O(1)-competitive. xc

LWF is 6-speed O(1)-competitive. LWF Optimal

LWF is 6-speed O(1)-competitive. LWF

 LWF is 6-speed O(1)-competitive. LWF ?

LWF is 6-speed O(1)-competitive. LWF

LWF is 6-speed O(1)-competitive. Hall’s Theorem Needs to be paid Able to pay

LWF is 6-speed O(1)-competitive. LWF Optimal One of s.

LWF is 6-speed O(1)-competitive. LWF

LWF is 6-speed O(1)-competitive. LWF 

LWF is 6-speed O(1)-competitive. LWF 

LWF is 6-speed O(1)-competitive. LWF + 

Time Requests Time Requests LWF Optimal LWF is 6-speed O(1)-competitive. xc Everyone paid enough. No one pays to much. LWF 6 (I) < Opt 1 (I) x c

LWF is best experimentally [AM] LWF is not 1.6-speed O(1)-competitive. New LWF is 6-speed O(1)-competitive. New Was hoped to be (1+  )-speed O(1)-competitive. A Maiden Analysis of Longest Wait First Conclusion Efficient implementation, [KTT ‘01]

LWF is best experimentally [AM] LWF is not 1.6-speed O(1)-competitive. LWF is 6-speed O(1)-competitive. Was hoped to be (1+  )-speed O(1)-competitive. A Maiden Analysis of Longest Wait First Future (2+  ) for any file lengths Conclusion The End Efficient implementation, [KTT ‘01] No Online is ?

Multicast Pull Scheduling: When Fairness is Fine Jeff Edmonds York University Kirk Pruhs University of Pittsburgh

Time Requests Scheduling Algorithms Not 2-speed O(1)-competitive. (4+e)-speed O(1)-competitive for any page lengths [EP 2002] B-Equipoise Proportional to number of requests

The Power of the Adversary in Multicast Pull Basic idea of the proof that there is no O(1)-competitive online algorithm Immediately after the online algorithm broadcasts a document, the adversary requests that document  The adversary broadcasts the document after the second request to the document utilizing the power of broadcast After a while the online algorithm still has a lot of work left while the adversary has little work left Then a high load stream of work that requires the full processing power of the server arrives

More on the Power of the Adversary in Multicast Pull Hence, the adversary forces the online algorithm to labor on sequential work  Sequential work = increasing the processing power devoted to the work does not change the rate at which the remaining work decreases Parallel work = doubling the processing power devoted to work doubles that rate at which that work is completed IMHO, the main contribution of this paper is the insight that Multicast pull scheduling = scheduling of jobs with arbitrary speed-ups

Scheduling Jobs with Variable Speed-up Curves In the Context of Parallel Processing Equipoise (Round Robin) = Give each job equal processing time Equipoise is a 3-speed 6-competitive algorithm for jobs with arbitrary speed-up curves [E, 1999] Formally means that Equipose with a speed 3 processor has average flow time at most 6 times the optimal average flow time for a speed 1 processor Intuitively means that Equipoise will perform reasonably well at low loads

Proof by picture that Bequi is O(1)-speed O(1)- approximation algorithm

More proof by picture

Replace jobs by sequential and parallel work in such a way that Broadcast-Equipoise is unaffected, and optimal is not hurt. Then apply Equipoise analysis.

Why transformation doesn’t hurt optimal Each reverse L shaped region, which contains the parallel work that optimal must finish, is contained within two consecutive BEqui broadcasts

Time Requests Scheduling Algorithms (8+e)-speed O(1)-competitive for unit sized files [EP 2002] B-Equipoise-EDF Non-preemptive ~ number of requests

BEQUI-EDF Algorithm for Unit Sized Documents (no preemption) B-EQUI-EDF Algorithm: Simulate BEQUI to get deadlines for jobs Run EDF on the jobs using these deadlines B-EQUI-EDF is an O(1)-speed O(1)- competitive algorithm