Measurement-based Admission Control CS 8803NTM Network Measurements Parag Shah.

Slides:



Advertisements
Similar presentations
DISTRIBUTED MULTIMEDIA SYSTEMS
Advertisements

Quality of Service CS 457 Presentation Xue Gu Nov 15, 2001.
William Stallings Data and Computer Communications 7 th Edition Chapter 13 Congestion in Data Networks.
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
Channel Allocation Protocols. Dynamic Channel Allocation Parameters Station Model. –N independent stations, each acting as a Poisson Process for the purpose.
Abhay.K.Parekh and Robert G.Gallager Laboratory for Information and Decision Systems Massachusetts Institute of Technology IEEE INFOCOM 1992.
Integrated Services High-speed networks have enabled new applications - they also need “deliver on time” assurances from network Applications that are.
Statistics review of basic probability and statistics.
Recent Progress on a Statistical Network Calculus Jorg Liebeherr Department of Computer Science University of Virginia.
Comments on the Performance of Measurement Based Admission Control Algorithms Lee Breslau, S. Jamin, S. Shenker Infocom 2000.
Lecture 13 – Continuous-Time Markov Chains
IP traffic and QoS control : the need for flow aware networking Jim Roberts France Telecom R&D NSF-COST Workshop.
Supporting Real-time Applications in An Integrated Service Packet Network CSZ Sigcomm 92.
A Case for Relative Differentiated Services and the Proportional Differentiation Model Constantinos Dovrolis Parameswaran Ramanathan University of Wisconsin-Madison.
Worst-case Fair Weighted Fair Queueing (WF²Q) by Jon C.R. Bennett & Hui Zhang Presented by Vitali Greenberg.
Multiple constraints QoS Routing Given: - a (real time) connection request with specified QoS requirements (e.g., Bdw, Delay, Jitter, packet loss, path.
*Sponsored in part by the DARPA IT-MANET Program, NSF OCE Opportunistic Scheduling with Reliability Guarantees in Cognitive Radio Networks Rahul.
On the Constancy of Internet Path Properties Yin Zhang, Nick Duffield AT&T Labs Vern Paxson, Scott Shenker ACIRI Internet Measurement Workshop 2001 Presented.
1 Token Bucket Based CAC and Packet Scheduling for IEEE Broadband Wireless Access Networks Chi-Hung Chiang
1 Performance Evaluation of Computer Networks Objectives  Introduction to Queuing Theory  Little’s Theorem  Standard Notation of Queuing Systems  Poisson.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
1 TCOM 501: Networking Theory & Fundamentals Lecture 7 February 25, 2003 Prof. Yannis A. Korilis.
EE 685 presentation Optimization Flow Control, I: Basic Algorithm and Convergence By Steven Low and David Lapsley Asynchronous Distributed Algorithm Proof.
Experimental Evaluation
7/3/2015© 2007 Raymond P. Jefferis III1 Queuing Systems.
Queuing Networks: Burke’s Theorem, Kleinrock’s Approximation, and Jackson’s Theorem Wade Trappe.
1 A State Feedback Control Approach to Stabilizing Queues for ECN- Enabled TCP Connections Yuan Gao and Jennifer Hou IEEE INFOCOM 2003, San Francisco,
Modeling Quality-Quantity based Communication Orr Srour under the supervision of Ishai Menache.
Review of Probability.
1 Chapters 9 Self-SimilarTraffic. Chapter 9 – Self-Similar Traffic 2 Introduction- Motivation Validity of the queuing models we have studied depends on.
A Generalized Processor Sharing Approach to Flow Control in Integrated Services Networks: The Single-Node Case Abhay K. Parekh, Member, IEEE, and Robert.
Asaf Cohen (joint work with Rami Atar) Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan March 11,
Simulation Output Analysis
Copyright warning. COMP5348 Lecture 6: Predicting Performance Adapted with permission from presentations by Alan Fekete.
Particle Filtering in Network Tomography
The paired sample experiment The paired t test. Frequently one is interested in comparing the effects of two treatments (drugs, etc…) on a response variable.
Network Analysis A brief introduction on queues, delays, and tokens Lin Gu, Computer Networking: A Top Down Approach 6 th edition. Jim Kurose.
Probability Review Thinh Nguyen. Probability Theory Review Sample space Bayes’ Rule Independence Expectation Distributions.
1 Chapter 5 Flow Lines Types Issues in Design and Operation Models of Asynchronous Lines –Infinite or Finite Buffers Models of Synchronous (Indexing) Lines.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
Bandwidth Estimation TexPoint fonts used in EMF.
MIT Fun queues for MIT The importance of queues When do queues appear? –Systems in which some serving entities provide some service in a shared.
1 Statistical Distribution Fitting Dr. Jason Merrick.
Queuing Theory Basic properties, Markovian models, Networks of queues, General service time distributions, Finite source models, Multiserver queues Chapter.
Huirong Fu and Edward W. Knightly Rice Networks Group Aggregation and Scalable QoS: A Performance Study.
1 Chapters 8 Overview of Queuing Analysis. Chapter 8 Overview of Queuing Analysis 2 Projected vs. Actual Response Time.
Competitive Queue Policies for Differentiated Services Seminar in Packet Networks1 Competitive Queue Policies for Differentiated Services William.
Florida State UniversityZhenhai Duan1 BCSQ: Bin-based Core Stateless Queueing for Scalable Support of Guaranteed Services Zhenhai Duan Karthik Parsha Department.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
EE 685 presentation Optimization Flow Control, I: Basic Algorithm and Convergence By Steven Low and David Lapsley.
1 OUTPUT ANALYSIS FOR SIMULATIONS. 2 Introduction Analysis of One System Terminating vs. Steady-State Simulations Analysis of Terminating Simulations.
Approximating the Performance of Call Centers with Queues using Loss Models Ph. Chevalier, J-Chr. Van den Schrieck Université catholique de Louvain.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
ECE-7000: Nonlinear Dynamical Systems Overfitting and model costs Overfitting  The more free parameters a model has, the better it can be adapted.
Random Early Detection (RED) Router notifies source before congestion happens - just drop the packet (TCP will timeout and adjust its window) - could make.
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
© 2015 McGraw-Hill Education. All rights reserved. Chapter 17 Queueing Theory.
Queueing Fundamentals for Network Design Application ECE/CSC 777: Telecommunications Network Design Fall, 2013, Rudra Dutta.
Providing QoS in IP Networks
Scheduling for QoS Management. Engineering Internet QoS2 Outline  What is Queue Management and Scheduling?  Goals of scheduling  Fairness (Conservation.
Integrated Services & RSVP Types of pplications Basic approach in IntServ Key components Service models.
Optimization-based Cross-Layer Design in Networked Control Systems Jia Bai, Emeka P. Eyisi Yuan Xue and Xenofon D. Koutsoukos.
7th Int'l Workshop on Rare Event Simulation, Sept , Rennes, France Ant Colony Optimized Importance Sampling: Principles, Applications and Challenges.
Lecture on Markov Chain
Dusit Niyato, Student Member, IEEE Ekram Hossain, Senior Member, IEEE
Provision of Multimedia Services in based Networks
Schedulability Conditions for Scheduling Algorithms
Prestented by Zhi-Sheng, Lin
Presentation transcript:

Measurement-based Admission Control CS 8803NTM Network Measurements Parag Shah

What, Why, How? Admission control based on measurements rather than source modeling Why MBAC? Source modeling is difficult (peak rate, average rate) Network utilization is low with descriptors like peak rate and average rate. High utilization can be achieved if we can weaken the reliability of the delay bound Applications like vat, vic and nv are tolerant How? Initial crude source characterizations (peak rates) Analytical modeling of memoryless and memory-based models Timescale-based analysis and simulation

Papers covered Sugih Jamin, Peter B. Danzig, Scott Shenker, Lixia Zhang, "A Measurement-based Connection Admission Control Algorithm for Integrated Services Networks", IEEE/ACM Transactions on Networking, 5(1): February R.J. Gibbens and F.P.Kelly, "Measurement-based connection admission control". In International Teletraffic Congress Proceedings, June Matthias Grossglauser, David N. C. Tse, "A Framework for Robust Measurement-based Admission Control", IEEE/ACM Transactions on Networking, 7(3): , June 1999.

Service Categories Gauranteed Service Gaurantees a worst-case delay bound for a flow by reserving bandwidth at the network elements along the path Lower network Utilization(acceptable only for smooth flows, not burst flows) Predictive Service Takes initial traffic descriptor, but then adapts according to effective bandwidth, allowing occasional delay violations Improves Network utilization

MBAC in Integrated Services Packet Networks (Jamin et. Al) a priori source characterizations only for incoming flows (token bucket filters) Measurements to characterize flows that are currently in place Utilization does not suffer significantly if the source descriptors are not tight (y?) Ability to occasionally incur delay violations Used only with predictive service and other more relaxed service commitments (y?) Useful only when there is a high-degree of statistical multiplexing (y?)

MBAC in Integrated Services Packet Networks (Jamin et. Al) Admission control algorithm done under CSZ scheduling algorithm Multiple levels of predictive service with per-delay bounds that are order of magnitude different from each other Approximate worst-case parameters with measured quantities (Equivalent Token Bucket Filter) Gauranteed services use WFQ and Predictive services use Priority queueing

Worst Case Delay: Predictive Service : Worst-case delay of priority queue level The worst-case class j delay, with FIFO discipline within the class and assuming infinite peak rates for the sources, is the following for each class j b: bucket depth of a flow r: token generation rate µ: link capacity : token bucket parameters for all flows of class j

Effect of a new predictive flow on traffic When a new flow α is added at the same priority level: When a new flow α is added at a lower priority level:

Effect of a new gauranteed flow on predictive traffic Effect of new gauranteed flow on predictive traffic:

Equivalent Token Bucket Filter : aggregate bandwidth utilization for flows of class j : experienced packet queueing delay for class j Describe existing aggregate traffic of each predictive class with an equivalent token bucket filter with parameters determined from traffic measurement.

The admission control algorithm For a new predictive flow α: 1. Deny if sum of current and requested rates exceeds targeted link utilization levels 2. Deny of new flow violates delay bounds at same or lower priority levels:

The admission control algorithm (ctd…) For a new guaranteed service flow: 1. Deny of bandwidth check fails 2. Deny when delay bounds are violated

Measurement mechanism To measure: Experienced delay & Utilization Queueing delay for each packet Usage rate for guaranteed service Usage rate for each predictive class j Measurement window Updating delay: Updating bandwidth:

Performance Tuning Knobs Utilization target, to keep utilization below certain levels Delay backoff estimate, (2) Averaging period (atleast 100 packet transmission times) Measurement window

Measurement-based connection admission control (Gibbens et.al) Performance of MBAC depends upon statistical interactions between several timescales (packet, burst, connection admission, connection holding time) Buffer overflow happens when: Extreme measurement errors allow too many sources Extreme behaviour by admitted sources They are analyzed at the following timescales: Admission decision and holding times Timescales comparable to busy period before overflow

The Basic Model as the load produced by a connection of class j at time t. No. of connections at class j Peak rate of class j Mean rate of class j Resource capacity rate of load lost at a resource of capacity C

The Basic Model (ctd…) Let connections of class j arrive in a Poisson stream of rate Let holding times of accepted connections be independent and exponentially distributed with parameter Let and letbe a subset of Suppose a connection arriving at time t is accepted if and is rejected otherwise. Back-off period: Period between the rejection of a connection and the time when the first connection then in progress ends Letaccording as at time t the system is in a backoff or not is then a Markov Chain with off-diagonal transition rates:

The basic model (ctd…) is a vector with a 1 in the jth component zeros otherwise acceptance probability The proportion of load lost is where the expectation is taken over the state n of the Markov chain. t : timescale associated with admission decisions and holding times τ : shorter time period, typically time before a packet buffer overflow

a model of two traffic classes with time-varying offered loads. Explicit priorities are assigned to connections by extending the state space to 0, 1 and 2.The precise description of the off-diagonal transition rates for the Markov chain are as follows

A Framework for Robust Measurement- Based Admission Control Assuming that the measured parameters are the real ones, can grossly compromise the target performance of the system. There exists a critical timescale over which the impact of admission decision persists.

MBAC Issues Estimation Error Certainty Equivalence Dynamics and Separation of time scale Flow arrival and departure dynamics Flow and Burst timescale dynamics Memory Can improve quality of estimators Large memory window can reduce adaptability to non-stationarities in the statistics

Unified Model Goal: make QoS guarantees in the presence of measurement uncertainty, without requiring the tuning of system parameters Heavy Traffic regime System size is large Can use statistical regularity by increasing utilization, but keeping QoS constant Allows Gaussian approximations and use of first and second order statistics of the traffic processes

Impulsive load model Bufferless single link with capacity c Bandwidth fluctuations are identical stationary and independent of each other (mean = µ, variance = σ) Normalized capacity n – (c/µ) : Steady-state overflow probability Infinite burst of flows arrive at time 0 After time 0, no more flows are accepted and the flows stay forever in the system Permits study of impact of performance errors on on the number of flows and on overflow probability

Impulsive Load Model (ctd…) The number of admissible flows in the system is the largest integer m such that : bandwidth of the ith flow at time t For large n, If mean and variance are known a priori, then the no. of flows m* to accept should satisfy Where Q(.) is the ccdf of a N(0,1) Gaussian RV

Impulsive Load Model (ctd…) Actual Steady-state Overflow probability: For reasonably large c If mean and variance are not known a priori, and if it uses Estimation from initial bandwidth of flows in certainty Equivalence, by Central Limit Theorem,

Impulsive Load Model (ctd…) We want an approximation of average overflow probability In steady state and for large t and compare it to the target To find an approximation of the distribution for Mo: We compare the estimated and actual means:

Can be interpreted as the scaled aggregate Bandwidth fluctuation at time 0 around the mean The estimated standard deviation: is Gaussian Deviation is of the order of Distribution of Mo can be approximated by a linearization of The relationship around a nominal operating point, which is the operating point under perfect knowledge

Further, is the order of the estimation error around m* (perfect knowledge) Further,

Let be the random number of flows admitted under MBAC where capacity is nµ.. Then the sequence of random variables converges to a distribution to a random variable Randomness is due to both randomness in the number of flows Admitted, as well as randomness in the bandwidth demands of those flows.

The aggregate load at time t can be approximated by Is the approximation for the scaled aggregate Bandwidth fluctuation at time t Further, For large n, the overflow probability at time t

To get overflow probability in steady state, set Is independent of The difference is a Gaussian RV with mean 0 and variance Thus, In the exact case, the bw fluctuation comes from fluctuations in individual flows, but in the estimated bw case, the fluctuations come from both the number of flows and the measurement of each flow.

Therefore, we adjust, Using the approximation, Q(x) ~ Φ(x)/x for small Q(x), where Φ(x) Is the pdf of N(0,1). = ifThe loss of utilization: Universal result, since performance in the certainty equivalence scheme is independent of the stationary distribution of the flow and its mean and variance. Difference between actual and measured value of µ,

Exponentially distributed holding time for which a flow Stays in the system Assumption: [Worst Case] There are always flows waiting to enter the system(admitted) The auto-correlation function of the flow: The Continuous Load Model

Memoryless MBAC - Estimates based only on the means and variances of the current bandwidths and flows - At any time t, MBAC estimates the admissible number of flows Mt:

is random and depends only on the current bandwidths of the flows. It can be approximated as: A stationary zero-mean Gaussian process with unit variance and autocorrelation functionand can be interpreted as the scaled aggregate bandwidth fluctuation around The mean Flow departure rate is of the order Repair Time is of the order Critical Time scale over which admission errors are repaired

For any s ≤ t, where A[s,t] is the number of flows admitted during [s,t]. Flow departures have a repair effect on past mistakes. Fluctuations around perfect knowledge of no. of flows is around √n. It takes √n flows to depart to rectify past errors in accepting too many flows. D[s,t] : Approximated Departure rate

Let be the aggregate load time at time t be the overflow probability at time t As converges in distribution to and the overflow probability converges to

Taking and using stationarity of

Analysis of Overflow Probability Since is stationary and symmetrically distributed around 0, Can be interpreted as the hitting probability of a Gaussian process on a moving boundary Define: to be the variance of Assuming that the single-sided derivatives ofat exist and are finite, letbe the right derivative of Then the hitting probability is approximated by: where is the N(0,1) probability density function.

Consider a specific auto-correlation function : governs the exponential drop-off rate of the correlation function. natural correlation time scale for burst dynamics now becomes the well-known Ornstein-Uhlenbeck process Further,

Making a time-scale assumption (γ >> 1) Comparing with the result for impulsive load model Much worse. In the impulsive model, errors can happen at 0 In the continuous model, errors happen upto roughly to have an impact on the load at time t.

Smaller Faster fluctuation in memoryless mean bandwidth estimates larger the probability in estimation at some time in the interval Since decreases aswhere is the actual mean Holding time, the overflow probability decreases roughly as Thus

MBAC with Estimation Memory Problems with memoryless scheme Estimation error at a specific time instant is large Correlation timescale is same as that of traffic causes the probability of under-estimation of mean Bandwidth during to be very high Use more memory in mean and variance estimators

First order auto-regressive filter with impulse response Thus

Governs how past bandwidths are weighted; measure of the estimated window length Relationship between memoryless and memory-based estimators Where * is the convolution operation Error in the Filtered estimate of the mean bandwidth of A flow at time t

The steady-state overflow probability under the MBAC with Memory can be approximated by This is the hitting probability if a Gaussian process on a moving boundary, and can be approximated as:

Under separation of timescales, γ >> 1 Thus Approximating and writing in terms of

Robust MBAC Chooseandsuch that Thus the average bandwidth utilization: For known

Robust MBAC For unknown Choose on the order of the critical timescale Suppose Suppose critical time scale is much longer than memory timescale, then

Questions???