1 Self Similar Traffic. 2 Self Similarity The idea is that something looks the same when viewed from different degrees of “magnification” or different.

Slides:



Advertisements
Similar presentations
Doc.: IEEE /1216r1 Submission November 2009 BroadcomSlide 1 Internet Traffic Modeling Date: Authors: NameAffiliationsAddressPhone .
Advertisements

Copyright © 2005 Department of Computer Science CPSC 641 Winter Self-Similar Network Traffic The original paper on network traffic self-similarity.
Introduction Background Knowledge Workload Modeling Related Work Conclusion & Future Work Modeling Many-Task Computing Workloads on a Petaflop Blue Gene.
Network and Service Assurance Laboratory Analysis of self-similar Traffic Using Multiplexer & Demultiplexer Loaded with Heterogeneous ON/OFF Sources Huai.
Finding Self-similarity in People Opportunistic Networks Ling-Jyh Chen, Yung-Chih Chen, Paruvelli Sreedevi, Kuan-Ta Chen Chen-Hung Yu, Hao Chu.
Computer Science Generating Streaming Access Workload for Performance Evaluation Shudong Jin 3nd Year Ph.D. Student (Advisor: Azer Bestavros)
STAT 497 APPLIED TIME SERIES ANALYSIS
2  Something “feels the same” regardless of scale 4 What is that???
Mark Shereshevsky, Bojan Cukic Fractal Analysis of Resource Exhaustion in Operating Systems: Initial Steps Mark Shereshevsky, Bojan Cukic Jonathan Crowell.
Chen Chu South China University of Technology. 1. Self-Similar process and Multi-fractal process There are 3 different definitions for self-similar process.
1 Self-Similar Ethernet LAN Traffic Carey Williamson University of Calgary.
Engineering experiments involve the measuring of the dependent variable as the independent one has been altered, so as to determine the relationship between.
CMPT 855Module Network Traffic Self-Similarity Carey Williamson Department of Computer Science University of Saskatchewan.
On the Self-Similar Nature of Ethernet Traffic - Leland, et. Al Presented by Sumitra Ganesh.
1 17. Long Term Trends and Hurst Phenomena From ancient times the Nile river region has been known for its peculiar long-term behavior: long periods of.
October 14, 2002MASCOTS Workload Characterization in Web Caching Hierarchies Guangwei Bai Carey Williamson Department of Computer Science University.
Analyzing stochastic time series Tutorial
Alon Arad Alon Arad Hurst Exponent of Complex Networks.
Finding Self-similarity in Opportunistic People Networks Yung-Chih Chen 1 Ling-Jyh Chen 1, Yung-Chih Chen 1, Tony Sun 2 Paruvelli Sreedevi 1, Kuan-Ta Chen.
Small scale analysis of data traffic models B. D’Auria - Eurandom joint work with S. Resnick - Cornell University.
Understanding and Predicting Host Load Peter A. Dinda Carnegie Mellon University
無線區域網路中自我相似交通流量之 成因與效能評估 The origin and performance impact of self- similar traffic for wireless local area networks 報 告 者:林 文 祺 指導教授:柯 開 維 博士.
A Nonstationary Poisson View of Internet Traffic T. Karagiannis, M. Molle, M. Faloutsos University of California, Riverside A. Broido University of California,
Self-Similarity in Network Traffic Kevin Henkener 5/29/2002.
1 Interesting Links
1 Using A Multiscale Approach to Characterize Workload Dynamics Characterize Workload Dynamics Tao Li June 4, 2005 Dept. of Electrical.
CSE 561 – Traffic Models David Wetherall Spring 2000.
Self-Similar through High-Variability: Statistical Analysis of Ethernet LAN Traffic at the Source Level Walter Willinger, Murad S. Taqqu, Robert Sherman,
CS 6401 Network Traffic Characteristics Outline Motivation Self-similarity Ethernet traffic WAN traffic Web traffic.
BOX JENKINS METHODOLOGY
Internet Traffic Modeling Poisson Model vs. Self-Similar Model By Srividhya Chandrasekaran Dept of CS University of Houston.
Self-Similar Traffic COMP5416 Advanced Network Technologies.
Self-Similarity of Network Traffic Presented by Wei Lu Supervised by Niclas Meier 05/
1 Network Simulation and Testing Polly Huang EE NTU
Traffic modeling and Prediction ----Linear Models
Applications of Poisson Process
1 Chapters 9 Self-SimilarTraffic. Chapter 9 – Self-Similar Traffic 2 Introduction- Motivation Validity of the queuing models we have studied depends on.
References for M/G/1 Input Process
Network Traffic Modeling Punit Shah CSE581 Internet Technologies OGI, OHSU 2002, March 6.
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Inference for regression - Simple linear regression
Dr. Nawaporn Wisitpongphan. What do you need in order to conduct a PhD Research? A lot of reading in order to Find a PhD thesis topic Find out what other.
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
EE484: Probability and Introduction to Random Processes Autocorrelation and the Power Spectrum By: Jason Cho
Time Series Spectral Representation Z(t) = {Z 1, Z 2, Z 3, … Z n } Any mathematical function has a representation in terms of sin and cos functions.
1 FARIMA(p,d,q) Model and Application n FARIMA Models -- fractional autoregressive integrated moving average n Generating FARIMA Processes n Traffic Modeling.
1 Statistical Distribution Fitting Dr. Jason Merrick.
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
K. Ensor, STAT Spring 2005 Long memory or long range dependence ARMA models are characterized by an exponential decay in the autocorrelation structure.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Geo479/579: Geostatistics Ch4. Spatial Description.
A Nonstationary Poisson View of Internet Traffic Thomas Karagiannis joint work with Mart Molle, Michalis Faloutsos, Andre Broido.
Burst Metric In packet-based networks Initial Considerations for IPPM burst metric Tuesday, March 21, 2006.
CY1B2 Statistics1 (ii) Poisson distribution The Poisson distribution resembles the binomial distribution if the probability of an accident is very small.
Sampling and estimation Petter Mostad
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
MODELING THE SELF-SIMILAR BEHAVIOR OF PACKETIZED MPEG-4 VIDEO USING WAVELET-BASED METHODS Dogu Arifler and Brian L. Evans The University of Texas at Austin.
Risk Analysis Workshop April 14, 2004 HT, LRD and MF in teletraffic1 Heavy tails, long memory and multifractals in teletraffic modelling István Maricza.
Power Spectral Estimation
1 Interesting Links. On the Self-Similar Nature of Ethernet Traffic Will E. Leland, Walter Willinger and Daniel V. Wilson BELLCORE Murad S. Taqqu BU Analysis.
Internet Traffic Modeling
Interesting Links.
Evaluation of Load Balancing Algorithms and Internet Traffic Modeling for Performance Analysis By Arthur L. Blais.
Self-similar Distributions
Mark E. Crovella and Azer Bestavros Computer Science Dept,
Nat. Rev. Cardiol. doi: /nrcardio
Presented by Chun Zhang 2/14/2003
CH2 Time series.
Threshold Autoregressive
CPSC 641: Network Traffic Self-Similarity
Presentation transcript:

1 Self Similar Traffic

2 Self Similarity The idea is that something looks the same when viewed from different degrees of “magnification” or different scales on a dimension, such as the time dimension. It’s a unifying concept underlying fractals, chaos, power laws, and a common attribute in many laws of nature and in phenomena in the world around us.

3 Cantor Each left portion in a step is a full replica of the preceding step

4 Fractals

5 What is a Fractal? Exhibits self-similarity Based on recursive algorithms Unique dimensionality Scale independent

6 Network Traffic in the Real World For years, traffic was assumed to be based on Poisson. It is now known that this traffic has a self similar pattern. Characterized by burstiness.

7 Self Similarity of Ethernet Traffic Seminal paper by W. Leland et al published in 1993, examined Ethernet traffic between 1989 and 1992, gathering 4 sets of data, each lasting 20 to 40 hours, with a resolution of 20 microseconds. Paper shattered the illusion of Poison distribution being adequate for traffic analysis. Proved Ethernet traffic is self similar with a Hurst factor of H = < H <1 ; the higher H, the more self similar the pattern

8

9 Self-similarity manifests itself in several equivalent fashions: –Slowly decaying variance –Long range dependence –Non-degenerate autocorrelations –Hurst effect Self-similarity: manifestations

10 Definition of Self-Similarity Self-similar processes are the simplest way to model processes with long-range dependence – correlations that persist (do not degenerate) across large time scales The autocorrelation function r(k) of a process (statistical measure of the relationship, if any, between a random variable and itself, at different time lags)with long-range dependence is not summable: –  r(k) = inf. – r(k)  k -  as k  inf. for 0 <  < 1 Autocorrelation function follows a power law Slower decay than exponential process –Power spectrum is hyperbolic rising to inf. at freq. 0 –If  r(k) < inf. then you have short-range dependence

11 Self-Similarity contd. Consider a zero-mean stationary time series X = (X t ;t = 1,2,3,…), we define the m-aggregated series X (m) = (X k (m) ;k = 1,2,3,…) by summing X over blocks of size m. We say X is H-self-similar if for all positive m, X (m) has the same distribution as X rescaled by m H. If X is H-self-similar, it has the same autocorrelation function r(k) as the series X (m) for all m. This is actually distributional self- similarity. Degree of self-similarity is expressed as the speed of decay of series autocorrelation function using the Hurst parameter –H = 1 -  /2 –For SS series with LRD, ½ < H < 1 –Degree of SS and LRD increases as H  1

12 Graphical Tests for Self-Similarity Variance-time plots –Relies on slowly decaying variance of self-similar series –The variance of X (m) is plotted versus m on log-log plot –Slope (-  greater than –1 is indicative of SS R/S plots –Relies on rescaled range (R/S)statistic growing like a power law with H as a function of number of points n plotted. –The plot of R/S versus n on log-log has slope which estimates H Periodogram plot –Relies on the slope of the power spectrum of the series as frequency approaches zero –The periodogram slope is a straight line with slope  – 1 close to the origin

13 Graphical test examples – VT plot

14 Graphical test example – R/S plot

15 How Inaccurate Are Older Models?