Presentation is loading. Please wait.

Presentation is loading. Please wait.

Multiscale Traffic Processing Techniques for Network Inference and Control Richard Baraniuk Edward Knightly Robert Nowak Rolf Riedi Rice University INCITE.

Published byCornelius Manning Modified over 8 years ago

Similar presentations

Presentation on theme: "Multiscale Traffic Processing Techniques for Network Inference and Control Richard Baraniuk Edward Knightly Robert Nowak Rolf Riedi Rice University INCITE."— Presentation transcript:

1 Multiscale Traffic Processing Techniques for Network Inference and Control Richard Baraniuk Edward Knightly Robert Nowak Rolf Riedi Rice University INCITE Project September 2000

2 Rice University | INCITE Project | September 2000 INCITE InterNet Control and Inference Tools at the Edge Overall Objective: Scalable, edge-based tools for on-line network analysis, modeling, and measurement Theme for DARPA NMS Research: Multiscale traffic analysis, modeling, and processing via multifractals Expertise: Statistical signal processing, mathematics, network QoS

3 Rice University | INCITE Project | September 2000 Technical Challenges Poor understanding of origins of complex network dynamics Lack of adequate modeling techniques for network dynamics Internal network inaccessible Need:Manageable, reduced-complexity models with characterizable accuracy

4 Rice University | INCITE Project | September 2000 Innovative Tools - 1 Multifractals:a natural “language” and toolset for traffic with –bursts and high variability on multiple time scales –short-range dependencies (SRD) –long-range dependencies (LRD) _________

5 Rice University | INCITE Project | September 2000 Innovative Tools - 2 Reduced-complexity statistical traffic models based on multifractal trees and cascades –realisticcapture multiscale variability, SRD+LRD, non-Gaussianity –analytically tractable eg: queuing analysis –linear complexity algorithms O(N) Statistical inference tools for model fitting, end-to-end path modeling

6 Rice University | INCITE Project | September 2000 Multiscale Traffic Modeling Time Scale Multiplicative innovations

7 Rice University | INCITE Project | September 2000 Multifractal Wavelet Model (MWM) Random multiplicative innovations A j,k on [0,1] eg: beta Parsimonious modeling (one parameter per scale) Strong ties with rich theory of multifractals

8 Rice University | INCITE Project | September 2000 Multiscale Traffic Trace Matching 4ms 16ms 64ms Auckland 2000MWM match scale

9 Rice University | INCITE Project | September 2000 Marginal Matching 4ms 16ms 64ms scale Auckland 2000MWMGaussian

10 Rice University | INCITE Project | September 2000 Multiscale Queuing

11 Rice University | INCITE Project | September 2000 End-to-End Path Modeling Abstract network dynamics into a single bottleneck queue driven by “effective cross-traffic” Goal: Estimate volume of cross-traffic

12 Rice University | INCITE Project | September 2000 Probing Ideally: delay spread of packet pair spaced by T sec correlates with cross-traffic volume at time-scale T

13 Rice University | INCITE Project | September 2000 Probing Uncertainty Principle Should not allow queue to empty between probe packets Small T for accurate measurements –but probe traffic would disturb cross-traffic (and overflow bottleneck buffer!) Larger T leads to measurement uncertainties –queue could empty between probes To the rescue: model-based inference

14 Rice University | INCITE Project | September 2000 Multifractal Cross-Traffic Inference Model bursty cross-traffic using MWM

15 Rice University | INCITE Project | September 2000 Efficient Probing: Packet Chirps MWM tree inspires geometric chirp probe MLE estimates of cross-traffic at multiple scales

16 Rice University | INCITE Project | September 2000 Chirp Probe Cross-Traffic Inference

17 Rice University | INCITE Project | September 2000 ns-2 Simulation Inference improves with increased utilization Low utilization (39%)High utilization (65%)

18 Rice University | INCITE Project | September 2000 ns-2 Simulation (Adaptivity) Inference improves as MWM parameters adapt MWM parametersInferred x-traffic

19 Rice University | INCITE Project | September 2000 Adaptivity (MWM Cross-Traffic)

20 Rice University | INCITE Project | September 2000 Challenges: Path Modeling Packet chirps balance measurement accuracy vs. disturbance to network and cross-traffic Enhancements needed: rigorous statistical accuracy analysis multiple bottleneck queues passive monitoring deal with losses as well as delays closed loop paths (feedback) practical implementation issues (clock jitter, estimating bottleneck service rate,...) Verification with real Internet experiments (need “ground truth” info on cross-traffic)

21 Rice University | INCITE Project | September 2000 INCITE: Near-term Goals Multifractal analysis, modeling, synthesis toolbox Path modeling theory and toolbox Preliminary verification –simulations (ns-2) –Rice testbed –Enron, Nokia, Texas Instruments –IPEX / XIWT

22 Rice University | INCITE Project | September 2000 INCITE: Longer-Term Goals New traffic models, inference algorithms –theory, simulation, real implementation Applications to control, QoS, network meltdown early warning TI Avalanche measurement system Leverage from our other projects –ATR program (DARPA, ONR, ARO) –RENE –NSF ITR

23 Rice University | INCITE Project | September 2000 Rice ATR Project Modeling, compression, automatic target recognition of multi-modal images, maps, … D. Healy (DARPA), W. Masters, W. Martinez (ONR), W. Sander (ARO)

24 Rice University | INCITE Project | September 2000 Leverage from Other Rice Projects RENE (NSF, Nokia, TI) –large wireless networking project (6 PIs) –substantial traffic modeling component ITR/INDRA (NSF SPN, ITR) –$5M collaboration between Rice/CMU/Virginia/Berkeley –scalable services: QoS communication, multicast and mirroring/caching –three core services: transfer, replication, and storage

25 Rice University | INCITE Project | September 2000 Natural Synergies Modeling team: New insights into –key traffic features models should capture –origins of complex network dynamics Simulation team –fast synthesis of realistic aggregate traffic Measurement team –novel model-based inference schemes –what and where to measure Emulation team –level of detail for desired realism Design –“what if?” –new approaches to control

26 Rice University | INCITE Project | September 2000 Natural Synergies What we need: –critique of our models –insight into the physical network mechanisms to inspire new modeling simplifications eg: how many bottlenecks on a typical path? –discussions on practical implementation issues –verification experiments (“ground truth”) (scale up from ns and Rice testbed)

Download ppt "Multiscale Traffic Processing Techniques for Network Inference and Control Richard Baraniuk Edward Knightly Robert Nowak Rolf Riedi Rice University INCITE."

Similar presentations

Internet Measurement Conference 2003 Source-Level IP Packet Bursts: Causes and Effects Hao Jiang Constantinos Dovrolis (hjiang,

Internet Measurement Conference 2003 Source-Level IP Packet Bursts: Causes and Effects Hao Jiang Constantinos Dovrolis (hjiang,
Edge-based Network Modeling and Inference

Edge-based Network Modeling and Inference
Collaborators: Mark Coates, Rui Castro, Ryan King, Mike Rabbat, Yolanda Tsang, Vinay Ribeiro, Shri Sarvotham, Rolf Reidi Network Bandwidth Estimation and.

Collaborators: Mark Coates, Rui Castro, Ryan King, Mike Rabbat, Yolanda Tsang, Vinay Ribeiro, Shri Sarvotham, Rolf Reidi Network Bandwidth Estimation and.
Adaptive Resource Allocation: Self-Sizing for Next Generation Networks Michael Devetsikiotis Electrical & Computer Engineering North Carolina State University.

Adaptive Resource Allocation: Self-Sizing for Next Generation Networks Michael Devetsikiotis Electrical & Computer Engineering North Carolina State University.
Connection-level Analysis and Modeling of Network Traffic understanding the cause of bursts control and improve performance detect changes of network state.

Connection-level Analysis and Modeling of Network Traffic understanding the cause of bursts control and improve performance detect changes of network state.
pathChirp Efficient Available Bandwidth Estimation

pathChirp Efficient Available Bandwidth Estimation
T.Sharon-A.Frank 1 Multimedia Quality of Service (QoS)

T.Sharon-A.Frank 1 Multimedia Quality of Service (QoS)
Multiscale Analysis for Intensity and Density Estimation Rebecca Willett’s MS Defense Thanks to Rob Nowak, Mike Orchard, Don Johnson, and Rich Baraniuk.

Multiscale Analysis for Intensity and Density Estimation Rebecca Willett’s MS Defense Thanks to Rob Nowak, Mike Orchard, Don Johnson, and Rich Baraniuk.
Aleksandar Kuzmanovic and Edward W. Knightly Rice Networks Group Measuring Service in Multi-Class Networks.

Aleksandar Kuzmanovic and Edward W. Knightly Rice Networks Group Measuring Service in Multi-Class Networks.
Advanced Computer Networking Congestion Control for High Bandwidth-Delay Product Environments (XCP Algorithm) 1.

Advanced Computer Networking Congestion Control for High Bandwidth-Delay Product Environments (XCP Algorithm) 1.
A Cloud-Assisted Design for Autonomous Driving Swarun Kumar Shyamnath Gollakota and Dina Katabi.

A Cloud-Assisted Design for Autonomous Driving Swarun Kumar Shyamnath Gollakota and Dina Katabi.
XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.

XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.
Lo Presti 1 Network Tomography Francesco Lo Presti Dipartimento di Informatica - Università dell’Aquila.

Lo Presti 1 Network Tomography Francesco Lo Presti Dipartimento di Informatica - Università dell’Aquila.
Simulation of O2 offline processing - tools and models Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture Eugen Mudnić.

Simulation of O2 offline processing - tools and models Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture Eugen Mudnić.
1 Ossama Younis and Sonia Fahmy Department of Computer Sciences Purdue University For slides, technical report, and implementation, please see:

1 Ossama Younis and Sonia Fahmy Department of Computer Sciences Purdue University For slides, technical report, and implementation, please see:
Internet Traffic Patterns Learning outcomes –Be aware of how information is transmitted on the Internet –Understand the concept of Internet traffic –Identify.

Internet Traffic Patterns Learning outcomes –Be aware of how information is transmitted on the Internet –Understand the concept of Internet traffic –Identify.
Maximum Likelihood Network Topology Identification Mark Coates McGill University Robert Nowak Rui Castro Rice University DYNAMICS May 5 th,2003.

Maximum Likelihood Network Topology Identification Mark Coates McGill University Robert Nowak Rui Castro Rice University DYNAMICS May 5 th,2003.
Internet Research Needs a Critical Perspective Towards Models –Sally Floyd –IMA Workshop, January 2004.

Internet Research Needs a Critical Perspective Towards Models –Sally Floyd –IMA Workshop, January 2004.
Multi-Scale Analysis for Network Traffic Prediction and Anomaly Detection Ling Huang Joint work with Anthony Joseph and Nina Taft January, 2005.

Multi-Scale Analysis for Network Traffic Prediction and Anomaly Detection Ling Huang Joint work with Anthony Joseph and Nina Taft January, 2005.
Building a Controlled Delay Assured Forwarding Class in DiffServ Networks Parag Kulkarni Nazeeruddin Mohammad Sally McClean Gerard Parr Michaela Black.

Building a Controlled Delay Assured Forwarding Class in DiffServ Networks Parag Kulkarni Nazeeruddin Mohammad Sally McClean Gerard Parr Michaela Black.

Similar presentations

Ads by Google