Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University

Slides:



Advertisements
Similar presentations
International Telecommunication Union Workshop on End-to-End Quality of Service.What is it? How do we get it? Geneva, 1-3 October 2003 Are Existing Performance.
Advertisements

AVTCore IETF 82 Taipei Current Burst Gap related Drafts Jing Zhao Zhao Sunshine
Reporting Metrics: Different Points of View (revisions and discussion) Al Morton Gomathi Ramachandran Ganga Maguluri March 21, 2006 draft-morton-ippm-reporting-metrics-01.
Using FEC for Rate Adaptation of Multimedia Streams Marcin Nagy Supervised by: Jörg Ott Instructed by: Varun Singh Conducted at Comnet, School of Electrical.
User Control of Streaming Media: RTSP
On the Constancy of Internet Path Properties Yin Zhang, Nick Duffield AT&T Labs Vern Paxson, Scott Shenker ACIRI Internet Measurement Workshop 2001 Presented.
Streaming Media. Unicast Redundant traffic Multicast One to many.
CSc 461/561 CSc 461/561 Multimedia Systems Part C: 1. RTP/RTCP.
Copyright Telchemy Inc 2001 Embedded Passive Monitoring of Voice over IP Service Quality Alan Clark Telchemy, Inc Atlanta, GA
Nov. 2010Geib/Morton/Fardid/Steinmitz / draft-ietf-metrictest-011 Testing Standards Track Metrics Draft-ietf-ippm-metrictest-01 Geib, Morton, Fardid, Steinmitz.
CS 218 F 2003 Nov 3 lecture:  Streaming video/audio  Adaptive encoding (eg, layered encoding)  TCP friendliness References: r J. Padhye, V.Firoiu, D.
CIS679: RTP and RTCP r Review of Last Lecture r Streaming from Web Server r RTP and RTCP.
Alok Shriram and Jasleen Kaur Presented by Moonyoung Chung Empirical Evaluation of Techniques for Measuring Available Bandwidth.
Computer Networks: Multimedia Applications Ivan Marsic Rutgers University Chapter 3 – Multimedia & Real-time Applications.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
Framework for Performance Metric Development draft-morton-perf-metrics-framework-01.txt Alan Clark IETF 70 PMOL WG.
POSTECH DP&NM Lab. Internet Traffic Monitoring and Analysis: Methods and Applications (1) 2. Network Monitoring Metrics.
(Long-Term) Reporting Metrics: Different Points of View Al Morton Gomathi Ramachandran Ganga Maguluri November 2010 draft-ietf-ippm-reporting-metrics-04.
1 Lecture 17 – March 21, 2002 Content-delivery services. Multimedia services Reminder  next week individual meetings and project status report are due.
Measurement and Modeling of Packet Loss in the Internet Maya Yajnik.
Hung X. Nguyen and Matthew Roughan The University of Adelaide, Australia SAIL: Statistically Accurate Internet Loss Measurements.
Consideration for Selecting RTCP XR Metrics for RTCWEB Statistics API draft-huang-xrblock-rtcweb-rtcp-xr-metrics-01 Rachel Huang
Active Measurements on the AT&T IP Backbone Len Ciavattone, Al Morton, Gomathi Ramachandran AT&T Labs.
Application Performance Metrics APM BOF July 25, 2007 Alan Clark Al Morton IETF 69 – Chicago – July 2007.
1 draft-ietf-ippm-loss-episode-metrics-00 Loss Episode Metrics for IPPM Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University IETF 79, Beijing,
LOG Objectives  Describe some of the VoIP implementation challenges such as Delay/Latency, Jitter, Echo, and Packet Loss  Describe the voice encoding.
On the Constancy of Internet Path Properties ACM SIGCOMM Internet Measurement Workshop November, 2001 Yin Zhang Nick Duffield Vern Paxson Scott Shenker.
Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-02 March 21, 2007 Al Morton Benoit Claise “
Burst Metric In packet-based networks Initial Considerations for IPPM burst metric Tuesday, March 21, 2006.
1 draft-duffield-ippm-burst-loss-metrics-01.txt Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University IETF 76, Hiroshima, Japan 11/10/2009.
Reporting Metrics: Different Points of View (revisions and discussion) Al Morton Gomathi Ramachandran Ganga Maguluri December3, 2007 draft-morton-ippm-reporting-metrics-03.
Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-03 July 24, 2007 Al Morton Benoit Claise.
Development of a QoE Model Himadeepa Karlapudi 03/07/03.
An Extensible RTCP Control Framework for Large Multimedia Distributions Paper by: Julian Chesterfield Eve M. Schooler Presented by: Phillip H. Jones.
A RTCP-based Retransmission Protocol for Unicast RTP Streaming Multimedia draft-podolsky-avt-rtprx-00.txt Matthew Podolsky, Koichi Yano, and Steven McCanne.
3.1 Statistical Distributions. Random Variable Observation = Variable Outcome = Random Variable Examples: – Weight/Size of animals – Animal surveys: detection.
Submission doc.: IEEE /1204r2November 2004 Emily Qi, Intel CorporationSlide 1 QoS Metrics for Traffic Category/Stream Emily H. Qi Intel Corporation.
Aditya Akella The Impact of False Sharing on Shared Congestion Management Aditya Akella with Srinivasan Seshan and Hari Balakrishnan.
Bandwidth estimation: metrics, measurement techniques, and tools Presenter: Yuhang Wang.
Network Models. 2.1 what is the Protocol? A protocol defines the rules that both the sender and receiver and all intermediate devices need to follow,
V Telecommunications Industry AssociationTR-30.3/ Lake Buena Vista, FL December 8 - 9, 2008.
Probabilistic Congestion Control for Non-Adaptable Flows Jörg Widmer, Martin Mauve, Jan Peter Damm (NOSSDAV’02) Presented by Ankur Upadhyaya for CPSC 538A.
03/27/12XRBLOCK IETF 83 Paris RTCP XR Report Block for Summary Statistics Metric Reporting draft-zorn-xrblock-rtcp-xr-al-stat-05 Glen Zorn Roland Scott.
RTCP XR Report Block for Packet Delay Variation Metric Reporting draft-ietf-xrblock-rtcp-xr-pdv-01 Qin Wu G. Hunt
Initial Performance Metric Registry Entries
Jitter Definitions What is what ? Discussion
A registry for IPPM metrics
Network Performance and Quality of Service
An IP-based multimedia traffic generator
Benchmarking Framework
RTP: A Transport Protocol for Real-Time Applications
Empirically Characterizing the Buffer Behaviour of Real Devices
Audio/Video Transport Working Group
Experiment with LBE Quality of Service on GÉANT
(Long-Term) Reporting Metrics: Different Points of View
IEEE P Working Group for Wireless Personal Area NetworksTM
IP Performance Specifications - Progress and Next Steps
Latency-sensitive Applications - metrics
draft-ietf-ippm-multipoint-alt-mark-00
VoIP Models for System Performance Evaluation
Pong: Diagnosing Spatio-Temporal Internet Congestion Properties
TCP Friendly Rate Control (TFRC): Protocol Specification RFC3448bis
VoIP Models for System Performance Evaluation
RAP: Rate Adaptation Protocol
A tool for locating QoS failures on an Internet path
Simple Two-way Active Measurement Protocol (STAMP): base protocol and data model draft-mirsky-ippm-stamp draft-mirsky-ippm-stamp-yang Greg Mirsky
Project proposal Multi-stream and multi-path audio transmission
Author: Ramana Rao Kompella, Kirill Levchenko, Alex C
Active RTP liveness discovery
Presentation transcript:

Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University draft-duffield-ippm-burst-loss-metrics-00.txt Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University

Burst Packet Loss Metrics Motivation One-way packet loss metrics Current standards (mostly) concerned with average loss Applications performance can be sensitive to patterns of loss Develop Burst Loss Metrics Characterize packet burst loss patterns by two metrics Average Loss Rate (as before) Average Loss Episode Duration Probing Methodology Need more that Poisson probes to accurately measure burst loss Build on Framework/Terms/Ideas from existing IPPM & AVT RFCs RFC 2680, RFC3357, RFC3393, RFC3611

Burst Loss vs. Average Loss Example VoIP Frequent small glitches vs. local burst (with same average loss rate) Suppose users don’t distinguish shorter from longer burst losses At least for burst lengths in some range Relevant metric: #of loss bursts Other examples: MPEG video: compare burst loss duration to frame duration TCP: compare burst loss duration to RTT X

Related IPPM and AVT Standards RFC 2680: A One-way Packet Loss Metric for IPPM Average Loss Metric: Type-P-One-way-Packet-Loss Samples: Type-P-One-way-Packet-Loss-Poisson-Stream RFC 3393: IP Packet Delay Variation Metric for IPPM Focus on delay variation. Useful Ingredient: selection function F specifies packets in stream RFC 3357: One-way Loss Pattern Sample Metrics (Informational) Per packet detail on packet loss e.g. {<T1,0>,<T2,1>,<T3,0>,<T4,0>,<T5,1>,<T6,0>,<T7,1>,<T8,0>, <T9,1>,<T10,1>} RFC 3611: RTP Control Protocol Extended Reports (RTCP XR) Burst Loss metrics for VoIP quality reporting Burst and gap loss statistics on seqno of received packets Related to parameters of 2-state Gilbert Model

Methodology Idea Loss Episode Poisson stream of bi-packet probes Defined as maximal sets of consecutive lost packets Want to estimate duration of loss episodes Poisson stream of bi-packet probes Potentially use background traffic as probes Probe pairs sample transitions into and out of loss episodes Loss Pair = a Bi-packet possible outcome from (0,0), (0,1), (1,0), (1,1) 1 = loss, 0= no loss Estimate loss episode frequencies and durations From measures frequencies of bi-packet outcomes

New Metrics and Associated Quantities Loss Pair Generic outcomes from a bi-packet probes Type-P-One-way-Bi-Packet-Loss Loss pair resulting from a bi-packet probe Type-P-One-way-Bi-Packet-Loss-Stream Loss pairs resulting from a set of bi-packet probes Type-P-One-way-Bi-Packet-Loss-Geometric-Stream Loss pairs from a discrete Poisson bi-packet probe stream Loss Episode Frequency Set of loss pairs -> Average packet loss Loss Episode Duration Set of loss pairs -> Average number packets per loss episode

Type-P-One-way-Bi-Packet-Loss Elementary 2 packet loss metric Parameters Src, Dst IP address T1 = sending time of the first packet T2 = sending time of the second packet F = a selection function P = the specification of the packet type Metric Units Loss Pair

Type-P-One-way-Bi-Packet-Loss-Stream Loss pairs resulting from set of bi-packet probes Parameters Src, Dst IP address (T11,T12), (T21,T22)....,(Tn1,Tn2) a set of n pairs of sending times for n packet pairs, with T11 < T12 <= T21 < T22 <=...<= Tn1 < Tn2 F, a selection function P, the specification of the packet type Metric Units Resulting loss pairs L1, L2,...,Ln

Type-P-One-way-Bi-Packet-Loss-Geometric-Stream (Discrete time) Poisson set of bi-packet probes Interval between probes = interval between packets within probe Parameters Src, Dst, IP address T time of first probe d, time interval n, number of possible probe launches q, per probe launch probability F, selection function P, the specification of the packet type Units Loss pairs L1, L2, ..., Lm for some m <= n

Loss Episode Metrics Convert set of loss pairs into burst loss metrics Pair Counts Input: sequence of successive loss pairs L1,,,,Ln Output: N(i,j) = #{loss pair type (i,j)} for (i,j) = (0,0), (0,1), (1,0), (1,1) Loss Episode Frequency Input: sequence of n successive loss pairs L1,,,,Ln Output: (N(1,0) +N(1,1))/(2*n) Average of single packet loss Formally equivalent to Type-P-One-way- Packet-Loss-Average / RFC 2680 Loss Episode Duration Output: 2*(N(0,1) + N(1,0) + N(1,1)/ (N(0,1)+N(1,0)) - 1 ( when N(0,1) + N(1,0) >0 ) Mean number of probe packets in a loss episode

Status Initial -00 draft submitted Details to be completed Methodologies, Errors and Uncertainties, Reporting Please read and comment