Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-02 March 21, 2007 Al Morton Benoit Claise “

Slides:



Advertisements
Similar presentations
1588V2 Telecom Profile Framework
Advertisements

1 Link-State IGP Data-Plane Convergence Benchmarking draft-ietf-bmwg-igp-dataplane-conv-meth-20 draft-ietf-bmwg-igp-dataplane-conv-term-20 S. Poretsky,
MPTCP Application Considerations draft-scharf-mptcp-api-01 Michael Scharf Alan Ford IETF 77, March 2010.
The Robert Gordon University
Academic Program and Unit Review at UIS Office of the Provost Fall 2014.
Pathload A measurement tool for end-to-end available bandwidth Manish Jain, Univ-Delaware Constantinos Dovrolis, Univ-Delaware Sigcomm 02.
Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-04 December 3, 2007 Al Morton Benoit Claise.
Fine-Grained Latency and Loss Measurements in the Presence of Reordering Myungjin Lee, Sharon Goldberg, Ramana Rao Kompella, George Varghese.
RTP: A Transport Protocol for Real-Time Applications Provides end-to-end delivery services for data with real-time characteristics, such as interactive.
Doc.: IEEE /0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for ax Date: Authors:
AVTCore IETF 82 Taipei Current Burst Gap related Drafts Jing Zhao Zhao Sunshine
Reporting Metrics: Different Points of View (revisions and discussion) Al Morton Gomathi Ramachandran Ganga Maguluri March 21, 2006 draft-morton-ippm-reporting-metrics-01.
DESCRIBING DATA: 2. Numerical summaries of data using measures of central tendency and dispersion.
SOCI 380 INSTRUCTIONS RE. RESEARCH PAPER DUE DATE: The research paper is due on the last day of class You are required to write and submit a detailed research.
1 Emulating AQM from End Hosts Presenters: Syed Zaidi Ivor Rodrigues.
Nov. 2010Geib/Morton/Fardid/Steinmitz / draft-ietf-metrictest-011 Testing Standards Track Metrics Draft-ietf-ippm-metrictest-01 Geib, Morton, Fardid, Steinmitz.
CIS679: RTP and RTCP r Review of Last Lecture r Streaming from Web Server r RTP and RTCP.
IMSS005 Computer Science Seminar
WG RAQMON Internet-Drafts RMON MIB WG Meeting Washington, Nov. 11, 2004.
(Long-Term) Reporting Metrics: Different Points of View Al Morton Gomathi Ramachandran Ganga Maguluri November 2010 draft-ietf-ippm-reporting-metrics-04.
1 Advancing Metrics on the Standards Track: RFC 2680 (1-way Loss) Test Plan and Results draft-ietf-ippm-testplan-rfc Len Ciavattone, Rüdiger Geib,
Quality of Service (QoS) of interconnected Packet- based Networks Workshop on “Monitoring Quality of Service and Quality of Experience of Multimedia Services.
Quality of Service (QoS) Monitoring and Functions of Internet ITU Regional Standardization Forum for Africa (Kampala, Uganda, June 2014) Yvonne UMUTONI.
Active Measurements on the AT&T IP Backbone Len Ciavattone, Al Morton, Gomathi Ramachandran AT&T Labs.
IPPM IETF65 Tuesday March 21 17:40-19:50. IPPM Working Group Chairs: –Henk Uijterwaal –Matt Zekauskas
1 draft-ietf-ippm-loss-episode-metrics-00 Loss Episode Metrics for IPPM Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University IETF 79, Beijing,
1.  Interpretation refers to the task of drawing inferences from the collected facts after an analytical and/or experimental study.  The task of interpretation.
1 draft-duffield-ippm-burst-loss-metrics-01.txt Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University IETF 76, Hiroshima, Japan 11/10/2009.
Ian F. C. Smith Writing a Conference Paper. 2 Disclaimer This is mostly opinion. Suggestions are incomplete. There are other strategies.
Reporting Metrics: Different Points of View (revisions and discussion) Al Morton Gomathi Ramachandran Ganga Maguluri December3, 2007 draft-morton-ippm-reporting-metrics-03.
Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-03 July 24, 2007 Al Morton Benoit Claise.
Framework for Metric Composition + Spatial Composition of Metrics Al Morton + many others December 3, 2007.
Report Writing JoAnn Syverson Carlson School of Management University of Minnesota.
Chapter 2 Understanding the Research Literature. Searching the literature Bibliographic databases Bibliographic databases –Proquest –ERIC –PsycINFO –
1 Sub-IP Protection Methods of Measurement: Considerations Al Morton bmwg Chair IETF-72.
Nov 2009Geib/Morton/ Hasslinger/Fardid / draft-geib-metrictest-011 Draft-geib-ippm-metrictest-01. Incorporates RFC2330 philosophy, draft-bradner and draft-morton.
1 Advanced Transport Protocol Design Nguyen Multimedia Communications Laboratory March 23, 2005.
A Comparison of RaDiO and CoDiO over IEEE WLANs May 25 th Jeonghun Noh Deepesh Jain A Comparison of RaDiO and CoDiO over IEEE WLANs.
Routing in Delay Tolerant Network Qing Ye EDIFY Group of Lehigh University.
1 Benchmarking Methodology WG (bmwg) 71st IETF – Philadelphia, PA USA Monday, March 10, 2008, 13:00-15:00 (Salon J) Chairs: –Al Morton
Extension of the MLD proxy functionality to support multiple upstream interfaces 1 Luis M. Contreras Telefónica I+D Carlos J. Bernardos Universidad Carlos.
Update on the IPPM WG Working Item: Multimetric ID 68 th IETF meeting Prague, Czech Republic, March 2007.
EGEE is a project funded by the European Union under contract IST Study of Performance Standards, kick off (Task 1.1.1) Robert Stoy DFN EGEE.
Marketing Plan.
Trust Anchor Update Requirements for DNSSEC Russ Mundy for the editors Steve Crocker, Howard Eland, Russ Mundy.
1 Advancing Metrics on the Standards Track: RFC 2680 (Loss) Test Plan and Results draft-morton-ippm-testplan-rfc Len Ciavattone, Rüdiger Geib, Al.
1 ICCCN 2003 Modelling TCP Reno with Spurious Timeouts in Wireless Mobile Environments Shaojian Fu School of Computer Science University of Oklahoma.
RTCP XR Report Block for Packet Delay Variation Metric Reporting draft-ietf-xrblock-rtcp-xr-pdv-01 Qin Wu G. Hunt
Authors: Scott Poretsky, Quarry Technologies Brent Imhoff, LightCore
Initial Performance Metric Registry Entries
The Transport Layer Congestion Control & UDP
Jitter Definitions What is what ? Discussion
RFC6374 Synonymous Flow Labels draft-bryant-mpls-rfc6374-sfl-03
Zhenbin Li, Li Zhang(Huawei Technologies)
Nick Duffield, Al Morton, AT&T Joel Sommers, Colgate University
RTP: A Transport Protocol for Real-Time Applications
IPFIX Requirements: Document Changes from Version -07 to Version -09
DASH Background Server provides multiple qualities of the same video
(Long-Term) Reporting Metrics: Different Points of View
IP Performance Specifications - Progress and Next Steps
Latency-sensitive Applications - metrics
SDP Media Loopback draft-hedayat-media-loopback-01.txt
DetNet Flow Information Model
Chapter Four Engineering Communication
Chapter Four Engineering Communication
Development of common training materials
Sally Floyd and Eddie Kohler draft-floyd-ccid4-01.txt July 2007
3rd meeting, 8 March 2006 EEA Copenhagen
Modeling and Evaluating Variable Bit rate Video Steaming for ax
STEPS Site Report.
Presentation transcript:

Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-02 March 21, 2007 Al Morton Benoit Claise “

Page 2 Recap of activity since IETF-67 Benoit Claise read the draft (through the early comparison section) and shared comments with Al off-list. Al summarized those comments on list, and produced the -01.txt version (Nov 27, 2006). Benoit completed his review and summarized all his comments on the list (Dec 1, 2006). Al and Benoit discussed these comments over the next few months. -02.txt version March 4, 2007 with Benoit as co- author.  much new material and questions for IPPM WG discussion

Page 3 Applicability Problem: “How will the results be used?” Krzanowski introduced the Delay Variation Problem at IETF-64 “How” Question asked at IETF-65, no suggestions yet RFC 3393 lists two key uses for the Delay Variation Metric Memo Considers these 2 Tasks and 2 Special Circumstances SRC DST Network Characterization: Inferring Queue Occupation on a Path Application Performance Estimation: Sizing of De-Jitter Buffers What about Spatial Composition ? What if circumstance s are challenging?

Page 4 Modified Outline of the Draft 1. Introduction 1.1. Background Literature in IPPM and Elsewhere 1.2. Organization of the Memo Purpose and Scope Brief Descriptions of Delay 3. Variation Uses (four) 4. Formulations of IPDV & PDV Earlier Comparisons Additional Properties and Comparisons 6.1. Packet Loss 6.2. Path Changes Lossless Path Change Path Change with Loss 6.3. Clock Stability and Error 6.4. Spatial Composition 6.5. Reporting a Single Number 6.6. Jitter in RTCP Reports 6.7. MAPDV Load Balancing Applicability of the Delay Variation Forms and Rec 7.1. Uses 7.2. Challenging Circumstances Clock Issues Frequent Path Changes Frequent Loss Load Balancing Measurement Considerations for Vendors, Testers, and Users 8.1. Measurement Stream Characteristics 8.2. Measurement Units 8.3. Test Duration 8.4. Clock Sync Options 8.5. Distinguishing Long Delay from Loss 8.6. Accounting for Packet Reordering 8.7. Results Representation and Reporting … Appendix on Reducing Delay Variation in Networks Appendix on Calculating the D(min) in PDV 13.

Page 5 Inter-Packet Delay Var. (selection f = previous packet) Src Dst T1 R1 T2 R2 T3 R3 T4 R4 T5 R5 IPDV(2) = (R2-R1) – (T2-T1) (5)(2)(4) IPDV(4) = (R4-R3) – (T4-T3) (3)

Page 6 Packet Delay Variation (selection f = minimum delay pkt in stream) Src Dst T1 R1 T2 R2 (minimum) T3 R3 T4 R4 T5 R5 PDV(3) = (R3-T3) – (R2-T2) (2)(4) PDV(4) = (R4-T4) – (R2-T2) (1,3,5)

Page 7 Summary of Comparisons Challenging Circumstances for measurement:  IPDV form offers advantages when  Path changes are Frequent  Meas. System Clocks exhibit significant Skew  PDV form is less sensitive to Packet Loss Spatial Composition of DV metric:  All known methods use PDV,  IPDV sensitivity to sequence is an issue Estimate of Queuing Time & Variation:  PDV estimates this, especially when sample min = true min Determine De-jitter Buffer Size Required  PDV “pseudo-range” reveals this property by anchoring the distribution at the minimum delay

Page 8 Examples from IPPM List Discussion (2000) Ex. A – Smooth Trend IPDV Range = (-10, 10) PDV Range = ( 0, 50 ) Ex. B – Faster Var with loss IPDV Range = (-20, 40) PDV Range = ( 0, 50 ) How can the detailed information IPDV provides be used? (to complete some task)

Page 9 What if there is load-balancing in the network? Load- balancing is based on the IGP metrics, while the delay depends on the path. So, we could have a multi-modal distribution, if we send test packets with different characteristics such as IP addresses/ports. Should the delay singletons using multiple addresses/ports be combined in the same sample? The PDV form makes the identification of multiple modes possible. Should we characterize each mode separately?  This question also applies to the Path Change case.

Page 10 New Sections Section 8: Measurement Considerations for Vendors, Testers, and Users  This section provides guidance in many areas – Useful?  Do we want to recommend measuring BOTH IPDV and PDV?  Do we want to reconstruct the IPDV and DV later on, with a different interval? Appendix: Guidance for reducing DV in networks  Useful? Appendix: Calculation of the Minimum Delay, D(min)  how is this D(min) calculated? Is it DV(99%) as mentioned by Roman in  do we need to keep all the values from the interval, then take the minimum?  Or do we keep the minimum from previous intervals?

Page 11 Summary IPDV and PDV each have their Strengths and Weaknesses Suggestions for additional Tasks & Circumstances Need Feedback on newly proposed sections and questions raised in the text of the draft.