Discussion on IEEE metrics guidelines Document Number: IEEE R0 Date Submitted: Source: Antonio BovoVoice: * Re: R0 Base Contribution: Purpose: WG discussion Notice: This document does not represent the agreed views of the IEEE Working Group or any of its subgroups. It represents only the views of the participants listed in the “Source(s)” field above. It is offered as a basis for discussion. It is not binding on the contributor(s), who reserve(s) the right to add, amend or withdraw material contained herein. Copyright Policy: The contributor is familiar with the IEEE-SA Copyright Policy. Patent Policy: The contributor is familiar with the IEEE-SA Patent Policy and Procedures: and..html#6sect6.html#6.3 Further information is located at and.

Discussion on IEEE metrics guidelines Content: Recap of IPPM metrics CAIDA AIMS 2014 Guidelines to be discussed for IEEE For WG discussion only

Recap of IPPM metrics (1/3) Summary of IPPM-related specifications is available at: There are either stable specifications or drafts related to new proposals (I-D Initial Default state). The metrics specified are related to the active test scenario (so called Type-T testing). There are several IP Performance metrics defined, for example: ROUND TRIP DELAY ONE-WAY CONNECTIVITY ONE-WAY DELAY ONE-WAY LOSS LOSS DISTRIBUTION, LOSS PATTERNS JITTER ROUND TRIP PACKET LOSS TCP THROUGHPUT … For WG discussion only

Recap of IPPM metrics (2/3) Some specifications are also related to service measurements, defining for example what could be the definition for some web metrics. Finally, it is mentioned also the possibility to define hybrid scenarios, with active and passive measurements both applied to the network. This hybrid scenario is claimed useful for several reasons, for example: the possibility to test paths with high and small traffic and potentially compare results. Or the possibility to build a measurement baseline with passive measurements against which comparing the results of the active ones. A couple of specifications describe the so called “Two-Way Active Measurement Protocol” (TWAMP) and the “One-way Active Measurement Protocol” (OWAMP) These protocols are dedicated to activation, control and results’ collection for one-way or two-way metrics. For WG discussion only

Recap of IPPM metrics (3/3) In addition, there are some proposals for measurements’ registry, in order to define for example which are the configuration parameters open for each measurements and the criteria used to provide the results. The proposed registry is different for active and passive measurements. Another aspect considered within IETF IPPM is the security mechanisms: The draft specification is related to the usage of IPSEC and IKEv2 protocols in order to assure confidentiality and authentication between the peers involved in the measurements process. For WG discussion only

CAIDA AIMS 2014 Last CAIDA Active Internet Measurements workshop has discussed several topics, some of them related also to mobile broadband performance measurements. Some examples of discussed topics are for example how a measurement app can be deployed and used to obtain meaningful results, or the Network Operator perspective about next generation networks and wireless measurements. Some of the contributions are focused more on the application perspective than on the IP side only. For WG discussion only

Guidelines to be discussed for IEEE About measurements within IEEE current approach is: –“…The standard should reference metrics specified by IETF (particularly from the IP Performance Metrics (IPPM) Working Group) whenever feasible. –The standard shall specify to consider also radio quality measurements, if possible. –The standard shall specify to consider measurements related to different radio conditions, if possible …. –In addition to active testing with specific test packets designed for “ad-hoc” measurements…, it could be considered also measurements obtained analyzing normal traffic to typical hosts/services…” So, a possible guideline to be discussed for performance metrics could be: –Propose which IPPM metrics to incorporate as reference into IEEE –Define which modifications, if any, should be needed to incorporate such IPPM metrics. –Define the strategy for new additional measurements definition (e.g. passive vs active, radio vs wired, application vs IP-based). For WG discussion only