Ouagadougou, Burkina Faso, 18 July Content and presentation of Recommendation E.MQoS Joachim Pomy, SG 12 Rapporteur Consultant, Opticom GmbH ITU Workshop on “Benchmarking QoS Evaluation of Multimedia Networks” (Ouagadougou, Burkina Faso, 18 July 2013) Ouagadougou, Burkina Faso, 18 July 2013

2 Draft New Rec. E.MQoS E-series: Overall network operation, telephone service, service operation and human factors E.800-series: Quality of telecommunication services: concepts, models, objectives and dependability planning Title: QoS Aspects for Popular Services in Mobile Networks

Ouagadougou, Burkina Faso, 18 July Scope of E.MQoS (1/2) Assessment of Quality of Service Summary of basics of QoS, always seen from the user's perspective Differences to Quality of Experience (QoE) Guidance to assure QoS assessments conducted in a meaningful way Definition of Quality of Service parameters and their computation QoS parameters and their computation for popular services abstract definition = generic description of parameters abstract equation user and technical trigger points Harmonized definitions are prerequisites for the comparison of QoS measurements and measurement results Typical procedures for Quality of Service measurement equipment Measurement procedures needed to perform the measurements of QoS parameters

Ouagadougou, Burkina Faso, 18 July Scope of E.MQoS (2/2) Requirements for QoS measurement equipment Defines minimum requirements of QoS measurement equipment values and trigger points needed to compute the QoS parameter allow performing measurements in a reliable and reproducible way Definition of typical measurement profiles Specifies typical measurement profiles required to enable benchmarking of different mobile networks both within and outside national boundaries. Post processing and statistical methods Describes procedures for statistical calculations for QoS measurement of mobile networks using probing systems. Network based Quality of Service measurements E2E QoS measurements inside the network without direct access to the end point terminal.

Ouagadougou, Burkina Faso, 18 July Popular Services Services are not standardized Focus on popular services Widely used in the market Test results are meaningfull to customers Examples Web radio clients Web portals

Ouagadougou, Burkina Faso, 18 July QoS aspects of Mobile

Ouagadougou, Burkina Faso, 18 July Main structure of E.MQoS 6Assessment of Quality of Service 7Definition of Quality of Service parameters and their computation 8Typical procedures for Quality of Service measurement equipment 9Requirements for Quality of Service measurement equipment 10Definition of typical measurement profiles 11Post processing and statistical methods 12Network based Quality of Service measurements Appendices (informative)

Ouagadougou, Burkina Faso, 18 July Assessment of Quality of Service 6.1QoS Background 6.2QoS Assessment Process 6.3Basic Settings for QoS Assessments 6.4Service Independent QoS Criteria 6.5Service dependent QoS Criteria

Ouagadougou, Burkina Faso, 18 July Definition of Quality of Service parameters and their computation 7.1QoS Parameter Basics 7.2Service independent QoS Parameters 7.3Direct Services QoS Parameters 7.4Store ‑ and ‑ forward (S&F) Services QoS Parameters

Ouagadougou, Burkina Faso, 18 July Service independent QoS Parameters 7.2.1Radio Network Unavailability [%] 7.2.2Network Non Accessibility [%] 7.2.3Attach Failure Ratio [%] 7.2.4Attach Setup Time [s] 7.2.5PDP Context Activation Failure Ratio [%] 7.2.6PDP Context Activation Time [s] 7.2.7PDP Context Cut ‑ off Ratio [%] 7.2.8Data Call Access Failure Ratio [%] 7.2.9Data Call Access Time [s] DNS Host Name Resolution Failure Ratio [%] DNS Host Name Resolution Time [s]

Ouagadougou, Burkina Faso, 18 July Direct Services QoS Parameters 7.3.1File Transfer (FTP) 7.3.2Mobile Broadcast 7.3.3Ping 7.3.4Push to Talk over Cellular (PoC) 7.3.5Streaming Video 7.3.6Telephony 7.3.7Video Telephony 7.3.8Web Browsing (HTTP) 7.3.9Web Radio WLAN service provisioning with HTTP based authentication Wireless Application Protocol (WAP) IMS Multimedia Telephony Group Call

Ouagadougou, Burkina Faso, 18 July Store ‑ and ‑ forward (S&F) Services QoS Parameters 7.4.1Generic Store ‑ and ‑ forward Parameters 7.4.2E ‑ mail 7.4.3Multimedia Messaging Service (MMS) 7.4.4Short Message Service (SMS) Short Data Service (SDS)

Ouagadougou, Burkina Faso, 18 July Typical procedures for Quality of Service measurement equipment 8.1Aim of measurement 8.2Classification of services 8.3General aspects for all types of services 8.4Telephony measurements 8.5Store-and-forward services measurement 8.6Data measurements

Ouagadougou, Burkina Faso, 18 July Telephony measurements 8.4.1General aspects 8.4.2Speech telephony 8.4.4Group Call 8.4.3Video telephony

Ouagadougou, Burkina Faso, 18 July Store-and-forward services measurement 8.5.1General aspects 8.5.2SMS measurements 8.5.3MMS SDS

Ouagadougou, Burkina Faso, 18 July Data measurements 8.6.1Common aspects 8.6.2FTP 8.6.3HTTP WAP 8.6.6Streaming Video 8.6.7Media Download

Ouagadougou, Burkina Faso, 18 July Requirements for Quality of Service measurement equipment 9.1Overview 9.2General requirements 9.3Fixed QoS Test-equipment (FQT) 9.5Mobile based measurement equipment 9.4Mobile QoS Test-equipment (MQT)

Ouagadougou, Burkina Faso, 18 July Definition of typical measurement profiles 10.1Measurement profiles Usage Profiles for Data Sessions Classification of measurement environments Service profiles

Ouagadougou, Burkina Faso, 18 July Post processing and statistical methods 11.1Important measurement data types in mobile communications 11.2Distributions and moments 11.3Visualization techniques 11.4Time series modelling 11.5Data aggregation 11.6Assessment of performance indices

Ouagadougou, Burkina Faso, 18 July Network based QoS measurements 12.1Network Measurement Basics 12.2Measuring QoS Parameters in the Network 12.3Comparing Network and End- point Test Measurements

Ouagadougou, Burkina Faso, 18 July Appendices (informative) IExamples for measuring trigger points IIStreaming explanations IIIPush to Talk over Cellular Information IVQoS parameter export VWhich parameters have an impact on the effect of blocking ? VIReference {SMS | SDS} VIIContent integrity checking VIIITransfer times versus used data rate and content size IXExamples of statistical calculations XThe concept of QoE reporting XIExamples of Network Based QoS Measurements XII3GPP SA5 "UE Management"

Ouagadougou, Burkina Faso, 18 July Confidence Intervalls for Different Sample Sizes (1) The following examples show the effect of different sample sizes in a measurement campaign. It is also based on the Pearson- Clopper formulas for the calculation of confidence intervals. Therefore, the examples are valid in a generic way and even for small sample sizes. For higher sample numbers, the calculation of confidence intervals based on the approximation of a normal distribution can be applied. Three different graphs are depicted: Sample sizes in the range: between 100 and samples; between and samples; and between and samples.

Ouagadougou, Burkina Faso, 18 July Confidence Intervalls for Different Sample Sizes (2)

Ouagadougou, Burkina Faso, 18 July Confidence Intervalls for Different Sample Sizes (3)

Ouagadougou, Burkina Faso, 18 July Confidence Intervalls for Different Sample Sizes (4)

Ouagadougou, Burkina Faso, 18 July Schedule for draft new Rec. E.MQoS 31 August 2013 Final timeline for submitting comments directly to the editors 7 November 2013 Submission as Contribution to SG November 2013 Deadline for Contributions submitted to TSB 12 December 2013 Planned Consent of SG12 Plenary January 2014 Start of Alternate Approval Procedure (AAP) March 2014 Pre-Publication ??? 2014 Publication

Ouagadougou, Burkina Faso, 18 July Any questions ? Joachim Pomy Telecommunications & Int'l Standards Germany Tel.: