Presentation on theme: "ITU-T Study Group 12: Structures and Guide for University Participants Sebastian Möller (with the support from Jean-Yves Monfort, ITU-T SG12 Chairman)"— Presentation transcript:
ITU-T Study Group 12: Structures and Guide for University Participants Sebastian Möller (with the support from Jean-Yves Monfort, ITU-T SG12 Chairman) Quality and Usability Lab, Deutsche Telekom Laboratories TU Berlin, Germany
1 Overview Structure of ITU-T Study Group 12 – General structure of the ITU-T – Study Group 12 – Documents, etc. Quality assessment and prediction for voice services
2 General Secretariat: Coordinates the Union's activities and the overall management of the Union ITU-T: Telecommunication standardization on a world-wide basis on technical, operating and tariff Questions ITU-R: Radio communications and wireless ITU-D: Use and deployment of telecom networks and services in the developing nations Plenipotentiary Conference ITU Council ITU-T World Telecommunication Standardization Assembly ITU-R World Radiocommunication Conference ITU-D World Telecommunication Development Conference General Secretariat Structure of ITU-T Study Group 12 General structure of the ITU-T.
3 STUDY GROUP XX Structure of ITU-T Study Group 12 Structure of ITU-T Study Groups and Working Parties.
4 Workshops / Seminars: Cover the most important topics in modern telecommunication technology and applications. Speakers are renowned telecommunication experts. Usually free of charge and open to public. To come : From Speech to Audio: Bandwidth Extension, Binaural Perception, see Focus Groups: Participation of non-member experts welcome. Work on a well-defined topic and time-schedule for completion. e.g. : IPTV Focus Group in which SG12 is involved Under SG12 : Focus Group From/In/ToCarCommunication, see Joint Coordination Groups: Coordinate a broad study by more than one study group. They do not perform technical studies nor write Recommendations. Structure of ITU-T Study Group 12 Structure of ITU-T Study Groups and Working Parties.
5 Responsible for Recommendations on the end-to-end transmission performance of terminals and networks, in relation to the perceived quality and acceptance by users of text, data, speech, and multi-media applications. Although this work includes the related transmission implications of all networks and all telecommunication terminals, a special focus is given to IP QoS, interoperability and implications for NGN, and also includes work on performance and resource management. Structure of ITU-T Study Group 12 Study Group 12 mandate.
6 Bridging the gap for developping countries Mr J.J. Massima-Landji, VC SG 12 – Performance and QoS ChairmanMr Jean-Yves Monfort Telephonometry, terminals and subjective assessment Co-Chairs : C. Quinquis, G. Lecucq Performance, planning and tools Mr Klemens Adler, SG 12 Vice Chair WP 1 WP 2 WP 3 IP-related QoS and resource management M. Paul Coverdale, SG 12 Vice Chair QoS Coordination Mr C. Dvorak, VC TSB Support Mrs J. Katona Kiss, Councellor Mrs S. Scott, Secretary Structure of ITU-T Study Group 12 Management team and structure.
7 SG 12 – Questions 1/12 and 15/12 Q.1/12 Q.15/12 QoS and performance coordination Mr C. Dvorak QoS and performance coordination Mr C. Dvorak Workprogram, definitions, handbooks, guides, tutorials, Bridging the Standardization Gaps Mr JY Monfort, Mr J. Pomy, Mr J.J. Massima-Landji Structure of ITU-T Study Group 12 SG12 structure and questions.
8 WP /12 – Telephonometry, terminals and Subjective assessment Co Acting ChairsC. Quinquis, G. Lecucq Q.4/12 Q.5/12 Hands-free communications in vehicles Mr H.W. Gierlich, Mr M. Rung Telephonometrics methodologies for handsets and headset terminals Mr L. Madec Q.7/12 Methods, tools and test plans for the subjective assessment… Mr P. Usai and Mrs C. Quinquis Q.3/12 Analysis methods using complex measurement signals…. Mr H.W. Gierlich Q.6/12 Speech transmission characteristics of speech terminals … Mr Shi Denian Structure of ITU-T Study Group 12 SG12 structure and questions.
9 WP 2/12 – Performance, Planning and Tools ChairmanMr Klemens Adler Q.9/12 Q.10/12 Perceptual-based objective methods for voice, audio and visual quality… Mr J. Berger Transmission planning and performance considerations… Mr V. Sypli Q.20/12 Objective assessment of conversational speech quality in networks Mr J. Pomy Objective assessment of conversational speech quality in networks Mr J. Pomy Q.8/12 In-service non intrusive assessment of voice transmission performance Mr V. Barriac Q.14/12 Extension of the E-model Mrs U. Jekosch and Mr S. Möller Q.12/12 Performance evaluation of services based on speech technology Mr S.Möller&MrA. Raake Structure of ITU-T Study Group 12 SG12 structure and questions.
10 WP 3/12 – IP-Related QoS andRessource management Chairman Mr Paul Coverdale (also involved in Questions* 13/12 and 19/12) Q.13/12 Q.16/12 IP based multimedia services end to end transm. planning …. M. J. Pomy IPTV and multimedia QoE/QoS performance requ. and assessment methods A. Takahashi IPTV and multimedia QoE/QoS performance requ. and assessment methods A. Takahashi Q.19/12 Performance of IP-based networks Mr A. Morton and Mr H. Kim Speech transmission charact. & meas. methods for IP terminals and gateways Mr U. Brunner Q.11/12 Broadband and IP-related resource management Mr D. Mustill Q.17/12 Call processing performance Q.2/12 Structure of ITU-T Study Group 12 SG12 structure and questions.
11 SG 12 Liaison Officers IEEE QSDG Electroacoustics Mr L. Madec, Mr H.Gerlich Electroacoustics Mr A. Woo Others Communication Mr C. Dvorak, EWM Mr J. Pomy, Bridging the standardization Gaps Mr J.J. Massima-Landji Joint Rapporteur Group "Multimedia quality assessment" Mr P. Juric IEC 29 QoS Development Group Mr D. Mustill TSAG Security, OAM, ICG-SAT Mr JY Monfort, FGNGN Mr C.Dvorak, FGNGN Mr P. Coverdale ITU-D Mr J.J. Massima Security, OAM, ICG-SAT Mr JY Monfort, FGNGN Mr C.Dvorak, FGNGN Mr P. Coverdale ITU-D Mr J.J. Massima JRG MMQA Flagship Group QoS Mr D. Waturu Structure of ITU-T Study Group 12 SG12 structure and questions.
12 Questions: Set up by the WTSA or by the Study Group. Define a particular subject to be studied. Rapporteurs: Appointed by the SG or a WP to each Question. Ensure progress of the group of experts towards Recommendations. Lead, moderate debates ( s, conf. Calls, etc.) and coordinate progress. Chair the meetings of the experts (Rapporteurs Group Meetings). Editors: Appointed by Rapporteurs, prepare and follow-up draft Recommendations. Structure of ITU-T Study Group 12 Questions, Rapporteurs and Editors.
13 Alternative Approval Process (AAP): For technical Recommendations Once the text is considered to be mature, it is submitted for AAP at an SG or WP meeting (Rec. A.8) Traditional Approval Process (TAP): For Recommendations subject to policy or regulatory implications Initiated at an SG or WP meeting and completed, for final approval, at the subsequent SG meeting (Res. 1) Structure of ITU-T Study Group 12 Approval of Recommendations.
14 TG (b) (c) 911 (a) (b) (a) (b) SG or WP meeting (1) Edited text for LC (2) Director's announcement and posting for LC (3) Edited text for AR (8) Director's announcement and posting for AR (10) Director's announcement and posting (5) SG Meeting (6) Director's notification and publication (see Rec. A.11) (12) 3 weeks LC: Last Call AR: Additional Review Approved Comment resolution AR 3 weeks LC 4 weeks (7) See Figure 1 (Rec. A.8) Structure of ITU-T Study Group 12 AAP Sequence.
15 Contributions (C): To be submitted at least 10 calendar days before the meeting. Reports (R): Official records of SG or WP meetings. To be available shortly after the closure of the meetings (Rec. A.1). Temporary Documents (TDs): Submitted by an ‘official’ (a member of the SG Management Team, Rapporteur, Editor, etc.) within the meeting participants. Working Documents (WDs): Issued during meetings by small groups. Structure of ITU-T Study Group 12 Meeting documentation.
Visit for more information.www.itu.int/ITU-T/studygroups/com12/index.asp Structure of ITU-T Study Group 12 Further information.
17 Overview Structure of ITU-T Study Group 12 Quality assessment and prediction for voice services – Quality assessment and prediction – Taxonomy of prediction models – E-model for NB and WB networks
18 Our focus: Methods for assessing narrow-band and wideband speech, but also video quality Quality Assessment and Prediction Voice services. Model Estimated Quality Index System Parameters Linguist. Backgr. Attitude Emotions Experi- ence Motivation, Goals User Factors Subjective Quality Judgment Transmission System
19 Quality: Result of judgment of the perceived composition of an entity with respect to its desired composition. (Jekosch, 2005) Quality of Service (Rec. E.800) Quality of Experience Quality Assessment and Prediction Quality aspects of transmitted speech. Quality of Service Service Factors Contextual Factors Speech Communication Factors Voice Transmission Quality Ease of Communication Conversation Effectiveness Communication Efficiency Economical Benefit Service Efficiency Usability Utility Acceptability User Satisfaction User Factors Quality of Experience (Möller, 2000)
20 Input information: Signals − one or two signals − acoustic or electric Parameters Protocol information Measurement of input information: Online Offline Estimation Quality Assessment and Prediction Taxonomy of prediction models. Output information: Listening-only − integral quality − quality features Conversational Talking-only Application area: Planning Set-up and optimization Monitoring Network type: Narrow-band Wideband
21 Quality Assessment and Prediction Taxonomy of prediction models: Narrow-band case. ListeningConversation Overall Quality Feat. Overall Quality Feat. Signals1, el.P.563Psychoac. Measures CCI (P.562) 1, ac.Psychoac. Measures 2, el.P.862 P.OLQA [Heute05]P.CQO? 2, ac.P.OLQA[STI] P.OLQA? ProtocolMeas.P.VTQ? P.CQO? ParametersEstim.G.107 Meas.NIEM (P.562) Output Information Input Information
22 ListeningConversation Overall Quality Feat. Overall Quality Feat. Signals1, el.Psychoac. Measures 1, ac.Psychoac. Measures 2, el.P P.OLQA [Heute05] 2, ac.P.OLQA[STI] P.OLQA? ProtocolMeas. ParametersEstim.WB-E- Model Meas. Quality Assessment and Prediction Taxonomy of prediction models: Wideband case. Output Information Input Information
23 Quality Assessment and Prediction E-model for narrow-band networks. Backgr. noise, acoustic coupling Linear distortion, delay CodecPacket loss Jitter buffer, VAD Talker echo, listener echo Circuit noise Backgr. noise, acoustic coupling IP WAN
24 IP WAN Quality Assessment and Prediction E-model for narrow-band networks. Overall qualityR =Ro - Is- Id- Ie,eff Estimated user judgmentMOS = f (R ) ImpairmentsSNR simultaneousdelayednonlin./timevar. Ps, Ds, STMR SLR, RLR, Ta Ie, qduPplBplTELR, T, WEPL, Tr Nc, Nfor Pr, Dr, LSTR
25 Quality Assessment and Prediction E-model extension for wideband networks. (Raake, 2006; Appendix II, ITU-T Rec. G.107, 2006) Ro,max = 129
26 Quality Assessment and Prediction E-model extension for wideband networks. Ref. Operating rate kbit/s Ie,wb value G G G G G G G.729A + VAD8 47 IS GSM 06.10, FR13 56 GSM 06.60, EFR G G Ro,max = 129 (Raake, 2006; Möller et al., 2006) AMR-WB (23.05) AMR-WB (6.6)
Thanks to Jean-Yves Monfort (ITU-T SG12 Chairman) for providing the description of Study Group 12. Thank you for your attention. Visit for more information.www.qu.tlabs.tu-berlin.de