Summary of Results Study Period ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Mr Pierre-André Probst Chairman, SG 16

International Telecommunication Union 2 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Contents Terms of reference Highlights of achievements Future work Conclusions Supplemental slides

International Telecommunication Union 3 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Terms of Reference Studies related to Multimedia (MM) service and application capabilities (including those supported by NGN). This encompasses MM terminals, systems, protocols and signal processing. Lead SG for: – MM terminals, systems and applications – Ubiquitous applications (e-everything)

International Telecommunication Union 4 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (I) Introduction Major changes in the Telecom industry during the Study Period that impacted SG16 activities: NGN: development of standards for the transition and deployment of NGN (including fix-mobile convergence). IPTV: network-agnostic standards for IPTV-Terminals and middleware RFID: tag-based ID triggered MM information access system USN: broad range of potential applications, need to standardize an information service infrastructure. ITS: In-vehicle network is becoming a key element for various applications (safety, maintenance, navigation, mobile office, etc), a standardized gateway platform should be developed. ICT and climate changes: SG16 can provide solutions for monitoring climate parameters (USN) and contribute directly/indirectly to reduce GHG production. Accessibility: increased interest and commitments of the telecommunication community to include the need of this category of users from the beginning in telecommunication systems

International Telecommunication Union 5 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (II) Modems, facsimile and equipment transmission(1/2): Support of modems connections over IP-based networks: new Recs V.151 and V.152 and maintenance of Recs of the V.150 series – V.151 (text telephony over IP network utilizing text relay) – V.152 (support of voice-band data over IP networks) Facsimile terminals standards: revision of existing Recs of the T.30 and T.40 series – T.30 and T.44 (Colour presentation) – T.38 (G3 fax over IP networks) Circuit multiplication equipment and systems: – Maintenance of DCME equipment Recs (G.767) – New Rec I.733 (Voice on ATM Multiplication Equipment) almost completed

International Telecommunication Union 6 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (III) Modems, facsimile and equipment transmission(2/2) Signal processing in network equipment: – Speech enhancement: two new Recs G.160 (Voice enhancement Devices) and G.168 (Digital network echo cancellers) Voice Gateway Equipment: – New Rec G.IP2IP (functionality and performance of an IP to IP voice gateway optimized for voice and voice band data) almost completed Interactions of signal processing network equipment (SPNE): – New Recs Q (Logic for control of voice enhancement devices) and G (SPNE mechanisms/auxiliary functions) – New Rec G.MDCSPNE (dynamic coordination of SPNE) under development, including its applications to mobile terminals (Collaboration with FG CarCom/SG12)

International Telecommunication Union 7 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (IV) MM Systems and terminals (1/4): New MM Services and Applications – New Recs of the F-Series on video telephony over IP (F.724), MM conferencing over IP (F.733), Audio-visual on demand (F.741), distance learning (F.742) and MM information access triggered by tag based ID (F.771) Real-time conversational MM system: – Extension and maintenance of the H.32x series of Recs, in particular for mobile (H.324) and IP networks (H.323) – Extensive work for accelerating call setup in H.324 (Annex K to H.324) – After preliminary consideration on the future requirements of a next generation Advanced MM System (AMS), the work has been formally started in July 2007 (New Question 12/16)

International Telecommunication Union 8 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (V) MM Systems and terminals (2/4): Media Gateway – Development of Version 3 of H (July 2005) – Development and approval of 49 new packages (coordination with other SDOs in specific cases) – Release 11 of Supplement 2 (H.248.x sub-series packages guide) H.323 NAT/Firewall traversal solutions: – New Recs for signalling traversal ( and H ) and media traversal (H ) – Documentation of problems, solutions, requirements in H.Sup.10 and Technical papers TP.FNTP/TP.NFT Security of H.245 based audiovisual communication system: – Enhancement of the H.235 security suite (additional functionalities)

International Telecommunication Union 9 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (VI) MM Systems and terminals (3/4): MM applications platforms and end systems for IPTV: – Work started in July 2007 under a new Question (Q13/16) based on the outcome of the IPTV Focus Group – SG16 roadmap includes the following series of Recs: H.700: General Aspects H.720*: Terminal Devices Consented! H.730: Middleware H.740: Application Event Handling H.750*: Metadata Consented! H.760: MM Applications Frameworks H.622.1*: Architecture and functional requirements for home network supporting IPTV services Consented! – First three new Recs started AAP in Oct 2008 (with *, above): – This work is closely related to WP3 for media coding related aspects and coordinated with SG9 and SG13.

International Telecommunication Union 10 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (VII) MM Systems and terminals (4/4): Home Networking: – New Rec H.622 on generic home network architecture (Jun 2008) – IPTV aspects in H (see previous slide!) MM Mobility: – Close cooperation with SG19 and SG13 on NGN FMC – Publication of technical papers TP.H.510-Mobile : Use of H.510 for the support of H.323 based MM Services within GPRS/IMT 2000 networks TP.MMSM: Service Mobility for new MM Service Architecture E-Health: – Development of a MM framework for e-health (TP.RTM) – Together with the key players under the umbrella of the e-health standardization coordination group (eHSCG), preparation of a roadmap (see

International Telecommunication Union 11 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (VIII) Media coding (1/4) Audio/Speech coding: General trends toward higher bandwidth, backward compatibility, improved quality and greater flexibility. New coders for wider bandwidth: – G Annex C: superwideband coder ( Hz) – G.719: fullband audio coder ( Hz) Scalable extensions to G.711 and G.729: G and G – Embedded wideband extensions – Bitstream interoperability with G.711 and G.729 respectively (two widely deployed ITU-T narrowband coders) Embedded extension G.718 for 3G (IMT-200) and 4G (e.g. Wimax) networks (robustness to frame erasures!) – Bitstream interoperability with G at kbit/s

International Telecommunication Union 12 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (IX) Media coding (2/4) Audio/Speech coding: Support of new applications with existing codecs: – G.722: new Appendices for the support of next generation of DECT systems (development of packet loss concealment mechanisms) – G.729: new Appendices to optimize G.729 Annex B VAD in VOIP applications Generic Voice Activity Detector (GSAD): – Numerous algorithms and solutions for VAD (Voice Activity Detection) are in operation today. – There is a need to extend VAD to rich audio signals and to provide common performance enhancement. – Work has started under a new Question (Q8/16). Software tools Library (G.191): – Extension to cover wider bandwidth and higher sampling frequencies – Important Rec used also by 3GPP, 3GPP2, MPEG

International Telecommunication Union 13 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (X) Media coding (3/4) Video & image coding: Enhancement to H.264 (JVT= Q6/16+MPEG): – New application profiles – Scalable video coding (allows a reduction of the bit-rates after encoding) High Profile of H.264: Efforts recognized with 2008 Primetime Emmy Award granted to ITU, ISO and IEC H.264 reference implementation and test vectors (H.264.1, H.264.2) First considerations on a possible next generation of video codec (H.265) Still image coding: new version of T.81 (JPEG-1) using alternative arithmetic coder

International Telecommunication Union 14 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (XI) Media coding (4/4) Character coding: Approval of T.55: use of ISO/IEC for non-Latin character (e.g. IDNs) IPTV: Review and further development of the media coding toolbox Media coding database Summary of characteristics for all media coding developed by ITU and other SDOs

International Telecommunication Union 15 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (XII) Lead SG Activities: Multimedia (1/2) ETS/TDR: in this area, leveraging the efforts from the last Study Period, SG16 has continued to support the organization of workshops and to develop MM capabilities for TDR applications E-Health: the work has been concentrated on the development of a Technical Paper and a roadmap together with key players in that area. It is expected that new technologies (e.g. RFID) and ongoing projects, will increase the need in future for global and interoperable standards as well as for information on best practices. Accessibility: high priority and visibility has been given to this work during the Study Period. Tools were developed to include accessibility requirements – from the beginning – in the development of MM systems and terminals, in particular in NGN, IPTV.

International Telecommunication Union 16 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Highlights of achievements (XIII) Lead SG Activities: Multimedia (2/2) Developing Countries: – SG16 took several initiatives to improve the involvement of experts from developing countries in the development of MM standards (e.g. action plan, Correspondence Group, ad hoc meetings,…) – These efforts should be continued during the next Study Period, with a special focus on the use and applications of SG16 Recommendations. E-Business/E-commerce: – This theme has been indirectly addressed through all Recs which support E-B/E-C, in particular on remote collaboration, Home Networking and tag based MM information retrieval.

International Telecommunication Union 17 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Future Work (I) Future Directions: – Enhancement and maintenance of existing Recs to ensure smooth and backward compatible evolution of telecommunication equipment and services – Infrastructure-agnostic architectures as enabler of the Internet of Things – Audio and Video coding: next generation of video coding, innovative audio coding approaches – Advanced MM System for NGN and beyond – Ubiquitous sensor networks – Impact of ICT on climate changes – Intelligent Transportation Systems: work on vehicle gateway platform and on a dynamic coordination mechanism for signal processing devices to ensure high quality end-to end voice and voiceband signals.

International Telecommunication Union 18 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Future Work (II) Coordination – Improve coordination with other key players in light of the convergence fix-mobile-broadcast Participation – Developing countries: create the conditions and provide the necessary support to involve experts from the beginning in the development of standards – Universities/Academia: promote SG16 work in the academic community and support the TSB initiative to facilitate participation from experts to the work of ITU-T in general and of SG16 in particular – Electronic meeting facilities: promotion of the use of such tools to reduce travelling cost and contribute to the reduction of GHG

International Telecommunication Union 19 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Conclusion Many new technology developments happening in SG 16 Response to trends and market needs – Increase in contributions and participation indicate interest of members in this field of work Opportunities for contribution from developing countries as new system and technology standards are defined SG 16 has been a pragmatic, efficient, high- productivity study group over its 12-years of existence – Proposed set of Questions reflects that philosophy

International Telecommunication Union 20 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Acknowledgements To SG16 customers ! To the management team of the SG To the Rapporteurs, editors and contributors To the TSB secretariat To the TSB Director

International Telecommunication Union 21 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Supplemental Slides Management team Structure Statistics List of workshops

International Telecommunication Union 22 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Management Team Chair:Pierre-André PROBSTCH Vice-Chairs:Paul BARRETTUK Ms. Claude LAMBLINF Yushi NAITOJ Istvan SEBESTYEN (until Nov. 2006)D WP Chairs:Yushi NAITO (WP1)J Istvan SEBESTYEN (WP2) (until Nov. 2006)D Sakae OKUBO (WP2)J Paul BARRETT (WP3)UK Ms. Claude LAMBLIN (WP3)F TSBSimão Ferraz de CAMPOS NETO

International Telecommunication Union 23 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Study Group Structure WP1 – Modems, fax and equipment transmission WP2 – MM systems and terminals WP3 - Media coding Areas directly under SG16 Plenary: – Mediacom: areas of general interests to SG16 and high level coordination in and outside ITU-T [Q20/16] – Accessibility to MM Systems and Services [Q26/16]

International Telecommunication Union 24 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Statistics (I) 138 Rapporteurs meetings held 823 Contributions received (without Rapporteurs meetings) Six SG meetings and six WP meetings held SG participants : – Max: 242 – Min: 126 – Average: 184

International Telecommunication Union 25 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Statistics (II) 219 new & revised Recommendations approved 24 Questions assigned by WTSA-2004 One revised and three new Questions during study period (Q6/16, Q8/16, Q12/16 and Q13/16) 23 Questions proposed for the next study period

International Telecommunication Union 26 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Workshops (I) "New ITU-T Audio and Speech Coding Standards" - Special Session in EUSIPCO-2008, Lausanne, Switzerland, August 2008 Joint ITU and G3ict Forum 2008 on "The Convention on the Rights of Persons with Disabilities: Challenges and Opportunities for ICT Standards", Geneva, Switzerland, 21 April 2008 The Fully Networked Car – A Workshop including Demonstrations on Information and Communication Technologies in Motor Vehicles, Geneva, Switzerland, 5–7 March 2008 Making Accessibility a Reality in Emerging Technologies and the Web, Rio de Janeiro, Brazil, 13 November 2007 Workshop on Multimedia in NGN, Geneva, September 2007

International Telecommunication Union 27 ITU-T Study Group 16 Multimedia Terminals, Systems and Applications Workshops (II) Joint ITU-T/ OASIS Workshop and Demonstration of Advances in ICT Standards for Public Warning, Geneva, October 2006 Workshop on "End-to-End QoE/QoS", Geneva, June 2006 Joint ITU-T Workshop and IMTC Forum 2006 on "H.323, SIP: is H.325 next?", San Diego, California, USA, 9-11 May 2006 ITU and UNESCO Global Symposium on Promoting the Multilingual Internet, Geneva, 9-11 May 2006 Opportunities and Challenges in Home Networking, Geneva, October 2005 Workshop on "Video and Image Coding and Applications" (VICA), Geneva, July 2005