Video Processing in an Open Source Environment Brian Peebles Chief Technology Officer

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 2  Extends Mobile VAS Segment Leadership  Video Algorithmic and Analytics Leadership  Extends Technology Enabling MSS Leadership −Fax Segment MSS Leadership  Converged Communications Technology Enabling Market Segment Share Leadership −Dialogic “pioneer” history, relationships and patent portfolio −Enterprise Gateway  Established SS7 / Signaling Part of Business  Established HMP as core to Dialogic customer value proposition  Deeper Service Provider Segment Products / Customers −Service Provider gateway and IP media server  Extends Technology Enabling MSS Leadership  TDM to IP Transition Leadership  Extend into Web communication and open source ISV innovators  Enabling Video IP Streaming Value Added Services “VIDEO IS THE NEW VOICE” ™ Dialogic Evolution “VIDEO IS THE NEW VOICE”™

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 3 Video-Enablement of Traditional VAS Services Video Enabled LBS Video Mail IVVR Video SMS Video Conferencing VRT Location Based Service Voice Mail IVR SMS Conferencing CRBT

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 4 Dialogic has an extensive history in Video  Already many 10s of thousands of ports of video applications built on Dialogic  First system shipped in early 2005  Currently there are dozens of active deployments of Dialogic Video Solutions involving –Video Telephony, –Video Enhanced Services –Mobile Video. –all Geos – NAR, APAC, CALA, EMEA, BRIC  We are now setting the pace for advanced techniques

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 5 Case Study – Video Chat – Description  Australia New Market – 3G Video Premium Rate for the largest provider of both local and long distance telephone services, mobile services, dialup, wireless, DSL and cable internet access in Australia.  Service and Development provided by a local Dialogic Partner as a Video Hosting Bureau (ASP)  Overview  Live Operator Chat & Video Portal  3G to SIP Softphone (High Quality) (and 3G)  H.264/MPEG4 & AMR  Billing - Premium Rate & Credit Card  SMS Subscription Notification

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 6 Dialogic MMA Case Study – Video Chat - Architecture Customer Platform 3G Video Handset Media 2/2.5 G Mobile TDM App Server VoiceXML TSL SS7 & IN CAMEL/IN AP IP SCP Streaming Server IP SoftPhone Web/IP IP VideoPhone ISDN/CAS ISUP RTSP Landline Phone GSM Handset IP Handset Speech/T TS MRCP Speech Business Systems XML/SOAP Web Services Lawful Interception Transaction Recording ETSI ES IP/SEC VOIP Media Server Video Chat Platform Dialogic Media Engine 3G Video Gateway Dialogic DNI Dialogic Media Engine 3G Mobile 3G- H.324M

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 7 Note on Video Clips  Due to Codec and Copyright limitations, the video clips used during the live presentation at ClueCon have NOT been included in this posted version.  Please contact for more

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 8 Innovation At Work  Video Telephony –Interactive Video ResponseInteractive Video Response –Video Security –On Line Banking  Video IP Streaming –Lets go to the mobile device 7-9 months development cycle On Line Banking Video Security

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 9 “Love Meter”  Application: Real-time voice analysis for mobile users –Detects range of emotions during session –Updates caller with current “love level” –Premium features: recording function –Final session analysis by SMS/MMS or Web  Developer & Host: EGTEK/Maxis  Platform: –EGTEK 3G Video Solution Suite –Based on Dialogic ® HMP Software

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 10 Video Challenges  Handset Compatibility and Interoperability  Maintaining Quality –Video Compression Techniques –Capture/Transcode Quality –Rate Control  Video Analytics for Advertising and Security –Pattern Matching Logo Detection –Image Analysis Digital Watermarking Video Forensics

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 11 Why do we need Video Compression?  Standard Definition (SD) Video: 30 frames/second (fps) requires: 720 x 480 pixels 30 frames 3 colors 8 bits x x x = ~250 Megabits/sec (Mbps) frame sec pixel color  H.264 is leading default with similar quality at half the bit rate of H.263 or MPEG-2 Typical video delivery pipesCompression Factor Required Dialup Modem: 48 Kbps ~5000 ISDN: 128 Kbps: ~1900 T1: 1.5 Mbps: ~160 T3: 45 Mbps: ~5

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 12 H.264 Codec Optimization: Subjective Comparison Quality degradation throughout the video frame Noise and artifacts impair video frame quality

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 13 H.264 Codec Optimization: Subjective Comparison Stefan, CIF 30fps

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 14 Advanced Algorithms: Bit Rate Control  To be incorporated in Dialogic ® Host Media Processing Software Release 4.1  First Dialogic ® product release using Dialogic ® Media Labs technology

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 15 Bit Rate Control

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 16 Advanced Algorithms: Error concealment Artifacts are concealed using motion vector estimation techniques

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 17 Advanced Algorithms: Perceptual Quantization OriginalPerceptual Quantization Normal Quantization

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 18 Measuring / Monitoring Video Quality Target use case Ensuring content is “advertiser-friendly” Goal Measure quality and quantify result Compare “score” against parameters If quality is in the “good” range, then video is useful for advertisers Analyzes the video content itself Not the “protocol” Not the “network” Measurement of the user experience

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 19 Video with Good Capture Quality

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 20 Video with Bad Capture Quality

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 21 Pattern Matching and Image Analysis  Identifying objects within the stream –Advertising applications –Identifying persons of interest –Medical imaging/diagnosis –Video search applications Views = 10 Eyeball seconds = 4.09

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 22 Logo Detection / Tracking  Demonstration identifies the Dialogic logo within our corporate video  Two-step process: –Identify the logo (in different sizes, even if partially hidden) –Track the duration of time the logo is visible  Highlight the logo when it is recognized…  … and keep track of number/duration of appearance  In some cases (quick appearance, hidden) we will not recognize/track the logo (not a useful appearance for advertising)

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 23 Dialogic Corporate Video Logo Tracking Demo

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 24 Digital Watermarking  Most obvious application is to reduce piracy  Also has applications in the enterprise space –Ensuring authenticity of video delivery to your customers –Tracking receipt of sensitive material to the intended audience  Additional consumer applications –Tracking what videos are being watched by a consumer –Useful for rating services (what people have watched) –Ad insertion/tracking (what advertising did people see?)

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 25 Top: Forgery picture Bottom: Two original pictures Los Angeles Times on March 31, 2003 Video Forensics: Is seeing believing?

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 26 Project DiaStar™

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 27 DiaStar Messaging  Solution for the high-end of the open source Market –Creates a Client/Server Architecture that allows Asterisk/FreeSWITCH/Other developers to continue to work in their native environment but still get access to the feature set provided by Dialogic. –Companies that are using open source but are not happy with the scalability, redundancy and reliability or those that would try open source except for concerns about those same issues. –Companies are using or would use open source except for missing features that we can provide via DiaStar First Available Feature: Dialogic Perfect Call Progress Analysis and Answering Machine Detection Next Feature: Video Support

Company Confidential © Copyright 2008 Dialogic Corporation. All rights reserved. Slide 28 Dialogic, Dialogic Pro, Brooktrout, Diva, Cantata, SnowShore, Eicon, Eicon Networks, NMS Communications, NMS (stylized), Eiconcard, SIPcontrol, Diva ISDN, TruFax, Exnet, EXS, SwitchKit, N20, Making Innovation Thrive, Connecting to Growth, Video is the New Voice, Fusion, Vision, PacketMedia, NaturalAccess, NaturalCallControl, NaturalConference, NaturalFax and Shiva, among others as well as related logos, are either registered trademarks or trademarks of Dialogic Corporation or its subsidiaries (“Dialogic”). The names of actual companies and products mentioned herein are the trademarks of their respective owners. Dialogic encourages all users of its products to procure all necessary intellectual property licenses required to implement their concepts or applications, which licenses may vary from country to country. Dialogic may make changes to specifications, product descriptions, and plans at any time, without notice. USE CASE(S) Any use case(s) shown and/or described herein represent one or more examples of the various ways, scenarios or environments in which Dialogic products can be used. Such use case(s) are non-limiting and do not represent recommendations of Dialogic as to whether or how to use Dialogic products. 2/09