JVT-J009 Overview of Known Deployment Plans and Status for H.264/MPEG-4 pt. 10/AVC Gary J. Sullivan Document JVT-J009 of 10th JVT Meeting Waikoloa, Hawaii, December, 2003 (Contents are from public information only)
Companies Publicly Known to be Doing Preliminary Implementation Work Amphion British Telecom Broadcom (chip) Conexant (chipset for STB) Deutsche Telekom Envivio Equator FastVDO France Telecom Harmonic (filtering and motion estimation) HHI (PC & DSP encode & decode; demos) iVast LSI Logic (chip, plus Videolocus acquisition demoing real-time FPGA+P4 encode, P4 dec) Mainconcept Mcubeworks Mobile Video Imaging Modulus Video (main profile levels 3 & 4 b’cast encoders & professional-use decoders) Moonlight Cordless Motorola Nokia PixelTools PixSil Technology Polycom (videoconferencing & MCUs) Radvision (videoconferencing) Sand Video (demoed 2 Xilinx FPGA decoder, encode/decode & decode-only chips to fab in ’03) Sony (encode & decode, software & hardware, including PlayStation Portable 2004 & videoconferencing systems) ST Micro (decoder chip in ‘03) Tandberg (shipping with all videoconferencing endpoints since July ’03, GW and MCU since Oct.) Thomson TI (DSP partner with UBV for one of two UBV real-time implementations) Toshiba UB Video (demoed real-time encode and decode, software and DSP implementations) Vanguard Software Solutions (s/w, enc/dec) VideoTele.com (a division of Tut Systems) VCON CAUTION: All such information should be considered preliminary and should not be considered to be product announcements – only preliminary implementation work. It will be awhile before robust interoperable conforming implementations exist.
Product Plans Announced Amphion Semiconductor http://www.eetimes.com/story/OEG20020920S0049 Envivio http://www.envivio.com/products/h264.html Equator http://www.embeddedstar.com/press/content/2002/10/embedded5816.html FastVDO http://www.fastvdo.com/newslist.html France Telecom http://www.econf-communication.com HHI http://www.eetimes.com/sys/news/OEG20020916S0072 iVast http://www.ivast.com/company/press/2003/SandVid_NAB_033103.pdf LSI Logic http://www.lsilogic.com/products/islands/h264.html Mainconcept http://www.mainconcept.com/h264.shtml Mcubeworks http://www.mcubeworks.com/products Mobile Video Imaging http://www.digitalwebcast.com/2003/03_mar/news/dlmvi32703.htm Modulus Video http://www.modulusvideo.com/products.html Moonlight Cordless http://www.prweb.com/releases/2003/3/prweb59692.php PixelTools http://www.pixeltools.com/experth264.html PixSil Tech http://www.pixsiltech.com/products.htm Polycom http://www.polycom.com/investor_relations/0,1406,pw-2573,FF.html Radvision http://www.radvision.com Sand Video http://www.sandvideo.com/pressroom.html Sony http://www.eetimes.com/issue/mn/OEG20030801S0024 & http://news.sel.sony.com/pressrelease/3691 ST Microelectronics http://www.eetuk.com/tech/news/OEG20021113S0026 Tandberg http://tandberg.net/tb.asp?s=pagesimple&aid={8395730F-6D6F-4101-812F-B10A37412E16} UB Video http://www.eetimes.com/semi/news/OEG20021202S0048 Vanguard Software Solutions (software encode & decode) http://www.vsofts.com/codec/h264.html VCON http://www.vcon.com/press_room/english/2003/03031102.shtml
Support Technology (Filtering, Motion Estimation, Stat Mux, etc.) Harmonic http://www.harmonicinc.com/ah_press_release_text.cfm?ID=453 http://www.harmonicinc.com/stageone/files/harmonic/collateral/H264_WP_0902_s.pdf Moonlight http://www.moonlight.co.il/technology_h264.htm
Videoconferencing Systems
Polycom Product Highlights http://www.polycom.com The world’s biggest videoconferencing company (whether counting units or revenue) VSX™ 7000 “entry-level” set-top videoconferencing system announced October 10, 2003 iPower™ 9000, 9400 and 9800 group videoconferencing systems shipping some form of H.264/AVC since Q103 MGC™ multipoint conferencing unit “bridge” support Encoder operates up to 30 fps SIF / 25 fps CIF Planned availability as an option on the ViewStation® EX, ViewStation FX and VS4000™ models in early 2004. Profile in all of these products: Baseline profile Shipping products not yet interoperating with Tandberg
Tandberg Product Highlights http://www.tandberg.no World’s second biggest videoconferencing company Entire product line (videoconferencing endpoints, MCUs, and gateways) supports H.264/AVC Videoconferencing endpoints have supported it since July 2003 Models 6000, 7000, 8000 group-use systems Models 880 & 2500 medium-size systems Models 550 & 1000 for small rooms & offices Up to 30 fps CIF (level 1.3 with some H.241 enhancements) MCU and gateway support since Oct 2003 Shipping products not yet interoperating with Polycom, although reportedly interoperating with some other pre-release products
Sony Videoconferencing Product Highlight http://www.sony.com/videoconference PCS-1 Series videoconferencing product announcement June 2003 at Infocomm, with plan for future support of H.264/AVC announced
France Telecom Product Highlight http://www.francetelecom.com France Telecom is developing new videotelephony / videoconferencing over IP services: Platform aspects integrating third-party components (MCU, Gatekeeper, etc…) Full software SIP/H.323 (3G-324M soon) end point: eConf Baseline profile, Levels up to 2 (CIF 30 fps) for mid 2004 Supported platforms: Microsoft OSes (98, Me, 2000, XP, CE) Other software and hardware platforms supported soon: Symbian OS, Linux, Mac OSX. For Enterprise and Mass Market services
Radvision Product Highlights http://www.radvision.com viaIP MCU 3.2 videoconferencing “bridge” product announced October 13, 2003 Plans for support across the videoconferencing product line
Consumer Electronics
Sony CE Product Highlights http://www.sony.com Playstation Portable (PSP) announcement at Electronic Entertainment Exposition in Las Vegas July 2003 PSP to have an LCD about 4.5 inches wide, with 480x272 resolution Incorporates single-chip 90-nm process custom silicon Decode only World-wide availability planned for Q404
Custom Silicon & FPGA Prototypes
LSI Logic Product Highlights http://www.lsilogic.com Technology platform product announced with Sept 2003 availability for small-scale deployments VLE4000 Encoder VLD4000 Decoder VSA2000 Stream Analyzer Demonstrated at IBC 2003, Amsterdam, Sept. 2003 SDTV resolution & frame rate
Sand Video Product Highlights http://www.sandvideo.com New company based in Andover Massachusetts Advantage264™ chip family SV-C011 codec chip SV-D011 decoder chip Commercial sample availability Q104 September 2003 demonstrations at IBC Amsterdam: MPEG-2-to-H.264/AVC transcoding SVP-IP01 Real-time 720p&1080i HD H.264/AVC Main Profile decoding hardware licensable core design currently on FPGA Focus especially on PVR functionality deployment
ST Microelectronics Product Highlights http://www.st.com In-Stat/MDR: “For the fourth year in a row ST Microelectronics was the largest supplier of MPEG ICs, based on revenue, with 31%.” (“while ESS Technology leads in units.”) To ship H.264 in future Nomadik implementations (press release October 2003)
Pixsil Technology Product Highlights http://www.pixsiltech.com Small company based in Newport Beach and San Diego System-on-chip hardware core designs Current focus on hand-held applications Future plans for additional applications
PC & DSP Software Solutions
Envivio Product Highlights Stated product offerings as of 10/31/03 http://www.envivio.com PC-based 4Coder™ encoder (CIF resolution real-time, higher resolution offline) PC-based EnvivioTV™ player Hardware encoder (up to SDTV BT.601 resolution real-time) Hardware MPEG-2 to H.264/AVC transcode Hardware decoder
Heinrich-Hertz-Institut fuer Nachrichtentechnik Berlin GmbH (HHI) Product Highlights http://www.hhi.de P4-based software decode SDTV (BT.601) resolution Real-time by end of 2003 Plan for ARM-based ASIC implementation – architecture to be finished by end of 2003 One version for mobile applications Another for set-top boxes
UB Video Product Highlights http://www.ubvideo.com UBLive-264-BP: "C" Source Code for Baseline Encode/Decode, for R&D and/or non-C64x-Based applications. UBLive-264-MP: "C" Source Code for Main Encode/Decode, for R&D and/or non-C64x-Based applications. UBLive-264-BP-C64: C64x- and DM642-optimized implementations of Baseline H.264 Encode/Decode, designed mainly for low-delay, real-time applications such as video conferencing, 64 kbps - 1.5 Mbps, up to 30 fps, progressive and interlace, up to VGA resolution. UBLive-264-MP-C64-Decode: C64x- and DM642-optimized implementations of Main profile Decode, designed for some Set-Top and streaming aplications, 1 Mbps - 5 Mbps, up to 30 fps, progressive and interlace, up to SDTV. Expected to support 10 Mbps in the future, likely with some hardware-assist. Also, pre-processing, post-processing, and error concealment capability
FastVDO Product Highlights http://www.fasvdo.com ANSI C++ Implementation for DSP & PC On 2.8 GHz PC, claims Encoder: 26 fps CIF Main profile, 40 fps CIF Baseline Decoder: 180 fps CIF Main, 200 fps CIF Baseline Target markets for Baseline: cell phone, PDA, videoconferencing Target markets for Main: broadcast, set-top, DVD
Moonlight Product Highlights http://www.moonlight.co.il 45-person company with R&D in Tel Aviv, IL and Tomsk, Russia SDK provider for encoder & decoder software fo PC Equator Nexperia/Trimedia Demonstration for cellular market in July, 2003 at ESEC (Embedded Systems Expo & Conference) in Tokyo: QCIF at 25 fps Demonstration for military surveillance market at Israel’s Military Technologies Show, July 2003 Demonstration at CeBit, March 2003: “industry first DirectShow encoder”: “VHS quality streams under 300 kb/s, full-frame rate” real-time SDTV (BT.601) decode
Mcubeworks Product Highlights http://www.mcubeworks.com Providing H.264 solutions for mobile video applications Commercial VOD support with PDA by SKT in Korea (2Q, 2002) Commercial VOD support with cellular phone will be provided by SKT (4Q, 2003) XEPEG Live : H.264 Real time encoding server for cellular VOD service by SK Telecom(Korea) XEPEG Broadcaster : H.264 Real time encoding server for DMB (Digital Multimedia Broadcasting) service(Korea and Japan) XEPEG Embedded : H.264 decoder for wireless VOD
Vanguard Software Solutions Product Highlights http://www.vsofts.com Primary target is Intel platform Real-time SD (level 3) encoding capability Plan to port it to different DSP platforms: Texas Instrument (C64 series), TriMedia (pnx1500 series) and Equator (BSP-15 series) and offer real-time Audio/Video encoding at D1 resolution (ITU-T CCIR-601 or VGA).
Broadcast Encoding
Modulus Video Product Highlights www.modulusvideo.com AVE-SD: SD real-time encoding: Prototype now, pilot production expected 1Q04, full production 2Q04 AVE-HD: HD encoding: Off-line now, real-time under development AVD decoder: Main profile level 3 (SD) Stream analyzer
Current Licensing Situation (Two distinct licensing authorities forming, final relationship between them is unknown, no obligation on IPR holders to join pools, comprehensiveness indemnification unlikely, “non-essential” IPR not pooled)
Via Licensing Pool Preliminary terms announced Oct 15, 2003 http://www.vialicensing.com Ten companies (Apple, Dolby, FastVDO, Fraunhofer-Gesellschaft eV / HHI, IBM, LSI Logic, Microsoft, Motorola, Polycom, and RealNetworks) announced preliminary licensing terms Oct 15, 2003 $US 15K initial fee (hardship terms for small orgs; waived for small deployments as defined below) No fees for small deployments (<50k devices & <0.5M$ revenue/yr) No royalties due for activities prior to 2005 “Encoder/Decoder” fees 25¢ per device for encoding and/or “permanent” decoding implementations (one price, even if multiple encoders and/or decoders implemented in the device); 0.25¢ for temporary dec Enterprise device fee cap: $2.5M for most products; additional $4M for PC SW also installed by OEMs “Replication” fees 2.5¢ per 90+ minute title for permanent sale of content 0.25¢ per (any length) title for temporary/pay-per-view content Replication fees are not capped
MPEG-LA Licensing Pool Preliminary terms announced Nov. 17, 2003 http://www.mpegla.com 17 Companies (Columbia University, ETRI, France Télécom, Fujitsu, LG Electronics, Matsushita, Mitsubishi, Microsoft, Motorola, Nokia, Philips, Robert Bosch GmbH, Samsung, Sharp, Sony, Toshiba, and Victor Company of Japan (JVC)) announced preliminary terms November 17, 2003. MPEG-LA is a private company not to be confused with MPEG or MPEG-IF (there is no formal relationship between these three organizations) No royalties due for activities prior to 2005 “Encoder/Decoder” fees: No fees for small deployments (<100k devices) 20¢ per device for encoding and/or decoding (10¢ above 5M devices/year) Enterprise device fee caps approx approx $4M for most products; additional approx $11M for PC SW also installed by OEMs “Participation” fees: 2¢ per 12 minute+ title or 2%, whichever lower, for permanent or PPV sale Subscription service use $0k to $100k depending on number of subscribers Over-air free broadcast $10k/yr per channel to 100k or more customers Internet free broadcast no fee (to at least 2010) Enterprise participation fee caps of approx $4M/yr Terms stated to be effective through 2010