Presentation is loading. Please wait.

Presentation is loading. Please wait.

HD video solution for Embedded device

Similar presentations


Presentation on theme: "HD video solution for Embedded device"— Presentation transcript:

1 HD video solution for Embedded device
- Low Power IP Video Solution utilizing the SH4A/7724 - Consumer & Industrial BU Renesas Electronics CONFIDENTIAL; NDA Required 00000-A

2 Key Takeaways By the end of this presentation you will understand:
Roadmap updates for SH-Mobile Activity updates The ecosystem supporting on SH7724 Qualification and engagement The Key Takeaways, what you are going to have by the end of this session are You will understand what the advantages of SH7722 in video phone application. You will have the idea how you are going to build video phone application on Renesas platform You will understand the ecosystem build on SH MPUs with turn key applications Renesas Electronics CONFIDENTIAL; NDA Required

3 Roadmap Updates Renesas Electronics CONFIDENTIAL; NDA Required

4 SH-Mobile Product Roadmap
90nm 65nm process 45nm process 32nm process SH-MobileG5 Platform Platform SH-MobileG4 Platform SH-MobileG3 Platform SH-Mobile R3 Now Available OpenOS APE SH-Mobile R2R Now Available SH-Mobile R2 ES: Q411, MP: 2Q12 CPU : Cortex A9 & SH4A VPU5H: 1080p Enc/Dec VPU5F: 720p Enc/Dec 3D:SGX540 JPEG: HW Sound DSP DDR2/3 Full HD1080p30 SH-Mobile MT1 Multimedia CC Now Available SH-Mobile HD1 ES: Q409, MP: 2Q10 SH4A: 500 MHz VPU5H: 1080p Encode JPEG: HW Sound DSP DDR2: 64-bit SH-Mobile L3G HD1 is EOL in Q4 2011 No longer available for new opportunity 2008 2009 2010 2011 Renesas Electronics CONFIDENTIAL; NDA Required

5 SH7724(SH-Mobile R2R) Delivers HD Video for Portables
Enabling 30 fps HD Video Encode & Decode Low power consumption – 250mW for 900 MIPS Host CPU 5MPixel camera input x 2 ch Rich I/O peripherals for flexibility 10/100 Ethernet MAC, SD x 2ch, USB HS with Phy x 2ch, ATAPI Visual Engines for Enhanced Images at HD 2DG accelerator for Rich Graphical User Interface Design Sound DSP Processing Renesas Electronics CONFIDENTIAL; NDA Required

6 SH7724(SH-Mobile R2R) Block Diagram
SH-4A(Super H RISC Engine) with FPU Operation frequency CPU Clock:500MHz Bus Clock:166 MHz Embedded memory ILRAM:16Kbyte Cache: I=32Kbyte, D= 32Kbyte L2 Cache : 256kbyte  Bus Interface SDRAM-DDR2 16/32bit Local bus 8/16/32bit Peripheral 32bit Timer : 3ch Watch dog timer : 1ch 10/100Ether MAC : 1ch I2C bus interface : 2ch DMA Controller : 6ch SCIF : 6ch MMC/NAND Flash Interface :1ch USB2.0 Host/Function : 2ch SD IO (max 50MHz) ; : 2ch LCDC/Digital RGB 24bit VPU H.264 encode/decode 2D Graphic Accelerator Blending Engine : 2ch Video manipulation Engine : 2ch Camera capture Engine : 2ch KeyScan GPIO with interrupt H-UDI (User Debug Interface ) Package  :BGA449 500MHz 900 MIPS I-Cache 32KB D-Cache 32KB L2 Cache 256KB MMU UBC INTC FPU MAC Video Processing Unit (VPU) MPEG4 and H.264 Video Codec Encode & Decode Up to 720p 30 fps DMAC x6 H-UDI CPG LCDC Others WDT TMU x3 BSC (ROM/SRAM) VOU VPU5F H.264 2DG DDR2 32/16bit SCIF x6 MMC NAND CEU x2 (Camera I/F) BEU x2 (Blend) VEU x2 (Scaling) GPIO KeyScan 10/100 Ethernet MAC w/DMA I2C x2 USB-HS Host or Device w/PHY x2 JPEG IrDA Video I/O units Camera Input Color format conversion Rotate, Scale, Filter Blend Layers with alpha CEU: Capturing Engine Unit VEU: Video Engine Unit BEU: Blending Engine Unit SDIO x2 SPU 24bit DSP ATAPI TIMER MEMORY ANALOG CPU I/O Multi media Renesas Electronics CONFIDENTIAL; NDA Required

7 Video Process Flow TV LCD Encode Stream Decode Stream VOU SH-4A L C
Debug Uart Jtag Keypad Decode Stream TV VOU NAND Flash SH-4A NTSC/PAL TV out LCD Up to XGA L C D VPU H.264 VIO 5MegPix DEC ENC RJ-45 CEU BEU VEU Ethernet Scaling Rotating Blending Overlay DRAM Control This diagram shows the how the system is going to work in Video Phone application. Video phone application needs to maintain two direction of video and audio stream simultaneously, one is Encode stream, the other one is decode stream. Let me start from capturing part of stream, the picture captured by the camera is token by CEU in VIO passed to VPU Encoder block, then will be encoded in VPU. The encoded stream will be packetized as IP packet then sent out through Network. The other stream, which is the decoded part. The packetized data will come from Network and need to de-packetized sent to VPU to decode. The deccoded data will be passed to VIO for post process such as scaling, blending then fed to Display. In the flow, major high cost process are all implemented in hardware, VPU and VIO SIU I2C I2C PCM System Memory Audio AD-DAC PMU Renesas Electronics CONFIDENTIAL; NDA Required

8 Standard Pricing for SH7724
Unit :USD Part Number Volume Kunit/year 10K 10S 11K 11S R8A77240D500BG#U0 (SH7724) 10 14.50 14.00 13.70 13.40 100 13.00 12.70 12.30 11.90 500 11.70 11.40 11.00 10.70 The prices are Disti cost This pricing is intended to enable initial discussions to progress through the qualification stage and into traction/interest Official quotation need to be approved by the Sales portal SH7724 is NOT in DDD program Renesas Electronics CONFIDENTIAL; NDA Required

9 SH-Mobile R3 (Tentative spec)
Full HD 30 fps Video Encode & Decode plus HD 30 fps Video Encode & Decode Cortex A9 & SH4A 3D/2D by SGX540 Encryption Engine (AES, DES, 3DES) Rich I/O peripherals for Flexibles 10/100/1000 Ethernet MAC, SD x 2ch, USB HS with Phy x 2ch, ATAPI Visual Engines for Enhanced Images at HD Sound DSP Processing Tentative Schedule ES: Q4/2011, MP: Q2/2012 Renesas Electronics CONFIDENTIAL; NDA Required

10 Promotion Updates with SH7724
Renesas Electronics CONFIDENTIAL; NDA Required

11 Primary target applications in IP Video segment
IP Camera Camera + Video encoder + Stream server, all in one Out put would be on wired or wireless IP network IP Encoder/Streamer Attached module/box for analog camera Accepts analog video in, digitize & encode video image, and stream out via wired or wireless IP network Video Recorder Accepts multiple analog coaxial cable video inputs, digitize & encode each video input and store to attached storage device. Usually HDD. Less Competition with Encoding application Lower Power consumption oriented Renesas Electronics CONFIDENTIAL; NDA Required

12 Available in Distribution! (MS7724 Development Kit)
Activities around SH7724 Available in Distribution! (MS7724 Development Kit) Great feedback from Arrow SH7724 will be on Arrow EDGE vol. 2 We will have several sessions for SH7724 in DevCon Two Linux hands on Labs – Introduction and Advanced Linux solution by MPC Data Future Roadmap beyond SH7724 Android support HMI solution by Crank Software Redpine WiFi driver is in progress Renesas Electronics CONFIDENTIAL; NDA Required

13 Development Kit Renesas Electronics CONFIDENTIAL; NDA Required

14 MS7724 Hardware Features - Renesas Multimedia Solution -
Main Board SH-Mobile R2R(SH7724) - SH4A 500MHz DDR2-SDRAM MBytes (Max.512MB) NOR FLASH - 64MBytes 100BT Ethernet - SH7724 on chip IP PoE(IEEE802.3af) class3 DVI out NTSC/PAL in/out Camera I/F x 2ch AUDIO - Mic In, Line out USB Host/Function x 2 ch - SH7724 on chip IP SD card slot - SH7724 on chip IP SD/eMMC card slot - SH7724 on chip IP E-10A Serial port Option boards WVGA LCD panel with touch panel 3.2M pixel auto focus HD camera 【Target Application】 - IP Camera (Network Camera) - Video Conference System - Multimedia Mobile Equipment - PDA - PND - Automotive Event Recorder Renesas Electronics CONFIDENTIAL; NDA Required

15 MS7724 Components Main board : R0P7724LC0021RL
HD Camera board : R0P7724LE0021RL (Tripod is not included) WVGA Panel board : R0P7724LE0011RL Renesas Electronics CONFIDENTIAL; NDA Required

16 MS7724 Package The system is composed of the main board and the parts, listed below. R0P7724LC0021RL is the Main CPU board. As option, R0P7724LE0011RL (Wide-VGA LCD Extension Board) and R0P7724LE0021RL (HD(720p) Camera Module Extension Board) are prepared P/N Item Description Standard Price (Disty Resale) R0P7724LC0021RL CPU Board MS7724 main CPU board $734 AC Adapter DC5V/4A CD-ROM Users Manual U-boot Linux BSP Tool chain Sample code USB memory Bootable Linux binaries, Kernel and root file system R0P7724LE0011RL LCD Panel Board Wide VGA(7inch) LCD with touch panel $522 R0P7724LE0021RL Camera Board HD(1280x720p) CMOS camera board $226 Renesas Electronics CONFIDENTIAL; NDA Required

17 MS7724 - GOOBE Platform Good Out of Box Experience package
Linux Kernel & Device Drivers Defined Package of Middleware Codecs Sample Applications for quick start Currently defined MW Library MPEG4. H.263, H.264 Video decoder / encoder - MP3, AAC audio decoder Application SW Free of Charge Only sample code (no support) Application SW Middleware codec‘s Standard product by Renesas Royalty is included in the device price Patent licenses to be paid by the customer/system manufacturer Standard MW Product Libraries Licensing of SW Linux / Drivers Free of Charge Linux Kernel as GPL (no support) Special drivers supported by Renesas which are not under GPL i.e. SDHI Peripheral drivers Linux BSP SH7724 Development Board Hardware / LSI Standard MCU/MPU Terms & Conditions Renesas Electronics CONFIDENTIAL; NDA Required

18 MS7724 Linux BSP Features U-Boot Bootloader
Boot device option, NOR flash, USB, eMMC/SD or Network Linux Kernel port using GCC Tool Chain SCIF & SIOF Serial device drivers Ethernet device driver USB Host and Function device drivers SIU device driver with ALSA Audio Driver API 2DG device driver with Direct FB 1.3.0 Display (LCD,NTSC,DVI) device driver SD Card device driver eMMC device driver Touch Panel device driver Video for Linux 2 (V4L2) driver Camera Capture DirectFB API libshcodec(VPU library) Pre-integrated video codec support for MPEG4 and H.264 encoding and decoding libshjpu (JPEG library) libshveu (VEU library) Sample code camera capture, sighttpd (HTTP server) Renesas Electronics CONFIDENTIAL; NDA Required

19 Software Development Environment
Host Linux PC (Dabian) Compile & debug an application program Ethernet Windows PC or Linux PC Use Hyper Terminal as Console to operate the board. Debug for Linux application can be done by software base GDB server. E-10A may be used for hardware level debug when customer make their own board USB cable MS7724 Renesas Electronics CONFIDENTIAL; NDA Required

20 Linux Development Renesas Electronics CONFIDENTIAL; NDA Required

21 MS7724 Software Platform Open Source Linux Platform Advantages Support
“Distribution” is from Renesas In-house tools, kernel, BSP Pre-configured for MS7724 Advantages Renesas maintains the SuperH tree of the Linux kernel Renesas participates in the Linux Kernel Summit Renesas’ Linux approach is well aligned with Linux community development which results in Professionally reviewed code Abstracted, fully portable code Code integration with standard Linux kernels Support All platform code is available under GPL (GNU Public License) ‘as-is’ Baseline support is for customers to either have in-house Linux integration capability or willing to work with 3rd Party Large deals (> 250k units minimum per year) will be reviewed for Renesas-direct support. Review with Marketing Middleware Video middleware is proprietary to the Video Processing Unit (VPU) on the SH-Mobile Runtime costs are integral to the device pricing Source code is not made available to customers – it is a user-space binary only Renesas and/or 3rd party will help customers with video integration Renesas Electronics CONFIDENTIAL; NDA Required

22 Linux Customer Support Scheme
Renesas provides sample BSP + demo. Renesas uploads all code to the upstream Linux community to become openly available Linux Distributor can pull the Open Source code and develop a project for a customer A Linux System Integrator can take the Renesas BSP Package and modify, combine with other components and deliver to a customer A customer with significant Linux integration resources can leverage the community code and complete their project System Integrator Customer project Free evaluation BSP for startup Renesas Electronics Corp embedded Linux Distributor Linux development community upstream master code Renesas supports customer’s development partners Renesas Electronics CONFIDENTIAL; NDA Required 22 22

23 Demo Description Renesas Electronics CONFIDENTIAL; NDA Required

24 2D Graphics accelerator Demos
Included in BSP Direct FB( included in BSP) is fully ported with 2D Graphics accelerator DirectFB is a thin library that provides hardware graphics acceleration, input device handling and abstraction, integrated windowing system with support for translucent windows and multiple display layers, not only on top of the Linux Framebuffer Device. It is a complete hardware abstraction layer with software fallbacks for every graphics operation that is not supported by the underlying hardware. DirectFB adds graphical power to embedded systems and sets a new standard for graphics under Linux. Renesas Electronics CONFIDENTIAL; NDA Required

25 HD Video Playback H.264 HD Video clip playback Included in BSP
720p 30 fps CPU usage is less than 5% during the playback Renesas Electronics CONFIDENTIAL; NDA Required

26 IP Camera streaming demonstration
Included in BSP Captured image 1280 x 720 Encode with H.264 real-time at 30 fps Stream with HTTP CPU usage is less than 5% during the streaming Renesas Electronics CONFIDENTIAL; NDA Required

27 Crank Storyboard Suite
Storyboard is a suite of UI development optimization solutions for developers of consumer electronics, automotive head units, and industrial devices that require an embedded dynamic graphical display. Crank Storyboard Designer Enables UI designers to leverage their core expertise to easily prototype the look and feel of a UI, run simulations of the interface to validate the designs, and then move the prototype directly to the embedded device for deployment. Crank Storyboard Embedded Engine The runtime component of the suite, Embedded Engine drives the content developed in Designer on embedded devices. Renesas Electronics CONFIDENTIAL; NDA Required

28 GUI demonstration by Crank Storyboard
Media Player UI Digital Picture Frame, Slide show Climate Control UI Lighting Control UI Renesas Electronics CONFIDENTIAL; NDA Required

29 Conclusion Renesas Electronics CONFIDENTIAL; NDA Required

30 Qualifying an Opportunity for SH-Mobile
What is the application ? What are the video encoding/decoding requirements ? Resolution and frame rate Codec standards What peripherals are required ? What CPU performance is needed ? Is power consumption a criteria ? What is the software operating environment ? Is Embedded Linux acceptable ? Who will build software for the target ? Who will build the application software ? Are there any software API requirements for multimedia ? What does the customer expect to receive from Renesas ? Customer experience, quantity and support expectations 250K/y we can provide “hand holding”; <100K/y no support Renesas Electronics CONFIDENTIAL; NDA Required

31 Summary SH7724 is the focus product, packaged & ready
Start Disti promotion program with SH7724 R3 is in roadmap, though later next year. Low-cost SH4A are also under consideration HD1 is EOL in 2011 (do not promote) MT1 is the successor “Black Box” low power 1080p encode Single function video Co-processor MS7724 Dev Kit is available Buy through Disti, with support constraints Demo and Loan can be discussed with Marketing Solutions with SH7724 are ready Many sample codes and demos are in the DVD 3rd parties can add application specialized software Recognition in Linux Community, with growing Ecosystem Renesas Electronics CONFIDENTIAL; NDA Required

32 Renesas Electronics CONFIDENTIAL; NDA Required


Download ppt "HD video solution for Embedded device"

Similar presentations


Ads by Google