Infotainment & Instrumentation Product Overview 0C06B

Renesas Technology & Solution Portfolio *The focus of this session will be the System LSI solutions from Renesas

‘Enabling The Smart Society’ Challenge: “In the smart society, SoC’s are required to provide more and more state of the art functionality and high end processing capability placing higher demands on the CPU, Software, and System Cost.”  Solution: “This class will show you how to utilize various technologies available in the R-Car family of devices to meet the technology demands set by the Market.” This is where our session, OC06B is focused within the ‘Big picture of Renesas Products’, SoC’s. <Click> ________________________________________________________________________________________________________________________________

System on a Chip Line-up 2010 2013 H2* 30K DMIPS 2/4x Cortex A15 @ 1.5GHz 2/4x Cortex A7 @ 1GHz Automotive, 28nm H1 10K DMIPS 4x Cortex A9 @ 1GHz SH4a @ 800MHz Automotive , 45nm M2* 10K DMIPS M1A 2K DMIPS 2x Cortex A15 @ 1.5GHz Automotive, 28nm Cortex A9 @ 1GHz SH4a @ 800MHz Automotive, 45nm The R-Car lineup contains a diverse SoC lineup for various application usage. H1 – sampling today offers high end processing performance and graphics M1 – sampling today offers mid-end processing and 3D graphics E1 – sampling today offers low-end processing and 3D graphics The next generation products will increase the performance capability H2 – will offer state of the art processing, graphics, and peripheral lineup M2 – will offer high end to mid end processing capability and 3D graphics E2 – will offer mid to low end processing capability and 3D graphics E2* 3K DMIPS 1/2x Cortex Ax @ 1GHz Automotive, 28nm 44 DMIPS, True Low Power E1 1.3K DMIPS 8/16-bit Cortex A9 @ 533MHz Automotive, 45nm 10 DMIPS, Capacitive Touch Wide Format LCDs *tentative naming

Agenda Market Trends Addressing the Market Trends Product Overview Past 5 years Future Addressing the Market Trends Ethernet AVB Image processing/renderer Advanced video processing Core and GPU Codec’s Virtualization Product Overview R-Car Gen 2 Series

Infotainment/Instrumentation Market Trends

Infotainment Past Trends iPod/iPad, media player connectivity Bluetooth 3D navigation USB DVD playback 6 disc CD changer AM/FM High Bluetooth 2D navigation USB DVD playback 6 disc CD changer AM/FM iPod/iPad, media player connectivity Bluetooth 2D navigation USB DVD playback 6 disc CD changer AM/FM Mid Bluetooth USB 6 disc CD changer AM/FM 5 years ago: Entry systems were comprised of a single line display, dot matrix Mid systems increased the lines in the display and added a couple of features High end systems incorporated bluetooth, 2D navigation, and DVD playback Today: Entry end systems incorporated the increased playback options, iPod/iPad for example Mid end systems expanded the media playback options to include bluetooth to the playback options High end systems incorporate the advanced graphics options, 3D graphics iPod/iPad, media player connectivity Bluetooth USB CD AM/FM Entry USB CD AM/FM 5 years ago Today

Instrumentation Past Trends High Mechanical gauges Multiple segment or dot matrix LCD Custom configurable virtual cluster WVGA/WXGA TFT Mid Mechanical Gauges Mono. Dot matrix LCD Mechanical gauges Color TFT LCD Mechanical gauges Multiple segment or dot matrix LCD Entry Mechanical gauges No or single segment LCD 5 years ago Today

Future CenterStack & Instrument Display CenterStack Display: Replacing mechanical HMI Instrument Display: Driving Assistant Driving Assist Rear Mirror ADAS Module Heads Up Display Parking Assist (Some portion moves to mirror) Instrument Display Location advantage Driver access Driving Assist feature Car information Expected Value Safety Route Navigation Car Information Customization CenterStack Display Location advantage Driver access Non-Driving Assist feature Passenger access to media Expected Value Entertainment Cloud Multi-task Information Human Machine Interface Front Wind Shield Gauge/MFD Map Routing Data CenterStack Display HVAC switches Switches for Tuner,DVD,CD, Telematics Entertainment: Connectivity of Future Media Cloud: Connectivity between the outside and inside Information: Driver assist, traffic information, etc. Human Machine Interface: Tuner, DVD, CD, HVAC, Navigation, Telematics, D-TV, etc control Rear Seat Entertainment Communication, HMI BCM/Other module Cloud

Market Trend: Displays Display and Semiconductor technologies are cost effective solutions for the Mid – High Automotive segments Displays: LCD & LED Graphic Processors: More demand for HD video and 3D graphics Today’s mid series cars often have two displays – centre stack and rear seat entertainment. Next generation vehicles are moving to four displays with the addition of screens in the instrument cluster and individual screens for each rear passenger. The additional displays require a high bandwidth network interface for transmitting the video data between the additional displays. HTML5 and Open GL/ES are important standards in the automotive display space. Displays in vehicles today (mid-level option) Displays in next generation vehicles

Display Use Cases Overview Mid High Premium Main Display 2nd Display (e.g. HUD) 3rd Display (e.g. 2nd main or HUD) Video Sources (Navi / ADAS) Cameras Car model complexity Virtual Gauges 800x480 (WVGA) 1920x720(HD) 800x480 (WVGA) 1920x720 (HD) Full screen, 24bpp This chart shows typical screen resolutions, cameras, image complexity and gauge complexity in typical mid, high and premium vehicles The high resolution displays (High and Premium) require video processing hardware and high end performance capability to handle the HD displays and refresh rate (60 fs) 1st camera (ITU656) 2nd, 3rd, 4th camera (ITU656, Eth.AVB / H.264) Low (<20KPoly) Mid (<50KPoly) High (<100KPoly) Real time 3D effects: Photo-realistic, Lighting, shadows, environment Petrol, Temperature RPM, Speed

GPU Performance Trend IMG Series6 R-CarH2 APE6 2013 is turning point of embedded Graphics performance User expect same level Apple iPAD/Tabletsgraphics for wider centerstack and RSE Next-gen Tablet The New iPad SGX543MP4 Performance R-CARH1 SGX543MP2 iPad2 SGX543MP2 OMAP5 SGX544MP2 The market requires that the graphics performance, resolution, refresh rate, etc. improve every generation. Do to this the graphics technology continues to progress every generation. The R-Car H2 will incorporate a state of the art GPU. iPad SGX535 Tegra3 R-CARM1 SGX540 Tegra2 2010 2011 2012 2013 2014~

Market Trend: Smartphone Integration Smartphone expansion by region Users want to access Internet based services Smartphone connectivity Significant worldwide expansion of smart phones Transfer display image of smart phone to the car head unit display 200-300MIPS for MirrorLink (in the head unit) USB and WLAN connectivity

Market Trend: Applications New applications and integration are possible in both systems, Infotainment HU and Instrumentation More entertainment features: applications, games, etc. Navigation Driver Assist (ADAS) integration Diagnostic systems Instrumentation systems are now being viewed as a potential auxiliary display [Contents] -Navi app. -Voice recog. -DLNA server -HMI

Market Trend: Safety, Customization, Scalable A focus for all OEM’s driver distraction; optimized HMI Driver information; traffic, road conditions, collision alert, surround view, image recognition/detection Customization The technology available allows for diversification, customization and personal imprint Configurable Instrumentation Configurable view Scalability and Modular software OS standards; Genivi, QNX Car 2.0, Windows 8 Ecosystem Safety: With the increase of applications and other functions in the head unit there is a growing concern of distraction for the driver. For this reason OEM’s are working toward optimized HMI models to allow the user to quickly and efficiently access the information, entertainment, or applications they desire with minimum distraction. In effort to aid the driver there is an industry wide push to integrate “safety” systems into the headunit. These include traffic and road conditions, Surround view, parking assist, backup driver assist, image recognition, lane highlighting, and many others. Customization:

Market Trend Challenges

Market Trend Challenges Increased Vehicle Network bandwidth Support Camera network Video information to RSE Video Synchronization between multiple displays Systems displaying the same data across multiple displays can experience delays in the data stream Increased connections/cabling in the vehicle Production liability Failure rate increase Increases production cost and weight Realtime applications With the growing push toward GPOS realtime applications cannot be executed Forces two chip solutions Increases Cost

Addressing the Challenges

Ethernet AVB: Addressing Bandwidth Fast 100Mbps, 1Gbps, 10Gbps: in use. 40Gbps. 100Gbps: standardized Translate moving pictures at real time Configurable/Controllable Easy to add/update/remove equipment and sensors Interoperability with external network Can be connected with internet and cloud. Deploy enhanced Security concept Ethernet driving down automotive cost of ownership System Integration MLB INIC AV Network CPU CPU Ether Ether AVB Debug Diag Debug Diag

Ethernet AVB: Why is it necessary? “Ethernet AVB” means Ethernet Audio Video Bridging AVB Features are necessary to keep the Quality of Service (QoS) in the case of various Flexible and Scalable configurations Minimum system RSE (Option) RSE #2 (Option) DVD HDD Rear DVD Rear #1 Display CE device Rear #2 Display Head Unit RSE #1 RSE #2 AMP Front Display Bridging Bridging Explanatory notes  Switch（Bridge） Example of Bridged Network End Point

Ethernet AVB & Available Solution Levels Definition of Implementation Levels Level AS (1588) 1722 Qat Qav notes 1 Traditional Ethernet - 2 AVB Subset ○ Corresponds to AVA. Basic implementation for time aware system. *Cannot Guarantee bandwidth & latency 3 AVB full spec Encouraged by AVnu. Bandwidth and latency are guaranteed. Standard Specification IEEE802.1 AS Timing and Synchronization for Time-Sensitive Applications in Bridged Local Area Networks. IEEE802.1 Qat Stream Reservation Protocol. IEEE802.1 Qav Forwarding and　Queuing　Enhancements for Time-Sensitive Streams. IEEE1722 Ethernet AVB transfer protocol. 　　　（Based on IEC61883） Ethernet AVB is made up of 4 standards: 802.1 AS 802.1 Qat 802.1 Qav IEEE1722 There are 3 levels of ethernet for the market Standard Ethernet AVB subset (time aware system) AVB full specification

Driver Assist Solutions Provide All-in-One solutions for: On-road obstacle and sign recognition 4-camera Top View system 1st step Make top view picture at real time 2nd step Parking lane, Pedestrian recognition 3rd step Make Balanced Picture by brightness correction Decoration Right camera Left Rear Front Image Render (IMR) Image Processing (IMP) ! DRC (Dynamic Range Control) We can offer the ADAS solutions. We will provide all in one solutions for on road obstacle and sign recognition with harware acceleration by IMR-X and IMP, And also 4 camera top view system with hardware acceleration by IMR-LSX and IMP. IMR: cameras are mounted at an angle. The IMR distorts the Camera image to make the video data appear as mounted on the side of the vehicle looking straight out IMP: Detects the parking lane and pedestrians, and additional obstacles the driver should be aware of DRC: Brightness correction

Image Renderer: Camera Perspective Correction Translated Image IMR-LSX View after Rendering with IMR IMR-LSX DDR3 IMR-LSX Direct View Through fish-eye lens IMR-LSX IMR-X: for Image data already in RAM IMR-LSX: for Image data on Vin using line memory IMP-X2 IMR-X The IMR is a hardware IP that takes care of the Fish Eye correction to reduce the CPU overhead for this feature. The IMR takes the image data directly from the camera or from Ram (depending on the instance of IMR included in the device. Key Design Points: IMR-LSX is in-line with video input, saving memory bandwidth 4-channel distortion correction is a ~10K MIPS operation. IMR-LSX is substantially more efficient than a general-purpose CPU

Dynamic Range Control: Brightness Compensation Dynamic range Control for multiple cameras New method of brightness distribution control can exchange the gradation of the picture at every pixel, it can handle Bright correction and Compensation and Dark Currents at same time. (a) (b) Before After Before After Luminance distribution Before After Luminance distribution level (a) Bright area control (b) Dark area control

Multi-tap Up/Down Scaler Three algorithms are supported: Nearest Neighbor Bi-Linear Multi-tap filtering Original Input Image Up Scaling Nearest Neighbor: Used for computer generated graphics such as game characters Bi-Linear: Used with alpha scaling Multi-tap Filtering: Used for high quality scaling Nearest Neighbor Bi-Linear Multi-tap Filtering

Advanced H/W Video Filters/Enhancements Super Resolution Video Signal Processors support H/W accelerations of various image filters/enhancements for video playback Allows lower CPU load and lower power consumption M/W is ready. Image simulators for PC are also available High Quality Image Processing Flexible Composite Operation Geometry Transformation Complementary Color Operation High Quality Image Processing: Super Resolution Multi-Tap UP/Down scaler FIR Median Filter Flexible Composite operation 4-Plane video composition Bitwise Raster operation Programmable Background Color Geometry Transformation 90/180/270 rotation Image flipping Complementary color operation 1D/3D LUT 1D/2D histogram Color keying Color space conversion Dither operation Original Image Conventional Scaling Super Resolution

Hardware Cryptographic Accelerator R-Car Cryptographic hardware accelerator “ Crypto Engine ” provides solutions for cryptography Supports accelerations of various algorithms: Public Key Algorithms: RSA; ECC; DH Symmetric Algorithms: AES; DES/3DES; RC4 Hash Algorithms: MD5; SHA1; SHA256/384/512; HMAC Off load engine to save CPU time and power consumption External NV Memory R-Car Gen2 Integrated into R-Car Gen 2 CortexA15　with TrustZone Secure RAM Secure DMA Crypto Engine Peripherals Secure Timer RAM ROM Crypto Engine Secret Crypto Key

High Performance CPU CPU requirements are continuing to increase do to the increased processing requirements High performance Cortex A15 CPU scalability, x1 ARM, x2 ARM and x4 ARM MME for real-time tasks and CPU off-load Cortex A15 Feature 3.5DMIPS/MHz per core Out of order execution Hardware enhanced virtualization 1TB physical addressing Computing Main Processors ARM Cortex-A15 Quad/Dual/Single 1.5GHz Major OS supported SW development efficiency Real time processor Renesas SH4A 780MHz Real-time tasks Off-load for Multimedia application DFS Coremark R-CarH2 Competitor A R-CarH1 5 10 1.33GHz CortexA15* 1.5GHz Quad CortexA9 2GHz Quad 1GHz Quad 1

IMG PowerVR Graphics Processor High Performance GPU’s IMG PowerVR Graphics Processor Same code runs on all products with OpenGL ES API Fully OpenGL ES compliant OpenGL ES3.0 has upper compatibility with OpenGL ES2.0. Driver compatibility can be applied for M/W and apps optimization OpenGL ES Automotive know how Matured drivers based on past use cases Original performance tuning tools Consultant, analysis, optimization of the customer application Various testing based on use cases Partnership between Renesas Over 15 years history of IMG GFX in Renesas SoC Quick action by the tight combined formation, and Long term support automotive life cycles Quick analysis of performance bottle neck SGX531 SGX540 SGX543MP2 I “A2” N “T2” Average of several benchmark Such as GridMark, GLbench, FutureMark N “T3” *1 *1: unproved value 1 2 ~0.6 1.2~1.4 ~5.1 Series6 *2 (Rogue/Hood) ~15 *2: Estimation SGX543MP2 (R-Car H1) SGX540 (R-Car M1)

Ecosystem for Codec’s Wide Codec availability With the increase overhead of software development 3rd party codec availability is imperative to reduce the development effort of Suppliers, Tier 1’s, and OEM’s.

R-Car + Virtualization: Addressing GPOS & RTOS Next generation Display Audio CVBS/Ether AVB Apps BT / USB / Wi-Fi Other Apps HTML5 / DLNA MirrorLink HMI Video / Audio Tuner (DAB/HD) I2C Apps Rear camera System ctrl GPOS monitor Other RT process USB3/MHL/HDMI Tuner (SDARS) I2C AM/FM /DSP I2C IIS SDIO/USB2 IIS RTOS GPOS UART Pwr Ctrl USB1 Virtualization CAN IEBus Virtualization allows for two different operating systems to run on a single core ( or SMP mode multi-core). This allows for a user to take advantage of the GPOS ecosystem and legacy RTOS capability. CPU JTAG Debug Most EtherAVB SD/eMMC UART DRGB888 TCON I2C INT SPI IIS GPS MIC Touch panel

R-Car System Solution

Car Infotainment Approach Renesas’ products contribute the following requests: Reduce number of parts Cost Lower development cost SH72x R-CAR Software development Scalable line-up Meet function trend Reusability TAT Function

Car Infotainment Product Road Map MY2013 MY2015 MP System Cont. Audio Media Display NAVI Tele- matics System Cont. Audio Media Display NAVI Tele- matics Samples Development Planning V850 R32C 78K0 R8C R-Car H1, ARM Cortex A9x4 RH850 RL78 R-Car Gen2 Navi/ Multimedia R-Car M1, ARM Cortex A9 OS R-Car E1 ARM Cortex A9 OS Display Audio SH7268/69 Next Gen Display Audio SH7266/67 SH7262/64 Connectivity Audio RTOS RTOS SH726A/6B Legacy Audio *tentative naming

Renesas Ecosystem Solution Integration System Integration Hitachi Advanced Digital The Renesas R-Car roadmap incorporates all the technologies mentioned throughout this presentation Middleware OS Pre-Boot Hardware IP Pre-Boot OS Middleware

Summary The Infotainment and Instrumentation technology is rapidly changing Growth in the number of displays HD video Connectivity options Graphics capability Driver Assist features The Renesas R-Car SoC’s have the IP technologies needed to meet the feature demands of the market Ethernet AVB to address the bandwidth needed for video transfers Advanced Video decoders for 4 HD decodes USB 3.0 for state of the art connectivity IMG PowerVR GC6400 for state of the art graphics IMR, IMP, and DSRC for driver assist requirements

‘Enabling The Smart Society’ in Review… Challenge: “In the smart society, SoC’s are required to provide more and more state of the art functionality and high end processing capability placing higher demands on the CPU, Software, and System Cost.”  “This class will show you how to utilize various technologies available in the R-Car family of devices to meet the technology demands set by the Market.” Do you agree that we accomplished the above statement? This is where our session, OC06B is focused within the ‘Big picture of Renesas Products’, Microcontroller and Microprocessors. <Click> ________________________________________________________________________________________________________________________________

Questions?