1. Infotainment & Instrumentation Product Overview
0C06B

2. Renesas Technology & Solution Portfolio
*The focus of this session will be the System LSI solutions from Renesas

3. ‘Enabling The Smart Society’
Challenge: “In the smart society, SoC’s are required to provide more and more state of the art functionality and high end processing capability placing higher demands on the CPU, Software, and System Cost.” 
Solution:
“This class will show you how to utilize various technologies available in the R-Car family of devices to meet the technology demands set by the Market.”
This is where our session, OC06B is focused within the ‘Big picture of Renesas Products’, SoC’s.
<Click>
________________________________________________________________________________________________________________________________

4. System on a Chip Line-up
2010
2013
H2* 30K DMIPS
2/4x Cortex 1.5GHz
2/4x Cortex 1GHz
Automotive, 28nm
H1 10K DMIPS
4x Cortex 1GHz
800MHz
Automotive , 45nm
M2* 10K DMIPS
M1A 2K DMIPS
2x Cortex 1.5GHz
Automotive, 28nm
Cortex 1GHz
800MHz
Automotive, 45nm
The R-Car lineup contains a diverse SoC lineup for various application usage.
H1 – sampling today offers high end processing performance and graphics
M1 – sampling today offers mid-end processing and 3D graphics
E1 – sampling today offers low-end processing and 3D graphics
The next generation products will increase the performance capability
H2 – will offer state of the art processing, graphics, and peripheral lineup
M2 – will offer high end to mid end processing capability and 3D graphics
E2 – will offer mid to low end processing capability and 3D graphics
E2* 3K DMIPS
1/2x Cortex 1GHz
Automotive, 28nm
44 DMIPS, True Low Power
E1 1.3K DMIPS
8/16-bit
Cortex 533MHz
Automotive, 45nm
10 DMIPS, Capacitive Touch
Wide Format LCDs
*tentative naming

5. Agenda Market Trends Addressing the Market Trends Product Overview
Past 5 years
Future
Addressing the Market Trends
Ethernet AVB
Image processing/renderer
Advanced video processing
Core and GPU
Codec’s
Virtualization
Product Overview
R-Car Gen 2 Series

6. Infotainment/Instrumentation Market Trends

7. Infotainment Past Trends
iPod/iPad, media player connectivity
Bluetooth
3D navigation
USB
DVD playback
6 disc CD changer
AM/FM
High
Bluetooth
2D navigation
USB
DVD playback
6 disc CD changer
AM/FM
iPod/iPad, media player connectivity
Bluetooth
2D navigation
USB
DVD playback
6 disc CD changer
AM/FM
Mid
Bluetooth
USB
6 disc CD changer
AM/FM
5 years ago:
Entry systems were comprised of a single line display, dot matrix
Mid systems increased the lines in the display and added a couple of features
High end systems incorporated bluetooth, 2D navigation, and DVD playback
Today:
Entry end systems incorporated the increased playback options, iPod/iPad for example
Mid end systems expanded the media playback options to include bluetooth to the playback options
High end systems incorporate the advanced graphics options, 3D graphics
iPod/iPad, media player connectivity
Bluetooth
USB CD
AM/FM
Entry
USB CD
AM/FM
5 years ago
Today

8. Instrumentation Past Trends
High
Mechanical gauges
Multiple segment or dot matrix LCD
Custom configurable virtual cluster
WVGA/WXGA TFT
Mid
Mechanical Gauges
Mono. Dot matrix LCD
Mechanical gauges
Color TFT LCD
Mechanical gauges
Multiple segment or dot matrix LCD
Entry
Mechanical gauges
No or single segment LCD
5 years ago
Today

9. Future CenterStack & Instrument Display
CenterStack Display: Replacing mechanical HMI
Instrument Display: Driving Assistant
Driving Assist
Rear Mirror
ADAS Module
Heads Up Display
Parking Assist
(Some portion moves to mirror)
Instrument Display
Location advantage
Driver access
Driving Assist feature
Car information
Expected Value
Safety
Route Navigation
Car Information
Customization
CenterStack Display
Location advantage
Driver access
Non-Driving Assist feature
Passenger access to media
Expected Value
Entertainment
Cloud
Multi-task Information
Human Machine Interface
Front Wind Shield
Gauge/MFD
Map
Routing Data
CenterStack
Display
HVAC switches
Switches for
Tuner,DVD,CD,
Telematics
Entertainment: Connectivity of Future Media
Cloud: Connectivity between the outside and inside
Information: Driver assist, traffic information, etc.
Human Machine Interface: Tuner, DVD, CD, HVAC, Navigation, Telematics, D-TV, etc control
Rear Seat
Entertainment
Communication, HMI
BCM/Other module
Cloud

10. Market Trend: Displays
Display and Semiconductor technologies are cost effective solutions for the Mid – High Automotive segments
Displays: LCD & LED
Graphic Processors: More demand for HD video and 3D graphics
Today’s mid series cars often have two displays – centre stack and rear seat entertainment.
Next generation vehicles are moving to four displays with the addition of screens in the instrument cluster and individual screens for each rear passenger.
The additional displays require a high bandwidth network interface for transmitting the video data between the additional displays.
HTML5 and Open GL/ES are important standards in the automotive display space.
Displays in vehicles today (mid-level option)
Displays in next generation vehicles

11. Display Use Cases Overview
Mid
High
Premium
Main Display
2nd Display (e.g. HUD)
3rd Display (e.g. 2nd main or HUD)
Video Sources (Navi / ADAS)
Cameras
Car model complexity
Virtual Gauges
800x480 (WVGA)
1920x720(HD)
800x480 (WVGA)
1920x720 (HD)
Full screen, 24bpp
This chart shows typical screen resolutions, cameras, image complexity and gauge complexity in typical mid, high and premium vehicles
The high resolution displays (High and Premium) require video processing hardware and high end performance capability to handle the HD displays and refresh rate (60 fs)
1st camera (ITU656)
2nd, 3rd, 4th camera (ITU656, Eth.AVB / H.264)
Low (<20KPoly)
Mid (<50KPoly)
High (<100KPoly)
Real time 3D effects: Photo-realistic, Lighting, shadows, environment
Petrol, Temperature
RPM, Speed

12. GPU Performance Trend
IMG
Series6
R-CarH2
APE6
2013 is turning point of embedded Graphics performance
User expect same level Apple iPAD/Tabletsgraphics for wider centerstack and RSE
Next-gen
Tablet
The New iPad
SGX543MP4
Performance
R-CARH1
SGX543MP2
iPad2
SGX543MP2
OMAP5
SGX544MP2
The market requires that the graphics performance, resolution, refresh rate, etc. improve every generation. Do to this the graphics technology continues to progress every generation. The R-Car H2 will incorporate a state of the art GPU.
iPad
SGX535
Tegra3
R-CARM1
SGX540
Tegra2
2010
2011
2012
2013
2014~

13. Market Trend: Smartphone Integration
Smartphone expansion
by region
Users want to access
Internet based services
Smartphone connectivity
Significant worldwide expansion of smart phones
Transfer display image of smart phone to the car head unit display
MIPS for MirrorLink (in the head unit)
USB and WLAN connectivity

14. Market Trend: Applications
New applications and integration are possible in both systems, Infotainment HU and Instrumentation
More entertainment features: applications, games, etc.
Navigation
Driver Assist (ADAS) integration
Diagnostic systems
Instrumentation systems are now being viewed as a potential auxiliary display
[Contents] -Navi app. -Voice recog. -DLNA server -HMI

15. Market Trend: Safety, Customization, Scalable
A focus for all OEM’s
driver distraction; optimized HMI
Driver information; traffic, road conditions, collision alert, surround view, image recognition/detection
Customization
The technology available allows for diversification, customization and personal imprint
Configurable Instrumentation
Configurable view
Scalability and Modular software
OS standards; Genivi, QNX Car 2.0, Windows 8
Ecosystem
Safety:
With the increase of applications and other functions in the head unit there is a growing concern of distraction for the driver. For this reason OEM’s are working toward optimized HMI models to allow the user to quickly and efficiently access the information, entertainment, or applications they desire with minimum distraction.
In effort to aid the driver there is an industry wide push to integrate “safety” systems into the headunit. These include traffic and road conditions, Surround view, parking assist, backup driver assist, image recognition, lane highlighting, and many others.
Customization:

16. Market Trend Challenges

17. Market Trend Challenges
Increased Vehicle Network bandwidth
Support Camera network
Video information to RSE
Video Synchronization between multiple displays
Systems displaying the same data across multiple displays can experience delays in the data stream
Increased connections/cabling in the vehicle
Production liability
Failure rate increase
Increases production cost and weight
Realtime applications
With the growing push toward GPOS realtime applications cannot be executed
Forces two chip solutions
Increases Cost

18. Addressing the Challenges

19. Ethernet AVB: Addressing Bandwidth
Fast
100Mbps, 1Gbps, 10Gbps: in use. 40Gbps. 100Gbps: standardized
Translate moving pictures at real time
Configurable/Controllable
Easy to add/update/remove equipment and sensors
Interoperability with external network
Can be connected with internet and cloud.
Deploy enhanced Security concept
Ethernet driving down automotive cost of ownership
System Integration
MLB
INIC AV
Network
CPU
CPU
Ether
Ether
AVB
Debug
Diag
Debug
Diag

20. Ethernet AVB: Why is it necessary?
“Ethernet AVB” means Ethernet Audio Video Bridging
AVB Features are necessary to keep the Quality of Service (QoS) in the case of various Flexible and Scalable configurations
Minimum system
RSE (Option)
RSE #2 (Option)
DVD
HDD
Rear
DVD
Rear #1
Display CE
device
Rear #2
Display
Head Unit
RSE #1
RSE #2
AMP
Front
Display
Bridging
Bridging
Explanatory notes 
Switch（Bridge）
Example of Bridged Network
End Point

21. Ethernet AVB & Available Solution Levels
Definition of Implementation Levels
Level AS
(1588)
1722
Qat
Qav
notes 1
Traditional Ethernet - 2
AVB Subset ○
Corresponds to AVA.
Basic implementation for time aware system.
*Cannot Guarantee bandwidth & latency 3
AVB full spec
Encouraged by AVnu.
Bandwidth and latency are guaranteed.
Standard
Specification
IEEE802.1 AS
Timing and Synchronization for Time-Sensitive Applications in Bridged Local Area Networks.
IEEE802.1 Qat
Stream Reservation Protocol.
IEEE802.1 Qav
Forwarding and　Queuing　Enhancements for Time-Sensitive Streams.
IEEE1722
Ethernet AVB transfer protocol.
　　　（Based on IEC61883）
Ethernet AVB is made up of 4 standards:
802.1 AS
802.1 Qat
802.1 Qav
IEEE1722
There are 3 levels of ethernet for the market
Standard Ethernet
AVB subset (time aware system)
AVB full specification

22. Driver Assist Solutions
Provide All-in-One solutions for:
On-road obstacle and sign recognition
4-camera Top View system
1st step
Make top view picture at real time
2nd step
Parking lane, Pedestrian recognition
3rd step
Make Balanced Picture by brightness correction
Decoration
Right
camera
Left
Rear
Front
Image Render
(IMR)
Image Processing (IMP) !
DRC
(Dynamic Range Control)
We can offer the ADAS solutions.
We will provide all in one solutions for on road obstacle and sign recognition with harware acceleration by IMR-X and IMP,
And also 4 camera top view system with hardware acceleration by IMR-LSX and IMP.
IMR: cameras are mounted at an angle. The IMR distorts the Camera image to make the video data appear as mounted on the side of the vehicle looking straight out
IMP: Detects the parking lane and pedestrians, and additional obstacles the driver should be aware of
DRC: Brightness correction

23. Image Renderer: Camera Perspective Correction
Translated Image
IMR-LSX
View after
Rendering with IMR
IMR-LSX
DDR3
IMR-LSX
Direct View
Through fish-eye lens
IMR-LSX
IMR-X: for Image data already in RAM
IMR-LSX: for Image data on Vin using line memory
IMP-X2
IMR-X
The IMR is a hardware IP that takes care of the Fish Eye correction to reduce the CPU overhead for this feature. The IMR takes the image data directly from the camera or from Ram (depending on the instance of IMR included in the device.
Key Design Points:
IMR-LSX is in-line with video input, saving memory bandwidth
4-channel distortion correction is a ~10K MIPS operation. IMR-LSX is substantially more efficient than a general-purpose CPU

24. Dynamic Range Control: Brightness Compensation
Dynamic range Control for multiple cameras
New method of brightness distribution control can exchange the gradation of the picture at every pixel, it can handle Bright correction and Compensation and Dark Currents at same time.
(a)
(b)
Before
After
Before
After
Luminance distribution
Before
After
Luminance distribution
level
(a) Bright area control
(b) Dark area control

25. Multi-tap Up/Down Scaler
Three algorithms are supported:
Nearest Neighbor
Bi-Linear
Multi-tap filtering
Original Input Image
Up Scaling
Nearest Neighbor: Used for computer generated graphics such as game characters
Bi-Linear: Used with alpha scaling
Multi-tap Filtering: Used for high quality scaling
Nearest Neighbor
Bi-Linear
Multi-tap Filtering

26. Advanced H/W Video Filters/Enhancements
Super Resolution
Video Signal Processors support H/W accelerations of various image filters/enhancements for video playback
Allows lower CPU load and lower power consumption
M/W is ready. Image simulators for PC are also available
High Quality Image Processing
Flexible Composite Operation
Geometry Transformation
Complementary Color Operation
High Quality Image Processing:
Super Resolution
Multi-Tap UP/Down scaler
FIR
Median Filter
Flexible Composite operation
4-Plane video composition
Bitwise Raster operation
Programmable Background Color
Geometry Transformation
90/180/270 rotation
Image flipping
Complementary color operation
1D/3D LUT
1D/2D histogram
Color keying
Color space conversion
Dither operation
Original Image
Conventional Scaling
Super Resolution

27. Hardware Cryptographic Accelerator
R-Car Cryptographic hardware accelerator
“ Crypto Engine ” provides solutions for cryptography
Supports accelerations of various algorithms:
Public Key Algorithms: RSA; ECC; DH
Symmetric Algorithms: AES; DES/3DES; RC4
Hash Algorithms: MD5; SHA1; SHA256/384/512; HMAC
Off load engine to save CPU time and power consumption
External NV Memory
R-Car Gen2
Integrated into R-Car Gen 2
CortexA15　with TrustZone
Secure RAM
Secure DMA
Crypto Engine
Peripherals
Secure Timer
RAM
ROM
Crypto
Engine
Secret Crypto Key

28. High Performance CPU
CPU requirements are continuing to increase do to the increased processing requirements
High performance Cortex A15
CPU scalability, x1 ARM, x2 ARM and x4 ARM
MME for real-time tasks and CPU off-load
Cortex A15 Feature
3.5DMIPS/MHz per core
Out of order execution
Hardware enhanced virtualization
1TB physical addressing
Computing
Main Processors
ARM Cortex-A15 Quad/Dual/Single
1.5GHz
Major OS supported
SW development efficiency
Real time processor
Renesas SH4A
780MHz
Real-time tasks
Off-load for Multimedia application
DFS
Coremark
R-CarH2
Competitor A
R-CarH1 5 10
1.33GHz
CortexA15*
1.5GHz Quad
CortexA9
2GHz Quad
1GHz Quad 1

29. IMG PowerVR Graphics Processor
High Performance GPU’s
IMG PowerVR Graphics Processor
Same code runs on all products with OpenGL ES API
Fully OpenGL ES compliant
OpenGL ES3.0 has upper compatibility with OpenGL ES2.0.
Driver compatibility can be applied for M/W and apps optimization
OpenGL ES Automotive know how
Matured drivers based on past use cases
Original performance tuning tools
Consultant, analysis, optimization of the customer application
Various testing based on use cases
Partnership between Renesas
Over 15 years history of IMG GFX in Renesas SoC
Quick action by the tight combined formation, and Long term support automotive life cycles
Quick analysis of performance bottle neck
SGX531
SGX540
SGX543MP2
I “A2”
N “T2”
Average of several benchmark
Such as GridMark, GLbench, FutureMark
N “T3” *1
*1: unproved value 1 2
~0.6
1.2~1.4
~5.1
Series6 *2
(Rogue/Hood)
~15
*2: Estimation
SGX543MP2 (R-Car H1)
SGX540 (R-Car M1)

30. Ecosystem for Codec’s Wide Codec availability
With the increase overhead of software development 3rd party codec availability is imperative to reduce the development effort of Suppliers, Tier 1’s, and OEM’s.

31. R-Car + Virtualization: Addressing GPOS & RTOS
Next generation Display Audio
CVBS/Ether AVB
Apps
BT / USB / Wi-Fi
Other Apps
HTML5 / DLNA
MirrorLink
HMI
Video / Audio
Tuner
(DAB/HD)
I2C
Apps
Rear camera
System ctrl
GPOS monitor
Other RT process
USB3/MHL/HDMI
Tuner
(SDARS)
I2C
AM/FM /DSP
I2C
IIS
SDIO/USB2
IIS
RTOS
GPOS
UART
Pwr Ctrl
USB1
Virtualization
CAN
IEBus
Virtualization allows for two different operating systems to run on a single core ( or SMP mode multi-core). This allows for a user to take advantage of the GPOS ecosystem and legacy RTOS capability.
CPU
JTAG
Debug
Most
EtherAVB
SD/eMMC
UART
DRGB888
TCON
I2C
INT
SPI
IIS
GPS
MIC
Touch
panel

32. R-Car System Solution

33. Car Infotainment Approach
Renesas’ products contribute the following requests:
Reduce number of parts
Cost
Lower development cost
SH72x
R-CAR
Software
development
Scalable line-up
Meet function
trend
Reusability
TAT
Function

34. Car Infotainment Product Road Map
MY2013
MY2015 MP
System
Cont.
Audio
Media
Display
NAVI
Tele-
matics
System
Cont.
Audio
Media
Display
NAVI
Tele-
matics
Samples
Development
Planning
V850
R32C
78K0
R8C
R-Car H1,
ARM Cortex A9x4
RH850
RL78
R-Car Gen2
Navi/
Multimedia
R-Car M1,
ARM Cortex A9 OS
R-Car E1
ARM Cortex A9 OS
Display
Audio
SH7268/69
Next Gen
Display Audio
SH7266/67
SH7262/64
Connectivity
Audio
RTOS
RTOS
SH726A/6B
Legacy
Audio
*tentative naming

35. Renesas Ecosystem Solution
Integration
System
Integration
Hitachi
Advanced
Digital
The Renesas R-Car roadmap incorporates all the technologies mentioned throughout this presentation
Middleware OS
Pre-Boot
Hardware IP
Pre-Boot OS
Middleware

36. Summary
The Infotainment and Instrumentation technology is rapidly changing
Growth in the number of displays
HD video
Connectivity options
Graphics capability
Driver Assist features
The Renesas R-Car SoC’s have the IP technologies needed to meet the feature demands of the market
Ethernet AVB to address the bandwidth needed for video transfers
Advanced Video decoders for 4 HD decodes
USB 3.0 for state of the art connectivity
IMG PowerVR GC6400 for state of the art graphics
IMR, IMP, and DSRC for driver assist requirements

37. ‘Enabling The Smart Society’ in Review…
Challenge: “In the smart society, SoC’s are required to provide more and more state of the art functionality and high end processing capability placing higher demands on the CPU, Software, and System Cost.” 
“This class will show you how to utilize various technologies available in the R-Car family of devices to meet the technology demands set by the Market.”
Do you agree that we accomplished the above statement?
This is where our session, OC06B is focused within the ‘Big picture of Renesas Products’, Microcontroller and Microprocessors.
<Click>
________________________________________________________________________________________________________________________________

38. Questions?