2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.2 Resent Embedded 3D Graphics Many Embedded 3D Hardware Accelerators are available.(See P3) –Separate Chip ： nVIDEA, ATI, etc. –IP Cores ： Imagination Technologies, BitBoy, etc. –Japanese Semicon Vender tends to provide their own cores. Various implementations (SeeP4) –Different CPUs, w/wo Floating Point Processor,w/wo Geometry -Vector Porcessor, w/wo 2D Accelerator,,, Many Embedded 3D Graphics Libraries are available. –OPEN/GL(ES) –Criterion, Fatfammer, IdeaWorks, Mascot Capsule, Superscape, etc.
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.3 3D Graphics Hardware ATI nVIDEA BitBoys Imageon 2300 GoForce SC10 TYPE Remarks Companion Chip Hardware IP-Core Acceleon G30 Imagination MBX ・ MBX-LITE Hardware IP-Core Company Style RENESAS （ Z3D/Z4D) Others TOSHIBA （ T4G ） FUJITSU GSHARK, etc. Selected by RENESAS TI, INTEL Companion Chip
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.4 Imagination MBX Implementations CPUFPUVGP3D-Acc2D-Acc SH4 SH4A SH3A ARM11 XSCALE （ Separate CHIP ） Yes No YesVGPMBX VGP-lite VGP MBX MBX-lite NoMBX-lite - Hardware Software using 3D Software using 3D Software using 3D
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.5 CELF AVG 2D Hardware Abstraction Integrating the abstraction layer named DirectFB. –Present Target: SH7751R+Silicon Motion for Digital TV application Benefit –Provides a light-weight and standardized interface for CE application. –Provides the portability and usability among the different hardware. –Provides application direct pass to controller to enable hardware drawing. –GTK+ on top of DirectFB will also provide the application portability. Requirement / Problem –Needs to develop a special driver for the hardware acceleration. Integrated with the frame buffer driver for standard LINUX environment –DirectFB is not so common in PC LINUX world such as PC LINUX adopt X11 based windowing environment. Then not so many implementation yet
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.6 Issues(1) To investigate the possibility of HAL for 3D graphics library. –Coexistence with HAL for 2D graphics library CELF 2D HAL is using DirectFB. Direct FB can be expanded to 3D using MESA(a free OpenGL compliant library ） /DRI named DirectFBGL. KAA mechanism for 2D acceleration implementation is also abvailable. Needs to investigate these HAL and the other candidates –To specify the way to put 3D image on a 2D structure.moving image frame. It may be possible to write 3D image on the specific moving image frame. –Needs to check the frame delay. –Needs to check 2D graphics component on top of 3D image. –Is it possible to draw both 3D and 2D image in a frame simultaneously? 2D and 3D Hardware needs to create synchronization way.
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.7 Issues(2) To improve the performance –Needs to provide the way to synchronize 2D/3D/Display Drivers. Ex. ： Imagination’s 3rd Party Display Driver API –Needs to provide the substitution way for the floating point mathematics capability. For the implementation with no floating point arithmetic unit or vector arithmetic unit for geometry. –Needs to check a resource allocation mechanism for CPU(and Bus or Memory) : This is an essential OS structure issue. It may be OK if CPU in one thread could be used for 2D/3D drawing using VSYNC Synchronization and if the application manages the priority. If the communication or sound drivers is initiating new thread, the session of communication or the sound stream could be disturbed, or 3D graphics loses some frames.
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.8 AURORA SYSTEM Integrated with CPU“SH-4” （ SuperH TM ）,“PowerVR ® ” （ Imagination Technologies ）, and AD PCM Sound Engine. SI-ELECTORNICS: a part of SEGA-SAMMY Holdings has designed AURORA System for their business. AURORA consists of a system-on-chip solution integrated with CPU, Graphics Hardware Accelerator Engine, and Sound Engine and provides very compact and high performance 3D graphics and sound system. High End 3D Graphics Capability : Triangle drawing : １０ M ｐｏｌｙｇｏｎ / ｓｅｃ, and Pixel Fill Rate : 150M ｐｉｘｅｌ / ｓｅｃ Specially designed 3D graphics library provides simple and easy development environment for 3D graphics application not requiring deep hardware knowledge. Movie/Stream Audio middleware provides High Quality and High Performance Video and Audio rendering. (Real-time) LINUX OS provides highly efficient Real-time multi-task operation. AURORA SYSTEM FEATURES
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.9 Block Diagram of AURORA System SH4 300MHz 150MHz Monitor mode Max 1280x1024 ROMUSB User Option ROM ETHER DMAC MEMEORY MPEG SOUND CPU PERIPHERAL SERIAL Sound GRAPHIC 3D PCI DDR
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.10 Software Configuration of Aurora System CPU (SH4-300MHz) Power VR (MBX+VGP:150MHz) ADPCM Sound LINUX 2.6 MGL GT LIBRARY A/V Steaming Middleware APPLICATION Sound Driver
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.11 Synchronization Issue Time X X+yX+2yX+4y VSYNC CPU calc. ACCELERATOR Write In to FB X X+y Display Readout from FB y=16.6ms(for NTSC) ○ Need (or not) to provide Synchronization API among CPU, ACC, and Display Driver. ○ ACCELERATOR may also require y or more time to draw the triangles and to full them with textures. How to detect the timing? ○ Need (or not) to provide mechanism to forcing to stop the CPU/ACC at next VSYNC? ○ 2D ACCELERATOR may this problem more difficult. Which has the priority among 2D or 3D? ○ Some user is requesting to draw 2D and 3D in a frame. Each accelerator needs to announce their finish of drawing to CPU. ○ Also Motion Image like MPEG2/4 could be integrated with these images. How to synchronize them? X+yX+2y X X+y X+2yX+3y True Time to display
2005/1/26 PROSPECT Inc. / Renesas Solutions Corp.12 Discussion Needs to specify the application requirements –To list up the application case: GAME on Cellular GAME on Car Navigation System 2D and 3D Mixed Image on Navigation System Digital TV 3D Surveillance Video, etc. –Needs to specify the coverage of OS for the functionality Needs to clarify on the requirement on HAL, Synchronization, Resource Management, 2D/3D Mixed Drawing –Activity with the other working group –To invite 3rd Parties Accelerator venders, Library venders, etc. –etc.