Presentation is loading. Please wait.

Presentation is loading. Please wait.

Mobile Platform: Technical Perspective

Similar presentations

Presentation on theme: "Mobile Platform: Technical Perspective"— Presentation transcript:

1 Mobile Platform: Technical Perspective
Justin (Joon Sung) Hong Software Center, Samsung Electronics

2 Contents Agenda Audience Introduction Technical Trend Case Studies
Standardization Conclusion Appendix. Subjective Recommendation Audience Researchers/Developers of embedded mobile software solutions Students majoring in electrical/computer/software engineering

3 Introduction

4 Computers Products in Samsung Electronics Quiz
Which programming languages are used for devices? How many lines of codes are inside a device? How many mobile phones are sold for a year? How many mobile subscribers in the world?

5 A Secret Life of a Cellphone
Samsung SGH-D600

6 Reference Hardware Architecture
LCD Keypad LCD Single or Dual CPU RF Modem Application Processor Audio FIFO or DPRAM MUX MCP Camera MCP Memory Card NOR NOR SDRAM NAND SDRAM

7 Reference Software Architecture
Native Application 3rd Party and VM Application Application Shell Application Service Extension (Optional) Platform Interface Application Framework (Optional) SW Platform OS, Security Graphics, Window Data Protocol & Local Connectivity Audio-Visual & Multimedia Telephony Processor MMI Connectivity Multimedia Net Access HW Platform Peripherals

8 What is Mobile Platform?
A mobile platform describes some sort of framework, either in hardware or software, which allows mobile applications to run. Typical platforms include a mobile device's architecture, operating system or middleware, and their runtime libraries. Related terms {Mobile|Wireless} {software|system|application|internet|} platform Examples Mobile software platform Wireless internet platform Mobile system platform Mobile application platform

9 Why Mobile Platform? Mobile operators Device manufacturers
Reduced content and services management Support of push-pull information delivery [ARPU] Multimedia, interactivity and location based features [ARPU] Multitasking [ARPU] Security Device manufacturers Common interfaces Better development environment Productive application framework Digital convergence Reliability (minimise crashes and bugs) Application providers Open APIs Enhanced libraries and tools for easier and faster development Support of a variety of programming languages Chipset vendors System engineering Fast time-to-market

10 Mobile Platform War Platform by platform/application software companies Symbian OS Microsoft Windows for Mobile MontaVista Mobilinux PalmOS Openwave PhoneSuite Teleca Obigo RIM BlackBerry Nokia Symbian OS + Series 40/60/80/UIQ/90 Platform by manufacturers Motorola Synergy-2000, Linux Samsung Mocha, Ocean

11 Mobile Platform War (Cont.)
Platform by chipset vendors Ericsson Mobile Platform QUALCOMM BREW TTPCom Ajar TI OMAP Platform by operators Java2 Mobile Edition WIPI SavaJe GVM, MAP, etc.

12 Connected PDA/ High-end High-end/rich Feature
Mobile Phone Sales 2004 % 32% % % 2.6% % 28% % % 1.5% Technology Requirements & BOM Technology Range Connected PDA/ High-end Smartphone Low-end Mid-range High-end/rich Feature Low-end Smartphone Source: Future Mobile Handsets 2004

13 Market Share Estimates for Smart Phones
Source: Public industry reports

14 Technical Trend

15 1.Processor CPU DSP Core: ARM9 with MMU
Multi-core Configuration: Single chip (CPU core, baseband processing, DSP) or dual chip (modem and application processor) Single CPU or MCP with dual-core DSP Core: TI TMS, Ceva, StarCore, Samsung CalmRISC, ARM DSP, QUALCOMM QDSP, etc. DSP array Software: Remote execution/wait, emerging DSP platform More DSP platforms, DSP virtualization

16 2.System Software OS Storage
Kernel: RTOS for modem (e.g. Nucleus, REX, AMX, OSE), RTOS or GPOS for application processor (e.g. Linux, Windows Mobile), multi-tasking, single address space, no memory protection Multi-threading, virtual memory, memory protection for applications Hybrid/Nano kernel for running multiple OS (e.g. Jaluna Vmware) Energy-awareness Storage File system: Proprietary NAND/NOR file system Performance/security enhancement eXecution-In-Place (XIP), shared library Database: Indexed file system or proprietary table data management Public database with connectivity (e.g. JDBC), SQL-like query

17 2.System Software (Cont.)
Security Anti-threats: Not yet covered but on going… Code protection, secure boot, RTC, memory Trusted computing Acceleration: SW ECC and HW RSA acceleration + Package engine (e.g. IPSec) Reliability Bug patch: Manual w/ USB, OTA firmware upgrade OTA firmware/component upgrade Zero administration

18 TI Applications Processing Solutions

19 OMAP1710 Architecture 90 nanometer CMOS technology
ARM926EJ CPU core (~220MHz) Secure boot-loader Hardware acceleration for security standards and random number generator Memory controller for I/F to 128MB SDRAM, 256MB Flash, Mobile DDR CompactFlash, SD/MMC/SDIO ports TMS320C55X DSP (~220MHz) One/two instr. executed per cycle Video HW accelerator for DCT, iDCT, pixel interpolation, and motion estimation for video compression Connectivity USB OTG, UARTS, I2C, Fast IrDA (FIR), SPI LCD Controller, camera ports

20 Models of Trusted Computing
Better! userland userland userland userland userland trusted userland kernel kernel kernel virtualization kernel kernel VMM kernel trusted kernel Normal OS Virtual Machine (VMWare, Java VM) Virtual Machine Monitor CPU with trusted mode (MS NGSCB, ARM TrustZone)

21 Trusted Computing Architecture

22 Microsoft Next-Generation Secure Computing Base
Main OS USB Driver Nexus-Mode (RHS) Nexus NexusMgr.sys HAL NAL User Apps. Agent NCA Runtime Library Trusted UI Engine (TUE) TSP Standard-Mode (LHS) User Kernel Hardware Secure Input Secure Video TPM 1.2 CPU Chipset

23 ARM TrustZone TrustZone adds a “parallel world” to allow trusted programs and data to be safely separated from the operating system and applications Not TPM-based TCG, but resolves the security requirements Similar to Intel’s.

24 3.Graphics 3D graphics Vector graphics Font
Engine: Proprietary or standard-based solutions (e.g. Hi MascotCapsule, Superscape Swerve, Fathammer) OpenGL-ES, Mobile 3D Graphics (JSR-184) Acceleration: SW or 1~2M triangles/sec acceleration, OpenGL-ES/EGL 1.0 (e.g. ARM MBX, nVIDIA GeForce) 50M < triangles/sec acceleration, OpenGL-ES 2.0 Vector graphics Engine: Standard-based solutions (e.g. Sharp SVG-T, BitBoys) SVG Basic Acceleration: 100~200M pixels/sec acceleration OpenVG Font Font: bitmap and vector trials Downloadable/upgradeable fonts Vector, 3D font

25 ARM MBX 3D Graphics Accelerator
Easily integrated with ARM926EJ-S, ARM1136J-S using AMBA Features Deferred texturing Tile-based rendering Scene manager PVR-TC : texture compression YUV to RGB conversion Flat & Gouraud shading Full-screen anti-aliasing Optimized UMA (Unified Memory Architecture) ITC (Internal True Color operations) Performed on chip at 32-bpp for superior color precision Two kinds of cores MBX HR-S Fill rate : M pixels/s Rendering rate : 2.5M tri/s Screen resolution : up to VGA MBX R-S Fill rate : M pixels/sec Rendering rate : 1M tri/s Screen resolution : up to QVGA

26 4.Multimedia A/V CODEC Broadcasting
Video: H.263/MPEG4, RTP/RTCP streaming (e.g. RealNetworks, PacketVideo) H.264/WMV10, OpenMAX Sound/Speech/Audio: Yamaha 40~64 poly, NB-AMR, MP3 MP3/AAC+, OpenMAX, WB-AMR Image: BMP, WBMP, GIF, JPEG, PNG + JPEG2000, Motion JPEG Broadcasting Trials on Satellite-DMB, Terrestrial-DMB, DVB-Handheld/IPDC, QUALCOMM MediaFLO Related to policy / regulation Interactive

27 5.Network WAN GSM: 3GPP release 4, WCDMA/EDGE commercialization
3GPP release 6, HSDPA CDMA: IS-856, 1xEVDO 1xEVDV (cdma2000 Rev.D) WAN+WiFi (seamless handover)

28 5.Network (Cont.) 4 G MAN/LAN/PAN 802.11a/b/g commercialization
802.11n, Mobile WiMax (802.11e) vs. WiBro IrDA, Bluetooth 1.0 More Bluetooth profiles, Bluetooth 2.0, UWB 2010+ Mobility 1995 2000 2005 High 4 G 3G+ 3G ( IMT2000 ) CDMA2000 EV-DO/DV WCDMA/HSDPA WiBro Mobile WiMax (802.16e) 2G ( Digital ) CDMA/GSM/TDMA 1G ( Analog ) UWB 802.11n MANET High speed WLAN AMPS ETACS JTACS NMT 5GHz WLAN 802.11a/g 2.4GHz WLAN 802.11b Bluetooth PAN Low Data Rate ~ 14.4 kbps 144 kbps 384 kbps <50 Mbps <100 Mbps

29 5.Network (Cont.) Upper layers Wireless-profiled TCP/IPv4, mobile IPv4
IPv6/v4 Ad-hoc networking Emerging SIP/SDP IP Multimedia Subsystem, VoIP, IMPS


31 MSM6250 Architecture

32 MSM6250 Features Processor NetAccess Connectivity Multimedia
ARM926EJ-S up to 150MHz with MMU Java HW acceleration MMC/SD interface NetAccess Dual-mode WCDMA plus GSM/GPRS ZIF RF supports WCDMA, quad-band GSM (GSM 850, 900, 1800, 1900) gpsOne solution RUIM/SIM Controller Connectivity Support Bluetooth baseband Multimedia 2D/3D graphics acceleration 2 Megapixel camera interface QDSP4000 up to 75MHz (Data transmit rate 153Kbps) Supports the advanced feature set of the Launchpad suite, including streaming video, audio, still image and video encoding and decoding

33 6.Application Browsing Messaging
Presentation (e.g. Access, Openwave, etc.): XHTML MP, WML1.3 XHTML, CSS Protocol: WSP/HTTP dual stack HTTP Messaging Multimedia messaging: OMA MMS 1.1 OMA MMS 2.0, Instant messaging: OMA IMPS 1.1 (WirelessVillage) IOP w/ wired IM clients Push-To-Talk

34 6.Application (Cont.) Security Java Remote service
Digital rights management: OMA DRM 1.0 (FL/CD/SD) OMA DRM 2.0, Microsoft Janus, Apple Java Virtual machine: SW – Sun CLDC HI, HotSpot, HW - ARM EJ, Nazomi Similar tech. but more hardwired Class libraries: MIDP/CLDC, Wireless Messaging, Mobile Multimedia API + CDC, Mobile 3D/Vector Graphics, New Architecture Remote service Web service OMA Mobile WS

35 Java2 Micro Edition Applet KVM / CVM

36 ARM Jazelle Java Acceleration
Jazelle bytecode partition 139 bytecodes executed directly in hardware (constant loads, variable loads/stores, array load/stores, etc.) 88 bytecodes executed in software (floating point, integer division, switch, invoke, etc.) ARM9EJ-S pipeline (6 stage - Java state) Jazelle logic turns on ALU Control Signals Bytecode Instruction Stream Java Decode Stack Management Java Decode Register Read Compute Partial Products Shift + ALU Sum/Accumulate & Saturation Memory Access Register Write Thumb Decode Instruction Fetch Register Decode Register Read ARM Decode Register Decode Register Read FETCH DECODE EXECUTE MEMORY WRITEBACK

37 7.User Interaction Man-Machine Interface Personalization
IME: Too many solutions (e.g. T9, ez, CJI, etc.) Similar but better idea (ex. Fast tap, Q12, Virtual keypad, etc.) Voice recognition: Used for voice dialing/phonebook lookup but not complete (e.g. VoiceSignal, Conversay) Voice command/browsing Personalization Context awareness: Trial Preference, location-based consulting, etc. UI customization: Color, theme, menu tree Whole look&feel with Macromedia Flash, XML, or COM technologies

38 8.Device Camera LCD Storage 1M~2M pixels, flash, optical zoom
5M < pixels, auto focus, etc. LCD TFT/TFD, 65K colors, 176x220 or QVGA size OLED/3D, <= 16M color, <= SVGA size Storage 32~64MB NAND internal flash memory 8GB < NAND flash memory card, 40GB < HDD

39 Case Studies

40 Symbian OS (+Series 60) Symbian OS Series 60
Owned by Nokia, Ericsson, SonyEricsson, Panasonic, Siemens, and Samsung. Series 60 Developed and licensed by Nokia

41 v9.1 Features Real-time Hardware support Security Graphics Multimedia
A real-time, multithreaded kernel Hardware support Latest CPU architectures, peripherals and internal and external memory types Security Application capabilities through certification, private protected data stores. full encryption and certificate management, secure protocols (HTTPS, SSL and TLS) and WIM framework Graphics Direct access to screen and keyboard, graphics accelerator API, increased UI flexibility Multimedia Recording, playback and streaming, image conversion Mobile telephony WCDMA (3GPP R4 and R5 IMS), GSM CSD and EDGE CSD, GPRS and EDGE GPRS, IS-95 and 1xRTT, SIM, RUIM, UICC Toolkit, CDMA specific features Communications protocols TCP/IP (dual mode IPv4/v6) and WAP 2.0 (Connectionless WSP and WAP Push), IrDA, Bluetooth and USB International support Unicode Standard version 3.0

42 v9.1 Features (Cont.) Device Management/OTA provisioning
OMA DM compliant, OMA Client provisioning v1.1 Data synchronization PC-based/OTA synchronization, a PC Connectivity framework PIMS Contacts, scheduling, and messaging, OBEX for exchanging appointments (vCalendar) and business cards (vCard) Messaging Enhanced messaging (EMS) and SMS, internet mail using POP3, IMAP4, SMTP and MHTML, attachments Java MIDP 2.0, CLDC 1.1, JTWI (JSR185), Mobile Media API (JSR135), Java API for Bluetooth (JSR082), Wireless Messaging (JSR120), Mobile 3D Graphics API (JSR184) and Personal Information Management and FileGCF APIs (JSR075)

43 Device Family Reference Design
Crystal Feature-rich, Communicator-type devices Full (typically qwerty) keyboard Landscape-oriented (horizontal) display Nokia 9290 Communicator Peal Standard smart phones Small display & limited keyboards Nokia 7650 Quartz Pen-based phone similar to the Palm PDA Portrait-oriented (Vertical) display SonyEricsson P802

44 Standardization

45 Standardization Bodies
OMA (Open Mobile Alliance) All mobile application middleware and services including browsing, synchronization, device management, messaging, location, security, etc. Multimedia ITU-T (International Telecommunication Union) MPEG4, H.324M, JPEG2000, etc. Khronos Media authoring and playback including OpenGL-ES, OpenVG, OpenMAX, etc.

46 Standardization Bodies (Cont.)
Operating System CELF (CE Linux Forum) Embedded Linux Internet W3C (World Wide Web Consortium) XML, DOM, PNG, SMIL, SVG IETF (Internet Engineering Task Force) SIP, TCP/IP, MIPv6, DNS, IPSec, RTP/RTSP ECMA (European Computing Machinery Association) C#, ECMAScript, etc.

47 Standardization Bodies (Cont.)
System MIPI (Mobile Industry Processor Interface) Mobile application processor TCG (Trusted Computing Group) Secure computing Telephony 3GPP GSM/GPRS/WCDMA 3GPP2 IS95, IS2000 CDG (CDMA Development Group)

48 Standardization Bodies (Cont.)
Wireless internet JCP (Java Community Process) J2ME, MMAPI, WMA, etc. KWISF (Korea Wireless Internet Standardization Forum) WIPI, LBS, MMS, etc. Operator OMTP (Open Mobile Terminal Platform) GSMA (GSM Association)

49 Conclusion

50 Conclusion The mobile world is moving very fast.
Digital convergence comes true and mobile phones are at the center of the trend. Digital still camera, MP3 player, PDA, GPS receiver, game console, digital video recorder, and TV have been converged. What will be the next? The mobile platform is the key technology. Currently, ARM, QUALCOMM, Symbian, Nokia, TI, Openwave, Real, etc. are winners. Who will be the next?

51 Appendix. Subjective Recommendation
To be a good software architect and/or software project manager in embedded worlds

52 Common Fallacies of Software Lovers
Software development is art. Computer/Software engineering is NOT computer science. Scientists develop for learning, but engineers learn for development. Design and coding are most valuable skills. Maintenance is the longest (> 40%~80%) phase of software lifecycle, i.e. Maintenance > Testing > Design > Coding/Requirements. Read good codes before writing your own. Development process is the only need to know. Learn various software engineering disciplines. The knowledge of hardware and system software is none of my business. The development without the knowledge is to create an empire built on sand.

53 Software Engineering Body of Knowledge
Requirements Design Construction Testing Maintenance Requirements Fundamentals Requirements Process Requirements Elicitation Requirements Specification Requirements Validation Requirements Analysis Practical Considerations Design Fundamentals Key Issues in Design Structure and Architecture Design Quality Analysis and Evaluation Design Notations Design Strategies and Methods Construction Fundamentals Managing Construction Practical Considerations Testing Fundamentals Test Levels Test Techniques Test Related Measures Test Process Maintenance Fundamentals Key Issues in Maintenance Maintenance Process Techniques for Maintenance Configuration Management Engineering Management Engineering Process Quality Tools and Methods Management of the SCM Process Configuration Identification Configuration Control Configuration Status Accounting Configuration Auditing Release Management and Delivery Initiation and Scope Definition Project Planning Project Enactment Review and Evaluation Closure Engineering Measurement Process Implementation and Change Process Definition Process Assessment Process and Product Measurement Quality Fundamentals Quality Management Processes Practical Considerations Related Disciplines Computer Engineering Computer Science Mathematics Software Ergonomics Systems Engineering

Download ppt "Mobile Platform: Technical Perspective"

Similar presentations

Ads by Google