1. CYPRESS PNSQC (15-17 Oct. 2001) 1 Testing a Bluetooth Product With Web and Embedded Software Rick Clements cle @ cypress.com Cypress Semiconductors 9125 SW Gemini Dr., Suite 200 Beaverton, OR 97008

2. CYPRESS PNSQC (15-17 Oct. 2001) 2 Purpose  Embedded & web based software have different constraints  Embedded & web based software have different tools  The embedded & web environments are merging  Provide a planning example of a project in both environments

3. CYPRESS PNSQC (15-17 Oct. 2001) 3 Presentation Structure  The process is in the paper  Sample documents are in the appendix  Slides available at http://www.geocities.com/rick_clements/blue.ppt

4. CYPRESS PNSQC (15-17 Oct. 2001) 4 Overview  Product under test  Scoping the effort  The QA plan  The test plan  Questions  Summary

5. CYPRESS PNSQC (15-17 Oct. 2001) 5 Internet Product Under Test Server Local PC Bluetooth

6. CYPRESS PNSQC (15-17 Oct. 2001) 6 Scoping The Effort  Software environments  Organization of the team  Tools

7. CYPRESS PNSQC (15-17 Oct. 2001) 7 Software Environments Internet & Windows  Compatibility with different servers running different OS  Servers may be busy or unavailable  Large amount of memory locally, storage locally and storage on servers  Tools for testing memory leaks, measuring test coverage and automating tests exist Scoping The Effort Embedded  Runs on a single device  Playing music requires real- time limits of msec.  A limited memory & storage  Few off the shelf tools

8. CYPRESS PNSQC (15-17 Oct. 2001) 8 Possible Team Organization  Test & QA team per discipline –Software –Electrical –Mechanical  Single combined team  System testing encompasses all disciplines Scoping The Effort

9. CYPRESS PNSQC (15-17 Oct. 2001) 9 Organization Of The Team  Test lead  Electrical, mechanical & software debug - designers  Embedded software - 1 software test engineer  Windows & web software- 1 software test engineer  Internal mechanical & electrical - 1 mechanical test engineer  EMI & UL tests - 1 environmental test engineer Scoping The Effort

10. CYPRESS PNSQC (15-17 Oct. 2001) 10 Tools  Windows and Internet - commercial test tool  Embedded test tools developed internally –This is a full development effort –It needs adequate planning, time & resources  Scopes, in circuit emulator, etc.  Time at EMI and UL facilities will be rented Scoping The Effort

11. CYPRESS PNSQC (15-17 Oct. 2001) 11 The QA Plan  Configuration management –Software / hardware changes –Typical change –Hardware description languages –Product / web configuration  Issue tracking

12. CYPRESS PNSQC (15-17 Oct. 2001) 12 Typical Change  Requirement for monitoring battery usage discovered  Add a gas gauge chip –Electrical & mechanical change  Add software driver for the chip  Add software to display status on GUI  Configuration management vitally important QA Plan

13. CYPRESS PNSQC (15-17 Oct. 2001) 13 Hardware Description Languages  Blurs the line between software and Hardware  Source easily managed  Graphical environment - same issues as Windows  Configuration management a “software thing” QA Plan

14. CYPRESS PNSQC (15-17 Oct. 2001) 14 Product / Web Configuration  Web content changes quickly  Software on PC changes more slowly  Firmware in device changes more slowly  Address in product & tests plans QA Plan

15. CYPRESS PNSQC (15-17 Oct. 2001) 15 Issue Tracking  It’s a software problem  Investigation shows electrical problem  Fix it in software  Must have a common tracking system QA Plan

16. CYPRESS PNSQC (15-17 Oct. 2001) 16 The Test Plan  Tools  Hooks into the product  Reviews  Compatibility tests  Host / device tests  Stress tests  Power tests  Electrical & mechanical tests  Schedule –Schedules & staffing levels - Cem Kaner & Kathy Iberle papers

17. CYPRESS PNSQC (15-17 Oct. 2001) 17 Tools  Web & windows tool selection  Embedded tool development  Buy or rent tools for electrical and mechanical tests Test Plan

18. CYPRESS PNSQC (15-17 Oct. 2001) 18 Hooks Into The Product  Affect the test approach  Warning and status easier to test  RS232 vs Bluetooth Test Plan

19. CYPRESS PNSQC (15-17 Oct. 2001) 19 Reviews  Catch error early  High risk –Interfaces –New technology –Tight timing requirements  Extendibility –Multiple languages –Multiple host platforms Test Plan

20. CYPRESS PNSQC (15-17 Oct. 2001) 20 Compatibility Tests  Product / web servers –Gold, silver & don’t care sites –Test when product OR site changes –On going management  Operating systems –Windows 95?, 98, ME, NT, 2000, XP?  Bluetooth cards in the host Test Plan

21. CYPRESS PNSQC (15-17 Oct. 2001) 21 Host / Device Tests  Protocol –Standard –Proprietary  Error handling –Handled by hardware –Handled by software Test Plan

22. CYPRESS PNSQC (15-17 Oct. 2001) 22 Stress Tests Host Tests  Low memory in host Test Plan Device Tests  Play music, change pages & download  Automation –Commands over Bluetooth –Two way communication changes timing –Must be manual

23. CYPRESS PNSQC (15-17 Oct. 2001) 23 Power Tests  Operates over entire battery life - hardware  Displays accurate battery life - software Test Plan

24. CYPRESS PNSQC (15-17 Oct. 2001) 24 Electrical & Mechanical Tests Internal Tests  Heat –Operation –LCD readable  Drop tests  Shipping container Test Plan Agency Tests  EMI  UL

25. CYPRESS PNSQC (15-17 Oct. 2001) 25 Summary  Many different areas –Web software –PC software –Embedded software –Electrical –Mechanical  You can’t be an expert in all areas  You need a good team