CYPRESS PNSQC (15-17 Oct. 2001) 1 Testing a Bluetooth Product With Web and Embedded Software Rick Clements cypress.com Cypress Semiconductors 9125 SW Gemini Dr., Suite 200 Beaverton, OR 97008
CYPRESS PNSQC (15-17 Oct. 2001) 2 Purpose Embedded & web based software have different constraints Embedded & web based software have different tools The embedded & web environments are merging Provide a planning example of a project in both environments
CYPRESS PNSQC (15-17 Oct. 2001) 3 Presentation Structure The process is in the paper Sample documents are in the appendix Slides available at
CYPRESS PNSQC (15-17 Oct. 2001) 4 Overview Product under test Scoping the effort The QA plan The test plan Questions Summary
CYPRESS PNSQC (15-17 Oct. 2001) 5 Internet Product Under Test Server Local PC Bluetooth
CYPRESS PNSQC (15-17 Oct. 2001) 6 Scoping The Effort Software environments Organization of the team Tools
CYPRESS PNSQC (15-17 Oct. 2001) 7 Software Environments Internet & Windows Compatibility with different servers running different OS Servers may be busy or unavailable Large amount of memory locally, storage locally and storage on servers Tools for testing memory leaks, measuring test coverage and automating tests exist Scoping The Effort Embedded Runs on a single device Playing music requires real- time limits of msec. A limited memory & storage Few off the shelf tools
CYPRESS PNSQC (15-17 Oct. 2001) 8 Possible Team Organization Test & QA team per discipline –Software –Electrical –Mechanical Single combined team System testing encompasses all disciplines Scoping The Effort
CYPRESS PNSQC (15-17 Oct. 2001) 9 Organization Of The Team Test lead Electrical, mechanical & software debug - designers Embedded software - 1 software test engineer Windows & web software- 1 software test engineer Internal mechanical & electrical - 1 mechanical test engineer EMI & UL tests - 1 environmental test engineer Scoping The Effort
CYPRESS PNSQC (15-17 Oct. 2001) 10 Tools Windows and Internet - commercial test tool Embedded test tools developed internally –This is a full development effort –It needs adequate planning, time & resources Scopes, in circuit emulator, etc. Time at EMI and UL facilities will be rented Scoping The Effort
CYPRESS PNSQC (15-17 Oct. 2001) 11 The QA Plan Configuration management –Software / hardware changes –Typical change –Hardware description languages –Product / web configuration Issue tracking
CYPRESS PNSQC (15-17 Oct. 2001) 12 Typical Change Requirement for monitoring battery usage discovered Add a gas gauge chip –Electrical & mechanical change Add software driver for the chip Add software to display status on GUI Configuration management vitally important QA Plan
CYPRESS PNSQC (15-17 Oct. 2001) 13 Hardware Description Languages Blurs the line between software and Hardware Source easily managed Graphical environment - same issues as Windows Configuration management a “software thing” QA Plan
CYPRESS PNSQC (15-17 Oct. 2001) 14 Product / Web Configuration Web content changes quickly Software on PC changes more slowly Firmware in device changes more slowly Address in product & tests plans QA Plan
CYPRESS PNSQC (15-17 Oct. 2001) 15 Issue Tracking It’s a software problem Investigation shows electrical problem Fix it in software Must have a common tracking system QA Plan
CYPRESS PNSQC (15-17 Oct. 2001) 16 The Test Plan Tools Hooks into the product Reviews Compatibility tests Host / device tests Stress tests Power tests Electrical & mechanical tests Schedule –Schedules & staffing levels - Cem Kaner & Kathy Iberle papers
CYPRESS PNSQC (15-17 Oct. 2001) 17 Tools Web & windows tool selection Embedded tool development Buy or rent tools for electrical and mechanical tests Test Plan
CYPRESS PNSQC (15-17 Oct. 2001) 18 Hooks Into The Product Affect the test approach Warning and status easier to test RS232 vs Bluetooth Test Plan
CYPRESS PNSQC (15-17 Oct. 2001) 19 Reviews Catch error early High risk –Interfaces –New technology –Tight timing requirements Extendibility –Multiple languages –Multiple host platforms Test Plan
CYPRESS PNSQC (15-17 Oct. 2001) 20 Compatibility Tests Product / web servers –Gold, silver & don’t care sites –Test when product OR site changes –On going management Operating systems –Windows 95?, 98, ME, NT, 2000, XP? Bluetooth cards in the host Test Plan
CYPRESS PNSQC (15-17 Oct. 2001) 21 Host / Device Tests Protocol –Standard –Proprietary Error handling –Handled by hardware –Handled by software Test Plan
CYPRESS PNSQC (15-17 Oct. 2001) 22 Stress Tests Host Tests Low memory in host Test Plan Device Tests Play music, change pages & download Automation –Commands over Bluetooth –Two way communication changes timing –Must be manual
CYPRESS PNSQC (15-17 Oct. 2001) 23 Power Tests Operates over entire battery life - hardware Displays accurate battery life - software Test Plan
CYPRESS PNSQC (15-17 Oct. 2001) 24 Electrical & Mechanical Tests Internal Tests Heat –Operation –LCD readable Drop tests Shipping container Test Plan Agency Tests EMI UL
CYPRESS PNSQC (15-17 Oct. 2001) 25 Summary Many different areas –Web software –PC software –Embedded software –Electrical –Mechanical You can’t be an expert in all areas You need a good team