1. Conformance Testing of MOST based Applications Towards Effective System Testing
André Baresel, Michael Schmidt DaimlerChrysler AG
Contact:

2. Overview on the Talk Telematics Application: The System Architecture
Specifying Functional Behaviour
Graphical Test Specification in Practice
Hardware in the Loop: Integration of Device Emulation
Using Graphical Logging: the importance of message tracing
Other Application Fields

3. Telematics Application From Users Point of View
Spec
Test Devel.
Test Exec
Logging
Other Appl
Telematics Application From Users Point of View
Audio (CD / Radio)
Telephone
Navigation
Video
Speech recognition
Short messaging (SMS)
User interface for body electronic

4. Telematics Application Architecture of Telematics Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Telematics Application Architecture of Telematics Application
Network of embedded devices
Bus system: MOST, CAN
Most Bus
Applications implemented by many devices
Logical separation of behaviour into FunctionBlocks

5. Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Specifying Functional Behaviour An Example of one Telematics Application
Show Tuning Info
Press Button,
Audio Application
Devices interacting * Audio Gateway * Head Unit * Microphone * CD Changer
„Switch from Tape to CD“
15 messages in this use case
interactions with other events like mobile phone
Manage Audio Channels
Fade Volume
Start Playing CD
Notify CD Position

6. Test Case Design & Execution
Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Test Case Design & Execution
Specification-based tests complex MSCs
Each MSC describes a single scenario
Specific Test Data has to be selected
Parallelism described by textual documentation
Ideas for using State Charts
textual

7. Graphical Test Specification In Practice
Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Graphical Test Specification In Practice
Test Case Design on System Level
Components are Black Boxes
Data Encodings based on XML-Spec
Timing of Messages
Variation in Message Orderings
Open Issue: “Different Ports for System Components” vs. “Modeling of parallel Components”

8. Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Test Case Design & Execution The Vision: Towards an Automated Test Environment
MSC & State based Specifications
Behavioral model
Scripts
Test execution
Starting with Specification MSC
Fill in Test aspects (e.g. Timing, Error Situation, Test Data)
Execute Tests within the different Integration phases
Compare easily with Specification e.g. Visualization in MSC style
Goal: As much as possible automated...
Systematic Definition of Test Data
Classification-Tree
Method

9. Test System Hardware Environment
Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Test System Hardware Environment
SUT: Interplay of MOST devices
Test Hardware allows Stimulation
Capturing of communication between all devices
SUT: Interplay of MOST devices to realize a specific functionality

10. Test System Software Architecture
Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Test System Software Architecture
TTCN Test Cases
MOST/CAN Message Definition
MOST/CAN Message Encoder
TTCN-3
TTCN-3 Execution Environment
Test Runtime Interface
Remote Test Runtime Interface
MOST Interface
PCI Karte
Optolyzer
MOST NetServices
stimulate / simulate Or
virtual devices
CAN Interface
verify & simulate
CAN Card
CAN Driver
Optolyzer Interface
Optolyzer
MOST Optolyzer Control
verify
Hardware Interface to Access SUT

11. Hardware in the Loop Integration of Device Emulation
Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Hardware in the Loop Integration of Device Emulation
Test Scripts running with virtual & existing Devices
TRI Implementation detects whether or not a Device exists
Message Verification or Stimulation* is used
voice
Virtual Key
CAN bus
Virtual
CD Changer
MOST
CAN
* Stimulation: Rules for the ordering of the Messages on the Bus is defined

12. Using Graphical Logging The Importance of Message Tracing
Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Using Graphical Logging The Importance of Message Tracing
Goal: Visualization of Message Passing for Analysis and Documentation
Telematics Testers work with Logs of different Sources, Filtering the important information is essential
Documentation and Error Reporting
Solution:
Graphical Logger Prototype using Logger-Interface
Allows Navigation and Filtering

13. Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Conclusion
TTCN-3 has been successfully used to test Telematic applications
First steps toward an efficient test development environment
The usage of GFN for specifying tests has been approved
The TRI allows us to create all scenarios of Hardware in a Loop (HIL)
It was easy to add new Hardware Interfaces
A prototype of a graphical logger has shown the advantages of the solution

14. Future Extensions… Using TTNC-3 to Execute State Based Test Models
Application
Spec
Test Devel.
Test Exec
Logging
Other Appl
Future Extensions…
Using TTNC-3 to Execute State Based Test Models
Wait for Events on Continue Signals
Describe Signal Generation
Other Aspects
Integration with Test Management Tools
Roundtrip Testing: From Logging to Test Cases

15. Other Application Fields for TTCN-3 In the Automotive Context
Spec
Test Devel.
Test Exec
Logging
Other Appl
Other Application Fields for TTCN-3 In the Automotive Context
Real Time Environments
motor controller (petrol & diesel engine)
electronic gear shifting, car body control (pneumatic shock absorption)
environmental electronics (e.g. window heating, air conditioning unit)
Characterisation of Applications
many components interact
over different networks (most, can, bluetooth)
overlapping functionality
Real time constrains to be validated

16. Conformance Testing of MOST based Applications Towards Effective System Testing
André Baresel, Michael Schmidt DaimlerChrysler AG
Contact: