1. © Fraunhofer FIRST Dr. Stephan Weißleder Research Manager Testing Department Quality of Embedded Systems (QUEST) Fraunhofer-Institute FIRST Relation of Model-Based Testing and Safety-Relevant Standards

2. © Fraunhofer FIRST Page 2 Fraunhofer-Institute FIRST – Department QUEST Review and AssessmentTestingVerification IEC 61508 DO-178B ISO 26262 IEC 62061 EN 50128 IEC 61508 DO-178B ISO 26262 IEC 62061 EN 50128 certified

3. © Fraunhofer FIRST Page 3 Model-Based Testing

4. © Fraunhofer FIRST Page 4 –Early testing –Low costs –Support for certification –Early testing –Low costs –Support for certification –Better test management –Early testing –Low costs –Support for certification –Better test management –High degree of automation –Better test coverage Model-Based Testing Requirements Model Implementation Unit test System test Acceptance test Validation and traceability of requirements Generation of test design & test oracle Early acceptance test by model simulation Design Test management, Variant management

5. © Fraunhofer FIRST Page 5 How Does MBT Support Safety-Relevant Standards?

6. © Fraunhofer FIRST Page 6 How Does MBT Support Safety-Relevant Standards? Requirements Tests ? Higher Efficiency, Automatic Traceability Validation of requirements, Better Traceability? Measure/Achieve code coverage, More detailed coverage information for system tests? Relation of model coverage and requirements coverage? TraceabilityCoverage

7. © Fraunhofer FIRST Page 7 How do Safety-Relevant Standards Support MBT?

8. © Fraunhofer FIRST Page 8 Standards The good things about standards is there are so many to choose from. VDE 0801 IEC 61508 ISO 15408 ISO 26262 RTCA DO-178B ARINC 653 EN 50126 EN 50128 EN 50159 IEC 62061 EN ISO 13849 ISO TR 15497 General purpose Automotive Aviation Railway Machinery

9. © Fraunhofer FIRST Page 9 ISO 26262 (under publication) 26262-4 26262-6 "Testing activities are also treated differently since models can be used as a useful source of information for the testing process (model-based testing)."

10. © Fraunhofer FIRST Page 10 RTCA DO-178B – 1992 DAL EDAL DDAL CDAL BDAL A No effectMinorMajorHazardousCatastrophic (Source: John Joseph Chilenski) (Source: DO-178B Standard)

11. © Fraunhofer FIRST Page 11 RTCA DO-178B – 1992 ObjectiveDAL ABCD Test coverage of high-level requirements is achieved. XXXX Test coverage of low-level requirements is achieved. XXX Test coverage of software structure is achieved. (MC/DC) X Test coverage of software structure is achieved. (Decision Coverage) XX Test coverage of software structure is achieved. (Statement Coverage) XXX Test coverage of software structure is achieved. (Data coupling / control coupling) XXX No support for model-based testing. Things are getting better in DO-178C ?

12. © Fraunhofer FIRST Page 12 IEC 61508 – 2010 !!!

13. © Fraunhofer FIRST Page 13 IEC 61508 – 2010

14. © Fraunhofer FIRST Page 14 IEC 61508 – 2010 Advantages: -Early requirements validation -Automatic test case generation -Combination of test case generation and code coverage measurement Model-based testing is (highly!) recommended. Model-based testing is (highly!) recommended.

15. © Fraunhofer FIRST Page 15 Dr. Stephan Weißleder stephan.weissleder@first.fraunhofer.de +49 (0)30 6392 1876 Our mission is to bring model- based testing to industrial practice.