1. Process Modeling Tool Example: Unit Tests
Oscar Slotosch, Validas AG
Process Modeling Tool Example: Unit Tests

2. Goals Provide an (short overview on PMT) First steps with the tool
Show how to model an (realistic) example
Requirements
Process
Compliance
Verification & Validation
Tutorial

3. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

4. PMT Overview
PMT = Process Modeling Tool (In future also Project Management Tool?)
Main goals
Define processes
Argue & show compliance
Use process model for
Product verification
Process documentation
Process consistency & validation
Project Planning
Project Management
Model-based processes
Reuse process modules
Variant handing & tailoring
Graphical visualization
Report Generation
Developed in research project SPEDIT (BMBF)
Successfully used for TÜV certification of Validas qualification processes

5. Process Modeling Tool PMT
Model-Based Process
Link Requirements to Processes and
Verification Actions
Formalize
Tailor
Parameters
PMT
QKit
ISO 26262,
IEC 61508, ..
Formalize
Parameter Values
Generate
Generate
Generate
VVT
Process Description
Verification Validation Plan
Verification Validation Report
Project: V&V
Compliance
Report
Safety Plan
Safety Case

6. How to Model Processes? PMT Metamodel Overview
Requirement
References
StakeHolder
Compliance
References
Artifact
Output
Input
ProcessModule
Parameter
Binding
Verifies
VerifcationModule
Before
/ After
References
Model
Criterion

7. Graphical Process Notation
Elements
Process Module: blue, rounded box:
Verification Module: green, rounded box:
Hierarchical Process Module: blue folders:
Hierarchical Verification Module: green folders:
Artifact: Grey box with note:
Model: Orange box with note:
StakeHolder: transparent box:
Conditions: yellow routes:
Relations
Before After: solid arrow:
Read/Write: dashed arrow:
Artifact Containment: dotted arrow:
Default
Start & End

8. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

9. Installation & Start Preparation
Java Runtime Environment (JRE) Version 8 installed
Graphviz 2.38 installed, e.g. from
Add dot.exe (from <graphvizhome>/bin) to your system path
Installation:
Unzip PMT Distribution, e.g. PMT-win32.win32.x86_64.zip
Start PMT by double clicking on (ProcessModelingTool.exe)

10. Creation of Process Model
PMT Tool (started with default views)
File -> New -> PMT Model
Define location and select Process as Model Object
Press Finish

11. PMT Views Menus for basic functions: New, Open, Save, Preferences
Property View
Tree Browser:
Model Structure
Special Views

12. Property Groups in Properties View
Properties are grouped (in collapsible groups)
Basic: Most important properties
Extended: further properties
Layout: Layout Preferences for graphical views
Tayloring: Properties for tailoring

13. Meta Model defines Model Structure
PMT has a fixed model structure
The PMT model structure is described using the „meta model“
Model elements are marked using red color in this training
The model is a tree: and Process is the (type of the) root element
Every model element has „Properties“ that can be edited using PMT
Most model elements in the tree can have children. Children can be created using tree viewer.
There are two (graphical) granularities:
1) Powerpoint: (model) elements and important relations
2) User manual (UML): above with multiplicities, association names and attributes
Element
Process
Multiplicity
Composition
Inheritance
Attributes
ProcessModule
VerificationModule
Association Name
Association
Aritffact

14. Association (single Value) Associations (value lists)
Editing the Model
2) Change values & associations of elements in property view
1) Select element in tree browser
Attribute
Attribute
Association (single Value)
Value
Composition
Composition
Link
Associations (value lists)
Associations
Associations
Unlink
Create New & Link
Composition
Boolean Attribute
Boolean Attribute

15. Example: Module Test (ISO 26262)
Example Model for module testing shall cover
ISO Requirements
Process Definition
Compliance Argumentation
V&V (Safety Plan & Safety Case)
Requirements (from ISO 26262: )
Process (Validas):
For every module create a test specification, covering all requirements and automatically generate the test cases
Perform tests
Measure required code coverage (100% or arguments)

16. Creating Process Model
In Tree-View
Unfold file (click on > )
Select Process
In Properties-View: Edit Properties (Name, Description,..)

17. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

18. Create Requirements In Tree-Viewer Select Process (or Requirement)
Start “New Child -> Requirement“ (using right mouse button)
Select new Requirement
In Properties Viewer: Edit Properties (use IDs for traceability)

19. Safety Level Specification
Can be specified (as in tables)
Use Extended Properties Group
Close Basic Group (Click on it)
Open Extended Group (Click on it)
Specify “Required From” and “Required To” Level (using pull-down menus)

20. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

21. Automated Tailoring
PMT automatically performs tailoring, based on model evaluation
Tailoring requires
Variables and possible values (types)
Conditions (Boolean terms) for elements to exists
Concrete values bound to variables

22. Automated Tailoring I: Define Variable
Basic Definition
Define a Process Variable “ISO_ASIL” (in Process)
Define an Enumeration Type “ISO_ASILS” (in Process) with values
ASIL_A
ASIL_B
ASIL_C
ASIL_D
Link Type ISO_ASILS to ISO_ASIL variable

23. Automated Tailoring II: Conditions
A “Variant-Condition” is a Boolean term over Variables and Constants, e.g. (ISO_ASIL==ASIL_A || ISO_ASIL==ASIL_B)
Add Conditions to Requirements (in Tree browser)
Select Requirement
Create “New Child -> OR Term”
Select OR Term
Create “New Child -> == Term”
Select == Term
Create “New Child -> Param Ref”
Create “New Child -> Enum Value Ref”
Select Param Ref
Link to Parameter to ISO_ASIL
Select Enum Value Ref
Link to Enum Value to ASIL_A
Select == Term and Copy it
Select OR Term and Paste == Term
Modify Enum Value Ref (in copy) from ASIL_A to ASIL B
Select OR-Term
Infer and Set Types
Refresh
Result:

24. Automated Tailoring III: Bindings
Bindings assign variables to parameters
Model (terms) are evaluated automatically
Terms with result false will not be considered (in reports & images)
In Tree-View:
Select Process
Create New Child -> Binding
Set Parameter to ISO_ASIL
Create New Child -> Enum Value Ref
Select Enum Value Ref
Link To Enum Value -> ASIL_D

25. Automated Tailoring IV: Example
Add Binding
Evaluate Terms (in Tree View)

26. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

27. Process Modeling: Basic Elements
Select Process (or ProcessModule) Container
Create new ProcessModule
Create new Artifacts/Models
Create StakeHolder
Specify and link elements
Process
StakeHolder
Input
Artifact
ProcessModule
Output
Before
/ After
References
References

28. Module Test Process: High Level View

29. Hierarchic Artifacts Combine many (sub-) artifacts
Simplify process interfaces
Maintain consistency
For example: Safety Case
Contains test specification ( )
Contains test result
Contains coverage report

30. Module Test Process: Lower Views
Tailoring! other Measurements are tailored away since
ISO_ASIL is bound to ASIL_D

31. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

32. Consistency Check: Validate Model
Configuration: Window -> Preferences -> Process Modeler -> Validation
Start (right mouse button)
Results can be found in:
Dialog (Details) Export Markers -> .xls
Problem View (Navigatable)

33. Example Finding
Execute Test creates “Test Report”, but no sub-process creates it
Solution: Create a Sub-Process: Run Test

34. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

35. Project Input / Part of Product
Input Output Consistency checks
Every Artifact is created somewhere
Every Artifact is used somewhere
Problems (violations) with
Artifacts that are “Project Input” (i.e. not created in process)
Artifacts that are “Part of Product” (i.e. not read in process)
For Example:
“Subject Under Test (SUT)”
Validation Result:
Solution: Specification with Attributes

36. Note: Also sub-modules “Inherit” Parameter <MODULE>
Project Parameters
Model that processes are “Parameterized”
Can be repeated for Instances of Parameters (Lists of values)
Important for Verification and Validation
Example Parameter (Module Test): “MODULE:String”
Modeling:
Select Process Module
Create New Child -> Project Parameter
Select Project Parameter
Specify Properties
Note: Also sub-modules “Inherit” Parameter <MODULE>

37. Models (not part of Unit Test Example)
Models have (in addition to Artifacts) a Meta Model
With the Meta model the process can
Specify mandatory elements
Specify optional elements
Specification elements are
Model Elements
Model Attributes
Model Associations
An “ecore importer” allows to import EMF Meta Model
Select Model Element
Start Ecore Importer: right mouse and
Select .ecore file
Use Meta Model, e.g. for TCA Test Models

38. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

39. Compliance Modeling
Compliance Claims: Process claims compliance with requirements
Compliance Arguments: Requirements are satisfied & verified (Plan)
Compliance Evidence: Verification & Validation (Report)

40. Compliance Claims
Are selected in the Compliance Group of Process Modules
Are displayed in the Tree-Browser using <-> ID

41. Compliance Argumentation
Add new “Compliance Elements” to Requirements
Select Requirement
Create New Child -> Compliance
Edit Compliance
Description/Argumentation
Links to implementing ProcessModule(s)
Links to Verification Modules
Note: Sub-Compliances can be used to comply with hierarchic requirements

42. Compliance View Shows argumentation using GSN Requirements Compliances
Verification Modules
Criteria
Requirement
Argument VM

43. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

44. Verification & Validation: Process
Perform all required VerificationModules (steps)
Repeat it for all components of the product (values of parameter)
Excel is used for
Description of Parameter Values
Performance of Checks
Verification & Validation Tool (VVT)
Manages V&V
Export/Import of Excel
Generates V&V Report
Initial VVT Model (“Schema”) is exported from PMT

45. Verification & Validation: Modeling
Necessary to ensure that requirements are satisfied
Verification Modules need to be “operative”
Add “Criterion” (=question to be answered) to it
Assign one verified artefact to them
Use them in compliance argumentations
Artifacts need to have a path (to determine date/version)
Example Criterion: Test Results OK

46. Export VVT Model Select ProcessModule Start PMT2VVT Converter
Save VVT-Model (“Schema”)

47. Parameter Values PMT Exports Excel Table Select ProcessModule Start
Open Excel Table
Fill in values of Parameter(s)

48. Plan V&V with VVT Start VVT (like PMT) Open Schema.vvt Select Project
Adapt Properties (assign Tester)
Import Parameters
Save as Plan.vvt

49. V&V Plan (Model) Tree of Checks to be performed
Leave-Checks for Criteria
Grouped by Artifacts
Parameterized (like in PMT)

50. V&V Plan Table (Excel)
Select Project
“Export Excel Check Plan”

51. Perform V&V
Fill Overview: Dates of (Checked) Artifacts and save as VVResult
For each parameter: one CheckResult Table, e.g. CR_MODULE
Fill Results (per Criterion): Result / Date / Issues / Comment
Criterion 1
Criterion 2
Criterion 3
Criterion 4
Criterion 5

52. Check Import Log for Errors & Warnings
Check & Document V&V
Select Project
Import V&V Results
Check Import Log for Errors & Warnings

53. Check V&V: Update Status
Browse Check Results
Infer Results of hierarchic Checks using “Update Status” on Project
Eventually re-check (using )
Finally: Set Verdict of Project manually

54. Check V&V: Validate Select Project Start Validate Analyze Results
Example Findings (above)
If Artifact changes, all checks need to be re-done (“DateOK”)
Artifacts must have dates or Revisions (also unchecked ones)
Issues must have descriptions (“DescriptionOK”)
Finally: All OK

55. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

56. Report Generation Select Project Generate V&V Report
Update Report Fields (Strg+A, F9)
Review and finalize report (Status := Final, Version := 1.0) -> PDF

57. Generated Reports PMT generates Process Report (PR): describes process
Compliance Report (CR): describes compliance of process
VVT generates
Verification and Validation Report (VVR)

58. Process Report

59. Compliance Report

60. Verification & Validation Report

61. Contents Overview PMT Tool Basics: Installation, Model Creation
Requirements Modeling
Automated Tailoring
Process Modeling
Process Validation
Advanced Modeling Aspects: Parameters, Meta Models,..
Compliance Modeling
Verification & Validation
Report Generation
Summary

62. Summary PMT & VVT powerful tools Integration into processes
Support of V&V
Support for model-based processes
Developed within Research Project SPEDIT
Successfully applied for certification of Validas qualification processes