A Discourse on Complexity of Process Models J. CardosoUniversidade da Madeira J. MendlingVienna University of Economics G. NeumannVienna University of.

Slides:



Advertisements
Similar presentations
Evaluation of Abstraction Techniques. Uses for the complexity metrics in our framework Comparing the complexity of the reference model with the abstracted.
Advertisements

Automated Software Maintainability through Machine Learning by Eric Mudge.
SIM5102 Software Evaluation Measuring Internal Product Attribute.
What causes bugs? Joshua Sunshine. Bug taxonomy Bug components: – Fault/Defect – Error – Failure Bug categories – Post/pre release – Process stage – Hazard.
1 Static Analysis Methods CSSE 376 Software Quality Assurance Rose-Hulman Institute of Technology March 20, 2007.
Software engineering for real-time systems
Software Metrics II Speaker: Jerry Gao Ph.D. San Jose State University URL: Sept., 2001.
Software metrics Selected key concepts. Introduction Motivation:  Management:  Appraisal  Assurance  Control  Improvement  Research:  Cause-effect.
Goal: Reconstruct Cellular Networks Biocarta. Conditions Genes.
24/06/2015Dr Andy Brooks1 MSc Software Maintenance MS Viðhald hugbúnaðar Fyrirlestur 41 Maintainability of OSS OSS Open Source Software CSS Closed Source.
1 Complexity metrics  measure certain aspects of the software (lines of code, # of if-statements, depth of nesting, …)  use these numbers as a criterion.
Chapter 9: Software Metrics
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Finding Data for Quantitative Analysis Lecture 11.
Unit Testing CS 414 – Software Engineering I Don Bagert Rose-Hulman Institute of Technology January 16, 2003.
Overview Software Quality Metrics Black Box Metrics White Box Metrics
A Comparative Analysis of Software Refinement Techniques Ion IVAN Adrian VISOIU.
Cyclomatic Complexity Dan Fleck Fall 2009 Dan Fleck Fall 2009.
Software Reliability Model Deterministic Models Probabilistic Models Halstead’s software metric McCabe’s cyclomatic complexity metrix Error seeding Failure.
University of Toronto Department of Computer Science © 2001, Steve Easterbrook CSC444 Lec22 1 Lecture 22: Software Measurement Basics of software measurement.
Software Metrics *** state of the art, weak points and possible improvements Gordana Rakić, Zoran Budimac Department of Mathematics and Informatics, Faculty.
Testing phases. Test data Inputs which have been devised to test the system Test cases Inputs to test the system and the predicted outputs from these.
Week 3 – Complexity Metrics and Models
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 20 Slide 1 Defect testing l Testing programs to establish the presence of system defects.
1 Software Quality CIS 375 Bruce R. Maxim UM-Dearborn.
Introduction to Defect Prediction Cmpe 589 Spring 2008.
Software Engineering 2003 Jyrki Nummenmaa 1 SOFTWARE PRODUCT QUALITY Today: - Software quality - Quality Components - ”Good” software properties.
1 Software Engineering: A Practitioner’s Approach, 6/e Chapter 15b: Product Metrics for Software Software Engineering: A Practitioner’s Approach, 6/e Chapter.
Product Metrics An overview. What are metrics? “ A quantitative measure of the degree to which a system, component, or process possesses a given attribute.”
Software Metrics Software Engineering.
1 ECE 453 – CS 447 – SE 465 Software Testing & Quality Assurance Lecture 23 Instructor Paulo Alencar.
OHTO -99 SOFTWARE ENGINEERING “SOFTWARE PRODUCT QUALITY” Today: - Software quality - Quality Components - ”Good” software properties.
Software Metrics (Part II). Product Metrics  Product metrics are generally concerned with the structure of the source code (example LOC).  Product metrics.
Software Quality Metrics
Generating Correct EPCs from Configured C-EPCs* Jan MendlingVienna University of Economics Jan ReckerQueensland University of Technology Michael RosemannQueensland.
1 Metrics and lessons learned for OO projects Kan Ch 12 Steve Chenoweth, RHIT Above – New chapter, same Halstead. He also predicted various other project.
Business Process Design by View Integration J. MendlingVienna University of Economics C. SimonUniversity of Koblenz.
Creator: ACSession No: 7 Slide No: 1Reviewer: SS CSE300Advanced Software EngineeringSeptember 2005 Software Measurement – Estimation and Productivity CSE300.
Measure18 1 Software Measurement Halstead’s Software Science.
Software Metrics.
INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN © The MIT Press, Lecture.
Software Engineering 2004 Jyrki Nummenmaa 1 SOFTWARE PRODUCT QUALITY Today: - Software quality - Quality Components - ”Good” software properties.
Evolution in Open Source Software (OSS) SEVO seminar at Simula, 16 March 2006 Software Engineering (SU) group Reidar Conradi, Andreas Røsdal, Jingyue Li.
Scatter Diagrams scatter plot scatter diagram A scatter plot is a graph that may be used to represent the relationship between two variables. Also referred.
CSC 480 Software Engineering Testing - I. Plan project Integrate & test system Analyze requirements Design Maintain Test units Implement Software Engineering.
Software Engineering – University of Tampere, CS DepartmentJyrki Nummenmaa SOFTWARE PRODUCT QUALITY Today: - Software quality -
Chapter1: Introduction Chapter2: Overview of Supervised Learning
Theory and Practice of Software Testing
Metrics "A science is as mature as its measurement tools."
Cyclomatic complexity (or conditional complexity) is a software metric (measurement). Its gives the number of indepented paths through strongly connected.
Martin Hoffman Monica Hoffman. Goal To determine if a correlation exists between specified internal and dependability (external) metrics.
CS223: Software Engineering Lecture 21: Unit Testing Metric.
Software Test Metrics When you can measure what you are speaking about and express it in numbers, you know something about it; but when you cannot measure,
CX Introduction to Web Programming Testing.
Static Software Metrics Tool
Software Metrics 1.
White-Box Testing Pfleeger, S. Software Engineering Theory and Practice 2nd Edition. Prentice Hall, Ghezzi, C. et al., Fundamentals of Software Engineering.
Halstead’s software science: An analystical model
Detection and Prediction of Errors in EPC Business Process Models
CPSC 873 John D. McGregor GQM.
Lecture 17 Software Metrics
CS223: Software Engineering
Halstead software science measures and other metrics for source code
Predict Failures with Developer Networks and Social Network Analysis
Information Flow Metric
Presented by Trey Brumley and Ryan Carter
Software Metrics SAD ::: Fall 2015 Sabbir Muhammad Saleh.
Detection and Prediction of Errors in EPC Business Process Models
INTRODUCTION TO Machine Learning
Faulty EPCs in the SAP Reference Model
Presentation transcript:

A Discourse on Complexity of Process Models J. CardosoUniversidade da Madeira J. MendlingVienna University of Economics G. NeumannVienna University of Economics H.A. ReijersTU Eindhoven

Folie 2 Is this complex?

Folie 3 Problems? deadlock

Folie 4 Agenda 1.Errors due to Complexity? The SAP Reference Model 2.From Software Metrics to Process Metrics 3.From Graph Metrics to Process Metrics 4.Conclusion

Folie 5 Agenda Errors due to Complexity? The SAP Reference Model

Folie 6 Verification Approach Mendling et al. 2006: A Quantitative Analysis of Faulty EPCs in the SAP Reference Model. BPM Center Report.

Folie 7 Results

Folie 8 Why Errors Hypotheses: Model Size Model Complexity Error Patterns Independent variables: Number of each element type Cycles Complexity metrics based on state space Logistic Regression: Explain error (yes/no) Nagelkerke R 2 : 0.30 and 0.26 in significant models Correct Classification: about 95%

Folie 9 Agenda From Software Metrics to Process Metrics

Folie 10 Adapting the LOC Metric In Software Engineering: Lines of Code For Business Processes: Number of Activities Number of Activities and Splits Number of Activities, Splits, and Joins

Folie 11 How complex is this? No. of Act.: 43 No. of Act.+Splits: 52 No. of Act.+Splits+Joins: 67

Folie 12 Adapting McCabe‘s Cyclomatic Complexity In Software Engineering: edges – nodes +2 For Business Processes: CFC = Σ xor fan-out(xor) + Σ or 2 fan-out(or) -1 + Σ and 1

Folie 13 How complex is this? No. of AND-Splits: 6 No. of OR-Splits: 2 No. of XOR-Splits: 1 CFC: 43

Folie 14 Adapting Halstead Complexity In Software Engineering: n1: No. of unique operators n2: No. of unique operands N1: No. of operator occurences N2: No. of operand occurences For Business Processes: n1: No. of node types n2: 1 N1: No. of nodes N2: 1 Halstead Metrics: Process Length: n1*log(n1)+n2*log(n2) Process Volume: (N1+N2)*log(n1+n2) Process Difficulty: (n1/2)*(N2/n2)

Folie 15 How complex is this? n1: F+E+ANDj+ANDs+XORj+XORs+ORj+ORs n2: 1 N1: 107 N2: 1 Process Length: 8*log(8)+1*log(1) = 24 Process Volume: (108)*log(9) = 342,35 Process Difficulty: (4)*(1) = 4

Folie 16 Adapting Henry&Kafura Information Flow In Software Engineering: Σ activity Length * (Fan-in * Fan-out) 2 For Business Processes: Σ activity 1 * (inputs * outputs) 2

Folie 17 How complex is this? Σ activity 1 * (inputs * outputs) 2 = 312

Folie 18 Agenda From Graph Metrics to Process Metrics

Folie 19 Adapting Network Complexity In Graph Theory: no. of arcs / no. of nodes For Business Processes: no. of arcs / no. of nodes

Folie 20 How complex is this? no. of arcs / no. of nodes = 122 / 107 = 1,14

Folie 21 Adapting Restrictiveness Estimator In Graph Theory: 2 * Σr ij – 6*(N-1) / (N-2)*(N-3) For Business Processes: 2 * Σr ij – 6*(N-1) / (N-2)*(N-3)

Folie 22 How complex is this? 2 * Σrij – 6*(N-1) / (N-2)*(N-3) = 2* 3389 – 6*(106) / (105)*(104)= 0,5625

Folie 23 Agenda Conclusion

Folie 24 Processes Compared No. of Act.: 3 vs. 43 No. of Act.+Splits: 7 vs. 52 No. of Act.+Splits+Joins:8 vs. 67 CFC: 14 vs. 43 Process Length: 19,65 vs. 24 Process Volume: 57 vs. 342,35 Process Difficulty: 3,5 vs. 4 Henry&Kafura: 36 vs. 312 Arcs/Nodes: 1 vs. 1,14 Restrictiveness Est.: 0,66 vs. 0,5615

Folie 25 Conclusion Metrics from Software Engineering and Graph Theory can be adapted Empirical Correlation of metrics with errors, maintainability, etc. to be tested Further Research into graph metrics required Future research: test correlation of perceived process complexity and metrics test predictive power of metrics for error probability