Test Effort Estimation Models Based on Test Specifications Eduardo Aranha Paulo Borba TAIC PART 2007 Informatics.

Slides:

Advertisements

Similar presentations

Rodrigo Bonifácio Paulo Borba Informatics Center Federal University of Pernambuco Brazil Sérgio Soares Department of Computing.

Advertisements

Financial Planning 2 Resource Mobilization. Learning Objectives Identify and understand various sources of funds Understand how the strategic planning.

Test Yaodong Bi.

Test Automation Success: Choosing the Right People & Process

HP Quality Center Overview.

University of California, Berkeley Business CaseScope By developing a co-located Shared Services organization, UC Berkeley will benefit from synergy across.

Early Effort Estimation of Business Data-processing Enhancements CS 689 November 30, 2000 By Kurt Detamore.

05 | Define End Value for the Software Iteration Steven Borg | Co-founder & Strategist, Northwest Cadence Anthony Borton | ALM Consultant, Enhance ALM.

Modeling Kanban Scheduling in Systems of Systems Alexey Tregubov, Jo Ann Lane.

ArcGIS Data Reviewer: An Introduction

Economic Perspectives in Test Automation: Balancing Automated and Manual Testing with Opportunity Cost Paper By – Rudolf Ramler and Klaus Wolfmaier Presented.

Software Testing and Quality Assurance

Test Execution Effort and Capacity Estimation Eduardo Aranha and Paulo Borba Informatics Center Federal University of Pernambuco Recife, PE, Brazil {ehsa,

Project Risks and Feasibility Assessment Advanced Systems Analysis and Design.

© 2002 McGraw-Hill Companies, Inc., McGraw-Hill/Irwin TURNING MARKETING INFORMATION INTO ACTION.

Test Execution Effort and Capacity Estimation Eduardo Aranha and Paulo Borba Informatics Center Federal University of Pernambuco Recife, PE, Brazil {ehsa,

GDAO Development Methodology & Database Analyzer 1.

Tester’s Role in Software Development and Acquisition Best Practice By Gabriel Rodriguez.

Centers for IBM e-Business Innovation :: Chicago © 2005 IBM Corporation IBM Project Management May 2006.

Pre-Project Planning Lessons from the Construction Industry Institute Construction Industry Institute Michael Davis, P. Eng, PMP Ontario Power Generation.

Standards setting and international coordination in food security statistics Pietro Gennari, Director, Fao Statistics Division.

NYC Technology Forum Introduction to Test Automation 11/2/07 All rights reserved Not to be reproduced without permission Bill Rinko-Gay Solutions Director,

What is Business Analysis Planning & Monitoring?

Milliman USA - Slide 1 Underwriting Risk Models: An Assessment Presented by Urban E. Leimkuhler, FCAS, MAAA Manager & Senior Consultant Milliman - Princeton.

Test Organization and Management

Testing – A Methodology of Science and Art. Agenda To show, A global Test Process which work Like a solution Black Box for an Software Implementation.

VTT-STUK assessment method for safety evaluation of safety-critical computer based systems - application in BE-SECBS project.

Business Analysis and Essential Competencies

UESCO/IFLA Workshop on Development of Information Literacy through School Libraries in Southeast Asia September 2005.

1 © Quality House QUALITY HOUSE The best testing partner in Bulgaria.

Measuring Test Execution Complexity Eduardo Aranha and Paulo Borba Informatics Center Federal University of Pernambuco Recife, PE, Brazil {ehsa,

1 Project Risk Management Project Risk Management Dr. Said Abu Jalala.

Saad El Beleidy Peyman Jamshidi Jared Kovacs Gabriel Lewis

Software Project Management With Usage of Metrics Candaş BOZKURT - Tekin MENTEŞ Delta Aerospace May 21, 2004.

Chapter 7 Business Process Redesign Reference: Tan, A. (2007). Business Process Reengineering in Asia: A Practical Approach, Pearson Education, Singapore.

1 Software Reliability Assurance for Real-time Systems Joel Henry, Ph.D. University of Montana NASA Software Assurance Symposium September 4, 2002.

Client Name Here - In Title Master Slide Data Requirements to Support Road Pricing Analyses Johanna Zmud, Ph.D. NuStats Partners, LP Expert Forum on Road.

9/17/2002 COSYSMO Usage Experience Panel: What is Happening at Lockheed Martin Garry Roedler, Lockheed Martin Engineering Process Improvement Center

ArcGIS Data Reviewer: An Introduction

The 6th European Conference on Intellectual Capital

Improving Certification, Training, & Professional Development for the AT&L Community Project Update Robert Hausmann, CNAC Judith Bayliss, DAU.

Copyright  2003 by Dr. Gallimore, Wright State University Department of Biomedical, Industrial Engineering & Human Factors Engineering Human Factors Research.

Motorola Internal Use OnlyGlobal Software – Performance Excellence Engineering Induction Training Program (E-ITP) Project Management Part 4 SG Performance.

March 2004 At A Glance NASA’s GSFC GMSEC architecture provides a scalable, extensible ground and flight system approach for future missions. Benefits Simplifies.

SOFTWARE PROCESS AND PROJECT METRICS. Topic Covered  Metrics in the process and project domains  Process, project and measurement  Process Metrics.

1 Software Reliability Analysis Tools Joel Henry, Ph.D. University of Montana.

© Federal Statistical Office, Institute for Research and Development in Federal Statistics, Elmar Wein Federal Statistical Office Concepts, materials and.

Module 12 – Analyzing Data Module 13 – Drawing Conclusions and Documenting Findings Module 14 – Disseminating Information Module 15 – Feedback for Program.

Trnsport Test Suite Status Presented to the AASHTOWare Trnsport IT TAG October 12, 2004.

Evaluating Wireless Network Performance David P. Daugherty ITEC 650 Radford University March 23, 2006.

Integrated project management optimization Orsolya Dobán.

July, 2008 Impati – Software Test Solutions. July, Contents Testing Service Overview and Approach Test Services and Industries Key Services Offering.

WERST – Methodology Group

Modeling Test Cases to Multi-Agent Systems Andrew Diniz da Costa

T EST T OOLS U NIT VI This unit contains the overview of the test tools. Also prerequisites for applying these tools, tools selection and implementation.

Hosted by Aligning Storage Management Tools with Operational Processes Stephen Foskett GlassHouse Technologies.

Overview of System or Process Design and Improvement 1.

97 th Annual Purdue Road School Presented by: Katie Zimmerman, P.E. Applied Pavement Technology Transportation Asset Management.

Project Management in Marketing Deirdre Makepeace Level Verifier – Professional Diploma Assignment brief June and September 2014.

Project Management in Marketing Assignment briefing June and September 2013 Frank McKee Senior Examiner Professional Diploma in Marketing.

Evaluation What is evaluation?

Tool Support for Testing

PREPARED BY G.VIJAYA KUMAR ASST.PROFESSOR

Project Portfolio Management

TechStambha PMP Certification Training

Future Year Scheduling

EXP file structure.

Presentation transcript:

Test Effort Estimation Models Based on Test Specifications Eduardo Aranha Paulo Borba TAIC PART 2007 Informatics Center of the Federal University of Pernambuco, Brazil Motorola Brazil Test Center Research Project

How to plan test schedules and resources? Several development teams Limited test resources Test of different parts of different applications

How Can We do Test Estimations? Test team Product Exp. Test Capability … Quality Test Specifications Test Size / Complexity … Test Platform Test Environment Test Tools … Test Estimates Test Estimation Model

Proposed Estimations Models Manual Test Execution Effort Estimation The specifications of a given test suite Test Coverage x Execution Effort Analysis Test Automation Effort EstimationCost-benefit Analysis to Prioritize Tests for Automation The specifications of a given test suite Maximum Effort (optional) The specifications of a given test suite 23.5 man-hours Estimated test execution effort APIs, Experience,...Tools, Experience,... The specifications of a given test suite APIs, Experience,... Tools, Experience, man-hours Estimated test automation effort Tests to execute manually Frequency of execution Quality Criteria Tests sorted to maximize coverage with minimal effort … Tests to not execute Tests to automate …

Assigning Points to Test Specifications Test Specification b AvgLowHigh 30 c... Contribution of the Test Step: 220 d Points Assigned to the Test Case: e a System Characteristics Exercised by the Test Step C 2 C 1 … C n Screen navigation File manipulation Pressed keys Network usage c Influence Levels b AvgLowHigh Guidelines Calibration Automation

Give us the possibility to  Sort the tests  Better analyze test productivity  Better analyze team capacity Execution Points and Automation Points

Empirical Studies in the Mobile Application Domain Survey and expert assessment  Identify relevant characteristics and risk factors  Define influence levels and weights Experiment  Validate the measure of test size and execution complexity  Calibration of characteristics weights based on the collected data Case studies  Calibration of risk factors based on the collected data  Evaluate the accuracy of the estimation model  Verify the cost to use the model in the mobile application domain

Conclusions New aproach of test effort estimation and test selection  Based on the test specification  Test size and execution/automation complexity  Team experience, environment conditions, etc. Empirical studies to calibrate and evaluate the model

Questions? Test Effort Estimation Models Based on Test Specifications Eduardo Aranha Paulo Borba Informatics Center of the Federal University of Pernambuco, Brazil Motorola Brazil Test Center Research Project