1. Software Project Management With Usage of Metrics Candaş BOZKURT - Tekin MENTEŞ Delta Aerospace May 21, 2004

2. DELTA AEROSPACE In this presentation... The importance of Metrics SPM and Usage of Metrics Problems in SPM Solution by using Metrics effectively Difficulties in collecting Metrics Automated Metrics Collection Tool Conclusion

3. DELTA AEROSPACE Measurement Measurement: process by which numbers or symbols are assigned to attributes of entities in the real world in such a way as to describe them according to clearly defined rules “What is not measurable make measurable”, Galileo Galilei “You cannot control what you cannot measure”, De Marco

4. DELTA AEROSPACE Role of Measurement

5. DELTA AEROSPACE Objectives of Software Measurement ? To collect objective information about the current state of a software product, project, or process. To allow managers and practitioners to make timely, data-driven decisions. To track your organization's progress toward its improvement goals. To assess the impact of process changes.

6. DELTA AEROSPACE Measurement Program

7. DELTA AEROSPACE Metrics Metrics: Quantitative measurement Important to the success of a project Project Metrics: Used to track project progress

8. DELTA AEROSPACE What are Software Metrics?

9. DELTA AEROSPACE Software Metrics Components of Software Measurement –Process Metrics (e.g. Time, Effort, Cost) –Product Metrics (e.g. Size, Reliability) –Resource Metrics (e.g. Price, Experience) Goal – Question – Metric (GQM) Approach  Metrics Methodology / Framework

10. DELTA AEROSPACE Difficulties When Using Metrics Lack of Management Commitment Measuring Too Much, Too Soon Measuring Too Little, Too Late Measuring the Wrong Things Imprecise Metrics Definitions Using Metrics Data to Evaluate Individuals Using Metrics to Motivate, Rather than to Understand Collecting Data That Is Not Used Lack of Communication and Training Misinterpreting Metrics Data “If you are miles away from your target it doesn’t make sense to measure in millimeters.”

11. DELTA AEROSPACE DON’T Measure individuals Use metrics as a “stick” Ignore the data

12. DELTA AEROSPACE Software Project Management Problems “Projects without clear goals will not achieve their goals clearly”, Tom Gilb Management of the software development, or namely “Software project planning, monitoring and control”

13. DELTA AEROSPACE Solution: Usage of Metrics to Manage Software Projects Use metrics in managing software project management by directly forming, updating and monitoring –software project planning, –schedule, –task assignment, –resource management and –software development processes

14. DELTA AEROSPACE Impact on Quality A quantitatively managed process is a defined (capability level 3) process that is controlled using statistical and other quantitative techniques, Quantitative objectives for quality and process performance are established and used as criteria in managing the process, The quality and process performance are understood in statistical terms and are managed throughout the life of the process

15. DELTA AEROSPACE Then, How to use Metrics? Project Management metrics collected should be used to support four functions of management –Planning, –Organizing, –Controlling and –Monitoring

16. DELTA AEROSPACE Measurement Tailoring Identify and Prioritize Project Issues Project Information and Risk Assessment Results New Issues Software Process Characteristics Measurement Plan Proposed Changes Proposed Changes Select and Specify Project Measures Integrate Into the Software Process

17. DELTA AEROSPACE Usage of Metrics Mainly four groups of Usable Data will be produced from the metrics, aiming: –Collection of objective information about the current state of a software product, project, or process –Managers and practitioners to make timely, data-driven decisions –Tracking the project's progress toward schedule –Assessing the impact of process changes

18. DELTA AEROSPACE Metrics Program Collect and Process Data Risk Management and Financial Performance Results Information New Issues Periodic Assessment Measurement Plan Analyze Issues Make Decisions Project Context Information Questions Actions Data

19. DELTA AEROSPACE Which of the Metrics Needed? Schedule performance (milestones, variances) Cost performance (actual vs. planned; variances) Effort performance (actual vs. planned; allocations) Requirements management (total, growth, traceability)

20. DELTA AEROSPACE Which of the Metrics Needed? …continuing Program size (SLOC, page counts - planned vs. actual) Test performance (requirements tested, passed test) Quality - Defect data status (problems open, closed, density, origin, SPRs etc.)

21. DELTA AEROSPACE Which of the Metrics Needed? …continuing Process performance (tasks completed, action items) Computer resource utilization (memory loading, CPU loading) Management planning performance (estimates vs. actual, re-planning etc.)

22. DELTA AEROSPACE How to Collect Metrics? Metrics Database Collect Metrics mainly from –Project Manager –Development Team –Testing Team –Quality Team –Help Desk

23. DELTA AEROSPACE Advantages of Using Metrics Organizational software process and quality improvement, Achieve “Quantitatively Managed Software” processes to be used in the company  CMMI Level 4 Process Areas Monitoring and controlling of the software development schedule, life cycle activities and the resulting risks

24. DELTA AEROSPACE Earned Value Example (Usage of Metrics) 151617 18 192021222324252627282930..... end of project CDR TRR COST VARIANCE CONTRACT BUDGET BASE SCHEDULE VARIANCE NOW $ } } Projected actual end cost Actual cost of work performed Planned cost of work scheduled Planned cost of work performed

25. DELTA AEROSPACE Future Improvements Improving Automated Metrics Collection Tool Use Metrics in Decision Support Systems Make Metrics directly affect the Project Plan.

26. DELTA AEROSPACE Why Use a Tool ? Efficient and Accurate Data Collection Real Time Decision Support Data Security and Privacy Effective Reporting

27. DELTA AEROSPACE Use Automated Software Metrics Collection Tool Usage of a distributed software project management tool that supports –organizational level planning, –task assignment (including predecessor and successor task assignments), –time and resource Management, –visual schedule preparation (Gantt Chart), –metrics collection and analysis, and –most importantly matching of the metrics data with the project schedule and task assignment modules

28. DELTA AEROSPACE EXAMPLE TOOLS PACE by Milsoft PROMACS by Delta Software Group MS Project SureTrack …

29. DELTA AEROSPACE Tool Expectations Metric collection tool should be integrated with Project Schedule should force to gather accurate data (Smart Tools can be used) should produce effective reports for decision making Should produce suggestions in some points Usage of Historical data

30. DELTA AEROSPACE Conclusion To survive a software development organisation must make accurate cost estimates and improve productivity and quality. If you do not know where you are now you certainly won't know where you will be in the future. To achieve accurate measurements of productivity and quality requires automated metrics collection and analysis. In order to characterize, evaluate, predict and improve the process and product a metric baseline is essential.

31. DELTA AEROSPACE Q & A Questions and Answers: –Are there any parts that needs to be clarified? –Are there any questions regarding the concepts talked about? –Are there any suggestions to improve this presentation?

32. DELTA AEROSPACE Thank Your for Your Attendance … The End