1. University of Southern California Center for Systems and Software Engineering Productivity Data Analysis and Issues Brad Clark, Thomas Tan USC CSSE Annual Research Review March 8, 2010

2. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 20102 Table of Contents Background Productivity Data Analysis by Application Domain Reducing the number of domains: Application Difficulty Topics for further discussion This work is sponsored by the Air Force Cost Analysis Agency

3. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 20103 Background DoD has been collecting Software resource data for a number of years –Product and development description –Product size –Resources and schedule –Product quality Analyzing ~140 records out of ~300 –Additional data is coming in Objective: Improved cost estimation of future DoD software- intensive systems, as well as to the DoD cost community. –Characterize different Application Domains within DoD –Analyze collected data for simple cost estimating relationships within each domain –Develop rules-of-thumb for missing data Make collected data useful to oversight and management entities

4. University of Southern California Center for Systems and Software Engineering Software Resources Data Report USC CSSE Annual Research Review - Mar 20104

5. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 20105 SRDR Data Notes: SRDR: Software Resources Data Report Missing Domains: Internet, Maintenance and Diagnostics, Spacecraft bus

6. University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop 20106 Preliminary Results - Do Not Use!

7. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 20107 Preliminary Results - Do Not Use!

8. University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop 20108 Preliminary Results - Do Not Use!

9. University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop 20109 Preliminary Results - Do Not Use!

10. University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop 201010 Preliminary Results - Do Not Use!

11. University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop 201011 Preliminary Results - Do Not Use!

12. University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop 201012 Preliminary Results - Do Not Use!

13. University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop 201013 Preliminary Results - Do Not Use!

14. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 201014 PM = A * (EKSLOC) B Simple Cost Estimating Relationships Notes: PM: Person Months (152 labor hours / month) EKSLOC: Equivalent Thousands of Source Lines of Code Preliminary Results - Do Not Use!

15. University of Southern California Center for Systems and Software Engineering Sizing Issues -1 Multiple SLOC counting methods –Physical: total number of lines in a file –Non-commented Source: no blank or comment lines –Logical No Deleted Code Counts SLOC Conversion Experiment –Use the results of USC’s Code Count Tool to find conversion ratios –Physical to Logical –NCSS to Logical –Results segregated by programming language USC CSSE Annual Research Review - Mar 201015

16. University of Southern California Center for Systems and Software Engineering NCSS to Logical Conversion USC CSSE Annual Research Review - Mar 201016 Ada: 45% C/C++: 61% C#: 61% Java: 72%

17. University of Southern California Center for Systems and Software Engineering Sizing Issues -2 No Modified Code parameters –Percent Design Modified (DM) –Percent Code Modified (CM) –Percent Integration and Test Modified (IM) –Software Understanding (SU) –Programmer Unfamiliarity (UNFM) Program interviews provided parameters for some records USC CSSE Annual Research Review - Mar 201017

18. University of Southern California Center for Systems and Software Engineering Effort Issues Missing effort reporting for different lifecycle phases –Software requirements analysis (REQ) –Software architectural design (ARCH) –Software coding and testing (CODE) –Software integration (INT) –Software qualification testing (QT) –Software management, CM, QA, etc. (Other – very inconsistent) USC CSSE Annual Research Review - Mar 201018

19. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 201019 Collapsing Application Domains Propose to reduce the number of application domains –Currently have a “sparse” data table Use a model-independent approach –5-level scale to capture the “difficulty” (and therefore impact) of an application domain on productivity

20. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 201020 Software Application Difficulties Difficulty would be described in terms of required software reliability, database size, product complexity, integration complexity, information assurance, real- time requirements, different levels of developmental risks, etc.

21. Application DomainsVery EasyEasyNominalChallengingVery Challenging Business Systems Large biz system Trillion $/day transaction Internet Simple web pages Web application (shopping) Mega-web application Tools and Tool Systems Verification toolsSafety critical Scientific Systems Offline data reduction Large dataset Simulation and Modeling Low fidelity simulator Physical phenomenon Test and Evaluation Usual Distributed debugging TrainingSet of screens Simulation network Command and Control Taxi-cab dispatch SOS (C4ISR) Mission Management Usual Multi-level security and safety Weapon Delivery and Control Weapon spaceSafety Communications Noise, anomalies handling Radio Safety/Security Frequency- hopping Application Difficulty Issues 21USC CSSE Annual Research Review - Mar 2010

22. University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar 201022 Questions? For more information, contact: Thomas Tan thomast@usc.edu@usc.edu 626-617-1128 Or Brad Clark bkclark@usc.edu 703-754-0115