1. National Aeronautics and Space Administration SAS08_Classify_Defects_Nikora1 Software Reliability Techniques Applied to Constellation Allen P. Nikora, JPL/Caltech This research was carried out at the Jet Propulsion Laboratory, California Institute of Technology under a contract with the National Aeronautics and Space Administration. The work was sponsored by the NASA Office of Safety and Mission Assurance under the Software Assurance Research Program led by the NASA Software IV&V Facility. This activity is managed locally at JPL through the Assurance and Technology Program Office Executive Briefing NASA OSMA Software Assurance Symposium September 9-11, 2008 09/09/2008

2. National Aeronautics and Space Administration 09/09/2008SAS08_CxP_SWRel_Nikora2 Agenda Problem/Approach Relevance to NASA Accomplishments and/or Tech Transfer PotentialAccomplishments and/or Tech Transfer Potential Next Steps

3. National Aeronautics and Space Administration 09/09/2008SAS08_CxP_SWRel_Nikora3 Problem/Approach Software-related failures responsible for more than half of NASA major space mission losses or malfunctions between 1996 and 2007 –Large majority due to system conditions not been anticipated or fully understood in the system / software specification and design process –As NASA space missions are increasingly controlled by software, probability of mission failure due to software may increase if no action is taken –Minimizing loss of crew/loss of mission requires appropriate techniques to evaluate reliability of on- board and ground-based support software during all development phases.

4. National Aeronautics and Space Administration 09/09/2008SAS08_CxP_SWRel_Nikora4 Problem/Approach (cont’d) Modeling of a software system in its anticipated operational context is an important aspect of assuring software reliability. –Recognized in concept of “operational profile”, software reliability model assumptions –Many techniques for modeling software reliability treat software in isolation from the hardware on which it runs and which it controls. Goals: –Demonstrate feasibility of applying Context-based Software Risk Modeling (CSRM) technique to CxP applications/scenariosContext-based Software Risk Modeling Focus on mission-critical applications such as GN&C, Safety and Health Monitoring, Launch Abort –Develop guidelines for use of context-based techniques –Infuse context-based SW reliability modeling techniques to other NASA SW development efforts

5. National Aeronautics and Space Administration 09/09/2008SAS08_CxP_SWRel_Nikora5 Relevance to NASA Reliability of software component depends on operating environment. CSRM explicitly includes context in system/software models. Unlike traditional software reliability modeling techniques, CSRM helps guide software testing CSRM can be used to evaluate risk of software failure during specification and design phases as well as during implementation and test. –Identify risk-prone areas earlier in development  reduced number of defects passed through to test and operations –Earlier identification of risk-prone areas  more effective management of development resources

6. National Aeronautics and Space Administration 09/09/2008SAS08_CxP_SWRel_Nikora6 Accomplishments and/or Tech Transfer Potential Selected PA-1 as initial scenario to be modeled Acquired relevant artifacts from Windchill, JSC contacts Analysis of PA-1 software specifications/design in progress

7. National Aeronautics and Space Administration 09/09/2008SAS08_CxP_SWRel_Nikora7 Next steps Complete development of PA-1 model(s) Analyze models; evaluate software failure risk Review models, results Refine models Select further applications to model

8. National Aeronautics and Space Administration Backup Information

9. National Aeronautics and Space Administration 09/09/2008SAS08_CxP_SWRel_Nikora9 CSRM Highlights From “Risk-Informed Software Assurance for NASA Space Missions”, Sergio Guarro, ASCA Inc., November, 2007 Approach PRA-style development of mission and risk scenario models Uses traditional event-tree / fault-tree logic models at top modeling level to capture the basic aspects of mission scenarios Uses Dynamic Flowgraph Methodology (DFM) models to capture dynamic and logically complex aspects of system/software interactions –DFM analytical and quantitative results are fully compatible and can be integrated with PRA tool binary models and results (SAPHIRE, CAFTA) Modeling and quantification framework is also compatible with / can incorporate risk and assurance info from other tools and sources –Traditional test results –SW-process-quality based information –SW defect / reliability model output