1. Certification

2. Team Members Kelly Hayhurst / NASA Langley John Knight / U Virginia
Jim Krodel / Pratt & Whitney (Moderator)
Richard Robinson / Boeing (Scribe)
Oleg Sokolsky / U Penn
Tucker Taft / Softcheck Inc
Hal Pierson / FAA (IT)
Steve Jacklin / NASA Ames
Jim Alves Foss / U of Idaho
Natasha Neogi / U of Illinois - UC
Patrick Graydon / U Virginia
Kelly Hayhurst / NASA Langley
John Knight / U Virginia
Robin Bloomfield / Adelard
Scott Beecher / Pratt Whitney
Darren Cofer / Honeywell
Frank Mueller / NC State U

3. What are the Top 3 Lessons Learned / Technology in the area of certification and assessment?
Certified Integrated Systems have failed in unexpected ways
Excessive, High Initial and Incremental Costs to Develop Certified Integrated Systems
Approaches to Certification of Integrated Systems are not well understood

4. What are the Top 3 certification needs that have not been met?
Initial Cost & Cost of rework
Coping with complexity
Deploying a safe system
Acceptance of New Technologies / Methods
System Development
Certification

5. 1. Alternate Approaches to Acceptance/Cert
What are the Top 3 Research topics/challenges (with timelines) being/should be pursued in your domain of expertise related to certification?
1. Alternate Approaches to Acceptance/Cert
Product Evidence Based vs Process based [EV]
Component based qual/certification [NT]
Cert. expressive interfaces in a formal manner (links to Model based design, Incremental Certification, When does composablity work and where, Models at different levels and how to validate)
Certification by Composition [MT]
Including environmental aspects / legacy components

6. What are the Top 3 Research topics/challenges (with timelines) being/should be pursued in your domain of expertise related to certification?
Continued: Alternate Approaches to Acceptance/Cert
Validation of new certification process [EV]
Approaches need acceptance/working together with the academic, certification & industry

7. What are the Top 3 Research topics/challenges (with timelines) being/should be pursued in your domain of expertise related to certification?
2. Tools
Need a methodology/tools for Certification of
COTS (with evidence) [NT] &
Open source (without development process evidence) [MT]
Includes software and Integrated Circuits.
Trusted tools with known pedigree to support qualification/certification evidence [EV]
Risk analysis needed to determine level of trust

8. 3. Cert Criteria and Systems Analysis
What are the Top 3 Research topics/challenges (with timelines) being/should be pursued in your domain of expertise related to certification?
3. Cert Criteria and Systems Analysis
Cert process framework to handle new technologies, both flexible and extensible. [MT]
Analysis methods to consider integration of Safety vs. other complex system attributes or requirements (eg. Human Factors, Security can have competing requirements) [MT]

9. Unmanned Vehicle Autonomy in a certified system or sub-system [MT]
What are the Top 3 challenges (with timelines) in the area of certification (including outside your domain of expertise?)
Security or other related system attributes that require resolution of conflicting requirements [NT]
Safety vs. Security
Unmanned Vehicle Autonomy in a certified system or sub-system [MT]
Authorities / people vs. machine

10. Education Needs/Topics
Incentives to motivate people to enter the domain & stay current
“Assessment of systems” as a career option
Benchmark US education capability vs. world standards (both higher education & in industry)
Shift culture such that cert is an integral part of system development
high level stuff in house
low level stuff out source
Sample systems for use by educational institutions

12. Education needs/topics