1. Engineering Management Systems Engineering Management MSE607B Chapter 8 System Engineering Program Evaluation

2. 2 Learning Objectives Explain the evaluation requirements of systems engineering program Describe benchmarking best practices in system engineering Explain the evaluation of system engineering organization Explain program reporting, feedback and control

3. 3 Evaluation Requirements Established system engineering organization may be involved in many different projects concurrently The system engineering organization must be able to respond to all of the functions across the board and at the same time Emphasis on “organizational development” and building capability The manager needs to define organizational objectives, goals and responsibilities. Establish benchmarking capability and a model for the measurement and evaluation of the organization and its operations Where are we today? How do we compare with the competition? Where would we like to be in the future?

4. 4 Benchmarking Defined as “the continuous process of measuring products, services, and practices against the toughest competitors of those companies recognized as industry leaders” (Robert C. Camp) There have been a number of benchmarking studies, and a few companies that practice concepts and principles of system engineering implemented an active benchmarking effort internally The emphasis has been oriented directly to organizations and the processes they use in accomplishing their day-to-day functions Need to first define company’s objectives in terms of product output and then address the organizational characteristics considered essential to successfully meet overall product goals

5. 5 Benchmarking (cont)

6. 6 Benchmarking (Cont)

7. 7 Evaluation of the System Engineering Organization Measure and evaluate the extent to which the system engineering organization has progressed toward meeting the goals Organization’s capability to meet desired level of performance There are some questions that should be addressed: Is the organization completing tasks effectively and efficiently? Does management understand principles and concepts of system engineering? Is there a commitment from the top down? What policies are currently being implemented? Standards, goals, and appropriate processes been established? Has organization developed a plan for continuous improvement?

8. 8 Program Reporting, Feedback, and Control System engineering evaluation highlight areas of weakness where improvements can be realized There are two steps that need to be addressed: 1.Determining ways for improvement of internal processes within the system engineering organization 2.Determining possible impact of changes in the processes being implemented by the systems engineering organization on any external and related organizational structures Proper environment must be established within the overall organizational to result in improvement Proposed changes cannot be initiated in a vacuum Must be a mutual commitment throughout the organization Must be a vehicle to initiate organizational improvement

9. 9 Summary Explained the evaluation requirements of systems engineering program Described benchmarking best practices in system engineering Explained the evaluation of system engineering organization Explained program reporting, feedback and control

10. 10 Interactive Workshop Benchmarking is defined as the continuous process of: a)Measuring employee performance against the toughest competitors b)Measuring products, services, and practices against the toughest competitors c)Measuring products, services, and practices against the weakest competitors d)Measuring employee performance against the weakest competitors

11. 11 Program Reporting, Feedback, and Control can be successfully implemented providing: a)A mutual commitment exist throughout the organization b)Proposed changes are not initiated in a vacuum c)A vehicle exist to initiate organizational improvement d)All of the above Interactive Workshop

12. 12 Evaluation of the system engineering organization is needed in order to determine: a)The extent to which the organization has progressed toward meeting the goals b)The organization’s capability to meet desired level of performance c)The organization’s likelihood to remain successful and get new program orders from customer d)Both (a) and (b) Interactive Workshop

13. 13 Homework Assignment Chapter 8 – Textbook page 391 Answer questions 1, 3, 6, 7, and 9. Finalize Project Presentation & Report Complete Research Assignment Peer Review Report Start to study for final exam

14. 14 Questions? Comments?