1. Total Quality Management and Evaluation Prof. Dr. Reinhard Stockmann, Director of the Center for Evaluation Сolloquium “Policy and program evaluation: methodology and application”, Moscow, 23.11.06 Visiting Lectures at the Higher School of Economics (Moscow)

2. Stockmann 11.06 2 Content of the Presentation 1.Evaluation 2.Quality Management 3.The European Quality Model EFQM 4.Similiarities and Varieties between EFQM and Evaluation

3. Stockmann 11.06 3 Everyday meaning Everyday meaning: Something is assessed by someone according to some criteria in some way. (Kromrey 2001: 106)

4. Stockmann 11.06 4 Scientific meaning Application of empirical (sociological) research methods for information gaining systematical (comparative method) for information gaining according to unfolded, intersubjectively verifiable criteria to asses the use (worth) of an object (e.g. program) to be able to make decisions

5. Technical Definition of Quality High Quality = high technical power + high resistance + high durability + faultless function + no mistakes Stockmann 11.06 5

6. Definition of Quality: „Quality in the totalness of attributes concerning their ability to fulfill defined and preconditioned demands.“ (Norm DIN EN ISO 8402) Stockmann 11.06 6

7. Summary of Quality: It has to be considered, that the quality of a product or a service can not be generally appointed, but is measured by the assessment of use by the customer. This assessment can be done according to various criteria which again can be of very different importance according to the situative context, the cultural characteristics or the nature of the product itself. Stockmann 11.06 7

8. Tasks of Quality Management : to determine the usability of a product/service, to form and constantly improve, as well as to guarantee its flawlessness Stockmann 11.06 8

9. Management Quality management Quality planningQuality improvement Quality controlQuality assurance Customer/ client Quality management system Tasks of Quality Management Stockmann 11.06 9

10. Quality Management Models Series of Standards DIN EN ISO 9000-9004 Principles: « client orientation « process orientation « continuous quality improvements « quality assurance « management Total Quality Management (TQM) Stockmann 11.06 10

11. The European Quality Model EFQM Results 500 points (9%)(20%) Employee satisfaction Client satisfaction Societal responsibility /Image (6%) Business results (15%) Potential factor (Enablers) 500 points Leadership Policy and strategy Employee oriented Processes Resources (10%) (8%)(9%) (14%) Stockmann 11.06 11

12. Advantages and disadvantages of EFQM closed QMS focus on the target group (client) comprises entire organization parameters are influenceable activates processes Advantages depends on acceptance complex and abstract Parameters and emphasis baseless Self assessment Disadvantages Stockmann 11.06 12

13. Similarities between EFQM and Evaluation Goal is the improvement of quality Both are of American origin Instruments of modern, rational business management or policy Problems of acceptance Stockmann 11.06 13

14. Varieties between EFQM and Evaluation EFQMEvaluation 4.top down 2. private sector, especially industry sector (profit-oriented, competition) 3.comprehensive, complex system, including desicion power 5.all employees involved with implementation 4.bottom up 2.public sector, NPO (hardly any competition) 3.no quality management system, no decision power 5.participatory, but during implementation employees partly excluded Stockmann 11.06 14 1.economical science1.social sciences

15. Varieties between EFQM and Evaluation II Stockmann 11.06 15 6. continuous EFQMEvaluation 6. periodic 7. internal (self-assesment instrument) 7. internal and/or external 8. specific8. broad 9. defined target group (clients) 9. amorphous target group (clients) 10. internal 10. external 11. quantitative11. qualitative and quantitative

16. Thank you for your attention Prof. Dr. Reinhard Stockmann, CEval Visiting Lectures at the Higher School of Economics (Moscow)