1. CONTEXTUAL FACTORS OF EVALUATION PRACTICES
Evaluation is a must in any program planning model
There is a gap between model and practice of program evaluation
In general evaluation models suggest:
Formal
Systematic
Comprehensive

2. Purpose of the Study
To identify how contextual factors shape evaluation practices

3. Specific Research Questions
What are the evaluation practices of different adult and continuing education agencies in Malaysia
What are the contextual factors involved in the evaluation practices of the agencies

4. RESEARCH METHODOLOGY Qualitative multiple case study
Purposive Sampling
Three types of organization
Panel of experts
Four criteria

5. Data Collection Data Analysis Triangulation
Semi structured interview guide
Official documents
Data Analysis
Within case
Cross-case

6. Findings Type of organization: Agency A – Continuing education
Agency B – Agricultural extension
Agency C – Entrepreneurial development

7. Numbers of respondents
Agency A – 4
Agency B – 4
Agency C – 8
Evaluation unit
Agency A - Publication & Consultancy Bureau
Agency B – Research & Evaluation Unit
Agency C – Every departments conduct own evaluation activities

8. Evaluation activity
Agency A – Informal process evaluation & end of course evaluation
Agency B – Periodic evaluation throughout the program & oral evaluation
Agency C – Periodic, informal evaluation throughout program and seminar

9. Contextual Factors Importance of evaluation to the organization
* Mission of public organizations
* Organizational structure of the organizations
* Management’s attitude toward evaluation

10. Ability of the evaluators
Culture of the clientele
Tradition bound evaluation practices

11. Conclusions Minimalist formal evaluation approaches * Reaction level
* Monitor input
* Findings are not fully utilized

12. Not comprehensive nor systematic
The four contextual factors
* Interconnected
* Collectively influence practice