MASS Project Evaluation Annie Paton
Agenda Indigo Background Overall Evaluation Format Internal Evaluation Topics Evaluation Focus & Objectives Baseline & Monitoring Information
Indigo Background MASS application development & evaluation Local authorities, colleges, charities European Funding ESF, ERDF, Interreg, LLP High success rate Project Management, Monitoring & Evaluation Other Services Varied experience Evaluation £16.5 million projects ESF, ERDF, LLP, Lottery & government funding Transnational (A1 for Jobs, Leonardo) Target group (ESF – LTP – Disengaged school children)
Format Interim Report August 2010 Report on progress Adhering to timescales & milestones Any barriers to success Final Report September 2011 Draw conclusions on design, implementation & success Inform stakeholders of results & impact Stimulate support for mainstreaming Identify further innovation
Internal/Self Evaluation Simona (RO) Self evaluation feeds into external Communication Effectiveness, frequency, methods, barriers Twice, middle & end (online survey)/ observation Partnership Meetings Effectiveness, structure, content, cultural aspects Learn & adapt Short post meeting questionnaire Team working Involvement, motivation & commitment Partner level
Topics Leonardo Other topics Innovation * Validity * Dissemination * Valorisation * Transnationality Partnership Design & Methodology Project Management & Delivery Feasibility of Products Progress
Focus Project Aim 1 – To enable professionals in Greece, Sweden, Netherlands & Romania to understand the need/value of adapting VET systems in a shift towards learning outcomes.... Project Aim 3 – Ensuring the professionals have the competencies to deliver VET to disaffected groups which is meaningful and conducive to learning and employment outcomes.... Dissemination & Valorisation of results
Project Aim 1 Evaluation Objectives How feasible is use of EQF to map soft skills at partner level? Is the value of soft skills within VET in partner countries relevant and recognised? How effective are the materials and tools for assessment within classroom context? - Methodologies - Benchmarking (desk research/ consultation) - Partner questionnaire (PM level & tutor level) - Analysis of progress of relevant work packages/documentation review
Project Aim 3 Evaluation Objectives What is the impact of the methodologies used in the piloting on disaffected learners? How do the outcomes for the group compare with that of the outcomes in the past? Do learners find the tools easy to use? Do the materials meet the requirements of trainers/tutors? Is there evidence to support employment outcomes for the group?
Project Aim 3 Evaluation Methodologies Consultation with piloters (twice, mid point & end) Consultation with tutors (twice, mid point & end) Analysis of outcomes for piloters Comparative analysis with past outcomes Limited budget, best way for each partner, questionnaire or telephone interviews.
Baseline Information & Monitoring Understand current situation Current learning & employment outcomes for learners Control group for comparison How do you monitor learners? How do you monitor tutors & teachers? Use of English
Next Steps.... Formalise the framework – Annie Produce a time plan - Annie Send baseline survey - Annie Keep in touch......All