1. MASS Project Evaluation Annie Paton anne@indigops.com

2. Agenda  Indigo Background  Overall Evaluation Format  Internal Evaluation Topics  Evaluation Focus & Objectives  Baseline & Monitoring Information

3. Indigo Background  MASS application development & evaluation  Local authorities, colleges, charities  European Funding  ESF, ERDF, Interreg, LLP  High success rate  Project Management, Monitoring & Evaluation  Other Services  Varied experience  Evaluation  £16.5 million projects  ESF, ERDF, LLP, Lottery & government funding  Transnational (A1 for Jobs, Leonardo)  Target group (ESF – LTP – Disengaged school children)

4. Format  Interim Report  August 2010  Report on progress  Adhering to timescales & milestones  Any barriers to success  Final Report  September 2011  Draw conclusions on design, implementation & success  Inform stakeholders of results & impact  Stimulate support for mainstreaming  Identify further innovation

5. Internal/Self Evaluation  Simona (RO)  Self evaluation feeds into external  Communication  Effectiveness, frequency, methods, barriers  Twice, middle & end (online survey)/ observation  Partnership Meetings  Effectiveness, structure, content, cultural aspects  Learn & adapt  Short post meeting questionnaire  Team working  Involvement, motivation & commitment  Partner level

6. Topics Leonardo Other topics  Innovation *  Validity *  Dissemination *  Valorisation *  Transnationality  Partnership  Design & Methodology  Project Management & Delivery  Feasibility of Products  Progress

7. Focus  Project Aim 1 – To enable professionals in Greece, Sweden, Netherlands & Romania to understand the need/value of adapting VET systems in a shift towards learning outcomes....  Project Aim 3 – Ensuring the professionals have the competencies to deliver VET to disaffected groups which is meaningful and conducive to learning and employment outcomes....  Dissemination & Valorisation of results

8. Project Aim 1  Evaluation Objectives  How feasible is use of EQF to map soft skills at partner level?  Is the value of soft skills within VET in partner countries relevant and recognised?  How effective are the materials and tools for assessment within classroom context? - Methodologies - Benchmarking (desk research/ consultation) - Partner questionnaire (PM level & tutor level) - Analysis of progress of relevant work packages/documentation review

9. Project Aim 3  Evaluation Objectives  What is the impact of the methodologies used in the piloting on disaffected learners?  How do the outcomes for the group compare with that of the outcomes in the past?  Do learners find the tools easy to use?  Do the materials meet the requirements of trainers/tutors?  Is there evidence to support employment outcomes for the group?

10. Project Aim 3  Evaluation Methodologies  Consultation with piloters (twice, mid point & end)  Consultation with tutors (twice, mid point & end)  Analysis of outcomes for piloters  Comparative analysis with past outcomes  Limited budget, best way for each partner, questionnaire or telephone interviews.

11. Baseline Information & Monitoring  Understand current situation  Current learning & employment outcomes for learners  Control group for comparison  How do you monitor learners?  How do you monitor tutors & teachers?  Use of English

12. Next Steps....  Formalise the framework – Annie  Produce a time plan - Annie  Send baseline survey - Annie  Keep in touch......All