Presentation is loading. Please wait.

Presentation is loading. Please wait.

European Statistical Training Programme: “Evaluation" Intro-Beginners and Advanced Courses On Seasonal Adjustment 2008-2012 Prepared by Adriano di Guglielmo.

Similar presentations


Presentation on theme: "European Statistical Training Programme: “Evaluation" Intro-Beginners and Advanced Courses On Seasonal Adjustment 2008-2012 Prepared by Adriano di Guglielmo."— Presentation transcript:

1 European Statistical Training Programme: “Evaluation" Intro-Beginners and Advanced Courses On Seasonal Adjustment Prepared by Adriano di Guglielmo Unit B1 Quality Methodology and Research, Eurostat.

2 2 European Statistical Training Programme: The purpose of the European Statistical Training Programme (ESTP) is to provide European statisticians the opportunity to participate in international training courses, workshops and seminars at postgraduate level. The programme is coordinated by Eurostat. Courses are delivered either at Eurostat premises in Luxembourg or in national training sites of EU and European Free Trade Association (EFTA) countries. It is tailored to meet the specific needs of the European Statistical System (ESS) by taking into account the different levels of statistical knowledge and working experiences. It comprises courses in Official Statistics, IT applications, Research and Development and Statistical Management. More info herehere "ESTP - Customer Satisfaction" by Adriano di Guglielmo

3 3 Analysis of Customer Satisfaction: Studying the questionnaires on evaluation, proposed at the end of each course, we are going to verify our attendants’ satisfaction. With this descriptive analysis will be possible to understand where to take action to improve the service offered. On the other hand, our data are not collected in such a way as to make a more in depth analysis (such as MCA or PLS PM). Therefore it would be useful to know all the sequence answers of each user and also a series of illustrative variables of them (the users) useful to describe the differents interviewees profiles, whitout invading any privacy. "ESTP - Customer Satisfaction" by Adriano di Guglielmo

4 4 Questionnaires Structure: Length Materials Quality Combination of methods Theoretical – practical Presentations Programme New Concepts/ Methods/ Techniques Deepening methods/techniques SA/Demetra+ Pace Topics - Expectations Course - Work Course organisation Support provided Logistics Actives Trainers "ESTP - Customer Satisfaction" by Adriano di Guglielmo

5 BEGINNERS COURSES Number of attendants, number of applicants Who are the course leaders, who are the trainers, who are the attendants? Questionnaires outcomes Time Series evaluation scores "ESTP - Customer Satisfaction" by Adriano di Guglielmo

6 6 Number of Attendants 2006 – 2012 Beginners "ESTP - Customer Satisfaction" by Adriano di Guglielmo

7 7 Beginners Courses Attendants/ applicants 22/2917/2414/2815/ Course Leader G. L. Mazzi; C.Calizzani D. Buono Trainers D. Buono; A. Maravall; B. Monsell; D. Ladiray D. LadirayE. Infante D. Buono Duration – Days 4433 Duration – Hours Duration – Breaks 1h 2h Daily Average -6h 45min5h "ESTP - Customer Satisfaction" by Adriano di Guglielmo

8 8 To be noticed that: *Old EU countries = Join EU before 2004 Countries that are never present: Macedonia, France, Liechtenstein, Switzerland. Last presence more than 4 years ago: Estonia, Denmark, Latvia, Luxembourg, Hungary. Countries with largest number of presences: Germany (7), Czech Republic (6), Greece (6), Sweden (6), Italy (6), Romania (6), Slovenia (6), Slovakia (6). General balance between students from old* and new** EU countries **New EU countries = Join EU after EFTA countries "ESTP - Customer Satisfaction" by Adriano di Guglielmo

9 9 Analysis of all variables - Beginners 2009 "ESTP - Customer Satisfaction" by Adriano di Guglielmo

10 10 Analysis of all variables - Beginners 2010 "ESTP - Customer Satisfaction" by Adriano di Guglielmo

11 11 Analysis of all variables - Beginners 2011 The duration of the course decreases (3 day – 5h per day) The evaluation scores increase "ESTP - Customer Satisfaction" by Adriano di Guglielmo

12 12 Analysis of all variables - Beginners 2012 The duration of the course decreases (3 day – 5h per day) The evaluation scores increase "ESTP - Customer Satisfaction" by Adriano di Guglielmo

13 13 Analysis of macro areas - Overall evaluation of the course - Beginners "ESTP - Customer Satisfaction" by Adriano di Guglielmo

14 14 Analysis of macro areas - Course content - Beginners "ESTP - Customer Satisfaction" by Adriano di Guglielmo

15 15 Analysis of macro areas - Training methods and training support - Beginners "ESTP - Customer Satisfaction" by Adriano di Guglielmo

16 16 Analysis of macro areas - Course Administration - Beginners "ESTP - Customer Satisfaction" by Adriano di Guglielmo

17 17 Final Evaluation – Beginners 12 old EU 10 new EU 9 old EU 8 new EU 6 old EU 7 new EU 9 old EU 4 new EU COUNTRIESCOUNTRIES "ESTP - Customer Satisfaction" by Adriano di Guglielmo

18 ADVANCED COURSES Number of attendants, number of applicants Who are the course leaders, who are the trainers, who are the attendants? Questionnaires outcomes Time Series evaluation scores "ESTP - Customer Satisfaction" by Adriano di Guglielmo

19 19 Number of Attendants 2008 – 2012 Advanced Courses "ESTP - Customer Satisfaction" by Adriano di Guglielmo

20 20 Advanced Courses Attendants/ applicants 20/2821/2916/1614/ Course Leader G. L. Mazzi, C.CalizzaniC.CalizzaniG.L. Mazzi, J.M. Museux D. Buono Trainers D. Findley; R. Kirchner A. Maravall; B. Monsell R. Kirchner; A. Maravall; T. Mc Elroy D. Findley D. Buono A. Maravall R. Kirchner; D. Buono; K. Attal-Toubert; A. Kocak; J. Palate Duration – Days 4543 Duration – Hours 24h 30min32h26h15 Duration – Breaks 1h 2h Daily Average More than 6hLess then 6h 30min6h 30min5h "ESTP - Customer Satisfaction" by Adriano di Guglielmo

21 21 Countries with largest number of presences (4): Turkey, Portugal, Slovenia, Romania, United Kingdom. Countries that are never present: Cyprus, Czech republic, Macedonia, France, Liechtenstein. To be noticed that: General balance between students from old and new EU countries It is strange that attendants from Czech Republic are very interested only in the beginners courses. In the next advanced course of 2012 there will be also a Mexican attendant. "ESTP - Customer Satisfaction" by Adriano di Guglielmo

22 22 Analysis of all variables - Advanced Course "ESTP - Customer Satisfaction" by Adriano di Guglielmo

23 23 Analysis of all variables - Advanced Course "ESTP - Customer Satisfaction" by Adriano di Guglielmo

24 24 Analysis of all variables - Advanced Course "ESTP - Customer Satisfaction" by Adriano di Guglielmo

25 25 Analysis of all variables - Advanced Course The duration of the course decreases (3 day – 5h per day) The evaluation scores increase "ESTP - Customer Satisfaction" by Adriano di Guglielmo

26 26 Analysis of macro areas - Overall Evaluation of the Course - Advanced "ESTP - Customer Satisfaction" by Adriano di Guglielmo

27 27 Analysis of macro areas - Course Content - Advanced "ESTP - Customer Satisfaction" by Adriano di Guglielmo

28 28 Analysis of macro areas - Training Methods & Support - Advanced "ESTP - Customer Satisfaction" by Adriano di Guglielmo

29 29 Analysis of macro areas - Course Administration - Advanced "ESTP - Customer Satisfaction" by Adriano di Guglielmo

30 30 Final Evaluation - Advanced 10 old EU 10 new EU 13 old EU 7 new EU 5 old EU 10 new EU 7 old EU 6 new EU COUNTRIESCOUNTRIES "ESTP - Customer Satisfaction" by Adriano di Guglielmo

31 31 Advanced VS Beginners – Final Evaluation "ESTP - Customer Satisfaction" by Adriano di Guglielmo

32 32 Advanced VS Beginners – Overall evaluation of the Course "ESTP - Customer Satisfaction" by Adriano di Guglielmo

33 33 Advanced VS Beginners – Course Content "ESTP - Customer Satisfaction" by Adriano di Guglielmo

34 34 Advanced VS Beginners – Training Methods & Support "ESTP - Customer Satisfaction" by Adriano di Guglielmo

35 35 Advanced VS Beginners – Course Administration "ESTP - Customer Satisfaction" by Adriano di Guglielmo

36 36 Advanced VS Beginners - Pace "ESTP - Customer Satisfaction" by Adriano di Guglielmo

37 37 Advanced VS Beginners – Theoretical/Practical "ESTP - Customer Satisfaction" by Adriano di Guglielmo

38 38 Findings (Beginners) As shown in the previous slides, we find extremely positive results for most of beginners courses (years 2009/2011/2012). On the other hand, the course of 2010 wasn’t able to fully satisfy the course participants: it seems to be crucial for the debacle of this course, the poor satisfaction shown for the “training methods and training support” where more of the half of interviewees (51%) didn’t show satisfaction (Neutral, Disagree, Disagree Strongly). More critical aspects involve the questions: “Theoretical and practical training was combined in an appropriate way” and “The combination of methods (lectures, presentations, group work, discussions, exercises, etc.) was appropriate”. The course of 2012 (73% of Agree Strongly) results the best ever with a peak of 93% of Agree Strongly in the Course Administration category. No neutral or negative scores in the final evaluation of the years 2011/2012. Balance between students from old and new EU countries. "ESTP - Customer Satisfaction" by Adriano di Guglielmo

39 39 Findings (advanced) The analysis performed on the advanced courses shows satisfactory evaluation scores. As for the beginners courses, 2010 is the year in which the satisfaction of the advanced course reaches its minimum point (47%) in terms of “Agree Strongly”, even if it doesn’t hit the negative peak of the corresponding beginners course (47% vs. 11% respectively). To be noticed that the advanced course of 2009 reaches the 63% of Agree Strongly and that the question: “The course was relevant to my job and will help me in my current and/or future work” collected 74% of Agree Strongly. On the other hand, when comparing the scores (Agree vs. Disagree), it can be noticed that the general satisfaction lies around a common threshold for the four years under consideration, with peaks in the years 2010 and No negative scores in the final evaluation of all the years considered. Balance between students from old and new EU countries. "ESTP - Customer Satisfaction" by Adriano di Guglielmo

40 40 Advices for new questionnaires’ compilation: In order to carry out a more detailed Customer Satisfaction analysis is necessary to make a different data collection that allows to have a more comprehensive dataset that can be applied to more complex statistical analysis such as the MCA or PLS. Therefore it would be useful to know all the sequence answers of each user and also a series of illustrative variables of them (the users) useful to describe the differents interviewees profiles, whitout invading any privacy. "ESTP - Customer Satisfaction" by Adriano di Guglielmo


Download ppt "European Statistical Training Programme: “Evaluation" Intro-Beginners and Advanced Courses On Seasonal Adjustment 2008-2012 Prepared by Adriano di Guglielmo."

Similar presentations


Ads by Google