1. Continuous student assesment : implementation and results P Truffert, D Lacroix, D Gosset M Lance, A Deroo, JC Alexandre

2. French medical studies 6 years DCEM4 CSCTU faculty exam ECN : national ranking exam About 8000 students in France DCEM4 (≈ 450 students)

3. Lille II rank at ECN : disappointing results One of the national universities quality criteria

4. Csctu before 2011 Written final exam  4 medical cases scenarios to resolve Problem solving, clinical reasoning, knowledge and therapeutic  80% of the total exam score Oral test  Bedside evaluation Specific therapeutic oriented program

5. Csctu 2011 : continuous assesment Same written/oral testing No specific program  The hole ECN program is covered by assesment  20 assesments, 2 case scenarios each

6. Csctu : continuous evaluation The « fridays » 2 cases « ecn type» Hématologia 2 cases « ecn » Psychiatry Course And correction Hématologia 1 Corrected record csctu Friday 1h30 evaluation 2h Monday 20 senior 1 spécialist Friday 1h30 evaluation Monday

7. Monday Correction Software 20 senior residents  Sensibilisation case elaboration Case correction (which keywords, what relative importance) Présence of 1 spécialist  Can modify some keywords (synonyms etc…)  Sees the principal difficulties encountered by the students  Can adapt the learning messages for next friday

8. Correction du lundi

9. 22% 2% 47% - 7

10. Continuous assesment Weekly individualized results

11. Other learning facilities Saturday morning seminars In the two last months before ECN  5 courses (3h) « best of » concerning themes chosen by the students Evening conferences  2 per week  4 case scenarios and 3h correction

12. Did results change? (and how…)

13. Analysis strategy Individual student ranking variation 2009-2011  Description by quartiles Correlation between csctu ranking and ECN ranking 2011

14. Analysis strategy ECN ranking estimation  linear Regression  Predicted values – Observed values Under estimation : student winned + 1000 ranks at ECN Over estimation : student lost -1000 ranks ECN Correct estimation : difference < 1000 places

15. Results Ranking distribution by quartiles 2009- 2011 QQQQ

16. Results Corrélation csctu ranking vs ECN Correlation r : 0.8 (p<10 -4 ) Détermination r 2 : 0.64 36% of the ECN was not explained by the csctu ranking

17. Results Predictive quality of the csctu ranking  38% overestimated : falsy reassured ? under Over

18. National ranking of Lille 2 : 2007-2011

19. Back to the future… Promotion effect? Waiting for 2012 confirmation… National ranking of Lille 2 : 2007-2011 Understanding which learning and teaching issues are involved?

20. Thank you for your attention