Continuous student assesment : implementation and results P Truffert, D Lacroix, D Gosset M Lance, A Deroo, JC Alexandre

French medical studies 6 years DCEM4 CSCTU faculty exam ECN : national ranking exam About 8000 students in France DCEM4 (≈ 450 students)

Lille II rank at ECN : disappointing results One of the national universities quality criteria

Csctu before 2011 Written final exam  4 medical cases scenarios to resolve Problem solving, clinical reasoning, knowledge and therapeutic  80% of the total exam score Oral test  Bedside evaluation Specific therapeutic oriented program

Csctu 2011 : continuous assesment Same written/oral testing No specific program  The hole ECN program is covered by assesment  20 assesments, 2 case scenarios each

Csctu : continuous evaluation The « fridays » 2 cases « ecn type» Hématologia 2 cases « ecn » Psychiatry Course And correction Hématologia 1 Corrected record csctu Friday 1h30 evaluation 2h Monday 20 senior 1 spécialist Friday 1h30 evaluation Monday

Monday Correction Software 20 senior residents  Sensibilisation case elaboration Case correction (which keywords, what relative importance) Présence of 1 spécialist  Can modify some keywords (synonyms etc…)  Sees the principal difficulties encountered by the students  Can adapt the learning messages for next friday

Correction du lundi

22% 2% 47% - 7

Continuous assesment Weekly individualized results

Other learning facilities Saturday morning seminars In the two last months before ECN  5 courses (3h) « best of » concerning themes chosen by the students Evening conferences  2 per week  4 case scenarios and 3h correction

Did results change? (and how…)

Analysis strategy Individual student ranking variation  Description by quartiles Correlation between csctu ranking and ECN ranking 2011

Analysis strategy ECN ranking estimation  linear Regression  Predicted values – Observed values Under estimation : student winned ranks at ECN Over estimation : student lost ranks ECN Correct estimation : difference < 1000 places

Results Ranking distribution by quartiles QQQQ

Results Corrélation csctu ranking vs ECN Correlation r : 0.8 (p<10 -4 ) Détermination r 2 : % of the ECN was not explained by the csctu ranking

Results Predictive quality of the csctu ranking  38% overestimated : falsy reassured ? under Over

National ranking of Lille 2 :

Back to the future… Promotion effect? Waiting for 2012 confirmation… National ranking of Lille 2 : Understanding which learning and teaching issues are involved?

Thank you for your attention