1. Workplace based assessment Dr Nav Chana

2. Assessment is not simple… Medical competence is content and case specific Medical competence is content and case specific Constructs are not stable and independent Constructs are not stable and independent Attribution is a problem Attribution is a problem

3. Lessons learned Need to build up a whole picture Need to build up a whole picture No single method is a panacea No single method is a panacea Content important, format less so Content important, format less so Less structure, more sampling Less structure, more sampling Focus on a programme of assessment, not individual methods Focus on a programme of assessment, not individual methods Van der Vleuten C & Schuwirth L Assessing professional competence from methods to programmes. Medical Education 2005. 39; 309-317

4. Miller’s pyramid of competence Knows Shows how Knows how Does

5. Workplace assessment Workplace assessment: the assessment of actual working practices undertaken in the working environment

6. Utility Validity Validity Reliability Reliability Educational impact Educational impact Acceptability Acceptability Cost effectiveness Cost effectiveness Van der Vleuten C. The assessment of professional competence. Adv Health Sci Educ 1996;1: 41-47

7. Validity The extent to which a test measures what it was designed to measure The extent to which a test measures what it was designed to measure

8. Validity Indirect Indirect Direct Direct

9. Reliability The accuracy with which the test measures the skill or attainment it is designed to measure The accuracy with which the test measures the skill or attainment it is designed to measure

10. Why workplace assessment? High validity High validity AuthenticityAuthenticity Reconnects assessment with learning Reconnects assessment with learning High educational impact High educational impact

11. Key features Competency-based Competency-based Developmental Developmental Evidential Evidential Locally assessed Locally assessed Triangulated Triangulated

12. Evidence needed ! Notion of multiple sampling Notion of multiple sampling From multiple perspectives From multiple perspectives Tool-box of “approved” methods Tool-box of “approved” methods

13. Needs pulling together That’s the role for the educational supervisor! That’s the role for the educational supervisor! Triangulation of evidence from other sources Triangulation of evidence from other sources

14. The medical record…