Presentation on theme: "Promoting Excellence in Family Medicine Educational Supervision & Find Your Way Around in the E-portfolio Dr Jane Mamelok RCGP WPBA Clinical Lead."— Presentation transcript:
Promoting Excellence in Family Medicine Educational Supervision & Find Your Way Around in the E-portfolio Dr Jane Mamelok RCGP WPBA Clinical Lead
Workplace Based Assessment The evaluation of a doctors progress over time, in their performance in those areas of professional practice best tested in the workplace FORMATIVE Summative judgment made by panels informed by evidence from WPBA
Millers Pyramid Knows Knowledge AKT Shows How Knows How Performance Competence CSA Does ActionWPBA
Coverage by assessments CurriculumWPBACSAAKT Primary care management Person centred care Specific Problem-solving skills Comprehensive approach Community orientation Holistic approach Contextual Aspects Attitudinal Aspects Scientific Aspects Psychomotor skills
RELATIONSHIP DIAGNOSTICS MANAGEMENT Professionalism Maintaining Performance, Learning & Teaching Primary Care Administration & IMT Community Orientation Maintaining an Ethical Approach to Practice Fitness to Practise Data Gathering & Interpretation Clinical Management Managing Medical Complexity Making a Diagnosis / Making decisions Communication & Consulting Skills Working with Colleagues & in Teams Practising Holistically
The potential of linking WPBA & the learning portfolio. WPBA assesses performance in the workplace over the entire training programme against 12 defined competencies. The portfolio gathers the information and offers the opportunity for reflection and formative feedback. Links assessment to learning outcomes and continuing professional development.
Clinical Supervision Clinical supervision describes the framework for regular, structured encounters reflecting on casework in the context of the post or specialty in which the health professionals are working and aims to identify areas of best practice and developmental needs. It has an important clinical governance function.
Educational supervision Educational supervision is organised supervision taking place in the context of a training programme, it is aimed more to act as an umbrella to guide the trainee through the training programme than assessing and discussing individual cases (which is in the domain of the clinical supervisor).
Gold Guide Requirements Clinical supervision Each trainee should have a named clinical supervisor for each placement, usually a senior doctor, who is responsible for ensuring that appropriate clinical supervision of the trainees day-to-day clinical performance occurs at all times, with regular feedback.
Gold Guide Requirements Educational supervision Educational supervisors are responsible for overseeing training to ensure that trainees are making the necessary clinical and educational progress. Where possible, it is desirable for trainees to have the same educational supervisor for the whole of their training programme or for stages of training (e.g. the early years or more advanced years of training).
What makes a good educational supervisor ? Senior educator with an understanding of training programme, assessments and employment issues. Good listener offering supportive challenge. Can give constructive feedback Professionalism, recognises the conflicting roles, sets boundaries etc.
The role of the ES in GP specialty training. This can be summarised as providing an overarching umbrella of guidance helping the trainee get the best out of their programme and navigating their way through it. However, the ES assesses the rate of progress and development of competence contributing to a summative judgement.
Varied roles of the Educational Supervisor Guidance and support with performance appraisal Learning needs assessment, empowering and facilitating the learner. Conduit and network function Appraiser and counsellor Coaching and career counselling Guardian role
So you are supervising a GP specialty trainee, what do you need to do? Identify you learner, ST1 ST2 or ST3. Arrange an early meeting to set boundaries, frequency of meetings etc. The ES needs to be able to navigate the e-portfolio proficiently. Review the evidence. Give formative feedback and define PDP at the staged reviews.
Reviewing the evidence 1.Check assessment schedule. 2.Review the self assessment ratings. 3.Review PDP objectives if follow on review. 4.Review competency and curriculum coverage 5.Purposeful sampling of the learning log – descriptive v reflective. 6.Look at CSR is there evidence to support their judgement? 7.Hone in on some of the COTs and CBDs
The Review page e-portfolio
Check the assessment schedule
Review the PDP
Review curriculum & competency coverage and self rating scales
Sample the learning log
Review the Clinical Supervisors report
Questions for debate How much is enough? How much evidence do you need to make a judgement? What do we mean by competence?
How much evidence is enough? The evidence gathered from WPBA builds up a picture of the competent GP.
Defence of evidence Have we got this right yet? Medical Schools using portfolios for undergraduates have a portfolio interview which allows the trainees to defend the evidence and this informs the portfolio assessment decision. Is there a role for portfolio viva? Is that final ARCP panels Or RCGP oral examiners?
Assessment decision Portfolios are criticised because they depend on subjective judgements that are unreliable. Schuwirth (2002) argues that they can be reliable if but the judgements must be collected in a way that samples through possible sources of bias – sampling professional behaviours on multiple occasions and multiple assessors
Key steps for development Define a portfolio framework but no so restrictive as to trivialise the evidence. Encourage reflection – can be learned. Educator and assessor training are crucial. Need to understand competency framework Define competence Achieve acceptable inter rater reliability Encourage Balanced portfolios Robust WPBA and portfolio standards for portfolio assessment – defend the JPC decision. Developments in e-portfolio functionality must match the work on standards and competency framework.
Summary The educational supervisor has a key role in directing and supporting the training programme for each learner. There are useful analogies between the role of the appraiser and the appraisal portfolio and the similar role for educational supervisors. Training and support for trainees and educators are key. The e-portfolio must be user friendly and functionality appropriate to purpose. Your feedback (to WPBA group) is important. WPBA Lead