Summative Assessment Training Day Tidworth College 16 September 2005

What are Formative and Summative Assessment? Formative assessment continues throughout the GPR year involves feedback to help you establish your needs and to help you improve performance Summative assessment an end-stage assessment of competence

What is Summative Assessment for GP Training? A test of minimal competence required for an independent practitioner in general medical practice Looks at knowledge skills attitudes The vast majority of GPRs and Returners should have no difficulty in passing SA

Why have Summative Assessment? Some GPRs aren’t ready for independent practice at the end of their GPR year SA identifies those that need extra support, or more time

So, Summative Assessment is easy BUT it must be approached professionally

If you don’t pass SA… You can’t work in General Practice  locum,  assistant, or  partner  money

What does SA involve? 1) M C Q 2) Written submission of practical work  usually an audit 3) Assessment of consulting skills  usually a video 4) Structured Trainer’s report

The National Office for Summative Assessment http//:

The MCQ  Positively marked  170 True/False questions  80 Extended Matching questions  10 Single Best Answer questions

The MCQ  Not recommended until completed 3 months as GPR  but SHOs in hospital do pass!  Unlimited attempts permitted  4 sittings per annum  Feb/May/Sept/Dec

The MCQ – true/false  Itching is commonly a presenting symptom in :  Atopic dermatitisT/F  Hodgkin’s diseaseT/F  Lichen planusT/F

The MCQ - Extended Matching Questions  A patient has difficulty swallowing. Which of the following investigations would help most with the diagnosis in the following clinical presentation:  A 19 year old male has been unwell for 10 days with a fever, sore throat, difficulty swallowing and general malaise A, Barium SwallowB, Bronchoscopy C, EndoscopyD, Manometry E, MonospotF, Serum Iron G, Thyroid Function TestsH, Throat swab I, Video fluoroscopy

The MCQ – Single Best Answer Questions Meningitis  ABenzyl penicillin (IV)  BErythromycin (IV)  COxygen via a face mask  D Phenoxymethylpenicillin (oral)  E Prednisolone (IV)  Which is the SINGLE best treatment from the above list of options?  A 4 year old boy is drowsy and shocked. He demonstrates neck stiffness and has a purpuric rash which doesn’t blanch on pressure. He has no known allergies.

The Structured Trainer’s Report

To be completed 1-2 months before the completion of training

The Structured Trainer’s Report BUT should be read by Trainer and Registrar at the onset of the GPR year AND reviewed regularly throughout the year

What is it? Minimum standard of competence To identify the incompetent or unready 35 basic competencies Must pass on all items

Collection of Evidence Specific Clinical Skills (12) Patient Care (12) Making a Diagnosis Patient Management Clinical Judgement Personal Skills (11) Organisation Skills Professional Values Personal & Professional Growth

Formative use of Trainer’s report Start using it now!

Formative use of Trainer’s report Identify problems early Share problems with Course Organisers and Associate Directors early Develop a strategy to deal with areas of difficulty

The Written Submission

 Completed Audit Cycle  or  National Project Marking Schedule (NPMS)

The Audit – a recipe for success Must contain the following: Title Reason for choice Criteria chosen Reasons for choice of criteria Standards set and why? Preparation and planning

The Audit – a recipe for success Must contain the following: First data collection - include charts and graphs Conclusions drawn from data Change to be implemented Second data collection – after change made Conclusion and learning Points

The Audit – a recipe for success KISSKISS EEP T IMPLE TUPID!

The Audit – a recipe for success Follow the recipe!

Audit Timetable Month 1Choose Topic Month 2First Data Collection Month 3Put in place changes Month 4Second Data Collection Month 5Completion + submit to Deanery

Audit checklist Is the audit anonymous? Layout Double spaced Pages single-sided and stapled Pages numbered GPR Number on each page Word Count – not more than 3000 Practice list size Appropriate references Audit declaration and consent form

Audit tips Listen to your tutor today KISS Follow the recipe Check out my audit website

MRCGP/SA Single Route  Submission of a single video for theMRCGP and Summative Assessment  Pass in MRCGP Video Module =  Pass in SA Consulting Skills component

Single route video Common video logbook summary sheet consent form Different standard - anticipate 20%+ failure at MRCGP video 5% failure at SA video

Single route video Register with RCGP for video component of MRCGP – 7 February 2006 Submit tapes to the Deanery by 28 April 2006 MRCGP and SA Results issued separately: SA by Deanery office on 30 June 2006 MRCGP video by RCGP on 21 July 2006

Simulated Surgery Examined in Leicester Deanery Wednesday evenings or Saturday afternoon Must have permission from Director of Postgraduate GP Education before application is submitted

Your Deanery contact… Vanessa Trickett

Audit Submission 2 first level assessors PASS Result to GPR One or both REFER 2 second level assessors agree outcome PASS REFER Return to GPR to RESUBMIT

Resubmission New or revised audit 2 second level assessors PASS REFER 2 National level assessors FAIL