1. How to evidence quality
Professor Jacky Hayden

2. How to evidence quality
What measurement tools are currently in use
What recording tools are currently in use
A framework for educational audit
Sharing and benchmarking

3. Why evidence quality?

4. "A long habit of not thinking a thing wrong gives it a superficial appearance of being right."
Thomas Paine (1737–1809)

5. Why evidence quality? To ensure continuous quality improvement
Financial
To meet the GMC standards
To meet the Deanery standards

6. Quality Improvement

7. Quality Improvement

8. Current reporting tools
NACT report form
Training programme/School report form
Electronic reporting tools

9. Current tools in use for measuring quality
GMC surveys
End of placement questionnaire
Specialty specific tools eg RCS
Systematic feedback from ARCP/portfolio review
Exam data
Patient satisfaction surveys
External review Deanery/College

10. Tools for measuring the quality of an interaction between a trainer and learner
On a ward round
In out patients
In a tutorial
In a joint consultation
In theatre
In a supervision meeting

11. What should we measure?

12. Lessons from Clinical Audit
Structure Process Outcome

13. Focus energy on this group
Easy to measure
Focus energy on this group
Important

14. Training and trainee/student reported outcomes
The Local Education Provider (LEP) can demonstrate that each trainee/student has agreed and defined learning outcomes and that these are achieved.
The LEP, working with the training programme directors and educational leaders ensures that educational supervisors are using educationally sound methods

15. Trainee/student and patient safety
The LEP is able to demonstrate that all students and doctors in training work with safe supervision.
The LEP works with training programme directors and educational leaders to ensure that the people responsible for workplace based assessments have been trained and calibrated and have time in job plans to undertake their role as well as receiving feedback and review through appraisal.

16. Trainee/student and trainer experience
The LEP ensures that trainees/students and trainers are treated with respect and dignity
The LEP can demonstrate that the culture is one that fosters, team working, clinical engagement and patient focused care.

17. The Local Education Provider (LEP) can demonstrate that each trainee/student has agreed and defined learning outcomes and that these are achieved

18. Structure
Process
Outcome

19. Structure
What evidence would a DME and TPD need to be confident that the learning opportunities of the post had been mapped to the curriculum?

20. Process
What evidence would a DME or TPD need to be confident that the trainee and their nominated supervisor had agreed the specific learning objectives, based on the opportunities of the post and the past experience of the trainee?

21. Outcomes What evidence would a DME or TPD need:
to be confident that the agreed outcomes have been achieved?
to be confident that assessments have been robust?
to be confident that any remaining objectives have been clearly documented?

22. Benchmarking

23. Graph of Programme total audit scores