1. Neil Millar Clinical Director
Enhancing quality assurance through a NES Psychology trainee survey -Stages to the process
Neil Millar
Clinical Director

2. Overview of stages
1a: Pre-pilot - Review of evidence base & Delphi process
1b: Pre-pilot - dissemination of pre-pilot survey to trainees, supervisors, HOS, Programme staff
2: pilot survey (mandatory) – dissemination of pilot survey via Questback and data analysed using factor analysis to generate factor structure for final survey.

3. Stage 1a: pre-pilot – developing the quality indicators & question items
This stage involves identifying quality indicators and item generation based on:
A review of previous survey tools used across applied psychology training courses and standardised tools developed
A brainstorming session with the working group to further identify quality indicators and as a credibility check of items generated
Working group to review preliminary quality indicators and develop operational definitions and further question items relevant to each indicator

4. Stage 1b: Pre-pilot – trainees to be sent pre-pilot survey
An initial pre-pilot survey tool developed. This tool would include a larger number of items than would be required in the final survey tool
This would then be sent to trainees, HOS, Programme staff & supervisors to comment on the suitability (clarity & relevance) of questions asked and also to add or comment on further items to be included
Responses used to form the pilot survey

5. Stage 2: Piloting of survey
Pilot stage – this involves the larger pilot set of items being set up on Questback for dissemination to trainees across all 4 courses for completion about their placement and supervision experiences
This also includes larger number of questions than will be included in final survey
Likert type scale responses completed by trainees
The outcome from this process would be to then subject the data to both exploratory and confirmatory factor analysis
Develop the factor structure for the final survey to be used
The data generated from this pilot survey would only be used to generate the final survey tool and NOT used for quality assurance/feedback purposes

6. Timeline Pre-pilot (1a) = February – May 2016
Pre-pilot (1b) = June – July 2016
Pilot survey (2) = August – October 2016
Aim to have final survey developed = November/December 2016