1. Quality Assurance Program National Research Coordinators Meeting Amsterdam, 16 - 19 October 2006

2. NRC Meeting Amsterdam 16-19 Oct 2006 Sampling School sampling and within-school sampling –Sample based on sound and defensible methodology –Sample is properly documented –Sample is approved Teacher sampling –Sample based on sound and defensible methodology –Sample is properly documented –Sample is approved  Sampling implementation –Meets sample size requirements –Meets coverage and exclusion standards –Meets participation rate standards

3. NRC Meeting Amsterdam 16-19 Oct 2006 National Instruments Translation/national adaptation of the instruments –Translation is correct –National adaptations are documented –Necessary corrections/changes are implemented Layout and instruments production –Layout is correct –Necessary corrections/changes are implemented

4. NRC Meeting Amsterdam 16-19 Oct 2006 Data Collection Administered students instruments according to procedures (including security and confidentiality provisions) –Cognitive Test –Student Perceptions Questionnaire –Student Background Questionnaire, and (if relevant) –Regional Module Instrument (s) Administer other instruments according to procedures (including security and confidentiality provisions) –School Questionnaire –Teacher Questionnaire Complete National Context Survey according to procedures

5. NRC Meeting Amsterdam 16-19 Oct 2006 Data All data is submitted in required format and quality All data is accompanied with required documentation – complete and correct

6. NRC Meeting Amsterdam 16-19 Oct 2006 Quality Assurance Tools Technical experts (e.g. on sampling, data processing, etc.) Manuals (e.g. Sampling Manual, Survey Operations Manual, etc.) Trainings (e.g. on scoring open response items, on data management, etc.) Forms (e.g. Sampling Form, National Adaptations Form) Software (e.g. WinW3S for within school sampling) WinDEM for entering and verifying the data) Self-reporting (e.g. Survey Activities Questionnaire) External Reviewers (e.g. Translation Verifiers, International Quality Control Monitors)

7. NRC Meeting Amsterdam 16-19 Oct 2006 Documentation of the Quality Control Documentation of the whole process and the achieved standards in the technical report

8. NRC Meeting Amsterdam 16-19 Oct 2006 Questions and comments ?!!