Quality Control Program in ICCS Plans for the Main Study National Research Coordinators Meeting Windsor, June 2008

NRC Meeting Windsor 9-12 June 2008 Content of presentation Goals and organization of the Quality Control Program National Quality Control Monitoring - Procedure International Quality Control Monitoring - Requirements - Responsibilities

NRC Meeting Windsor 9-12 June 2008 Quality Assurance Program for ICCS Two components: - National (organized by the National Center) - International (organized by IEA) Goal: - To provide evidence that the standard international procedures for data collection were followed

NRC Meeting Windsor 9-12 June 2008 National Quality Control Monitoring in Field Trial Feedback received from 22 countries - 20 implemented IEA NQCM program - 2 took other measures Countries used IEA manual 7 countries used external agency to control the process of implementation

NRC Meeting Windsor 9-12 June 2008 National Quality Control Monitoring in Main Study The same procedure as in Field Trial  IEA provides a manual with guidelines  The National Center identifies National Quality Control Monitors (NQCM) to: - Visit 10% of participation schools - Verify distribution of materials to students - Observe survey administration procedures - Verify information on Tracking Forms - Interview School Coordinator and Survey Administrator  NQCM reports to NRC  NRC provides information about implementation of the national program through SAQ

NRC Meeting Windsor 9-12 June 2008 International Quality Control Monitoring The National Center: - identifies an International Quality Control Monitor (IQCM) IEA Secretariat: - Signs contract with IQCM - Provides all necessary materials - Conducts training for the IQCM in Amsterdam SH countries: 29 – 30 September 2008 NH countries: 19 – 20 January 2009

NRC Meeting Windsor 9-12 June 2008 Identifying International Quality Control Monitor Person acceptable for schools Person who understands school functioning Fluent in English Independent of the National Center and if possible: Familiar with educational research

NRC Meeting Windsor 9-12 June 2008 Responsibilities of International Quality Control Monitor Visit the NRC, collect the final set of instruments, manuals and documentation Visit 15 selected schools and report on data collection Interview School Coordinator and Survey Administrator Comment on the implementation of the translation and layout verification Reports to IEA Secretariat IEA Secretariat summarizes result in Technical Report

NRC Meeting Windsor 9-12 June 2008 Questions and comments ?!!