Multiple Indicator Cluster Surveys Survey Design Workshop Data Analysis and Reporting MICS Survey Design Workshop

Provide an overview of the MICS process in analyzing data Provide an overview of the preparation of the Summary Findings and the Final Report Purpose

Data entry and processing programs will be covered in second workshop Standard set of MICS tabulations and guidelines will be provided Standard guidelines and templates for Summary Findings and Final Report will be provided Process for report preparation

Technical support for data analysis and report writing will be through UNICEF regional consultants Once a draft final report is produced, a review process is initiated with the Regional and Global MICS Team

Carry out basic checks of data quality (non- sampling errors) using the Data Quality Tables Calculate response rates Response rates lower than 90% suggest results may be biased Before producing tabulations and writing reports

Missing Check for variables with large numbers of Missing. Make sure it is not a problem with data entry or editing Any variable with 10% or more missing values, use with caution; if very high, do not use at all Before producing tabulations and writing reports (continued)

Don’t knowOther Check for variables with large numbers of “Don’t know” or “Other” answers. Large numbers of DKs can indicate difficulty understanding the questions High proportions of “Other” indicates questionnaire did not account for most common responses Before producing tabulations and writing reports (continued)

expected patterns Check for expected patterns in the data. Unexpected patterns may result from faulty sample design, improper implementation of the sample, interviewer errors, or respondents’ inaccurate answers. Before producing tabulations and writing reports (continued)

background variables Decide on basic background variables and their groupings - Geographic areas, urban/rural residence, level of education, male/female, wealth quintiles, religion of household head, etc. Calculate the wealth index Before producing tabulations and writing reports (continued)

Use tabulation plan unweighted number of observations Check unweighted number of observations for displaying results fewer than 25 unweighted cases unweighted cases Cells based on very small numbers of cases are not reliable and should not be shown; results based on fewer than 25 unweighted cases should not be shown, unweighted cases should be shown within parentheses (caution) Producing final tables

The MICS Report Templates There are two templates available in MICS which can be customized by countries depending on the content of the survey: 1.Summary Findings Report 2.Final Report Templates are/will be available in English, French, Arabic, Russian and Spanish.

MICS Report Templates

Why use the MICS templates? efficient productionTo facilitate the efficient production of MICS reports so countries do not have to “reinvent the wheel” and spend time on the design of tables, indicator explanations etc. comparable reportsTo ensure the production of comparable reports that can be used easily to draw comparisons between countries. increase confidence among usersTo increase confidence among users in the survey; MICS is a recognised household survey programme with an internationally accepted methodology

The Summary Findings Report A very short and visual report that does not need a lot of text/writing. The tables and topics included in the report are a subset of the final report Quick results on critical indicators such as mortality and malnutrition to allow for possible programme response as soon as possible. Will buy time while working on the final report See childinfo.org for examples

Make sure that data quality is taken into account during report writing When comparing findings to previous results or between groups, make sure that sampling errors are taking into account Describing findings

Content of the Final Report Template Front Matter Foreword, Executive Summary, Contents, Summary Table of Findings Introduction Sample and Survey Methodology Results Chapters (presented by theme) Appendices Sample Design Personnel Involved Estimates of Sampling Errors Data Quality Tables Indicator List Questionnaires

The Final Report To convey the results of the survey to a wide audienceTo convey the results of the survey to a wide audience which includes government agencies, non- governmental organizations, other multilateral donors, the press, and the general public all indicator results included in the surveyThe report describes the current situation of children and women taken from all indicator results included in the survey. It also includes detailed information on survey methodology and implementation. See childinfo.org for examples

Who should write the Final Report? Once tables are generated and finalized it should be quite straight forward to write the report. Typically it is the MICS implementing agency and/or members of a stakeholder/technical committee who write the report. Chapters can be divided among different people. It is useful to have people familiar with subject matter. Experts in various fields should be consulted and asked to review the tables in order that the key messages and any unusual findings are addressed and dealt with properly in the report and that technical terminology is appropriately used.

Report Writing Data Dissemination and Further AnalysisWill partly be covered during the 3 rd MICS Workshop: Data Dissemination and Further Analysis However, the writing process should begin earlier. The survey teams should not wait for attending the workshop to start preparing the reports See childinfo.org for MICS4 3 rd workshop presentation files

Dissemination of Findings There will be a separate workshop session Data Dissemination and Further Analysis3 rd MICS Workshop: Data Dissemination and Further Analysis National seminar, distribution of findings, other dissemination activities

MICS data can be used for statistical analysis beyond that contained in the survey report The data collected should be exploited as fully as possible Data Dissemination and Further Analysis3 rd MICS Workshop: Data Dissemination and Further Analysis Potential topics for further analysis: –Analysis of data quality, Analysis of trends –Identification of “most vulnerable” groups –Multivariate analyses of determinants of child health or schooling outcomes Further Analysis of the Data