Joint UNECE/Eurostat/OECD « Techical approval of surveys Statistics Portugal Ana Paula Guerra (ana.guerra@ine.pt) Isabel Morgado (isabel.morgado@ine.pt) 29-30 September 2008 Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Lisbon, 11– 13 March, 2009

Business Process Model

Business Process Model Phase: Design Process:

Business Process Model

Business Process Model Phase: Design Process:

Business Process Model

Business Process Model Phase: Production Process:

Business Process Model

Business Process Model Phase: Production Process:

Business Process Model

Business Process Model Phase: Production Process:

Business Process Model

Business Process Model Phase: Dissemination Process:

Business Process Model

Business Process Model Phase: Evaluation Process:

Business Process Model

Phase: Design Registration Business Process Model Process: Methodological documents Data collection instruments Registration

Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata « STATISTICS PORTUGAL Methodological Documentation Ana Paula Guerra (ana.guerra@ine.pt) Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Lisbon, 11 – 13 March, 2009

Statistical Metadata System The Metadata System (current system) Access: homepage of the Official Statistics website – Portal (http://www.ine.pt/)

Statistical Metadata System Main purposes Central metadata repository Common terminology Improve statistical literacy Homogeneous technological environment Standard documentation of surveys Methodological document (DMet) Support surveys life cycle Technical approval

Technical approval/ /Methodological document workflow Stages DMet

Technical approval/ /Methodological documentation Characteristics Core subsystem (implementation: 2004) Standard documentation of surveys (in force: 2005) Standard format (contents) General characterization Methodological characterization Concepts Classifications Variables Data collection instruments Abbreviations and acronyms Bibliography Product (output) that gathers, in a coherent way, all the metadata generated during the survey design phase

Technical approval/ /Data collection instrument (D.C.I.) Stages D.C.I.

=> final act of the technical approval Data collection instruments Characteristics Repository of questionnaires used in NSS (aprox.: 3500) Access to historic information (background) Access to detailed information (contents) General characterization (status/registration number (ID_code)/ name/validity/statistical area/responsible entity/geographic coverage/ periodicity/type of instrument) Methodological characterization (collection method/respondent entity/statistical observation unit) Data collection instrument (image) Methodological document (subsystem link) Variables (subsystem link) Instrument used for data collection and for which an identification can be specified by means of an attribute => final act of the technical approval

METHODOLOGICAL DOCUMENT/ Methodological documentation/ /Data collection instruments New survey or Changes in the survey due to: changes Business Proccesses reflects: DMet contents consequence: DMet new version WHEN TO CREATE A NEW VERSION OF A METHODOLOGICAL DOCUMENT/ (DMet) substitution system New survey = new questionnaire or Changes in the questionnaire due to: changes observation variables reflects: questionnaire contents consequence: questionnaire new version /DATA COLLECTION INSTRUMENT (questionnaire) substitution due to: changes in validity period reflects: questionnaire validity date consequence: maintains ID_code/changes date prorogation

Methodological documents subsystem User interface

Methodological documents subsystem User interface

Methodological documents subsystem User interface

restricted area Methodological documents subsystem Management area Methodological Documents - Management Search Management area PDF file loading restricted area Loading without link Cont@ct us

Data collection instruments subsystem User interface 

Data collection instruments subsystem User interface

Data collection instruments subsystem User interface

Data collection instruments subsystem User interface

restricted area Data collection instruments subsystem Management area Data Collection Instruments - Management Presentation Search Advanced search New register Prorogation Translation (name) Historic information Respondent entities Users (internal) General documentation Contac@t us Management area restricted area

Joint UNECE/Eurostat/OECD « Methodological Documentation Next Steps Isabel Morgado (isabel.morgado@ine.pt) Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Lisbon, 11– 13 March, 2009 «

« Towards a universal archetype for reference metadata Quality Report Methodological Documentation System « Towards a universal archetype for reference metadata Methodological Document Quality Report Euro-SDMX …. «

« Methodological Document « Standard format: Methodological document survey General characterization, Methodological characterization, Concepts, Classification, Variables, Data collection instruments, Abbreviation and acronym, Bibliography. «

Methodological Document Structure Survey Observation Derived Concepts used Variables Indicators Dimensions Classifications used Methodological Document Products Questionnaires Collection Instruments Data Files «

« Euro-SDMX « Standard format: Contact, Euro-SDMX for Data set Metadata update, Statistical presentation, Unit of measure, Reference period, Institutional mandate, Confidentiality, Release policy, Dissemination, Accessibility, Quality management, …….. Euro-SDMX for Data set «

« Standard Quality Report « Standard format: Introduction, Relevance, Accuracy, Timeliness and Punctuality, Accessibility and clarity, Coherence and comparability, Trade-off between Output Quality Components, Assessment of User Needs and Perceptions, Performance, Cost and Respondent Burden, Confidentiality, Transparency and Security, « Quality report for Statistical process «

« Methodological Documentation System What in common? Standard formats - MSD’s Cross Domain Concepts (shared) Documentation of a particular “Level of attachement” «

« A possible solution: Methodological Documentation System Common infrastructure based on SDMX model Diferent reports depending on different MSD’s Reutilization of the same concept content in different reports «

Methodological Documentation (MSD’s) Methodological Documentation System « Methodological document Standard Quality Report Other reports Euro-SDMX Interface Methodological Documentation (MSD’s) Concepts Variables Data Collection Instruments Products Classifications … «

« Implementation: Methodological Documentation System Analysis of existing implementations ESSnet on SDMX: common solution for Euro-SDMX? Generalization for other report types? «

Methodological Documentation System « Thank you for your attention «