How official statistics is produced Alan Vask

Collecting customer needs Statistical programme draft Government acknowledge- ments 5-year statistical programme Preparation of statistical activity Data collection Data processing Analysis Dissemination of official statistics Production of official statistics Production of statistics Suggestions Negotiations Statistical council opinion Consumer surveys EU statistical programme Suggestions Negotiations Statistical council opinion Consumer surveys EU statistical programme Public interest Existence of data sources Load for data providers Feasibility of producing official statistics Country budget strategy and next years budget project. Public interest Existence of data sources Load for data providers Feasibility of producing official statistics Country budget strategy and next years budget project. Consists of statistical activities Determines output indicators of every statistical activity Consists of statistical activities Determines output indicators of every statistical activity Persons and households Economical units Registries Persons and households Economical units Registries Control and fixing Coding Imputations Anonymization Calculate extra indicators Calculate weights Control and fixing Coding Imputations Anonymization Calculate extra indicators Calculate weights Companies Government institutions Sience and education institutions Eurostat and international institutions Media Private persons Companies Government institutions Sience and education institutions Eurostat and international institutions Media Private persons Aggregations Seasonal adjustment Quality indicators Interpret and clarification Preparation for publishing Aggregations Seasonal adjustment Quality indicators Interpret and clarification Preparation for publishing Mostly ministries1 Define input variables Sampling Describe workflow Design and create survey form Testing, piloting Define input variables Sampling Describe workflow Design and create survey form Testing, piloting

Satistical production main process Production of statistics 1. Specify needs 2. Design 3. Build 4. Collect 5. Process 6. analyse 7. Dissemi- nate 8. Archive 9. Evaluate Main production process

Generic Statistical Business Process Model Production of statistics Marketing and Dissemination Department Statistics Departments Data Warehouse Department Data Processing and Registers Department General Department Metadata Department

Structure of Statistics Estonia Production of statistics

Results: product development/ planning workflow (from up to down) 1.User needs 2.Output description (statistical programme) 3.Design principles 4.Interviewer or self service, client support and specifying Production of statistics

Results: statistical production workflow (from bottom to top) A.Filled questionnaire and changes in contact details B.Source data and quality report C.Output (cubes, articles, inquiry responses etc) and clarifications D.Products and services, customer support Production of statistics

1. User and dissemination Conducts user surveys Collects change propositions from main consumers Collects requests and orders for information Collects and analyses user feedback Collect and analyses statistical domain departments direct contacts with users Collects Eurostat’s requirements from statistical domain departments Collects OECD’s and other international institution’s requirements from statistical domain departments Production of statistics USER NEEDS MARKETING AND DISSEMINATION DEPARTMENT (1 Specify needs + 7 Disseminate) 1 1

2. Dissemination and Statistical domains Agree on statistical programme List of statistical activities Output description (inc cube variables, maps, publications, articles, etc) Agree on contract terms for activities outside statistical programme Agree on operative plan Advanced release calendar Preparation calendar Data collection calendar etc Production of statistics MARKETING AND DISSEMINATION DEPARTMENT (1 Specify needs + 7 Disseminate) BUSINESS AND AGRICULTURAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse) ECONOMIC AND ENVIRONMENTAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse) 2 2 METHODOLOGY AND ANALYSIS DEPARTMENT (2 Design + 3 Build + 6 Analyse)

3. Statistical domains and Data Processing and Registers Agree on view of source database (involve data warehouse department) Agree on list of registry variables and quality requirements Agree on deadline of data processing Agree on classification versions to be used Agree on definition of total population and statistical unit Provides recommendations for stratification and data processing (inc imputations, exceptions, etc) Terms and definitions Algorithms for calculated indicators List of data sources Survey form Pre-fill rules Production of statistics DATA WAREHOUSE DATA PROCESSING AND STATISTICAL REGISTERS DEPARTMENT (2 Design + 4 Collect + 5 Process) ECONOMIC AND ENVIRONMENTAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse) METHODOLOGY AND ANALYSIS DEPARTMENT (2 Design + 3 Build + 6 Analyse) 3 3 BUSINESS AND AGRICULTURAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse)

3. Data warehouse Agree on survey design Agree on data processing design Agree on source database design Agree on workflow design Agree on test cases Agree on production deadline Production of statistics DATA WAREHOUSE DATA PROCESSING AND STATISTICAL REGISTERS DEPARTMENT (2 Design + 4 Collect + 5 Process) ECONOMIC AND ENVIRONMENTAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse) METHODOLOGY AND ANALYSIS DEPARTMENT (2 Design + 3 Build + 6 Analyse) 3 3 BUSINESS AND AGRICULTURAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse)

4. Data processing and registers and data provider Provides interviewer or self service to data provider Provides support to data provider Sends notifications and reminders to data provider Specifies manually sent data Production of statistics 4 4 DATA PROCESSING AND STATISTICAL REGISTERS DEPARTMENT (2 Design + 4 Collect + 5 Process) COLLECTION INSTRUMENT

A. Data provider and data collection Fills questionnaire or gives a cause for no response Provides changed contact details Provides feedback Provides application to register main users Production of statistics DATA PROCESSING AND STATISTICAL REGISTERS DEPARTMENT (2 Design + 4 Collect + 5 Process) DATA A A

B. Data processing and registers and Statistical domains Loads data with metadata to data warehouse Forwards data collection report Forwards data processing report Forwards quality report Production of statistics ECONOMIC AND ENVIRONMENTAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse) DATA PROCESSING AND STATISTICAL REGISTERS DEPARTMENT (2 Design + 4 Collect + 5 Process) METHODOLOGY AND ANALYSIS DEPARTMENT (2 Design + 3 Build + 6 Analyse) DATA WAREHOUSE B B BUSINESS AND AGRICULTURAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse)

C. Statistical domains and dissemination Forwards verified output (cubes, articles, answers for requests, etc) Forwards metadata (ESMS format) Forwards responses to requests Provides explanations (presentations, interviews, etc) Forwards detailed data to scientists and Eurostat Production of statistics MARKETING AND DISSEMINATION DEPARTMENT (1 Specify needs + 7 Disseminate) BUSINESS AND AGRICULTURAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse) ECONOMIC AND ENVIRONMENTAL STATISTICS DEPARTMENT (2 Design + 3 Build + 6 Analyse) METHODOLOGY AND ANALYSIS DEPARTMENT (2 Design + 3 Build + 6 Analyse) C C

D. Dissemination and users Disseminates products and services Statistical database Publications Press releases Etc Marketing products and services Provides feedback to users Organises press conferences Provides user training and user support Production of statistics PRODUCTS MARKETING AND DISSEMINATION DEPARTMENT (1 Specify needs + 7 Disseminate) D D

Production of statistics Thank you! Alan Vask Deputy Head of Marketing and Dissemination Department

Production of statistics