Support for design of statistical surveys at Statistics Sweden Eva Elvers Process Department Statistics Sweden (SCB) eva.elvers@scb.se

Outline Design Statistics production Support A process support system A guide for design Communication and implementation Development Discussion

Design – and context Statistics production: based on a statistical survey or more than one survey Generic Statistical Business Process Model, UNECE Situations: New survey Re-design Continuous improvements for an ongoing survey

Statistics production process ~ a statistical survey (one or more) Evaluate and feed back 8 Specify needs 1 Design and plan 2 Build and test 3 Collect 4 Process 5 Analyse 6 Disseminate and communicate 7 Support and infrastructure

Statistics production process – two levels Specify needs 1 Design and plan 2 Build and test 3 Collect 4 Process 5 Analyse 6 Disseminate and communicate 7 Identify information needs and availability 1.1 Design end product 2.1 Build collection instrument 3.1 Generate frame and register population 4.1 Classify and code microdata 5.1 Produce statistics 6.1 Prepare dissemination 7.1 Identify customers 1.2 Design frame, register population and sample 2.2 Build and adapt tools 3.2 Select sample 4.2 Edit microdata 5.2 Edit macrodata 6.2 Compile end product 7.2 Establish customer contact 1.3 Design data collection 2.3 Build workflow 3.3 Set up data collection 4.3 Impute for nonresponse 5.3 Carry out disclosure control 6.3 Disseminate end product to customer 7.3 Confirm information needs 1.4 Design processing 2.4 Test collection instrument 3.4 Run data collection 4.4 Complement microdata 5.4 Finalise observation register 6.4 Communicate end product 7.4 Negotiate and contract 1.5 Design analysis 2.5 Test tools and workflow 3.5 Transfer and store data electronically 4.5 Calculate weights 5.5 Interpret and explain 6.5 Dispose and preserve 7.5 Design dissemination and communication 2.6 Conduct pilot study 3.6 Finalise outputs for dissemination 6.6 Design workflow 2.7 Initiate workflow 3.7 Plan production cycle 2.8

Process support system This system contains descriptions of processes The tree of sub-processes varies in detail; from level 2 down to level 5 (a few cases) Input Process description – character varies Output Contacts Latest update occasion

Standardisation and process description Different types and ways of standardisation IT-tools Templates Checklists – character varies Detailed activities, step-by-step Tasks to be done, without /precise/ instructions Issues to consider For a survey/product: a mixture of standards and survey/product adaption

Guide at SCB: Design of statistical surveys Main contents: Starting points for design and planning some basic concepts and reasoning, intro for the survey manager Customer (user) contacts specifications, concepts, deliverables, contacts under way, ... Preparatory actions Trade-off examples (next) Design the IT-solution References

Guide to design: Trade-off examples Different choices, different error sources, errors and costs mixed mode: questionnaires, respondents, follow-up response rate: bias, group strategy, ‘easy’ responses data collection method: content, time, costs comparability and accuracy – when there are changes balance together with customer pilot study

Communication and implementation Communication – two ways! Courses, seminars Networks, visits Feedback, suggestions Situation to consider New survey Re-design Continuous improvements Support – additional Maintenance model with roles, planning, ... Model on test, ... Design teams recommended

Development directions Guide on choices and intensities (what and how much) overall perspective (the last €) Quality and costs more process data needed Optimisation – or a structured procedure Can everything be measured in one way? Rather multi-facetted: quality components and costs Certain conditions/restrictions Then: some optimisation (often accuracy involved) More knowledge → better support

Discussion The process support system is somewhat like a handrail. The guide complements through suggestions and thoughts. More communication, examples, process data Furthermore: Suitable procedure for successive choices Responsive design, in simple form More connections Quality assurance and quality control Architecture Build and test: collection instrument, tools, workflow