Generic Statistical Business Process Model (GSBPM) Petr Elias Czech Statistical Office

OUTLINE GSBPM GSBPM mapping to SIS SIS SMS

What is GSBPM? The GSBPM describes and defines the set of business processes needed to produce official statistics. standard framework and harmonised terminology helps statistical organisations to modernise their statistical production processes, as well as to share methods and components can also be used for integrating data and metadata standards, as a template for process documentation, for harmonizing statistical computing infrastructures, and to provide a framework for process quality assessment and improvement.

What is GSBPM? Published by United Nations Economic Commission for Europe (UNECE) current version 5.0 (December 2013) based on Joint UNECE / Eurostat / OECD Work Sessions on Statistical Metadata (METIS) => Common Metadata Framework (CMF) http://www.unece.org/stats/cmf/

What is GSBPM? Relation to other standards GSBPM ver. 5 is fully aligned with version 1.1 of the Generic Statistical Information Model (GSIM) http://www1.unece.org/stat/platform/display/metis/Generic+Statistical+Information+Model

What is GSBPM? Relation to other standards GSBPM ver. 5 provides a basis for the implementation of the Common Statistical Production Architecture (CSPA) http://www1.unece.org/stat/platform/display/CSPA/Common+Statistical+Production+Architecture+Home

What is GSBPM? Structure Phases of the statistical business process (8) Sub-processes within each phase (44) In practice, activities do not need to follow the strict order of the model. In specific cases, some activities may not be applicable, some activities may go in different order or may be repeated. Over-arching processes that apply throughout the eight phases, and across statistical business processes

GENERIC STATISTICAL BUSINESS PROCESS MODEL Source: http://www.unece.org

What is GSBPM? Over-arching processes Quality management Metadata management Data management Process data management Knowledge management Statistical framework management Statistical program management Provider management Customer management

What is GSBPM? Over-arching processes – more general Human resource management Financial management Project management Legal framework management Organisational framework management Strategic planning

What is GSBPM? Main changes from the version 4.0 Phase 8 (Archive) has been removed, and incorporated into the over-arching process of data and metadata management A new sub-process: "Build or enhance dissemination components" has been added within the "Build" phase Several sub-processes have been re-named to improve clarity The descriptions of the sub-processes have been updated and expanded where necessary. The terminology used has been changed to be less survey-centric, in recognition of the growing use of non-survey sources (administrative data, big data etc.).

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – PRODUCTION – Requests Evidence of users‘ requests Internal & external users describe their needs Change of the process (questionnaire, processing…) Data (new data, complaints about accuracy…) Task force (methodologists & domain experts) evaluates requests – the sub-system keeps record of: Decision Reasoning Further steps Reports for management

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – PRODUCTION – Preparation Methodological preparation of surveys Timetables Description & identification of data (input & output) Structure & design of questionnaires Sample frame & samples Metadata definition of data validation rules Metadata definition of autocorrections Description of processing methods to be used Requested outputs (output tables layout) Programming specification

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – PRODUCTION – Program Programming activities necessary for data collection & processing Applications Update of existing applications or development of new ones for the processing of collected data Procedures Conversion of metadata definitions of data validation rules & autocorrections into PL/SQL procedures and Java Script According to the specifications (of the survey) from the sub-system Preparation Spadá sem i testování aplikací (ověřovací zpracování)

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – PRODUCTION – Input Collection of data Paper questionnaires Electronic questionnaires (pdf, web) Administrative data sources Primary processing of data Data validations interaction with respondents & administrative data sources Corrections Definition of quality indicators Intelligent (fillable) PDF files - Data can be stored in „layers“ – e.g. monthly questionnaire contains 12 data layers

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – PRODUCTION – Central Production of statistical outputs (of the survey) Automated steps Imputation of missing values Calculation of derived indicators Aggregations of individual data (primary data confidentiality) Support for creation of time series Analyses of results Production of outputs needed for evaluation Expert estimations Results are published or used as input for other surveys

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – PRODUCTION – Dissemination Dissemination of statistical outputs Planning Publishing (secondary data confidentiality) Flash information Standard outputs Public database (PDB) Regular file exports (for Eurostat, OECD etc.) Statistical analyses (incl. printed publications) Ad-hoc outputs Monitoring

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – INTEGRATION – Data warehouse Common place to store data Input data (aggreed part of them) Output data (all) Data in the phase of processing are in the Central DB Browsing of data via data marts Data source for analyses (for internal users) Primary source for dissemination (for external users)

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – INTEGRATION – GIS Geographic information system applied to statistical purposes Visualisation and interpretation of data in the form of maps Combines different layers of data Allows for analyses of relationships, patterns and trends INSPIRE metadata standard

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – INTEGRATION – Registers ROS ROB RÚIAN Government basic registers SIS REGISTERS RES RSO DFO FR Statistical surveys Administrative data sources Standard statistical data sources

PRODUCTION SUB-SYSTEMS INTEGRATION SUB-SYSTEMS REQUESTS DISSEMINATION CENTRAL INPUT PROGRAM PREPARATION INTEGRATION SUB-SYSTEMS DATA WAREHOUSE REGISTERS GIS METADATA GSBPM: Zelené – over-arching activities Modré – processes

SIS – INTEGRATION – SMS SMS modules Requests (part of Requests) Code lists & classifications Variables Tasks (= Surveys) Respondents (part of Input) Processing (part of Central) Time series Quality Outputs Users (part of Dissemination)

GENERIC STATISTICAL BUSINESS PROCESS MODEL Source: http://www.unece.org

Any questions?