1. Census Technology: Processing architecture and data analysis
Nicki Thomas Spöcker
Swiss Federal Statistic Office
Espace de l‘Europe 10
2010 Neuchatel
Luzern,
9/21/2018 nsp

2. Table of Contents TOC SFSO - Roles and deliverables
Service center: overview
Service center: data processing
Data processing: elements
Data processing: technical architecture
Data analysis: brief overview
Data analysis: elements
Next presentation
9/21/2018 nsp

3. Swiss Federal Statistic Office
Roles and deliverables within the Census project
requirements definition
software acceptance
system integration
development of various data processing applications (in cooperation with interact)
development of data analysis system
user support/consulting, progress and quality control
9/21/2018 nsp

4. Database Service center: Overview System Mail Management
Data Processing System
Other statistical data
Def. household
formation
Link persons to
households
plausibilities
coding
Data Capturing System
Population
Scanning
Recognition
Controlling
Correction
Controlling
Correction
Controlling
Correction
Manual Keying
Transfer
in database
e-census
System Call Center
Checkbacks
Key from Call
Hotline & Resend
Database
9/21/2018 nsp

5. Other statistical data
Service center: data processing
Server-automatic procedures: batch processing to perform plausibility tests, prepare and load data for interfacing subsystems, do automatic coding and prepare unfilled orders for the manual (GUI) applications
Client-manual applications: use form image to correct recognition errors, link census data (eg household formation), manual coding and many more.
Server logic programmed with Oracle (stored procedures)
Client application programmed in C++
Data Processing System
Other statistical data
Def. household
formation
Link persons to
households
plausibilities
coding
Database
9/21/2018 nsp

6. Data processing: elements
Plaus1 - data and image transfer data capturing system - data processing system
Plaus2 - data transfer temporary tables - working tables
Plaus3 - plausibility tests and generation of records in the error table
Plaus0 - Ecensus plausibility process
Plaus5/Plaus8 - call center interface (checkbacks, key from call)
DDS - interface with mail management, internet and call center
DHH - definitive household formation
V2 - link households and residents
BURV - link census data with registry of enterprises
PROCODE - coding of professions
WSA - handling people with multiple residents
MK - correct recognition with form image
data cleaning - inputation of missing values and data correction processes
progress/quality control
9/21/2018 nsp

7. Data processing: technical architecture
DB Server: Database engine. Execution of stored procedures and transaction handling. Automatic/batch processing.
Application Server: Code engine. Provides processing power for various data processing applications. Load balancing implemented to distribute the workload between 10 PC workstations.
Application Server
Clients: PC workstations with locally installed GUI applications (C++ Clients). Manual processing.
Clients
Multi Tier Architecture (Unix, NT, Corba, Oracle, C++).
Distributed computing.
DB Server
LAN
9/21/2018 nsp

8. DB data processing Data Mart Bridge DB other
Data analysis: brief overview
DB data processing
Online: Query, cross tabulation, analysis tools
Security: according to swiss federal laws and rules
Internet: Query, Ordering
Data Mart
Bridge
Offline: batch processing, preparation of statistical products. CD, Excel, maps, barcharts, diagrams, graphic representation of statistical results.
DB other
9/21/2018 nsp

9. Bridge: SFSO metadata and classification database
Data analysis: elements
DB data processing: census primary entities like buildings, persons, households on the attribute level (micro data)
Bridge: SFSO metadata and classification database
DB other: external data sources
Data mart: microdata, aggregated datasets (cubes, macrodata) prepared and optimized for data analysis. Contains only error-free, non-redundant data.
Online: the experts use sophisticated tools for complicated data analysis tasks
Offline: batch and automatic processes cover performance and resource intensive tasks.
Internet: public services to provide access to statistical results and products.
9/21/2018 nsp

10. Following presentation:
Mr. Hans Peter Stamm - „Ecensus“: concept and presentation of realisation
9/21/2018 nsp