1. Étienne Saint-Pierre, Statistics Canada
Obtaining Wide Support for Statistics Canada’s IBSP: a Key Task in the Project Plan
UNECE - Work Session on Statistical Editing (Topic iii – Getting support of all people when implementing data editing)
Étienne Saint-Pierre, Statistics Canada
Paris, France, April 2014

2. Statistics Canada’s Integrated Business Statistics Program (IBSP)
Major transformational project for business surveys aimed at:
enhancing quality assurance
achieving efficiencies
improving responsiveness in the delivery of new programs
Covers all statistical processes from sampling to estimation
120 surveys in 10 different programs to be integrated by 2017
annuals, sub-annuals, industry specific, economy wide
will impact hundreds of employees
New standardized data editing approach –Rolling Estimates
Iterative production of estimates, quality indicators and micro-record scores
Statistics Canada • Statistique Canada
18/08/2019

3. Statistics Canada • Statistique Canada
Overview of the IBSP Rolling Estimates Approach
Statistics Canada • Statistique Canada
18/08/2019

4. Culture Change - Challenges
Strong belief in the uniqueness and non-standard nature of the program
Fears that client needs will not be met
Skepticism in regards to the success of the project
Passive and active obstructionism
Uncertainty as to the new roles and responsibilities
Why change methods that have worked for decades?
Validation of all micro data is essential for producing high quality estimates
Statistics Canada • Statistique Canada
18/08/2019

5. Strong Governance and Clear Directions
New Corporate Business Architecture (CBA) imposing:
Decision-making process promoting tools, processes and systems serving corporate interest as opposed to local preferences
Mandatory use of centralized services and the Business Register
Effective communication strategy at the agency level
Ongoing messages from the Chief Statistician and seniors managers on CBA objectives and progress
Manager’s performance objectives developed to foster compliance to the new CBA
Statistics Canada • Statistique Canada
18/08/2019

6. Engaging Program Managers
Consultation processes prior to the development of the new model
Solutions to reduce manual interventions
Similarities and exceptions to be considered in the design of the IBSP model
Validation of new operational model and the new data editing approach
Program managers are members of the various IBSP Working Groups (Content and Collection, Metadata, Processing, Methodology)
Senior managers of each program are on the IBSP Steering Committee
Statistics Canada • Statistique Canada
18/08/2019

7. Deconstruction of Existing Methods and Processes
Required a significant number of consultations
Every step of current processes scrutinized in detail to assess:
Relevance, efficiency and impact on the quality of the data
IBSP compliant solutions developed by a multi-disciplinary team
Adjusting parameters
Different sequencing of the tasks
Automating manual interventions
Better usage of the options provided by the generalized systems
Debunk the myth that surveys are too unique to be efficiently processed through the application of a standardized model
Report detailing new operational model and strategies submitted to program manager for sign-off.
Statistics Canada • Statistique Canada
18/08/2019

8. The Use of Proof-of-Concepts
Large scale proof-of-concepts
Simulation of the Rolling Estimates process for 50 or so surveys
For 2 reference years
Introduce analysts to the new editing approach
Iterative production of estimates
Quality indicators and micro-record impact scores
Requirements for the Analytical tool
Assess impact of the new methodologies
Previous approach: 85% of domains of estimates reached their quality target
Rolling estimates: 98% of domains of estimates reached their quality target
Potential of 1/3 reduction in non-response follow-ups compared to current model
Statistics Canada • Statistique Canada
18/08/2019

9. Communication Strategy
Agency-wide information sessions
Targeted information sessions by program
Client satisfaction evaluations
Communication strategy
Decision-making process
Governance structure
Ability of the development team to understand needs
Quarterly newsletters
Document on “Key” decisions
A comprehensive training program
Statistics Canada • Statistique Canada
18/08/2019

10. Design Choice – High Degree of Vertical Integration
Follow-ups
Based on a list of priorities…
…determined by quality indicators
Quality Indica-tors
Based on estimates and CV…
…calculated via a generalized system (G-EST) from the output of E&I
E&I
Imputation of missing data via a generalized system (BANFF) from the output of…
…Central Collection Services and Tax Data Division
Collect-ion
Data collected for units sampled using the generalized system (G-SAM)…
…with frame information stored on the Business Register.
Business Register
Frame info updated via survey feedback from Collection and Subject Matter Areas
All IBSP Surveys are hooked-up to the BR
Processes supported by an integrated metadata framework
Statistics Canada • Statistique Canada
18/08/2019

11. Conclusion
Getting the buy-in from employees involved in the IBSP is essential to the success of the IBSP
Significant efforts are dedicated to this task...
...which consists of a delicate balancing act.
Getting partners involved
Flexibility to survey specific needs
Strong governance/ firm directions
Standardized Processes / methods/ tools
Statistics Canada • Statistique Canada
18/08/2019

12. For more information,  Pour plus d’information,
please contact: veuillez contacter :
Étienne Saint-Pierre
Statistics Canada • Statistique Canada