The implementation of tools to support the data quality of the survey frame Mario Ménard November 2008

20/08/2015 Statistics Canada Statistique Canada 2 Outline  Data sources to populate and maintain the survey frame  Quality Assurance Survey  Interceptor Module  Survey Frame Assessment Tool

20/08/2015 Statistics Canada Statistique Canada 3 Data Sources used to maintain the frame Central Survey Frame Business Register Canadian Revenue Agency (CRA) NAICS Coding Survey Feedback Profilers and Frame Analysts 99% of businesses have only one operating entity Legal name, business address, main activity description, geographical location, size measures etc new businesses each year 45 % are coded automatically based on the description provided at the time of registration 55 % requires manual intervention Identification of inactive businesses # of misclassified businesses Data collection centers transmit survey feedback to the Register Interception of legal name, business status and NAICS changes Review the validity of the survey feedback Review the updates performed on business structures and its characteristics Updates business structure and its characteristics

20/08/2015 Statistics Canada Statistique Canada 4 Quality Assurance Survey  QAS measures the number of inactive businesses and the quality of NAICS coding for units on the BR  Monthly sample of 600 businesses Allows small constant surveys conducted by a few individuals Reduces QAS interviewer re-training and ensures survey consistency from month to month Provides timely, relevant measurements Gives an indication of the inactive units and coding quality over time  Units eligible for selection exclude very large and complex businesses and recently surveyed units

20/08/2015 Statistics Canada Statistique Canada 5 Quality Assurance Survey Results from June July 2008 Sectors % Death Rate % NAICS 2 Digit Error Rate % Error Rate by Revenue % Volatility Rate All sectors Agriculture, Forestry, Fishing & Hunting Mining, Oil and Gas Extraction Utilities Construction Manufacturing Wholesale Trade Retail Trade Transportation & Warehousing Information & Cultural Industries Finances & Insurance Real Estate, Rental & Leasing Professional, Scientific and Technical Services Management of Companies and Enterprises Administrative & Support Educational Services Health Care & Social Assistance Arts, Entertainment & Recreation Accommodation & Food Services Other Services except Public Administration

20/08/2015 Statistics Canada Statistique Canada 6 Quality Assurance Survey Results from June July 2008 Sectors % Death Rate % NAICS 2 Digit Error Rate % Error Rate by Revenue % Volatility Rate All sectors Agriculture, Forestry, Fishing & Hunting Mining, Oil and Gas Extraction Utilities Construction Manufacturing Wholesale Trade Retail Trade Transportation & Warehousing Information & Cultural Industries Finances & Insurance Real Estate, Rental & Leasing Professional, Scientific and Technical Services Management of Companies and Enterprises Administrative & Support Educational Services Health Care & Social Assistance Arts, Entertainment & Recreation Accommodation & Food Services Other Services except Public Administration Sectors % Death Rate % NAICS 2 Digit Error Rate % Error Rate by Revenue % Volatility Rate All sectors

20/08/2015 Statistics Canada Statistique Canada 7 Interceptor Module  Intercepts requests for updates received from the data collection centres  The following events are intercepted: Classification changes Legal name changes Business Status changes  Survey program managers have the choice to decide if they want to use this module  After 35 days in the interceptor module, requests for updates are processed automatically to avoid the accumulation of events

20/08/2015 Statistics Canada Statistique Canada 8 Number and status of update requests received in the Interceptor Module From January 2008 to September 2008 # of update requests # of update requests cancelled % of update requests cancelled # of update requests accepted % of accepted requests Total # of update requests % % Services Surveys % % Distributive Trade Surveys % % Manufacturing Surveys %61440 % Others % %

20/08/2015 Statistics Canada Statistique Canada 9 Survey Frame Assessment Tool  Indicates changes on the survey frame from one period to the other  Easily accesses the details of the changes  Analysis performed just before the release of the monthly Generic Survey Universe File  Identifies the largest contributors to the change from one period to the another  Measures the quality of work being performed by the people making updates to the frame  Provides constructive feedback and a good indication of additional training that may be required

20/08/2015 Statistics Canada Statistique Canada 10 Survey Frame Assessment Tool Number of additional establishments and their revenue contribution by type of updates between the June 1 st and July 1 st G-SUF, 2008 Type of updates # of additional establishments Total revenue (000,000) New establishments: 1) From profiling activities349$ ) From assigning a NAICS code11 800$ ) From obtaining a size measure from administrative source $ NAICS Changes to existing establishment: 4) From profiling activities 1 100$ ) From the Quality Assurance Survey125$ 10 6) From a new description received from CRA270$ 76 Total24 973$

20/08/2015 Statistics Canada Statistique Canada 11 Survey Frame Assessment Tool Number of additional establishments and their revenue contribution by type of updates between the June 1 st and July 1 st G-SUF, 2008 Type of updates # of additional establishments Total revenue (000,000) New establishments: 1) From profiling activities349$ ) From assigning a NAICS code11 800$ ) From obtaining a size measure from administrative source $ NAICS Changes to existing establishment: 4) From profiling activities 1 100$ ) From the Quality Assurance Survey125$ 10 6) From a new description received from CRA270$ 76 Total24 973$

20/08/2015 Statistics Canada Statistique Canada 12 Survey Frame Assessment Tool Number of additional establishments and their revenue contribution by type of updates between the June 1 st and July 1 st G-SUF, 2008 Type of updates # of additional establishments Total revenue (000,000) New establishments: 1) From profiling activities349$ ) From assigning a NAICS code11 800$ ) From obtaining a size measure from administrative source $ NAICS Changes to existing establishment: 4) From profiling activities 1 100$ ) From the Quality Assurance Survey125$ 10 6) From a new description received from CRA270$ 76 Total24 973$

20/08/2015 Statistics Canada Statistique Canada 13 Survey Frame Assessment Tool Operating entity NAICS Before NAICS After Revenue Size ChangesUser IDDivisionUpdate Source S Birth – New NAICS stlogaeBRDOn-line - Profiling S Birth - New Establishment Stat flags menamarBRDOn-line - Profiling S NAICS ChangecorejoaIOFDOn-line - Profiling S Birth – Size measure ExternalBRDActivation - CRA S Birth – NAICSlemarocBRDOn –line - NAICS Example of the detailed regarding each update that contributed to the changes in the GSUF from June 1 st and July 1 st G-SUF, 2008

20/08/2015 Statistics Canada Statistique Canada 14 Questions Thank you