Presentation is loading. Please wait.

Presentation is loading. Please wait.

The implementation of tools to support the data quality of the survey frame Mario Ménard November 2008.

Similar presentations


Presentation on theme: "The implementation of tools to support the data quality of the survey frame Mario Ménard November 2008."— Presentation transcript:

1 The implementation of tools to support the data quality of the survey frame Mario Ménard November 2008

2 20/08/2015 Statistics Canada Statistique Canada 2 Outline  Data sources to populate and maintain the survey frame  Quality Assurance Survey  Interceptor Module  Survey Frame Assessment Tool

3 20/08/2015 Statistics Canada Statistique Canada 3 Data Sources used to maintain the frame Central Survey Frame Business Register Canadian Revenue Agency (CRA) NAICS Coding Survey Feedback Profilers and Frame Analysts 99% of businesses have only one operating entity Legal name, business address, main activity description, geographical location, size measures etc. 400 000 new businesses each year 45 % are coded automatically based on the description provided at the time of registration 55 % requires manual intervention Identification of inactive businesses # of misclassified businesses Data collection centers transmit survey feedback to the Register Interception of legal name, business status and NAICS changes Review the validity of the survey feedback Review the updates performed on business structures and its characteristics Updates business structure and its characteristics

4 20/08/2015 Statistics Canada Statistique Canada 4 Quality Assurance Survey  QAS measures the number of inactive businesses and the quality of NAICS coding for units on the BR  Monthly sample of 600 businesses Allows small constant surveys conducted by a few individuals Reduces QAS interviewer re-training and ensures survey consistency from month to month Provides timely, relevant measurements Gives an indication of the inactive units and coding quality over time  Units eligible for selection exclude very large and complex businesses and recently surveyed units

5 20/08/2015 Statistics Canada Statistique Canada 5 Quality Assurance Survey Results from June 2007 - July 2008 Sectors % Death Rate % NAICS 2 Digit Error Rate % Error Rate by Revenue % Volatility Rate All sectors18.513.2 1.3 2.5 11 Agriculture, Forestry, Fishing & Hunting14.88.2 0.5 5.2 21 Mining, Oil and Gas Extraction1923 3.0 6.5 22 Utilities14.57.6 0.0 - 23 Construction17.47.3 0.9 0.1 31-33 Manufacturing1620.2 0.3 2.2 41 Wholesale Trade21.824.2 0.3 5.7 44-45 Retail Trade16.48.3 0.1 2.1 48-49 Transportation & Warehousing21.612.8 4.7 5 51 Information & Cultural Industries22.713. 6 1.5 3.1 52 Finances & Insurance19.222.7 2.8 2.2 53 Real Estate, Rental & Leasing24.916.6 1.9 2.2 54 Professional, Scientific and Technical Services18.410.5 1.0 0.1 55 Management of Companies and Enterprises2333.5 8.5 3.8 56 Administrative & Support17.329.7 8.9 5.5 61 Educational Services1616.9 1.4 1.6 62 Health Care & Social Assistance16.13.5 6.2 - 71 Arts, Entertainment & Recreation20.212 14.2 2.6 72 Accommodation & Food Services17.93.5 0.0 0.1 81 Other Services except Public Administration18.89.9 4.8 1.7

6 20/08/2015 Statistics Canada Statistique Canada 6 Quality Assurance Survey Results from June 2007 - July 2008 Sectors % Death Rate % NAICS 2 Digit Error Rate % Error Rate by Revenue % Volatility Rate All sectors18.513.2 1.3 2.5 11 Agriculture, Forestry, Fishing & Hunting14.88.2 0.5 5.2 21 Mining, Oil and Gas Extraction1923 3.0 6.5 22 Utilities14.57.6 0.0 - 23 Construction17.47.3 0.9 0.1 31-33 Manufacturing1620.2 0.3 2.2 41 Wholesale Trade21.824.2 0.3 5.7 44-45 Retail Trade16.48.3 0.1 2.1 48-49 Transportation & Warehousing21.612.8 4.7 5 51 Information & Cultural Industries22.713. 6 1.5 3.1 52 Finances & Insurance19.222.7 2.8 2.2 53 Real Estate, Rental & Leasing24.916.6 1.9 2.2 54 Professional, Scientific and Technical Services18.410.5 1.0 0.1 55 Management of Companies and Enterprises2333.5 8.5 3.8 56 Administrative & Support17.329.7 8.9 5.5 61 Educational Services1616.9 1.4 1.6 62 Health Care & Social Assistance16.13.5 6.2 - 71 Arts, Entertainment & Recreation20.212 14.2 2.6 72 Accommodation & Food Services17.93.5 0.0 0.1 81 Other Services except Public Administration18.89.9 4.8 1.7 Sectors % Death Rate % NAICS 2 Digit Error Rate % Error Rate by Revenue % Volatility Rate All sectors18.513.2 1.3 2.5

7 20/08/2015 Statistics Canada Statistique Canada 7 Interceptor Module  Intercepts requests for updates received from the data collection centres  The following events are intercepted: Classification changes Legal name changes Business Status changes  Survey program managers have the choice to decide if they want to use this module  After 35 days in the interceptor module, requests for updates are processed automatically to avoid the accumulation of events

8 20/08/2015 Statistics Canada Statistique Canada 8 Number and status of update requests received in the Interceptor Module From January 2008 to September 2008 # of update requests # of update requests cancelled % of update requests cancelled # of update requests accepted % of accepted requests Total # of update requests 13 5004 90036 %8 60064 % Services Surveys7 7971 94125 %5 85675 % Distributive Trade Surveys 1 57189957 % 672 43 % Manufacturing Surveys 1 53391960 %61440 % Others2 5991 14144 %1 45856 %

9 20/08/2015 Statistics Canada Statistique Canada 9 Survey Frame Assessment Tool  Indicates changes on the survey frame from one period to the other  Easily accesses the details of the changes  Analysis performed just before the release of the monthly Generic Survey Universe File  Identifies the largest contributors to the change from one period to the another  Measures the quality of work being performed by the people making updates to the frame  Provides constructive feedback and a good indication of additional training that may be required

10 20/08/2015 Statistics Canada Statistique Canada 10 Survey Frame Assessment Tool Number of additional establishments and their revenue contribution by type of updates between the June 1 st and July 1 st G-SUF, 2008 Type of updates # of additional establishments Total revenue (000,000) New establishments: 1) From profiling activities349$ 9 400 2) From assigning a NAICS code11 800$ 5 699 3) From obtaining a size measure from administrative source 11 329$ 6 480 NAICS Changes to existing establishment: 4) From profiling activities 1 100$ 5 600 5) From the Quality Assurance Survey125$ 10 6) From a new description received from CRA270$ 76 Total24 973$ 27 265

11 20/08/2015 Statistics Canada Statistique Canada 11 Survey Frame Assessment Tool Number of additional establishments and their revenue contribution by type of updates between the June 1 st and July 1 st G-SUF, 2008 Type of updates # of additional establishments Total revenue (000,000) New establishments: 1) From profiling activities349$ 9 400 2) From assigning a NAICS code11 800$ 5 699 3) From obtaining a size measure from administrative source 11 329$ 6 480 NAICS Changes to existing establishment: 4) From profiling activities 1 100$ 5 600 5) From the Quality Assurance Survey125$ 10 6) From a new description received from CRA270$ 76 Total24 973$ 27 265

12 20/08/2015 Statistics Canada Statistique Canada 12 Survey Frame Assessment Tool Number of additional establishments and their revenue contribution by type of updates between the June 1 st and July 1 st G-SUF, 2008 Type of updates # of additional establishments Total revenue (000,000) New establishments: 1) From profiling activities349$ 9 400 2) From assigning a NAICS code11 800$ 5 699 3) From obtaining a size measure from administrative source 11 329$ 6 480 NAICS Changes to existing establishment: 4) From profiling activities 1 100$ 5 600 5) From the Quality Assurance Survey125$ 10 6) From a new description received from CRA270$ 76 Total24 973$ 27 265

13 20/08/2015 Statistics Canada Statistique Canada 13 Survey Frame Assessment Tool Operating entity NAICS Before NAICS After Revenue Size ChangesUser IDDivisionUpdate Source S769211574441901 679 790 761Birth – New NAICS stlogaeBRDOn-line - Profiling S77093355413190 1 512 330 738Birth - New Establishment Stat flags menamarBRDOn-line - Profiling S756283864121104191201 277 462 141NAICS ChangecorejoaIOFDOn-line - Profiling S77021577336310 689 831 265Birth – Size measure ExternalBRDActivation - CRA S66586043336310545 678 900Birth – NAICSlemarocBRDOn –line - NAICS Example of the detailed regarding each update that contributed to the changes in the GSUF from June 1 st and July 1 st G-SUF, 2008

14 20/08/2015 Statistics Canada Statistique Canada 14 Questions Thank you


Download ppt "The implementation of tools to support the data quality of the survey frame Mario Ménard November 2008."

Similar presentations


Ads by Google