International Conference on Establishment Surveys 1 Everything you wanted to know about Electronic Data Reporting (EDR) at Statistics Canada June 2007

International Conference on Establishment Surveys 2 Outline of Presentation  Introduction  Background  Original approach for EDR Services  What happened?  Consequences  Electronic Collection Framework  Summary/Conclusions

International Conference on Establishment Surveys 3 Introduction  Statistics Canada (STC) began using Electronic Data Reporting 10 years ago by mailing questionnaires on diskettes.  Six years ago a Government On-line initiative was launched; STC awarded funding to develop a comprehensive Internet collection platform.

International Conference on Establishment Surveys 4 Introduction  Project originally focused on developing an EDR solution for 50 business and agriculture surveys, since these respondents complete large numbers of surveys on an ongoing basis.  Since then, the 2006 Census provided a customized electronic data reporting option, and achieved a 20% take-up rate on the household side.  Today, Statistics Canada has a new plan to provide electronic collection service to respondents, based on last 5 years of somewhat painful experience.

International Conference on Establishment Surveys 5 Background  STC administers over 400 surveys across four business lines: social, institutional, agricultural and business.  Computer assisted telephone interviewing (CATI) and personal interviewing (CAPI) are the mode of collection for social surveys; paper as well as CATI are used for agriculture, business and institutional surveys.

International Conference on Establishment Surveys 6 Background  Strict confidentiality and privacy policies require a sophisticated security model for EDR, along with a complex technical infrastructure.  The wide diversity in STC’s surveys (complexity, length, frequency, sample size) added to the challenges for developing EDR applications.

International Conference on Establishment Surveys 7 Original Approach for EDR Services  Introduced EDR to small surveys or sub samples of larger business/agriculture surveys to minimize potential reduction in response rates. Original mode (usually paper) kept as an option for respondents.  Selected sub-annual surveys whenever possible.  Created separate EDR applications and integrated later with other collection streams (e.g. CATI and paper).

International Conference on Establishment Surveys 8 Original Approach  Web-based and Excel-based options developed to handle different requirements for different surveys.  Web-based option used HTML, Java Script.  Both options used PKI-Entrust (which required respondents to download a Java Applet on a JVM).

International Conference on Establishment Surveys 9 Original Approach  Created secure staging area physically separate from the Internet and STC’s internal network for maximum security.  Built authentication and encryption services, along with virus and detection capability.  Implemented a “Thick client” model (edits executed on client-side).

International Conference on Establishment Surveys 10 What Happened?  Unable to assess cost/benefit of EDR as a mode of collection, given small EDR sample sizes.  Response rates varied (0% - 60%).  Technical infrastructure not stable due to high level of complexity.  Respondents had technical difficulties accessing site and completing surveys.

International Conference on Establishment Surveys 11 What Happened?  Costs to develop and support 50 unique applications too high.  EDR with a CATI follow-up (i.e. multiple, independent systems) does not provide significant benefits (time or money).  Surveys adopting EDR need to develop their collection approach from a single instrument point of view.  Overall - minimum success achieved with majority of surveys originally selected for EDR.

International Conference on Establishment Surveys 12 Consequences  Undertook a complete review of Statistics Canada’s approach to EDR services.  Statistics Canada moving towards a simpler, more technically integrated collection environment.  Proceeded to adopt an enterprise wide view of collection with a more generic/integrated approach across modes.  Adopted new standards for surveys wanting to offer an EDR option (e.g. minimum sample of 6,000).  Developed an Electronic Collection Framework outlining short to medium term strategy for EDR.

International Conference on Establishment Surveys 13 Electronic Collection Framework  Stabilize current EDR environment  Gather Business Requirements  Conduct Options Analysis  Conduct Pilots  The Way Forward

International Conference on Establishment Surveys 14 Electronic Collection Framework  Stabilize Current EDR Environment (Completed)  Documented all outstanding issues  Created lessons learned document  Reduced existing suite of EDR surveys to only those with a good business case  Implemented upgrades to environment based on maximum improvement for minimum cost

International Conference on Establishment Surveys 15 Electronic Collection Framework  Gather Business Requirements (Completed)  Conducted an Agency wide analysis of the business requirements for EDR. Involved 40 divisions and all types of surveys  Produced the “STC Electronic Collection Services”, a summary of requirements  Identified the need for 2 core electronic services  e-file transfer service (urgent)  e-questionnaire service

International Conference on Establishment Surveys 16 Electronic Collection Framework  e-file transfer service  a secure service to collect (& share) survey related administrative files  bi-directional: serves STC and its partners  based on the “Managed File Transfer” Technology  e-questionnaire service  a self-administered questionnaire service  Enables respondents to securely fill and submit surveys online (internet)

International Conference on Establishment Surveys 17 Electronic Collection Framework  Conduct Options Analysis (Completed)  Assessed buy (using COTS) vs build software for new infrastructure  Identified potential COTS products aligned with each of the 2 core services  Undertook detailed analysis of key products

International Conference on Establishment Surveys 18 Electronic Collection Framework  Conduct Pilots (in progress)  Obtained free access to 2 COTS products  Record STC hands-on experience  Gather end-user feedback  e-file transfer pilot (complete)  9 Divisions, 5 External Partners  Very positive feedback  e-questionnaire pilot (underway)  2 social surveys participating in pilot as well as business survey

International Conference on Establishment Surveys 19 Electronic Collection Framework  Way Forward  Obtain corporate approval for Electronic Collection Framework Strategy/Business Case  Complete e-questionnaire Pilot  Undertake competitive processes for both e-file transfer and e-form COTS software  Launch Agency wide e-file transfer service spring 2008  Offer limited e-questionnaire service summer 2008

International Conference on Establishment Surveys 20 Summary/Conclusions  Difficult start up for EDR at Statistics Canada  New approach of integration and simplification of collection processes helping to redefine the role of EDR in future  Consultation exercise established priorities for e- services.  Re-engineering of current infrastructure under way (subject to funding approval)  Increasing interest by Social Surveys  Future looks promising