European Conference on Quality in Official Statistics Session 26: Census 2011 « Helsinki, 6 May 2010 « Census quality control with BSC: the Portuguese experience « 1 Carlos Dias - Statistics Portugal Álvaro Rosa and Paula Vicente – ISCTE

2 « Census quality control with BSC: the Portuguese experience « Summary  Pilot Survey;  Strategic mapping of 2011 Census operations;  Human resources process;  Delivery and collection processes;  Conclusions. «

3 « « 1. Pilot Survey The final stage of preparation of the 2011 Census. In this test, respondents had two response modes available: « Census quality control with BSC: the Portuguese experience Paper questionnaire Online form (e-Census)

4 « « 1. Pilot Survey « Census quality control with BSC: the Portuguese experience

5 « « 2. Strategic mapping of 2011 Census operation To produce high quality data from the Census, the integrated process of data collection and processing must undergo a stringent system of quality management. To achieve the designated objective Statistics Portugal will adopt the Balanced Scorecard (BSC) as its quality management framework. « Census quality control with BSC: the Portuguese experience

6 « « 2. Strategic mapping of 2011 Census operations Mission The mission of Statistics Portugal is to produce and disseminate, in an effective, efficient and independent manner, high-quality official statistical information relevant to the whole society. The 2011 Census shall be carried out under high quality standards and accountability. Vision The Vision is the guideline for the development of an organization, establishing the goals to be achieved: "The 2011 Census will be acknowledged at an internal and external level as an official statistical information of great quality." « Census quality control with BSC: the Portuguese experience

7 « « 2. Strategic mapping of 2011 Census operations Values of 2011 Census operations The 2011 Census operations staff, in accordance with the European Statistics Code of Practice, is subject to the following Values: Professionalism, ethics and observance of confidentiality; Respect for primary data providers; Technical independence, objectivity and impartiality. « Census quality control with BSC: the Portuguese experience

8 « « 2. Strategic mapping of 2011 Census operations Strategic framework The 2011 Census programme and products will be guided by the following strategic vectors: Increasing confidence in the final results; Improving the final product quality by minimizing errors; Facilitating the response by maximizing the overall response rate; Increasing resource efficiency: increase the quickly availability of information and cost savings. « Census quality control with BSC: the Portuguese experience

9 « « 2. Strategic mapping of 2011 Census operations For the Pilot Survey operation we have identified two key processes that are associated with: Human resources; Delivery and collection. « Census quality control with BSC: the Portuguese experience

10 « « 3. Human resources process The completion of a census requires the mobilization of a large number of human resources. In the last Census (2001), 26,500 people have been involved and submitted to training sessions (including effective enumerators and substitutes). The quality and effectiveness of census operations are strongly determined by the capabilities of fieldwork staff and the training provided. The key factors for assessment and intervention in the processes associated with human resources are the recruitment, selection and training. « Census quality control with BSC: the Portuguese experience

11 « « 3. Human resources process In the processes associated with human resources we have established the following strategic goals: 1 – To enhance the process of recruiting and selecting staff to ensure the recruitment of candidates with the required profile; 2 – To minimize the turnover rate (withdrawal) of the census; 3 – To increase / improve training; 4 – To increase the satisfaction of human resources involved; 5 – To identify the critical points of the process. « Census quality control with BSC: the Portuguese experience

12 « « 3. Human resources process « Census quality control with BSC: the Portuguese experience

13 « « 3. Human resources process Matrix Initiatives/Strategic goals « Census quality control with BSC: the Portuguese experience

14 « « 3. Human resources process F - Quality Assurance Questionnaire for fieldwork staff When completing the Pilot Survey, a questionnaire of quality control will be administered to all fieldwork staff including Municipal Delegates, Civil parish Coordinator and the enumerators. The questionnaire is intended to evaluate the logistics and the procedural aspects of the Pilot Survey operation and will evaluate the level of fieldwork staff motivation and their perception of operational and organizational problems. « Census quality control with BSC: the Portuguese experience

15 « « 4. Delivery and collection processes The distribution and collection of questionnaires in a properly and thoroughly manner, are key tasks of the enumerator. These activities are of great importance to ensure the quality of a census. The focus on the fieldwork supervision is to monitor and assess the proper implementation of procedures carried out by the enumerators. In order to closely monitor the fieldwork, two mechanisms were developed: Individual fieldwork Control procedure and the Alert Indicator System. « Census quality control with BSC: the Portuguese experience

16 « « 4. Delivery and collection processes In the processes associated with delivery and collection we establish the following strategic goals: 1 – To meet the deadlines for delivery of support material for enumerators; 2 – To meet the deadlines for delivery and collection of questionnaires to the population; 3 – To minimize the error rate in completing the questionnaires; 4 – To implement procedures for fieldwork control; 5 – To detect and correct in real time the possible deviations, 6 – To identify the critical points of the process. « Census quality control with BSC: the Portuguese experience

17 « « 4. Delivery and collection processes « Census quality control with BSC: the Portuguese experience

18 « « 4. Delivery and collection processes « Census quality control with BSC: the Portuguese experience Matrix Initiatives/Strategic goals

19 « « 4. Delivery and collection processes D – Alert Indicators System (SIA); SIA will enable the monitoring of the quality of information during the collection process and will allow correcting deficiencies prior to completion. It is intended to monitor the results of the statistical units of dwelling and persons by comparing to expected values. When deviations are identified according to established parameters, it is triggered an additional checking procedure of the fieldwork. « Census quality control with BSC: the Portuguese experience

20 « « 5. Conclusions Monitoring and evaluating the quality of the census involves complex challenges that need adjusted solutions. The success of its use in the Pilot Survey of Census 2011 encourages its adoption in the final Census operation. For the Pilot Survey, we have identified two key processes to monitor: human resources; delivery and collection. For each of these processes, the objectives, indicators, targets and tolerances, and actions /initiatives are established. « Census quality control with BSC: the Portuguese experience

21 « « 5. Conclusions In this presentation, we intend to share with other experts in quality management in this forum, the control and monitoring procedures that Statistics Portugal is preparing to adopt for Census This is to ensure the implementation of a monitoring and quality assessment process which can detect and correct in real- time any rising deficiency during the various stages of the operation and to ensure that the final results are doubtless as to its quality. « Census quality control with BSC: the Portuguese experience

22 « « Thank you for your attention ; « Census quality control with BSC: the Portuguese experience