1. ICES III - Montréal, Canada Listening to Respondents for Better Results Alexander Hays Distributive Trades Division Statistics Canada

2. ICES III - Montréal, Canada Content The Statistics Act Surveys Inter-provincial Wholesale Commodity Survey Annual Retail Chain Survey Response Rates Beginning the Collaborative Process Action Plan Consultative Results Actions from the Consultation Respondent Reaction Continuing Challenges Conclusion

3. ICES III - Montréal, Canada The Statistics Act Gives Statistics Canada the authority to collect the necessary information directly from respondents, and for business surveys, makes the reporting mandatory. Grants Statistics Canada the authority to collect, compile, analyse, and publish information.

4. ICES III - Montréal, Canada The Statistics Act Considers refusal or the provision of false or misleading information a criminal offence subject to penalties. Statistics Canada has hesitated in the past from taking legal action for non-compliance.

5. ICES III - Montréal, Canada Statistics Canada has favoured a collaborative approach working towards a viable solution satisfactory to both parties.

6. ICES III - Montréal, Canada Inter-provincial Wholesale Commodity Survey Origin and destination by commodity survey. Measures the value of inter-provincial trade by Canadian wholesalers. Better understanding of provincial growth and measures of Gross Domestic Product (GDP) by province. 1990, 1996, 2001. Preset list of 103 commodities.

7. ICES III - Montréal, Canada Annual Retail Chain Survey Operating and financial characteristics of domiciled retail corporate chain stores and department stores. Better understanding of provincial economic growth and measures of GDP by province. Retail Chain – 4 or more retail locations. Location-based survey (individual chain stores) Revenue and major expense items at the store location

8. ICES III - Montréal, Canada DISCONNECT Data Needs versus Data Availability

9. ICES III - Montréal, Canada Inter-provincial Wholesale Commodity Survey Single: one province / territory, one NAICS industry Complex: either one province / territory, multi NAICS or one NAICS, multi province / territory Very Complex: multi province / territory and more than one NAICS industry YearComplexityResponse Rate 2001Single34.7 2001Complex40.0 2001Very Complex36.8

10. ICES III - Montréal, Canada Annual Retail Chain Survey Response rates on revenue and expense variables at the store location level Year Operating Revenue Labour remuneration Operating Expenses Cost of Goods Sold 199957.236.738.1 200046.236.739.539.2 200158.040.045.644.3 200265.748.952.752.1 200355.743.746.747.5

11. ICES III - Montréal, Canada Respondents willingness and ability to answer understand the question understand the concept understand the terminology used appropriateness of the question Question: Were the two surveys too onerous to complete?

12. ICES III - Montréal, Canada Beginning the Process – Inter-provincial Wholesale Commodity Survey The 2001 survey was treated as a supplement to the Annual Wholesale Trade (Financial) Survey. Did the supplement allow respondents the choice between completing 1 of the 2 aspects of the questionnaire under time or ease of data availability constraints? Were the pre-set commodities not relevant to the wholesale operation in question? Was origin and destination information not readily available from company books and records?

13. ICES III - Montréal, Canada Beginning the Process – Annual Retail Chain Survey Studied ways to reduce and simplify the questionnaire to increase response rates. Could model individual store level expenses and attain comparable estimates. The 3 expense variables at the store location level were removed for the 2004 reference year. Some of our clients expressed concerns. Decided to study further: 1.Study: Impact on provincial – territorial gross margins. 2.Go to the respondent to find other opportunities to improvement the questionnaire and to understand reporting concerns. Question: How could we allay client concerns and improve response rates?

14. ICES III - Montréal, Canada Collaborative Approach Action Plan: Work with Questionnaire Design and Resource Centre Mock up sample questionnaires that meet the data requirements of Statistics Canada Test questionnaires on selected respondents

15. ICES III - Montréal, Canada Action Plan Inter-provincial Wholesale Commodity Survey 27 one-on-one interviews. Wholesalers operating in a variety of NAICS classifications. Wholesalers operating from either one of Canada’s 3 largest cities. Annual Retail Chain Survey 23 one-on-one interviews. Retailers operating in a variety of NAICS classifications. Retailers with accounting functions operating out of Toronto or Montreal.

16. ICES III - Montréal, Canada Consultative Results – Inter-provincial Wholesale Commodity Survey Origin of commodity more difficult than destination – wholesalers are sales driven. Origin – billing or shipping address? STC commodity list has no bearing on respondents product lines. Once a reporting mistake is made – tend to be repeated year after year. Reporting guides are not read. One-on-one personalized help is often needed, e.g., Enterprise Portfolio Management Program.

17. ICES III - Montréal, Canada Consultative Results – Annual Retail Chain Survey Due to the large number of store locations, a fully functional spreadsheet or relational database application would make it easier to complete the survey. Respondents were happy that the 3 expense variables were removed. Adding additional variables would require respondents to seek help from inside their organization, e.g., systems

18. ICES III - Montréal, Canada Actions from the Consultation Annual Retail Chain Survey The 3 expense variables not re-added to questionnaire. The electronic version of the questionnaire was made more user-friendly. Inter-provincial Wholesale Commodity Survey Fully integrate the questionnaire into the Annual Wholesale Survey. 3-tier collection strategy based on company size. Mail-out / Mail-back Telephone Assistance On-site collection Eliminate the commodity dimension Conduct a pilot project due to unproven collection strategy.

19. ICES III - Montréal, Canada Respondent Reaction Annual Retail Chain Survey The simple reduction of the 3 expense variables turned-around many non-compliant respondents. Improved Response Rates Inter-provincial Wholesale Commodity Survey Pilot project, although still on- going, is showing a 60% return with some level of origin & destination. So far 59% of most complex companies responding to origin & destination. Telephone assistance in completing the questionnaire is helping to convert non or partial response.

20. ICES III - Montréal, Canada Continuing Challenges Inter-provincial Wholesale Commodity Survey Obtaining information still requires a lot of time and effort. Acknowledgement of need for personalized assistance, but no enterprise has agreed to on-site collection by a Statistics Canada representative. Annual Retail Chain Survey Though response rates improved greatly, and the study on the Impact on Provincial Gross Margins showed little degradation in store level estimates, work continues in understanding the financial differences and the decision making process at the store level. Trade-off between

21. ICES III - Montréal, Canada Conclusion Respondents: Fewer questions = less burden Questionnaires structured to respondent data sources. Better understanding by Statistics Canada on respondents concerns. Statistics Canada Better understanding by the respondent on the need for the data. Better understanding of record keeping and reporting capability. Better response rates. Information collection will always remain a contentious issue. Respondent’s perspective – surveys are time consuming and can be conceptually impractical. Listening to respondents can be a win-win situation.

22. ICES III - Montréal, Canada Listening to Respondents for Better Results Questions