1. Component D: Activity D.3: Surveys Department EU Twinning Project

2. "Evaluation of Business Trends Survey” Development of an Online Response Method for Business Surveys Dganit Stein Surveys Department EU Twinning Project

3. What is in the Presentation?  General background of the survey  The process of developing an online questionnaire, version 1  Work procedure  Improvement in the online response method, version 2  Findings about online response Surveys Department EU Twinning Project

4. Introduction 1  Background of the survey o It has been conducted since December 2010 o It began with Israel's acceptance to the OECD. o About 1,200 units are surveyed monthly on an ongoing basis o The company's CEO is approached about the survey o The questionnaire is qualitive and not quantitative Surveys Department EU Twinning Project

5. Introduction 2  The survey is conducted in the following questionnaires: o Manufacturing o Construction o Retail trade o Hotels o Services  Data collection methods: o Mail o Fax o Telephone o Internet (a new method, which was improved in 2013) Surveys Department EU Twinning Project

6. Introduction 3  Sections of the questionnaire: o Corrent financial situation o Change in the financial situation in the past three months o Expectation of the financial situation for the next three months o Expectations for changes in the US Dollar currency and CPI o Limitations of the company’s operations today o Details of the responder Surveys Department EU Twinning Project

7.  A secure site that requires a username and password to enter and fill out the questionnaire was established.  To answer online the user needs to download software to his computer.  Defining employees in the CBS for professional and technical assistance (especially when downloading software). Surveys Department EU Twinning Project

8. Surveys Department EU Twinning Project

9. Surveys Department EU Twinning Project

10. Surveys Department EU Twinning Project

11. Surveys Department EU Twinning Project

12. Surveys Department EU Twinning Project

13. Surveys Department EU Twinning Project

14. Surveys Department EU Twinning Project

15. Surveys Department EU Twinning Project

16. Surveys Department EU Twinning Project

17. Work Procedure 1  A letter of introduction explaining the online response system, including a user name and password was prepared.  The letters were sent to the sampled businesses and the website was uploaded.  The responder would enter the online questionnaire by accessing the website and entering his user name and password.  Until the 15th of the month it was possible to respond online without contact initiated by the interviewer.  Collecting corrent email addresses from the responders. Surveys Department EU Twinning Project

18. Work Procedure 2 o The interviewer calls and checks whether the letter was received. He should ask if they want to answer online? o Depending on the responder's answer, a new date was scheduled for contact or conducting the survey by telephone.  Comment: Training was held for the interviewers and the guidelines were taught. Surveys Department EU Twinning Project

19. Reminder by Email  The approval of Information Security was received. (The approval included attaching the questionnaire in a PDF format but without the user name and password)  Preparation of the text that will be in the reminder.  Preparing questionnaire files (PDF). This included adding the relevant months into the questionnaire and relevant questionnaires to the responders.  Defining conditions for sending a reminder.  Setting dates for sending a reminder. Surveys Department EU Twinning Project

20. First Month in the Field  The percentage of response was lower than expected.  Most of the responders were not aware of the new response system.  The use of the reminder actually increased the fax response rate (because the questionnaires were attached).  According to the Information Security guidelines, the username and password were to be delivered only by mail. Sending questionnaires again to the correct address took a lot of the coordinator's time and did not enable an immediate online response, only after receiving the questionnaire by mail. Surveys Department EU Twinning Project

21. Conclusions  The date the responder answered the previous month should be taken into account in sending the reminder.  Using the user name and password was not convenient and the responders did not want to use them.  This led to the need to improve the online response method and eliminate the user name and password. Surveys Department EU Twinning Project

22. o The use of the new link “Click A Link” began on March 3, 2013. o We began to use CATI around the 10 th of each month (after providing time to fully utilize the online response) o The interviewers can use the computer system to filter out the companies who responded online in the previous month, and thereby follow up on the online response in the current month. o We updated the introduction letters (deleting the website address, user name and password). o The price: A company without an email address cannot respond online! Surveys Department EU Twinning Project

23. Reminders – Structure  The method is based on sending reminders via email.  A first text reminder was prepared – sent the first time the company receives a reminder. It includes a link to latest Press Release of the survey. (Used as of April 2013).  A second stage text was prepared (reminder) – for the second time and followed.  At first, the reminder still included the questionnaire in PDF format. Later we remove the PDF version. This was to prevent response via fax or the mistaken thinking that the file was the online questionnaire. Surveys Department EU Twinning Project

24. Reminders – Frequency  Reminders are sent manually once a week, in a comprehensive fashion, taking into account the date the responder answered the previous month.  A control system for sending reminders was built.  Documentation when the reminders were sent out per responder was established.  The minute a reminder is sent the company is put in the "under treatment“ status. Surveys Department EU Twinning Project

25. "Online Response" Field  We added an "online response" field: o The responder answers to the question: "Are you interested in responding online next month?" – "Yes" or "No". o The field can be updated within the questionnaire in accordance with the responders answer. o The information is kept for the durations of months. o The reminders are sent only to those who indicate "yes" or who left the "online response" field blank. o If the responder answered "yes" – he is required to fill in the field for "email address". o If he answered "no" – he must fill in the reason for not responding online (described in the next slide). Surveys Department EU Twinning Project

26. Reasons for Not answering via web o I'm not interested in trying. I want to continue to answer by fax or telephone. o I want to continue to get the Excel file by email. o I have no email address. o Problems with installation/operation. o I cannot install due to information security issues. o I'm not interested in reminders. o I prefer direct contact with the interviewer. o I will try next month. o Other  The answer to this question does not disappear each month; it is saved for a long time. Surveys Department EU Twinning Project

27. Refresher Course of Guidelines for Interviewers  A refresher course of guidelines about online response was conducted for interviewers: o This refresher course enabled interviewers to understand the improved response method and the manner of online response, because the guidelines that were taught in the first training session were no longer relevant. o A number of ways to persuade responders to respond online were taught:  Use of a direct link.  Immediate response to malfunctions.  Helpful for a green environment.  High level of Information security Surveys Department EU Twinning Project

28. Responsibilities of the Staff Coordinator Supervising an Online Response Survey  Sending reminders on schedule (selecting the text, choosing the date, updated Press Release).  Issuing a list of incorrect email address list and making corrections.  Preparing a list of companies interested in technical support for the next month.  Opening the month online, in coordination with the development team.  Online response supervision. Surveys Department EU Twinning Project

29. Findings on Online Response Surveys Department EU Twinning Project

30. Surveys Department EU Twinning Project

31. Surveys Department EU Twinning Project

32. Surveys Department EU Twinning Project

33. Surveys Department EU Twinning Project

34. Surveys Department EU Twinning Project

35. Thanks for listening! Questions Surveys Department EU Twinning Project

36. Surveys Department EU Twinning Project

37. Surveys Department EU Twinning Project