13 June 2005CES, June 2005, Geneva1 The Annual Dutch Business Inquiry Developing and Testing the electronic form Ger Snijkers Evrim Onat Jo Tonglet Statistics Netherlands Division of Business Statistics

13 June 2005CES, June 2005, Geneva2 Developing the electronic form In three steps: 1.Small scale usability test (31-1-’05) -Small development team -Prototype of the e-form 2.Improving the e-form (1-10-’05) -additional usability tests 3.Implementation (15-2-’06)

13 June 2005CES, June 2005, Geneva3 1.Tested e-form 1Tested form 2Test waves 3Research issues 4Conclusions

13 June 2005CES, June 2005, Geneva4 2.Test waves Test 1Test 2Test 3 PeriodAug. 2004Oct. 2004Nov./Dec FormBlaise ISBlaise - EDR Blaise - CBSquest On/off-lineOn-lineOff-line ModeBrowserCD-romDownloadable via internet Number of interviews 15 CBS employees 37 businesses 6 businesses Tested byCBS employees, external designer 6 business interviewers 2 cogn. lab interviewer + 2 business interviewer ResultsMost bugs identified Experiences from interviewers Most results; Inexperienced respondents 1Tested form 2Test waves 3Research issues 4Conclusions

13 June 2005CES, June 2005, Geneva5 3.Research issues 1.How does the e-form work in practice? -Completing the questionnaire -Question-and-answer process 2.What features should be included to make it easy to use? -‘Computer-assisted’ tools to make it respondent friendly -User wishes 3.How should the e-form be designed in relation to the paper form? -The same or a different design -‘look-and-feel’ of paper and e-form 1Tested form 2Test waves 3Research issues 4Conclusions

13 June 2005CES, June 2005, Geneva6 3.Research issues 1.How does the questionnaire work? Laborious and complex process -Long, complex questionnaire (≥ 25 items) -Complex completion process:  several sessions, several informants  kick-and-rush behaviour -Imagine... a respondent sitting behind his/her computer... 1Tested form 2Test waves 3Research issues 4Conclusions  Respondent got lost in the questionnaire

13 June 2005CES, June 2005, Geneva7 3.Research issues 2.Features to make it easy to use? What am I supposed to do (next)? -Easy to download and install -Clear instructions and explanations -Easy to send data back How is the questionnaire built up? -Show how the questionnaire is structured -Help to find the way in the questionnaire -No hidden rules, no unexpected functionalities Where am I? What did I do so far? -Provide overview of the completion process -Clear navigation, no scrolling -Printing function Where can I put these data? -Entry-search (google) 1Tested form 2Test waves 3Research issues 4Conclusions

13 June 2005CES, June 2005, Geneva8 3.Research issues 3.Design of paper and e-form? The computer is different than paper -The e-form reacts to the respondent -Reading from the screen is different -Navigating and getting an overview works differently -Kick-and-rush behaviour, even stronger than on paper 1Tested form 2Test waves 3Research issues 4Conclusions  In order to get good data in time …

13 June 2005CES, June 2005, Geneva9 4.Conclusions Visual design  Clear and logical  Simple, transparent, consistent  No hidden and unexpected functionalities Support the completion process  other mode, other features, other visual design  Different than paper form, same ‘look-and-feel’ Tailor to kick-and-rush behaviour  Small sections, small tasks  Short and clear explanations 1Tested form 2Test waves 3Research issues 4Conclusions

13 June 2005CES, June 2005, Geneva10

13 June 2005CES, June 2005, Geneva11 Web questionnaire design is communication design

13 June 2005CES, June 2005, Geneva12

13 June 2005CES, June 2005, Geneva13

13 June 2005CES, June 2005, Geneva14