1. Using SurveyMonkey: Advantages and Problems Jill Rosenbaum B.A.Jill Rosenbaum B.A.

2. Our Research Describe how competing commitments, adhering to protocol and providing good clinical care, are managed in clinical trials (CTs)Describe how competing commitments, adhering to protocol and providing good clinical care, are managed in clinical trials (CTs) Describe how this competition arises in different methodological domains (e.g., recruitment, randomization), study designs and medical situations.Describe how this competition arises in different methodological domains (e.g., recruitment, randomization), study designs and medical situations. Ascertain the frequency of perceived conflicts.Ascertain the frequency of perceived conflicts. Determine the correlates of violations of the rules of the CT.Determine the correlates of violations of the rules of the CT.

3. First Steps What questions should we ask? What questions should we ask? Interview Physicians and Nurses about competition between trial design and good care of subjects Pilot interview questions with both nurses and physicians Develop list of survey subjects from Centerwatch.com Develop list of survey subjects from Centerwatch.com

4. The Dillman Method 5 Necessary Elements For Achieving High Response Rate 1)A respondent-friendly survey 2) Inclusion of stamped return envelopes. 3) Five varied contacts with survey recipients 4) Personalized correspondence. 5) Include token financial incentive in the same mailing as the survey.

5. A Respondent-friendly Survey Trial and Error Trial and Error Piloting survey on physicians and nurses Piloting survey on physicians and nurses Rewording questions for coherence Rewording questions for coherence Revamping survey Revamping survey Eliminating complex questions Eliminating complex questions We achieved this through:

6. Inclusion of returned stamped envelopes Because ours was an internet survey, we eliminated this step. Because ours was an internet survey, we eliminated this step.

7. 5 Varied contacts with survey recipients 1 st contact - letter requesting participation in an online survey 1 st contact - letter requesting participation in an online survey 2 nd contact - email with link to the survey 2 nd contact - email with link to the survey 3 rd contact - thank you letter / reminder 3 rd contact - thank you letter / reminder 5 th contact - telephone call 5 th contact - telephone call 6 th contact - with link to the survey (not traceable) 6 th contact - with link to the survey (not traceable) 4 th contact - resend email with link to the survey 4 th contact - resend email with link to the survey

8. Personalized Correspondence Each letter was hand signed. Each letter was hand signed. Each letter was personalized with recipient’s name and address. Each letter was personalized with recipient’s name and address. Personal notes on some letters. Personal notes on some letters. Personal phone calls were made to track down non-respondents. Personal phone calls were made to track down non-respondents. Each envelope was stamped. Each envelope was stamped.

9. Token Financial Incentive We included a $10 Starbucks gift card with the original mailing. We included a $10 Starbucks gift card with the original mailing. The gift card was offered as an incentive for completing the survey, not as a reward for completion of it. The gift card was offered as an incentive for completing the survey, not as a reward for completion of it.

10. What is SurveyMonkey? An on-line survey systemAn on-line survey system Automates much of the process of designing and implementing surveysAutomates much of the process of designing and implementing surveys Basic analysisBasic analysis Reasonable priceReasonable price

11. Designing Surveys Can be done on-lineCan be done on-line Can adjust appearanceCan adjust appearance Examples:Examples:

15. There are 17 different question formats that you can use.There are 17 different question formats that you can use. Many different Question Types

16. Single Answer Vertical

17. Multiple Answer

18. Matrices

19. Open-ended

20. Features of Questions On-line refusalOn-line refusal Conditional Logic - Questions asked depending on other answersConditional Logic - Questions asked depending on other answers Require answers to essential questionsRequire answers to essential questions Add your own logo to the SurveyAdd your own logo to the Survey Send respondents to specific follow-up page when completeSend respondents to specific follow-up page when complete

21. Data Collection Automatic invitation to uploaded list of emailsAutomatic invitation to uploaded list of emails Automated remindersAutomated reminders Automatic Data Collection - No data entry!Automatic Data Collection - No data entry!

22. Analysis Output to Excel formatOutput to Excel format Prepared output of frequenciesPrepared output of frequencies Specify simple bivariate analysesSpecify simple bivariate analyses

23. Our Results Overall, we achieved a 75.4% response rate to our survey. Response rate for M.D.s - 57% Response rate for study coordinators, nurses, etc. 80.5%