What’s Wrong with that Survey? Writing Good Survey Questions

“Don’t you think that Chocolate is better than Vanilla?” A.) It’s just fine. B.) Do you prefer Chocolate or Vanilla? C.) Given that most people like Chocolate, do you think that Chocolate or Vanilla is better?

“Do you prefer the cold, rainy days of Winter, or the warm and pleasant days of Spring?” A.) It’s just fine. B.) Would you prefer to stay at home in the Winter or to enjoy being outside in Spring? C.) Do you prefer Winter or Spring?

Do you think that Fenger students should take AP Statistics? A.) It’s just fine. B.) Do you think that Fenger students should take AP Statistics, a course that requires a lot of time? C.) Would you take AP Statistics even if your friends were not enrolled in the course?

Change the Question Do you agree that a national system of health insurance should be favored because it would provide health insurance for everyone and would reduce administrative costs? A.) Would create response bias B.) Would not create response bias

Change the Question? How many movies have you watched in a movie theater within the last 12 months? A.) Would create response bias B.) Would not create response bias