Research Methods in MIS: Instrument Design Dr. Deepak Khazanchi
Instrument Design Process Phase 1: Developing the instrument design strategy Phase 2: Constructing and refining the measurement questions Phase 3: Drafting and refining the instrument
Developing the Instrument Design Strategy Management-Research Question Hierarchy: The management problem/question Research question(s) Investigative questions Measurement questions
Strategic Concerns of Instrument Design What type of data is needed to answer the management question? What communication approach will be used? Should the questions be structured, unstructured, or some combination? Should the questions be disguised or undisguised?
Ways to Interact with the Respondent Personal interview Telephone Mail Computer
Types of Measurement Questions? Target Classification Administrative
Appropriate Question Content Should this question be asked? Is the question of proper scope and coverage? Can the respondent adequately answer this question, as asked? Will the respondent willingly answer this question, as asked?
How to Test a Respondent’s Appropriateness Filter questions Screen questions
Question Wording Criteria Is the question stated in terms of a shared vocabulary? Does the question contain vocabulary with a single meaning? Does the question contain unsupported assumptions? Is the question correctly personalized? Are adequate alternatives presented within the question?
What Dictates Your Response Strategy? Characteristics of respondents Nature of the topic(s) being studied Type of data needed Your analysis plan
Types of Response Questions Free-response Dichotomous Multiple-choice Checklist Rating Ranking
Guidelines to Refining the Instrument Awaken the respondent's interest Use buffer questions as a guide to request sensitive information Use the funnel approach to move to more specific questions
Improving Survey Results Pretesting is an established practice for discovering errors and useful for training the research team
Self-Administered Surveys Types Mail survey Computer-delivered Intercept studies Disadvantages Large nonresponse error Cannot obtain detailed or large amounts of information
Concurrent Techniques to Improve Mail Response Anonymity Size, Color, and Reproduction Money Incentives Deadline Dates Cover Letters Reduce Length Survey Sponsorship Return Envelopes Postage Personalization
Outsourcing Survey Services Research Firms Provide Centralized-location interviewing Focus group facilities Trained staff with experience Data-processing and statistical analysis capabilities Access to point-of-sale data Panels