1. IS research strategies Richard T. Watson rwatson@terry.uga.edu copyright © 2005

2. The fundamental problem All research strategies and methods are flawed A method’s strengths are also the source of its weaknesses Researchers must decide which method best fits their goals

3. Classes of strategies Experimental simulations Field experiments Field studies Computer simulations Formal theory Surveys Judgment tasks Laboratory experiments Obtrusive research operations Unobtrusive research operations Universal behavioral systems Particular behavioral systems A BC

4. A three-horned dilemma It is always desirable to maximize: –Actors Generalizability with respect to populations –Behavior Precision in control and measurement of variables –Context Existential realism, for the participants, of the context within which those behaviors are observed There is no way to maximize all three goals The researcher must choose among the lesser of three evils

5. Quadrant I strategies Existentially real for the participants Field studies –Settle on C –Lack precision and generalizability Field experiments –Increasing precision

6. Quadrant II strategies Deliberately contrived settings Laboratory experiments –Settle on B –Lack contextual realism and generalizability Experimental simulations –Increasing realism

7. Quadrant III strategies Context should not play a part in the behavior of concern Sample surveys –Settle on A –Lack contextual realism and precision Judgment –A few population units construed as ‘judges’ rather than ‘respondents’

8. Quadrant IV strategies Not empirical No actors, no behaviors, and no context Formal theory –Settle on A –Lack contextual realism and precision Computer simulations –Increasing realism –Model a particular concrete system

9. The construct validity dilemma Goal is to test the relationship between concept A and concept B Other factors affecting concept B Concept AConcept B Operational definition a Operational definition b Other factors affecting operational definition of b

10. The relationships A-B is conceptual and cannot be tested empirically A-a and B-b are definitional and can only be tested indirectly a-b is an empirical relation used to assess the validity of the three other relations

11. Faulty logic Since strategy X, the one I am opposing is bad and has many flaws, then strategy Y, the one I am proposing must be good. It is a waste of time arguing which is the right strategy Argue about how to combine multiple strategies in multiple studies of a given problem Studying a problem by multiple methods means that you do not focus on one strength or weakness