Research Methods in I/O Psychology Chapter 2 Research Methods in I/O Psychology Psychology Applied to Work®

Learning Objectives Understand the empirical research cycle. Know the relative advantages and disadvantages of the laboratory experiment, quasi-experiment, questionnaire, and observation research methods. Understand meta-analysis and data mining. Understand the purpose of organizational neuroscience. Understand the value of qualitative research. Understand the concept of correlation and its interpretation. Understand the limitations of assessing causality. Have an awareness and appreciation of the ethical issues associated with I/O psychological research. Understand the difference between academic-based and practitioner-based research. Psychology Applied to Work®

Overview Generalizability Three goals of science Describe Predict Explain Psychology Applied to Work®

The Empirical Research Process Psychology Applied to Work®

Step 1: Statement of the Problem Theory F. Kerlinger’s definitions Theory, Hypotheses, Concepts, Constructs, Operational definitions. Inductive vs. deductive method Induce a theory, deduct a hypothesis Why theory is important in psychology Psychology Applied to Work®

Step 2: Design of the Research Study Research design Naturalness of the setting Degree of control External vs. internal validity Psychology Applied to Work®

Primary Research Methods Laboratory Experiment Causality Problems of generalizability Quasi-Experiment Less control, more generalizability Psychology Applied to Work®

Primary Research Methods (cont’d) Questionnaire Response rate problem Truthfulness of responses Internet surveys Observation Generate ideas for further testing Rich with data in environment where behavior being studied occurs Psychology Applied to Work®

Secondary Research Methods Meta-analysis Statistical study of studies – aggregates results Estimate of “true” relationship Subjective decisions File drawer effect of non-published studies Problem from differences in level of analysis of original studies Psychology Applied to Work®

Secondary Research Methods Data Mining "Big Data" Used to reveal patterns of large data sets Three research issues distinctive from other I/O research methods Wide range of possible scale values Uses correlation coefficient and other statistical indices Not necessarily used to test theories Psychology Applied to Work®

Organizational Neuroscience Study of organizational attitudes and behavior at the physiological level High cost Psychology Applied to Work®

Qualitative Research Ethnography Etic and emic perspectives Still rarely used in comparison to quantitative research Psychology Applied to Work®

Steps 3 & 4: Measurement & Analysis Measurement of Variables Quantitative vs. categorical Research variables – Independent, dependent, predictor, criterion Psychology Applied to Work®

Steps 3 & 4: Measurement & Analysis (cont’d) The Correlation Coefficient (r) Reflects degree of linear relationship Range from -1.00 to + 1.00 Direction is either positive or negative Magnitude – size is index of strength of the relationship Determining Causality Cannot be inferred from correlation Determining causality through non- experimental methods is highly controversial Psychology Applied to Work®

Step 5: Conclusions from Research Boundary conditions for generalizability Representativeness of subjects Degree of fit between subjects and research task Research method (laboratory vs. field study) The debate about university students as subjects Research as a cumulative process Research as a craft The role of serendipity Psychology Applied to Work®

Ethical Issues in Research APA Code of Ethics – Five rights of participants Informed consent Privacy Confidentiality Protection from deception Debriefing Consequences for violating these rights during and after The complexity of real-life ethical dilemmas Research is not value-free Psychology Applied to Work®

Academic-based and Practitioner-based Research Transfer of knowledge from lab to life (medical model) Scientist-practitioner gap Descriptive vs. prescriptive information Differing goals of research Psychology Applied to Work®