SOCI 2003B: Sociological Methods Colleen Anne Dell, Ph.D. Carleton University, Department of Sociology & Anthropology Canadian Centre on Substance Abuse November 16, 2006 Interviewing and Evaluation Research MODES OF OBSERVATION

OVERVIEW 1. Evaluation Research a. Key Aspects of Evaluation Research i. Possible topics ii. Designing evaluative research b. Experimental Designs i. Classic experiment ii. Quasi-experiment c. Limitations of evaluation research 2. Interviews a. Definition b. Advantages of interviews c. Constructing interview questions d. Interviewing techniques e. Essential components of interviewing

WORKSHOP Interviewing

1. EVALUATION RESEARCH The systematic application of social science research procedures for assessing the conceptualization, design, implementation, and utility of social intervention programs (Babbie and Benaquisto). Evaluation research focuses on the research PURPOSE rather than the METHOD.

A.KEY ASPECTS OF EVALUATION RESEARCH

i) Possible Topics Social intervention: An action taken within a social context for the purpose of producing some intended result.

ii) Designing Evaluation Research a. Can the program be evaluated? b. Identify the program goals / Defining the program c. Measurement The researcher must be able to operationalize, observe and recognize the presence or absence of what is under study.

d. Specify outcomes e. Account for experimental contexts f. Specify interventions g. Specify other variables

B. EXPERIMENTAL DESIGNS

i) Classic Experiment design

ii) Quasi-Experiment design Lack of random assignment of subjects to an experimental and a control group. a) Time Series b) Non-equivalent control groups c) Multiple time series design d) Qualitative evaluations

C. LIMITATIONS OF EVALUATION RESEARCH As you review reports of applied studies, you should be especially sensitive to these problems (Babbie and Benaquisto) 1. Logistical problems 2. Ethical issues 3. Researcher Responsibility 4. Research Stakeholders

2. INTERVIEWS

A. Definition A data collection encounter in which one person (an interviewer) asks questions of another (a respondent) (Babbie and Benaquisto) A qualitative interview is essentially a conversation in which the interviewer establishes a general direction for the conversation and pursues specific topics raised by the respondent (Kirby and McKenna)

B. Advantages of Interviews

C.Constructing Interview Questions

D. Interviewing techniques A. Interviewer Qualities…. understanding, accepting, non-judgmental, straightforward, honest, sense of humour, reassuring, relaxed, calm, friendly, intelligent, adjusted, secure, patient, experienced in life, quiet, gentle, sympathetic interested, caring, focused B. Appearance & Demeanor C. Familiar with the Questionnaire

D. Follow Wording Exactly E. Record Answers / Responses Exactly F. Probe for Responses G. Listening Skills

NEVER THINK YOU KNOW THE LAST WORD ON ANY HUMAN HEART -- HENRY JAMES

E.Essential components of interviewing (Kirby & McKenna) - Egalitarian setting and relationship between the interviewer and the participant - Identify your research approach to the research participant at first contact - Recognize the investment made by all: participants, researchers and others - Account for yourself - The researcher must experience the interview as both an interviewer and a research participant early on in the data gathering process - The research process is dynamic – continually changing in response to new information and new participants