Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Chapter 9 Nonreactive Research: Content Analysis and Existing Documents/Statistics 1

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Digging Up Data Unobtrusive Measures - another name for nonreactive measures that emphasize how the people being studied are not aware of it because the measures do not intrude. Nonreactive Data - a class of data that are collected in such a way that the people being studied are unaware that they are part of a study. Three categories of unobtrusive measures include: 1.Physical Traces 2.Archival Material 3.Unobtrusive Observation 2

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Quantitative Content Analysis What is Content Analysis? Content analysis is a technique for gathering and analyzing the content of text. –Text - the general name for a communication medium from which symbolic meaning is measured in content analysis. –Content Analysis - a technique for gathering and analyzing the content of text. 3

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Measurement and Coding General Issues Careful measurement is crucial in content analysis because a researcher takes murky symbolic communication and turns it into precise, quantitative data. Coding System A set of instructions or rules used in content analysis to explain how a researcher systematically observe and record content from text. 4

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved What is Measured? Structured Observation - a method of watching what is happening in a social setting that is highly organized and follows systematic rules for observation and documentation. Coding systems identify four characteristics of text content: Frequency Direction Intensity Space 5

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Types of Coding Manifest Coding A type of content analysis coding in which a researcher first develops a list of words, phrases, or symbols and then locates them in a communication medium. Latent Coding A type of content analysis coding in which a researcher identifies subjective meaning such as themes or motifs and then systematically locates them in a communication medium. 6

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved How to Conduct Content Analysis Research 1.Question Formulation 2.Units of Analysis 3.Sampling 4.Variables and Constructing Coding Categories 5.Inferences 7

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Note on Reliability Intercoder Reliability Equivalence reliability in content analysis with multiple content coders that require a high degree of consistency across coders. Researchers do this by asking coders to code the same text independently and then checking for consistency across coders. 8

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Existing Documents/Statistics Locating Data and Existing Statistics The main sources of existing documents are government agencies, private sources, and international agencies involved in crime control. Many existing statistics are free, but the time and effort it takes to search for specific information can be substantial. The single most valuable source of statistical information about the United States is the Statistical Abstract of the United States. 9

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Reliability and Validity Validity problems are a real threat to legitimacy of existing statistics research. Three potential threats include: 1.When the researcher’s theoretical definition does not match that of the government agency or organization that collected the information. 2.When official statistics are a surrogate or proxy for a construct in which a researcher is really interested. 3.When researcher lacks control over how information is collected. 10

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved Stability Reliability Stability Reliability - a technique that checks to see whether the coding is stable or changing. Problems with reliability can also plague existing statistics research. Stability reliability problems arise when official definitions or the methods of collecting information change over time. Equivalence reliability can also be a problem due to poor bookkeeping and recordkeeping. Representative reliability is also a problem in official statistics. 11

Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved The Issue of Missing Data Missing data is another serious problem that plagues researchers using existing documents/statistics. However, more frequently, data was never collected. Government agencies start or stop collecting information for political, budgetary, or other reasons. 12