Best Practices for Teaching Statistics within the AP Psychology Curriculum Melissa J. Kennedy, PhD. Holy Names Academy Seattle, Washington

Let’s Talk About Research & Statistics!

Fall 2010 Course Description: Topics & Learning Objectives Objectives for Research Methods (8-10%) Psychology is an empirical discipline. Psychologists develop knowledge by doing research. Research provides guidance for psychologists who develop theories to explain behavior and who apply theories to solve problems in behavior.

Fall 2010 Course Description: Content Outline II. Research Methods –10% – A. Experimental, Correlational, and Clinical Research – B. Statistics 1. Descriptive 2. Inferential – C. Ethics in Research

Fall 2010 Course Description: Topics & Learning Objectives Objectives for Testing and Individual Differences (5–7%) An understanding of intelligence and assessment of individual differences is highlighted in this portion of the course. Students must understand issues related to test construction and fair use.

Fall 2010 Course Description: Content Outline XI. Testing and Individual Differences.... 5–7% A. Standardization and Norms B. Reliability and Validity C. Types of Tests D. Ethics and Standards in Testing E. Intelligence

Fall 2010 Course Description: Topics & Learning Objectives Objectives: Personality (5–7%) In this section of the course, students explore major theories of how humans develop enduring patterns of behavior and personal characteristics that influence how others relate to them. The unit also addresses research methods used to assess personality.

Fall 2010 Course Description: Content Outline X. Personality –7% A. Personality Theories and Approaches B. Assessment Techniques C. Growth and Adjustment

The Mind Reader Karnak, the Educator by Robert B. Bain available at px px HIGHLY Recommended Activity

Overconfidence Exercise Activity Truth or Lie?

Research Methods The Scientific Method

Research Designs #1. Differentiate types of research (e.g., experiments, correlational studies, survey research, naturalistic observations, and case studies) with regard to purpose, strengths, and weaknesses.

Research Methods Case Study Naturalistic Observation Survey Correlational Study

Activity Worksheet MethodDescriptionType of Data (Qualitative, Quantitative or Either/Both) AdvantagesDisadvantages Case Study Naturalistic Observation Survey Correlational Study Experiment

Applet Understanding Correlation

Activity Experimental Practice Exercise #1 Additional Practice Exercises at End of Slide Show and in Handout Packet Cell phones and brain cancer One study of cell phones and the risk of brain cancer looked at a group of 469 people who have brain cancer. The investigators matched each cancer patient with a person of the same age, sex, and race who did not have brain cancer, then asked about the use of cell phones. Result: “Our data suggest that the use of handheld cellular phones is not associated with risk of brain cancer.” (a) Is this an observational study or an experiment? Justify your answer. (b) Based on this study, would you conclude that cell phones do not increase the risk of brain cancer? Why or why not? All exercises from: Yates, D.S., Moore, D.S., & Starnes, D.S. (2007)The Practice of Statistics, 3rd. Ed., New York, NY: W.H.Freeman.

Experimental Design Practice Problem (#2) Survey, experiment, or observational study? What is the best way to answer each of the questions below: a survey, an experiment, or an observational study that is not a survey? Explain your choices. For each question, write a few sentences about how such a study might be carried out. (a) Are people generally satisfied with how things are going in the country right now? (b) Do college students learn basic accounting better in a classroom or using an online course? (c) How long do your teachers wait on the average after they ask the class a question? Activity All exercises from: Yates, D.S., Moore, D.S., & Starnes, D.S. (2007)The Practice of Statistics, 3rd. Ed., New York, NY: W.H.Freeman.

Experimental Design Practice Problem (#3) I'll drink to that! In adults, moderate use of alcohol is associated with better health. Some studies suggest that drinking wine rather than beer or spirits yields added health benefits. (a) Explain the difference between an observational study and an experiment to compare people who drink wine with people who drink beer. (b) Suggest some characteristics of wine drinkers that might benefit their health. In an observational study, these characteristics are mixed up with the effects of drinking wine on people's health. Activity All exercises from: Yates, D.S., Moore, D.S., & Starnes, D.S. (2007)The Practice of Statistics, 3rd. Ed., New York, NY: W.H.Freeman.

Experimental Design Practice Problem (#4) Abstinence or not? An August 2004 Gallup Poll asked 439 teens aged 13 to 17 whether they thought young people should abstain from sex until marriage. 56% said “Yes.” (a) If Gallup had asked all teens aged 13 to 17 this question, would exactly 56% have said “Yes”? Explain. (b) In this sample, 48% of the boys and 64% of the girls said “Yes.” Are you convinced that a higher percent of girls than boys aged 13 to 17 feel this way? Why or why not? All exercises from: Yates, D.S., Moore, D.S., & Starnes, D.S. (2007)The Practice of Statistics, 3rd. Ed., New York, NY: W.H.Freeman. Activity

Experimental Design Practice Problem (#5) TV violence. A typical hour of prime-time television shows three to five violent acts. Linking family interviews and police records shows a clear association between time spent watching TV as a child and later aggressive behavior. a. Explain why this is an observational study rather than an experiment. b. Suggest several other variables describing a child’s home life that may be related to how much TV he or she watches. Explain why these variables make it difficult to conclude that more TV causes aggressive behavior? All exercises from: Yates, D.S., Moore, D.S., & Starnes, D.S. (2007)The Practice of Statistics, 3rd. Ed., New York, NY: W.H.Freeman. Activity

Aside from RM: Personality #2 (Personality). Describe and compare research methods (e.g., case studies and surveys) that psychologists use to investigate personality.

Activity OnLine Personality Measures Big Five I: Big Five II: Keirsey Personality Sort: Self-Report Personality Exercise

Drawing Conclusions From Research #2. Describe how research design drives the reasonable conclusions that can be drawn (e.g, experiments are useful for determining cause and effect; the use of experimental controls reduces alternative explanations).

Research Methods

Order in Random Events Applet

Activity An In-Class Experiment: Chocolate Improves Memory

Validity #5. Predict the validity of behavioral explanations based on the quality of research design (e.g., confounding variables limit confidence in research conclusions).

Threats to Validity: Confounding or Third Variables Research Methods

Threats to Validity: Experimenter Expectancy

Research Methods Threats to Validity: Placebo Effects

Threats to Validity: Demand Characteristics Research Methods

Aside: Testing & Personality # 4 (Testing). Explain how psychologists design tests, including standardization strategies and other techniques to establish reliability and validity. #3 (Personality): Identify frequently used assessment strategies (e.g., the Minnesota Multiphasic Personality Inventory [MMPI], the Thematic Apperception Test [TAT]), and evaluate relative test quality based on reliability and validity of the instruments.

Research Methods Reliability Test - Retest

Validity Research Methods

Random Selection & Random Assignment #4. Distinguish between random assignment of participants to conditions in experiments and random selection of participants, primarily in correlational studies and surveys.

Research Methods Random Selection

Research Methods 2010 FRQ #1 For each of the pairs below, use an example to show how the first term in each pair affects or is related to the second. Definitions alone without examples will not score. Double-blind research.. bias Random Assignment

Variables: Identification #3. Identify independent, dependent, confounding, and control variables in experimental designs.

Research Methods IV and DV

Research Methods Control & Experimental Groups

Variables: Operational Definitions #8. Discuss the value of reliance on operational definitions and measurement in behavioral research FRQ #1 For each of the pairs below, use an example to show how the first term in each pair affects or is related to the second. Definitions alone without examples will not score. Operational definition.. replication

Research Methods Replication: Operationally Define Variables/Conditions

Statistics Statistics is…. Statistics are…..

Developing Critical Thinking Key Questions: 1) Who? How many are there? 2) What are the variables? What units recorded? 3) Why were the data gathered? Specific questions or draw conclusions about individuals other than the ones we actually have data for? 4) When, where, how, and by whom were data produced? Where did data come from? Archival or new data to answer current questions? From experiment or observational study? From census or sample? Who directed data production? Can we trust the data? Statistics

Research Study Summary Assign Research Articles. (i.e., 40 Studies text or Scientific American (SA) or SA The Mind; for academic reprint permission for any SA article: nal). nal Provide Assignment Sheet with critical questions (sample included in handout). Activity

Descriptive & Inferential Statistics #6. Distinguish the purposes of descriptive statistics and inferential statistics.

Descriptive Statistics Statistics Measures of Central Tendency Measures of Variability

Application of Descriptive Statistics #7. Apply basic descriptive statistical concepts, including interpreting and constructing graphs and calculating simple descriptive statistics (e.g., measures of central tendency, standard deviation).

Graphs Statistics

3 Ms of Central Tendency Mode: the most frequent score – Example: – Ordered: Statistics MODE

3 Ms of Central Tendency Median: the the middle score of any ordered set of numbers – Ex (odd # of scores): – Ex (even # of scores): ( )/2 = 12.5 = median Statistics MEDIAN

3 Ms of Central Tendency Mean: the arithmetic average of scores Mean = add their values and divide by the number of observations. If the n observations are x 1, x 2,….. x n1, their mean is: A simpler notation: Statistics

Mean, cont. Ex: ( ) 10 (211) Statistics

Mean & Median Applet I Mean and Median Applet II Mean and Median Applet III Applet

Measures of Variability: Range Range – Range = (highest score – lowest score) – Example: RANGE: 9 – 1 = 8 Statistics

Measures of Variability: Variance Variance = average squared deviation from the mean Statistics

Measure of Variance: Standard Deviation Standard deviation: how far, on average, scores vary from the mean. Computed by taking square root of variance. Statistics

To Calculate Variance & Standard Deviation ScoresMeanDeviation from Mean Deviation Squared Total Activity

The Ever Popular Living Histogram Activity

4’6”- 4’7” 4’8”- 4’9” 4’10”- 4’11” 5’0” – 5’1” 5’2”- 5’3” 5’4”- 5’5” 5’6”- 5’7” 5’8” – 5’9” 5’10”- 5’11” 6’0” – 6’1” 6’2”- 6’3”

Measures of Variability: The Normal Curve #5 (Testing). Interpret the meaning of scores in terms of the normal curve.

Statistics

Normal Distribution & Standard Deviation Applet

Inferential Stats Statistics

Central Limit Theorem: Larger Sample Size = More Normal Applet

Statistics Statistical Significance

Statistics

Ethics in Research #9. Identify how ethical issues inform and constrain research practices. #10. Describe how ethical and legal guidelines (e.g., those provided by the American Psychological Association, federal regulations, local institutional review boards) protect research participants and promote sound ethical practice.

Ethics APA Code of Ethics

Ethics Institutional Review Board (IRB)

Informed Consent Ethics

Protection from Harm

Confidentiality Ethics

Within Psychological Treatment: HIPPA Ethics

Debriefing Right to Withdrawal Ethics

Animal Rights Ethics

Thank you for your attention and interest! Please contact me for further discussion: