Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.

Slides:



Advertisements
Similar presentations
Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Advertisements

Chapter Eight & Chapter Nine
Topics: Quality of Measurements
Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
Some (Simplified) Steps for Creating a Personality Questionnaire Generate an item pool Administer the items to a sample of people Assess the uni-dimensionality.
MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
Chapter 5 Measurement, Reliability and Validity.
Defining, Measuring and Manipulating Variables. Operational Definition  The activities of the researcher in measuring and manipulating a variable. 
 A description of the ways a research will observe and measure a variable, so called because it specifies the operations that will be taken into account.
Part II Sigma Freud & Descriptive Statistics
Copyright © Allyn & Bacon (2007) Data and the Nature of Measurement Graziano and Raulin Research Methods: Chapter 4 This multimedia product and its contents.
Reliability and Validity of Research Instruments
Data and the Nature of Measurement
QUANTITATIVE DATA ANALYSIS
Concept of Measurement
Appraisal in Counseling Session 2. Schedule Finish History Finish History Statistical Concepts Statistical Concepts Scales of measurement Scales of measurement.
A quick introduction to the analysis of questionnaire data John Richardson.
Manipulation and Measurement of Variables
Measures of Variability: Range, Variance, and Standard Deviation
Measurement and Data Quality
Understanding Research Results
Chapter 1: Introduction to Statistics
Chapter 1: Introduction to Statistics
CHAPTER 4 Research in Psychology: Methods & Design
Measurement in Exercise and Sport Psychology Research EPHE 348.
APPENDIX B Data Preparation and Univariate Statistics How are computer used in data collection and analysis? How are collected data prepared for statistical.
Chapter 15 Correlation and Regression
Instrumentation.
Foundations of Educational Measurement
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Chapter 1: Introduction to Statistics. 2 Statistics A set of methods and rules for organizing, summarizing, and interpreting information.
Statistical analysis Prepared and gathered by Alireza Yousefy(Ph.D)
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
Research Methodology Lecture No :24. Recap Lecture In the last lecture we discussed about: Frequencies Bar charts and pie charts Histogram Stem and leaf.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
Tests and Measurements Intersession 2006.
TYPES OF STATISTICAL METHODS USED IN PSYCHOLOGY Statistics.
Stats/Methods I JEOPARDY. Jeopardy Validity Research Strategies Frequency Distributions Descriptive Stats Grab Bag $100 $200$200 $300 $500 $400 $300 $400.
Variables and their Operational Definitions
Appraisal and Its Application to Counseling COUN 550 Saint Joseph College For Class # 3 Copyright © 2005 by R. Halstead. All rights reserved.
A way to organize data so that it has meaning!.  Descriptive - Allow us to make observations about the sample. Cannot make conclusions.  Inferential.
Measurement and Questionnaire Design. Operationalizing From concepts to constructs to variables to measurable variables A measurable variable has been.
CHAPTER OVERVIEW The Measurement Process Levels of Measurement Reliability and Validity: Why They Are Very, Very Important A Conceptual Definition of Reliability.
Psy 230 Jeopardy Measurement Research Strategies Frequency Distributions Descriptive Stats Grab Bag $100 $200$200 $300 $500 $400 $300 $400 $300 $400 $500.
Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.
©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)
Reliability Ability to produce similar results when repeated measurements are made under identical conditions. Consistency of the results Can you get.
Chapter 1: Introduction to Statistics. Variables A variable is a characteristic or condition that can change or take on different values. Most research.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
A way to organize data so that it has meaning!.  Descriptive - Allow us to make observations about the sample. Cannot make conclusions.  Inferential.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
© 2009 Pearson Prentice Hall, Salkind. Chapter 5 Measurement, Reliability and Validity.
Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.
Chapter 12 Understanding Research Results: Description and Correlation
Ch. 5 Measurement Concepts.
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
Introduction to Measurement
1 Chapter 1: Introduction to Statistics. 2 Variables A variable is a characteristic or condition that can change or take on different values. Most research.
Introduction to Statistics
15.1 The Role of Statistics in the Research Process
Chapter 8 VALIDITY AND RELIABILITY
Presentation transcript:

Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why does behavior vary across situations, people, and time. 2. All research questions in behavioral sciences are about behavioral variability.

3. Research should be designed to permit the researchers to describe and account for the variability in behavior. A good study will determine why behavior varied. 4. Measurement of behavior involves the assessment of behavioral variability. A participant’s score should correspond to the variability in a his or her behavior.

5. Stats are used to describe and account for observed variability in behavior. Descriptive statistics: describe behavior, using numbers like averages and percentages. Inferential statistics: used to make conclusions about significance and reliability and generalizability of results.

Depicts the amount of variability in participants’ behavior. The dispersion of scores. Range: difference between largest and smallest score >but range does does not take into account the other scores in your sample. Usually variability is described in terms of how much the scores vary around the mean (average). Variance

Low Variability

High Variability

1. Standard deviation (s) is the square root of the variance (s 2 ). 2. Thus, the larger the variance, the larger the standard deviation, and the more variability (dispersion) in the scores.

Systematic variance: part of total variance in behavior that is related in an orderly, predictable way to the variables you are researching. >Aggression scores may vary systematically to changes in TV violence viewing. Error variance: variance that is not accounted for or unrelated to variables the researcher measures. Factors that the researcher does not study that may relate to variability in behavior. Systematic and Error Variance

Total variance = systematic variance + error variance

Strength of Relations Proportion of total variance that is systematic: systematic variance/total variance Effect Sizes: measures of the strength of association between two variables range from 0.0 to : none of variability is systematic (0/100) 1: all of the variability is systematic (100/100) The larger the proportion the stronger the relation between the two variables

Strength of association between two variables: small.01 medium.06 large.15+ Thus, a strong association between two variables can account for only 15% of the total variance, leaving 85% error or unaccounted for variance.

Meta-Analysis One study will provide a rough estimate of of the strength of association between two variables But, remember the importance of replication! Meta-Analysis: statistical procedure used to analyze and integrate the effect sizes from many different studies to get a single estimate of the strength of association between two variables. Also used to explore other factors that may be affect the relationships.

Types of Measures 1. Observational measures: direct observation of behavior > time to complete task, number of bar presses 2. Physiological measures: internal processes that are not observable > heart rate, brain waves Chapter 3: The Measurement of Behavior

3. Self-report measures: participant gives answer Cognitive: what people think about something > child’s response when answering a question such as which ball is heavier Affective: participants’ report of how they feel > depression questionnaire Behavioral: participants’ report of how they act > questionnaire on how child behaves in school

Measurement To assign numbers to a participants’ response (measured variable) so it can be analyzed and correspond in a meaningful way to what the variable you a are measuring (conceptual variable). 1.Measured variables: numbers that represent measured variables 2.Conceptual variables: what you are try to measures (anxiety, self-esteem) An operational definition is a statement of how a conceptual variable is turned into a measured variable.

Psychometrics: the study of psychological measurement in order to improve measures and reduce error. Converging operations: using different measures for a single concept (e.g. anxiety) to get a better measure of the concept (triangulation).

1. Nominal Scale: a number (label) is assigned to name or identify a particular characteristic. >1 blue eyes, 2 brown eyes, 3 green eyes etc. 2. Ordinal Scale: rank order the variable. Numbers indicate if there is more or less of a variable but not the distance between the variables. >Score of 5 is better than 1, but does not say how much better it is. Scales of Measurement

3. Interval Scale: equal differences between points on the scale correspond to equal differences in characteristic measured. >IQ test, difference between 85 and 95 (10) is same as between 105 and 115 (10). Does not have a true zero, so cannot multiply or divide numbers. 4. Ratio Scale: has a true zero point so numbers can be multiplied and divided. >Weight: 100 pounds is twice a heavy as 50.

Reliability The consistency and stability of a measure. The extend to which it is free from error. >IQ is 100 one day and 140 next day, then the measures is unreliable. Observed score = true score + measurement error True score: real score if there is no error Measurement error: factors that distort the score

Measurement error may be due to: transient states of participant (mood, fatigue) stable attributes of participant (motivation, IQ) situational factors (lighting, harsh researcher) measure characteristics (ambiguous questions, long test) mistakes in recording responses Measurement Error

Total variance in set of scores = variance due to true scores + variance due to measurement error. Variance due to true scores is systematic variance Reliability = True score variance/Total variance proportion of total variance in a set of scores that is systematic (true score) variance. Assessing Reliability

0 = none of total variance is true score variance 1 = all of total variance is true score variance Reliability ranges from 0.0 (no reliability) to 1 (perfect reliability). Reliability of.70 is considered good meaning 70% of total variance is true score (systematic) variance.

Test-retest reliability: The extent to which scores on the same measure, administered at two different times, correlate with each other. Interitem reliability: The extent to which scores on items of a scale correlate with each other. Item-total correlation: correlation between one item and the sum of all the other items. Split-half reliability: correlation of scores on one half of test with scores on another half. >Cronbach’s alpha

Equivalent-forms reliability: The extent to which scores on similar, but not identical measures, administered at two different times, correlate with each other. >Does IQ test A correlate with IQ test B? Interrater reliability: The extent to which ratings of one or more judges correlate with each other.

Standardize test administration Use clear instructions and questions Train observers Minimize errors in coding data Increasing Reliability