Download presentation

Presentation is loading. Please wait.

1
MEASUREMENT

2
Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant

3
Measurement Selecting measurable phenomena Developing a set of mapping rules Applying the mapping rule to each phenomenon

4
What is to be measured? CONCEPTS/CONSTRUCTS/VARIABLES Operational Definitions Operational Definitions - Dimensions - Elements Scales Scales

5
CONCEPT A GENERALIZED IDEA ABOUT A CLASS OF OBJECTS, ATTRIBUTES, OCCURRENCES, OR PROCESSES. (e.g., Technology, Dynamism, Adoption, Learning)

6
CONSTRUCT An image or idea specifically invented for a given research and/or theory-building purpose An image or idea specifically invented for a given research and/or theory-building purpose Higher level concepts for specialised scientific explanatory purposes that are not directly observable and for thinking about and communicating abstractions Higher level concepts for specialised scientific explanatory purposes that are not directly observable and for thinking about and communicating abstractions Concepts and constructs are used at theoretical levels

7
VARIABLE Used at empirical level Used at empirical level Accept numeral or values for the purpose of testing and measurement Accept numeral or values for the purpose of testing and measurement

8
OPERATIONAL DEFINITION A definition for a construct stated in terms of specific criteria for testing or measurement A definition for a construct stated in terms of specific criteria for testing or measurement Specifies what the researcher must do to measure the concept/construct under investigation Specifies what the researcher must do to measure the concept/construct under investigation

9
SCALE - Definition SERIES OF ITEMS SERIES OF ITEMS ARRANGED ACCORDING TO VALUE ARRANGED ACCORDING TO VALUE FOR THE PURPOSE OF QUANTIFICATION FOR THE PURPOSE OF QUANTIFICATION A CONTINUOUS SPECTRUM A CONTINUOUS SPECTRUM

10
SCALE PROPERTIES UNIQUELY CLASSIFIES UNIQUELY CLASSIFIES PRESERVES ORDER PRESERVES ORDER DISTANCE/EQUAL INTERVALS DISTANCE/EQUAL INTERVALS NATURAL ORIGIN (ZERO) NATURAL ORIGIN (ZERO)

11
Types of Scales Ordinal Interval Ratio Nominal

12
NOMINAL SCALE

13
Nominal Scales Mutually exclusive and collectively exhaustive categories Mutually exclusive and collectively exhaustive categories Exhibits the classification characteristic only Exhibits the classification characteristic only

14
NOMINAL SCALE PROPERTIES UNIQUELY CLASSIFIES Male/Female Male/Female Academic/Admin Academic/Admin Asian/European Asian/European Strategy types Strategy types Adopters/Non Adopters Adopters/Non Adopters

15
Levels of Measurement Ordinal Interval Ratio Nominal Classification

16
ORDINAL SCALE

17
Ordinal Scales Characteristics of nominal scale plus an indication of order Implies statement of greater than and less than

18
ORDINAL SCALE PROPERTIES UNIQUELY CLASSIFIES PRESERVES ORDER Win, Place & Show Win, Place & Show Podium/Grid positions Podium/Grid positions Ranking Ranking

19
Levels of Measurement Ordinal Interval Ratio Nominal Classification Order Classification

20
INTERVAL SCALE

21
Interval Scales Characteristics of nominal and ordinal scales plus the concept of equality of interval. Characteristics of nominal and ordinal scales plus the concept of equality of interval. Equal distance exists between numbers Equal distance exists between numbers

22
INTERVAL SCALE PROPERTIES UNIQUELY CLASSIFIES PRESERVES ORDER EQUAL INTERVALS Consumer Price Index (Base 100) Consumer Price Index (Base 100) Fahrenheit Temperature Fahrenheit Temperature Assessment of attitude, beliefs, intention Assessment of attitude, beliefs, intention

23
Levels of Measurement Ordinal interval Ratio Nominal Classification Order Classification Order Classification Distance

24
RATIO SCALE

25
Ratio Scales Characteristics of previous scales plus an absolute zero point Characteristics of previous scales plus an absolute zero point Examples Examples Weight Height Number of children

26
RATIO SCALE PROPERTIES UNIQUELY CLASSIFIES PRESERVES ORDER EQUAL INTERVALS NATURAL ZERO Weight and distance Weight and distance Age, years of service Age, years of service

27
Levels of Measurement Ordinal Interval Ratio Nominal Classification Order Classification Order Classification Distance Natural Origin Order Classification Distance

28
Goodness of Measures Accurately measuring what actually the concept one sets out to measure Accurately measuring what actually the concept one sets out to measure Should be easy and efficient to use Should be easy and efficient to use

29
Evaluating Measurement Tools Criteria Validity Practicality Reliability

30
Validity The ability of a scale to measure what was intended to be measured.

31
Validity Determinants Content Construct Criterion

32
Increasing Content Validity Content Literature Search Expert Interviews Group Interviews Question Database

33
……Goodness of Measures Validity Validity Content Validity Includes Face Validity How well the dimensions and elements of a concept have been delineated Professional agreement that a scale logically appears to accurately measure what it is intended to measure

34
Validity Determinants Content Construct

35
Increasing Construct Validity New measure of trust Known measure of trust Empathy Credibility

36
……Goodness of Measures Construct Validity – when empirical evidence generated by a measure is consistent with the theoretical logic of the concept Convergent Validity – the measure should “converge” with other similar measures Discriminant Validity – when the measure has low correlation with measures of dissimilar concept

37
Judging Criterion Validity Relevance Freedom from bias Reliability Availability Criterion

38
Criterion-Related Validity Concurrent – When the scale discriminates individuals who are known to be different; A type of criterion validity whereby a new measure correlates with a criterion measure taken at the same time. Predictive Validity – Ability to differentiate among individuals with reference to a future criterion

39
VALIDITY

40
Reliability The degree to which measures are free from random error and therefore yield consistent results.

41
Reliability Estimates Stability Internal Consistency Equivalence

42
Reliability Estimates Stability Internal Consistency Equivalence

43
Stability of Measures Test-Retest Reliability – the administering of the same scale or measure to the same respondents at two separate points in time Parallel-Form Reliability - when responses on two comparable sets of measures tapping the same construct are highly correlated … Reliability

44
Reliability Estimates Stability Internal Consistency Equivalence

45
Variations at one point in time among observers and samples of items Variations at one point in time among observers and samples of items

46
Reliability Estimates Stability Internal Consistency Equivalence

47
… Reliability Internal Consistency Measures Interitem Consistency Reliability - where items that are independent measures of the same concept correlate with one another. Split-Half Reliability – reflects the correlations between two halves of an instrument

48
RELIABILITY

49
Understanding Validity and Reliability

50
Practicality EconomyInterpretability Convenience

51
SENSITIVITY A measurement instrument’s ability to accurately measure variability in stimuli or responses. A measurement instrument’s ability to accurately measure variability in stimuli or responses.

52
Rating Scales Used to elicit responses with regard to the object, event, or person studies: Dichotomous scale Category scale Likert scale Numerical scale Semantic differential scale

53
….. Rating Scales Itemised rating scale Fixed or constant sum rating scale Stapel scale Graphic rating scale Consensus scale

54
Ranking Scales To tap preferences between two or more objects or items Paired Comparison Paired Comparison Forced Choice Forced Choice Comparative Comparative

Similar presentations

© 2020 SlidePlayer.com Inc.

All rights reserved.

To make this website work, we log user data and share it with processors. To use this website, you must agree to our Privacy Policy, including cookie policy.

Ads by Google