1. LECTURE 9

2. MEASUREMENT
Procedure for assigning symbols, letters, or numbers to empirical properties of variables according to rules.

3. Difficulty in measuring concepts directly (e.g., academic achievement)
Usually measure indicators of concepts (e.g., CGPA)
Level of measurement determines the type of statistical analysis.
The level of measurement you use depends on how you want to measure an outcome.

4. Levels of Measurement
Nominal
Ordinal
Interval
Ratio

5. Nominal Latin word nomin (name) Variable categorical in nature
Differ in quality not quantity (numbers have no meaning only label)
Characterizes observation into one (and only one) category  mutually exclusive
Solely qualitative
No obsolute zero (0)
Matematical operation not possible.

6. Ordinal
Describes variables that can be ordered along some type of continuum.
Not only categories, order as well.
Ranking according to various outcomes, e.g., big & little.
No obsolute ‘0’, only relative position; e.g., Zul is taller than Sheereen and Sheereen is taller than Rozumah (no information on how much taller).
Matematical operation not possible.

7. Interval Latin word intervalum (spaces between walls).
Describes variables that have equal intervals btw them.
Allow us to determine the difference btw points along the same type of continuum (e.g., the difference btw 300 and 400 is the same as the difference btw 700 and 800; i.e., 100).
0 is arbitrary (subjective, temporary).
Simple matematical operation.
More precise & convey > info than nominal & ordinal; but must be cautious in interpreting.

8. Ratio Latin word ratio (calculation).
Describes variables that have equal intervals btw them & have absolute 0.
Most precise.
Complex matematical operation.
Highest level of measurement.

10. QUIZ: Matching questions
Nominal
Ordinal
Ratio
Interval
Have a true zero (highest level).
Categorical in nature (lowest level)
Have equidistant points along some underlying continuum.
Are ranked.

11. QUIZ: Matching questions
TYPES OF MEASUREMENT ON HEIGHT
A is 5 inches taller than B (know precise difference).
Precise height measured on a scale with true zero.
Categorize people into A and B (people different in height).
d. Tall and Short (have some meaning, but nature of difference is not known).
Nominal
Ordinal
Ratio
Interval

12. Summary
Nominal level variables are categorical in nature (lowest level)
Ordinal -- are ranked.
Interval -- have equidistant points along some underlying continuum.
Ratio -- have a true zero (highest level).

13. RELIABILITY & VALIDITY OF MEASUREMENT
Reliability and validity are the hallmarks of good measurement. Assessments tools must be reliable and valid, otherwise the research hypothesis may be incorrectly rejected.

14. Reliability is a practical measure of how consistent and stable a measurement instrument or a test might be.
Reliability is often measured using the correlation coefficient.

15. Synonyms for Reliability
Dependency
Consistency
Stablility
Trustworthiness
Predictability
Faithfulness

16. Types of Reliability Test-retest Parallel forms Inter-rater
Internal consistency

17. 1. Test-retest: A measure of stability.
Examines consistency over time.
Administer the same test/measure at two different times to the same group of participants.
Coefficient: rtest1.test2

18. 2. Parallel Forms A measure of equivalence.
Examines consistency between forms.
Administer different forms of the same test to the same group of participants.
Coefficient: rform1.form2

19. 3. Inter-rater A measure of agreement.
Examines consistency across raters.
Have two raters, rate behaviors and determine the amount of agreement between them.
Coefficient: % of agreement.

20. 4. Internal consistency
A measure of consistently each item measures the same underlying construct.
Examines reliability within a particular set of item.
Correlate performance on each item with overall performance across participants.
Coefficient: Chronbach’s alpha

21. Validity Is the quality of a test doing what it is designed to do.
The test or instrument you are using actually measures what you need to have measured.

22. Synonyms for Validity Truthfulness, Accuracy Authenticity Genuineness
soundness

23. Types of Validity
Content
Criterion
Concurrent
Predictive
Construct

24. Content Validity
A measure of how well the items represent the entire universe of items
Established by asking expert if the items assess what you want them to.
History test = test items ask questions on history not Science.

25. Criterion Validity A measure of how well a test estimates a criterion.
Concurrent validity
A measure of how well a test estimates a criterion.
Established by selecting a criterion and correlate scores on the test with scores on ther criterion in the present.
Good student = test result + reports by lecturers.

26. ii. Predictive Validity
A measure of how well a test predicts a criterion.
Select a criterion and correlates scores on the test with scores on the criterion in the future.
High merit on STPM/Diploma = Score high CGPA.
Pass driving test = Good driver.

27. Construct Validity
A measure of how well a test assesses some underlying construct.
Assess the underlying construct on which the test is based and correlate these scores with the scores.
Theoretically and practically sound.
Intelligence test actually measures intelligence.

28. Relationship between Reliability and Validity
A test can be reliable without being valid but the reverse is not true.
A test can be reliable, but not valid, but a test cannot be valid without first being reliable.
Reliablity is a necessary, but not sufficient, condition of validity.
You are answering questions on simple addition, but we called it spelling test! Obviously it is not a test on spelling  lack of validity, does not affect reliability.