1. Spanish and English Neuropsychological Assessment Scales - Guiding Principles and Evolution
Friday Harbor Psychometrics Workshop 2005

2. A Brief Detour Th(eta) estimation - a simple minded approach
Information
Friday Harbor Psychometrics Workshop 2005

3. P(yij=1|£)=1/(1+exp(-aj(£i-bj))
Friday Harbor Psychometrics Workshop 2005

4. Basic Data Structure Subject Item1 Item2 Item3 Item4 S1 X11 X12 X13
Friday Harbor Psychometrics Workshop 2005

5. Sample size considerations
Large samples required for stable estimation
for 1PL
for 2PL
for 3PL
Friday Harbor Psychometrics Workshop 2005

6. Information Curves
Friday Harbor Psychometrics Workshop 2005

7. Back to Our Regular Program
Friday Harbor Psychometrics Workshop 2005

8. Purpose of SENAS Project
Create matched English and Spanish language neuropsychological tests for ages 60+
New scales based upon neuropsychological model of cognitive functioning
Scales psychometrically matched
Within English and Spanish language versions
Between English and Spanish language versions
Distribution of item difficulty appropriate to elderly population
Friday Harbor Psychometrics Workshop 2005

9. Psychometric Considerations
Concept of item and test bias central to project
A test is biased if its validity for measuring a particular attribute is different in different groups
Bias is present if individuals from different groups having the same ability have a different expected score
Empirical question
Definition of ability
Capacity to successfully respond to test items
Net result of all genetic and environmental influences
Measured by scales composed of homogenous items
Friday Harbor Psychometrics Workshop 2005

10. Guiding Principles Initial Scale Development
Scales targeted to assess neuropsychologically relevant cognitive domains
Domains that are affected by dementia and other age-related causes of cognitive impairment
Verbal and non-verbal measures
Non-timed
New scales, not translations of existing scales
Examiner administered
Item generation
items generated per scale to comprise initial item pool
Broad range of difficulty
Friday Harbor Psychometrics Workshop 2005

11. Original SENAS Scales and Abilities Measured
Friday Harbor Psychometrics Workshop 2005

12. Psychometric Methods Based upon Item Response Theory
Modern approach to psychometric test development
Item selection
Identify items without language DIF
Based upon empirical data
Use these items as foundation for scale construction
Add English and Spanish items to achieve target test information curve
Friday Harbor Psychometrics Workshop 2005

13. Friday Harbor Psychometrics Workshop 2005

14. Friday Harbor Psychometrics Workshop 2005

15. English and Spanish Item Characteristic Curves for “Stone/Piedra” Item
Friday Harbor Psychometrics Workshop 2005

16. English and Spanish Item Characteristic Curves for “Lamb/Cordero” Item
Friday Harbor Psychometrics Workshop 2005

17. Model for Item Selection
Friday Harbor Psychometrics Workshop 2005

18. Test Information for 3MS and SENAS Object Naming
Friday Harbor Psychometrics Workshop 2005

19. Initial Subject Sample
Community dwelling older persons (60+)
English or Spanish speakers
208 English
200 Spanish
Recruited using representative sampling methods and targeted outreach
Hispanics and non-Hispanics (mainly Caucasians)
Used for preliminary item calibration and selection
Friday Harbor Psychometrics Workshop 2005

20. Phase 2 Data Collection English Administration SALSA Hispanics
Random Sample (All scales) - 141
Screened (Subset of scales) - 156
Woodland Community Sample - 153
Spanish Administration
Random Sample (All scales) - 264
Screened (Subset of scales) - 287
Used for item calibration and scale construction
Friday Harbor Psychometrics Workshop 2005

21. Scales by Information Values
High
Object Naming
Picture Association
Spatial Localization
Verbal Attention
Visual Attention
Verbal Comprehension
Verbal Memory 1
Moderate
Verbal Conceptual
Pattern Recognition
Verbal Memory 2
Low - 4-8
Verbal Expression
Non-Verbal Conceptual
Friday Harbor Psychometrics Workshop 2005

22. Phase 3 Data Collection New goals Measures of executive function
Fluency
Working memory
African American recruitment and evaluation
Additional Hispanics and Caucasian recruitment and validation
Friday Harbor Psychometrics Workshop 2005

23. Phase 3 Data Collection
Community recruitment - health care systems and community outreach
200 African Americans
300 Hispanics
200 Caucasians
Full spectrum of cognitive ability
Friday Harbor Psychometrics Workshop 2005

24. Clinical Diagnosis by Ethnicity
Friday Harbor Psychometrics Workshop 2005

25. Supplementary Data Demographic and linguistic variables
Reading measures
Clinical variables
Diagnosis, global cognition, global function
Volumetric MRI
Brain matter, white matter hyperintensity, hippocampus
Friday Harbor Psychometrics Workshop 2005

26. Previous Work Scale construction and psychometric characteristics
Mungas et al., Neuropsychology, 2000
Mungas et al., Psychological Assessment, 2004
Friday Harbor Psychometrics Workshop 2005

27. Previous Work Scale construction and psychometric characteristics
Mungas et al., Neuropsychology, 2000
Mungas et al., Psychological Assessment, 2004
Impact of DIF (Object Naming)
Friday Harbor Psychometrics Workshop 2005

28. Mean Object Naming Ability by Group DIF Adjusted and Unadjusted
Friday Harbor Psychometrics Workshop 2005

29. Mean White-Hispanic Difference in Object Naming Ability
Friday Harbor Psychometrics Workshop 2005

30. Previous Work Scale construction and psychometric characteristics
Mungas et al., Neuropsychology, 2000
Mungas et al., Psychological Assessment, 2004
Impact of DIF (Object Naming)
Demographic effects - Hispanics and Caucasians
Mungas et al., Neuropsychology, 2005
Friday Harbor Psychometrics Workshop 2005

31. Language Utilization English and Spanish
How well do you speak English
0 - Not at all
1 - A little
2 - Well
3 - Very well
How well do you speak Spanish
Friday Harbor Psychometrics Workshop 2005

32. Ethnicity Effect Sizes for Raw Scores and Demographically Adjusted Scores
Friday Harbor Psychometrics Workshop 2005

33. Previous Work External validation
Global cognition/function, Hispanics and Caucasians
Mungas et al., Neuropsychology, 2000
Mungas et al., Neuropsychology, 2005
Clinical diagnosis, Hispanics and Caucasians
Mungas et al., JINS, 2005
Friday Harbor Psychometrics Workshop 2005

34. Cognition by Clinical Diagnosis for Hispanics and Caucasians
Friday Harbor Psychometrics Workshop 2005

35. New Data Adjustment for reading and education 114 African Americans
145 Hispanics
77 Caucasians
Friday Harbor Psychometrics Workshop 2005

36. Ethnicity Effect Sizes for Raw Scores and Demographically Adjusted Scores
Friday Harbor Psychometrics Workshop 2005

37. New Data Adjustment for reading and education
Age and education effects on relationship with MRI
Friday Harbor Psychometrics Workshop 2005

38. MRI Effect Sizes and Age and Education Adjustment - Full Sample (n=135)
Friday Harbor Psychometrics Workshop 2005

39. MRI Effect Sizes and Age and Education Adjustment - Whites (n=68)
Friday Harbor Psychometrics Workshop 2005

40. MRI Effect Sizes and Age and Education Adjustment - Minorities (n=67)
Friday Harbor Psychometrics Workshop 2005

41. Questions
Measurement characteristics in more specific ethnic/linguistic groups
Especially different English speakers
Hispanics, African Americans, Caucasians
DIF other than language
Psychometric properties of executive measures
Friday Harbor Psychometrics Workshop 2005

42. Questions
Deconstructing ethnic differences in distributions of test scores
Premorbid ability or expected test score
Broader external validation
Clinical diagnosis (including African Americans)
MRI
Friday Harbor Psychometrics Workshop 2005