Why use nonverbal tests? 1.Measure abilities in ways that are fair to all students 2.Increase the diversity in programs for academically gifted and talented 3.Actively assist children who have not had the advantages of wealth or who have not from birth been immersed in English
Other factors to consider Get the right kids, not just the right number Especially critical for minority students –Next generation of writers, scientists, mathematicians Crafting policy for the identification and development of a diversity of academic talents
Nonverbal Tests Present visual stimuli (objects, line drawings) and Require a nonverbal response (assemble a puzzle, point, fill in a circle) Nonverbal describes the test, not the cognitive processes used to solve items Involvement of verbal processes –Explicit (UNIT Analogic reasoning subtest) –Implicit (Figural Reasoning tests)
Disadvantages Figural reasoning tests –Task specificity greater than for V or Q –Large practice effects –Largest Flynn effect –Appearance of measuring something innate –Appearance of being culture fair
Culture fair? Intuitively plausible but long discredited idea Anastasi & Urbina (1997) Psychological Testing (7 th ed.) –no test can be equally fair to all cultures –nonlanguage tests may be more culturally loaded than language tests
Cronbach quote Cronbach (1990) Essentials of Psychological Testing (5 th ed). –no behavioral evidence is culture free. –the term culture fair makes a dubious claim
Scarr quote Scarr (1994) In Sternbergs Encyclopedia of Intelligence –intelligence and ability tests sample human cultural knowledge, acquired (through) development. –Although tests such as the Raven Matrices may seem fair… puzzle-like tasks turn out to have their own limitations.
Disadvantages Figural reasoning tests –Task specificity greater than for V or Q –Large practice effects –Largest Flynn effect –Appearance of measuring something innate –Appearance of being culture fair –Distal predictors of academic success
Selecting students on the basis of a test of nonverbal reasoning ability would: admit many students who are unprepared for advanced instruction in mathematics or science or other content-rich domains. exclude many students who either have already demonstrated high levels of accomplishment in these domains OR whose high verbal or quantitative reasoning abilities make them much more likely to succeed in such programs.
Figural reasoning as an inaptitude? 140506099 Verbal Quantitative Nonverbal 140506099 Verbal Quantitative Nonverbal N + N -
Figural reasoning as an inaptitude? Students with an N+ profile do less well in school than students with an N- profile Gohm, Humphreys & Yao (1998) find high spatial students do poorly on a wide range of academic outcomes. High N, high Q = engineer profile Cannot look at Nonverbal test alone
Extravagant Claims, Unlikely Promises NNAT claims –culture fair –a very good predictor of school achievement –small and inconsequential difference in mean scores for White, Black, & Hispanic students –identify equal proportions of high-scoring White, Black, & Hispanic students
Predict achievement? r (NNAT, Reading) =.56 r (NNAT, Reading in Spanish) =.32 r (NNAT, Math) =.6 r (CogAT, Reading) =.80 r (CogAT, Math) =.81
Small mean differences between ethnic groups? equal proportions of high scorers? Exceedingly implausible –e.g. NAEP differences 1 SD –Matrix format much studied Sample is small and unrepresentative –5.6 % Urban school children –More high SES Hispanics & Blacks Numbers do not add up –W-B and W-H differences inconsistent –means < 100 for all three groups –SDs all greater than 15
Mean W-B, W-H differences W-B W-H Naglieri & Ronning (2000) 4.2 2.8 Naglieri & Ford (2003) 3.2 2.0
Aptitude Perspective Aptitude is –the degree of readiness to perform well in a particular situation or fixed domain. Examples –Ability to comprehend instructions –To use previously acquired knowledge and skill appropriately –To make good inferences and generalizations –To manage ones emotions
Predicting Math Achievement in Grades 1-12 from CogAT 6
Multiple R =.220.127.116.11 Predicting Math Achievement in Grades 1-12 from CogAT 6
Predicting Reading Comprehension/ Vocabulary in Grades 1-12 from CogAT 6
Multiple R =.80.63.15.07 Predicting Reading Comprehension/ Vocabulary in Grades 1-12 from CogAT 6
Multiple R =.81 (.80).66 (.72).14 (.12).06 (.04) Predicting Reading Comp/ Vocab for All Students (Hispanics) grades 1-6
Predictors of Achievement The regression equations that best predict achievement in Reading, Mathematics, Social Studies, & Science from CogAT Verbal, Quantitative, and Nonverbal reasoning are the same for White, Black, Hispanic, and Asian-American students Other investigators find the same (Keith)
Predicting Future Achievement Math Achievement Math Achievement Quant. Reasoning Grade 4Grade 9.27.19 Nonverbal Reasoning.19
Recap 1.Structure of abilities the same within ethnic groups 2.Predictors of concurrent achievement are the same in White, Black, Hispanic, & Asian- Americans 3.Best predictors of future achievement in a domain are current achievement in that domain and the ability to reason in the symbol system(s) used to communicate new knowledge in the domain 4.Therefore….
Bilingual students Verbal achievement in both L1 and L2 depend on a common set of verbal processes –Phonemic awareness in Spanish predicts reading in English (Lindsey et al. 2003) –Grades in English are more strongly related to (Swedish) verbal abilities than are grades in Swedish (Gustafsson & Balke, 1993). –Best predictors of learning French are verbal abilities and achievements in English -- not mathematical or figural reasoning abilities (Carroll, 1981)
Aptitude versus Achievement Estimates of academic aptitude must always be judged relative to circumstances. Estimates of academic attainment, on the other hand, must be made on a scale that is similar for all.
Common Cut Scores? Current Accomplishment Common standards more reasonable Potential for future accomplishment Common standards not defensible Lead to the search for aptitude tests that predict achievement but not group differences in achievement Get more kids, but more of the wrong kids
Who is most likely to improve? Strongest reasoning abilities in the symbol systems used to communicate knowledge in the domain Best, most appropriately challenging instruction Motivation and persistence
Guidelines 1.Except for very young children, academic giftedness should be defined primarily by measures of academic accomplishment. 2.The primary cognitive aptitudes for future academic accomplishment are domain- specific achievement and the ability to reason in the symbol systems used to communicate new knowledge. 3.The predictors of achievement are the same in different ethnic groups.
4. Use the nonverbal test as a helpful adjunct, but as a measure of last resort. 5. Provide different levels of challenge to those who have already exhibited academic excellence and those who are working to attain it 6. Use common aptitude measures but uncommon cut scores (e.g., rank within group) when identifying minority students most likely to profit from intensive instruction.
The Role of Nonverbal Ability Tests in Identifying Academically Gifted Students: An Aptitude Perspective David Lohman The University of Iowa http://faculty.education.uiowa.edu/dlohman