Presentation is loading. Please wait.

Presentation is loading. Please wait.

Test construction 1. Testing in a cross-cultural context

Similar presentations


Presentation on theme: "Test construction 1. Testing in a cross-cultural context"— Presentation transcript:

1 Test construction 1. Testing in a cross-cultural context

2 Ways to handle emotions
Culture Behaviors Values Ways to handle emotions Norms Attitudes

3 Culture - meanings People living in different countries.
Minority groups within a particular country. Social groups within the same nationality, e.g. workers, football fans, college students etc.

4 Culture - ingredients Attitudes - state of mind with regard to some matter Values a broad tendency to prefer a certain state of affairs over others Behaviours - actual practice of concepts or beliefs

5

6 Test bias in cross-cultural assessment
Test bias may occur when the contents of the test are more familiar to one group than to another or when the tests have differential predictive validity across groups.

7 Example 1. IQ Culture-free tests?

8 Example 2. Sensation seeking
I like to drive fast a cadillac.

9 Example 3. Abilities Math abilities Tasks with difficult vocabularity
Disadvantage for e.g. imigrants

10 How to avoid bias? The test user must ascertain that the test and do not systematically discriminate against one cultural group or another. Proper adaptaion.

11 Problems Are the tests culture-free?
Maybe culture-fair or culture-reduced?

12 Test adaptation Process by which a test is ushered form a source language and culture into one or more target languages/cultures. Aim: fair, equivalent, applicable, interpretable instrument.

13 Cross culture studies Two approaches (from antropology):
Etic from „phonetic” - description of a behavior can be applied to other cultures; Emic from „phonemic” - description of behavior meaningful to a person within the culture

14 Etic studies Compare the same variable across cultures.
E.g. anxiety or agression in various countries. Etic account attempts to be "culturally neutral."

15 Emic studies Focus on only one culture and do not attempt to compare across cultures. E.g. how anxiety before and after exam changes in Polish students.

16 When adaptation is required?
In some tests people differ within the same culture (e.g. men and women). Adaptation - when populations differ: In culture Country Language

17 Types of adaptation Test translation – simple translation from one language to another. E.g. tests with very general phrases like anxiety: I feel tense. I feel anxious. I feel upset.

18 Types of adaptation Test reconstruction – construction of a new test but with the same procedure as used in original test. E.g., Information subtest from WAIS-R In Polish: question from history about former presidents. How it could be adapted in other culture?

19 Steps for adapting a measure
1. Translate and adapt the measure Can the measure be translated question by question? Does it have to adapted only in concept? E.g., excitment seeking: I love to drive car fast. I like to spent Friday night dancing in a club.

20 Translation process Forward translation - the original test is translated into the target language by bilinguals. Back-translation - the test is translated into the target language and then it is re-translated back to the source language. This process can be repeated several times. The final back-translated version is compared to the original version.

21 Steps for adapting a measure
2. Review the translated/adapted version Review the criteria used by the translator Original autrhor can assess the translation 3. Adapt the instrument on the basis of reviewers comments.

22 Steps for adapting a measure
4. Pilot test 5. Field test the isntrument – on a target population. Information on reliability, structure. 6. Standarize test score – to use in diagnosis

23 Steps for adapting a measure
7. Perform validation research to show: That test measures the same qualities in both cultures That new version can provide scores interpratable in the original theory.

24 Types of tests equivalence
Linguistic - actual translation. Measurement invariance: the psychometric properties and indicates.

25 Measurement invariance
Configural - the items measure the same construct across groups, the meaning is the same Metric – the structure is the same, factors loading are identical across groups

26 Measurement invariance
Scalar - starting values, i.e. intercepts, are the same across groups, Uniqueness- the groups have the same item residual variances.


Download ppt "Test construction 1. Testing in a cross-cultural context"

Similar presentations


Ads by Google