Week 3 Class Discussion

Confidence Intervals Pull out the psychometric summary data from the sample report. Discuss the relationship between the reported standard scores and the confidence intervals. What relationship does a smaller confidence interval have to test error? What relationship does test error have to reliability?

What is Reliability? Reliability refers to the degree to which test scores are dependable, consistent, and stable upon additional testings. Multiple factors can impact reliability.

Level of Acceptable Reliability The level of acceptable reliability depends on: the construct being measured the way the test scores will be used the method used for estimating reliability

Validity: Definitions Validity: the claims and decisions made on the basis of assessment results are sound, meaningful, and useful for the intended purpose of the results. Validity: adequacy and appropriateness of the uses of assessment results. Construct: scientifically developed concepts, ideas, or hypotheses that are used to describe or explain behavior

Sources of Validity Evidence Description Procedures for Assessing Validity Content Evidence based on the representativeness of test content (test items) and response processes to the content domain Table of specifications Expert judges Analysis of response processes Criterion-Related Evidence based on the relationship between test scores and external variables Correlation b/w test scores & other scores on similar test. Correlation b/w test scores & some other data about same concept. Construct Evidence based on the appropriateness of inferences drawn from test scores as they relate to a particular construct Evidence of homogeneity Convergent and discriminant validity evidence Group differentiation studies Factor analysis

Test Selection Examine the following advertisements from test publishers. What information is useful in determining the selection of the test? What additional information would you need to know? Where might you locate that information?

Evaluate a Test: WRAT-4 Evaluate the following Reliability Validity What did they use to evaluate this? Rate the reliability information for this test. What does that mean in real words? Validity Rate the validity information for this test.

Career Assessment You have a private practice: When might you use a career assessment for a client? What type might you want to use and why? Base the type you might use on the clients you expect to see. When might you use a career assessment for your business?

Project Discussion Discuss what is expected of the first project. Discuss how the first project will be graded. Distribute materials needed to complete the first project. Question and Answer?