1. Week 3
Class Discussion

2. Confidence Intervals
Pull out the psychometric summary data from the sample report.
Discuss the relationship between the reported standard scores and the confidence intervals.
What relationship does a smaller confidence interval have to test error?
What relationship does test error have to reliability?

3. What is Reliability?
Reliability refers to the degree to which test scores are dependable, consistent, and stable upon additional testings.
Multiple factors can impact reliability.

4. Level of Acceptable Reliability
The level of acceptable reliability depends on:
the construct being measured
the way the test scores will be used
the method used for estimating reliability

5. Validity: Definitions
Validity: the claims and decisions made on the basis of assessment results are sound, meaningful, and useful for the intended purpose of the results.
Validity: adequacy and appropriateness of the uses of assessment results.
Construct: scientifically developed concepts, ideas, or hypotheses that are used to describe or explain behavior

6. Sources of Validity Evidence
Description
Procedures for Assessing Validity
Content
Evidence based on the representativeness of test content (test items) and response processes to the content domain
Table of specifications
Expert judges
Analysis of response processes
Criterion-Related
Evidence based on the relationship between test scores and external variables
Correlation b/w test scores & other scores on similar test.
Correlation b/w test scores & some other data about same concept.
Construct
Evidence based on the appropriateness of inferences drawn from test scores as they relate to a particular construct
Evidence of homogeneity
Convergent and discriminant validity evidence
Group differentiation studies
Factor analysis

7. Test Selection
Examine the following advertisements from test publishers.
What information is useful in determining the selection of the test?
What additional information would you need to know?
Where might you locate that information?

8. Evaluate a Test: WRAT-4 Evaluate the following Reliability Validity
What did they use to evaluate this?
Rate the reliability information for this test.
What does that mean in real words?
Validity
Rate the validity information for this test.

9. Career Assessment You have a private practice:
When might you use a career assessment for a client?
What type might you want to use and why?
Base the type you might use on the clients you expect to see.
When might you use a career assessment for your business?

10. Project Discussion Discuss what is expected of the first project.
Discuss how the first project will be graded.
Distribute materials needed to complete the first project.
Question and Answer?