Presentation is loading. Please wait.

Presentation is loading. Please wait.

Chapter 6 Process and Procedures of Testing Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6.

Similar presentations


Presentation on theme: "Chapter 6 Process and Procedures of Testing Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6."— Presentation transcript:

1 Chapter 6 Process and Procedures of Testing Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

2 Decision Theory Model A decision theory model provides a frame of reference in deciding whether to test and how to locate and select a test. 1. Making judgments and decisions (What kinds of judgments or decisions have to be made?) 2. Identifying the type of information needed 3. Identifying available information 4. Strategies to obtain additional information 5. Locating appropriate tests 6. Evaluating and selecting tests Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

3 Locating Tests Buros Mental Measurement Yearbook Buros Mental Measurement Yearbook Test Critiques Test Critiques Publishers catalog Publishers catalog ERIC website ERIC website Journal articles Journal articles Textbooks Textbooks Experts in the field Experts in the field Specimen sets Specimen sets Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

4 Forms of test administration Self-administered Self-administered Group-administered Group-administered Individually-administered Individually-administered Computer-assisted/computer-adaptive Computer-assisted/computer-adaptive Videotape-administered Videotape-administered Audiotape-administered Audiotape-administered Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

5 Components of the Test Manual Rationale and uses of test discussed Rationale and uses of test discussed Studies presented on general and specific uses Studies presented on general and specific uses Special qualifications of users stated Special qualifications of users stated Test manual updated and revised when new edition of test was published Test manual updated and revised when new edition of test was published Test administration conditions and modes explained Test administration conditions and modes explained Test interpretation easy to understand Test interpretation easy to understand Norming groups described Norming groups described Validity presented Validity presented Reliability presented Reliability presented Evidence presented on whether construct being measured corresponds to nature of assessment intended Evidence presented on whether construct being measured corresponds to nature of assessment intended Rationale for specific combination of subtests and justification of interpretive relationships among scores included Rationale for specific combination of subtests and justification of interpretive relationships among scores included Gender and relevant racial or ethnic group information presented Gender and relevant racial or ethnic group information presented Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

6 Criteria for selecting a test What is the purpose of the test? What is the purpose of the test? Does the test measure what needs to be assessed? Does the test measure what needs to be assessed? Does the test have validity information? Is the test reliable? Does the test have validity information? Is the test reliable? Does the test provide the necessary information to make a proper interpretation? Does the test provide the necessary information to make a proper interpretation? Does the test provide interpretive feedback for the examinee? Does the test provide interpretive feedback for the examinee? Is the test appropriate for the examinee? Is the test appropriate for the examinee? Is the test free from bias? Is the test free from bias? What level of competency is needed to administer the test? What level of competency is needed to administer the test? Is the test a practical one to select? Is the test a practical one to select? Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

7 Practical Measurement Concepts To be considered in the evaluation of the test: Time of testing Time of testing Cost of testing Cost of testing Format of the test Format of the test Readability Readability Ease of administration Ease of administration Ease of scoring Ease of scoring Use of interpretation Use of interpretation Usefulness of the test manual Usefulness of the test manual Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

8 Test Administration Guidelines and Procedures A test has to be administered under standardized or controlled conditions. A test has to be administered under standardized or controlled conditions. If the examiner does not administer the test as directed, the results may be different from those obtained under standard procedures, and nonstandard results may affect the accuracy of the interpretation. If the examiner does not administer the test as directed, the results may be different from those obtained under standard procedures, and nonstandard results may affect the accuracy of the interpretation. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

9 Major competencies needed by test administrators: Adequate training Adequate training Knowledge of the content being measured Knowledge of the content being measured Knowledge of test construction Knowledge of test construction Awareness of measurement concepts Awareness of measurement concepts Knowledge of good assessment practices Knowledge of good assessment practices Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

10 Standards for Test Administration Proper procedures in administering tests. Proper procedures in administering tests. Carefully follow the standardized procedures for administration and scoring specified by the test publishers. Carefully follow the standardized procedures for administration and scoring specified by the test publishers. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

11 Examiner Knowledge The examiner needs to review the test booklet, test manuals, and answer sheet. The examiner needs to review the test booklet, test manuals, and answer sheet. Be familiar with the content of the test, the type of test items, and the directions for administering the test. Be familiar with the content of the test, the type of test items, and the directions for administering the test. One of the best ways to become familiar with the test is to follow the procedures and actually take the test. One of the best ways to become familiar with the test is to follow the procedures and actually take the test. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

12 Management Details Maintain the security of testing materials before and after the testing. Maintain the security of testing materials before and after the testing. Avoid labeling students based on a single test score. Avoid labeling students based on a single test score. Adhere strictly to the copyright law and under no circumstances photocopy or otherwise reproduce answer forms, test booklets, or other materials. Adhere strictly to the copyright law and under no circumstances photocopy or otherwise reproduce answer forms, test booklets, or other materials. Administer, score, interpret, and use tests exactly as specified in the manual. Administer, score, interpret, and use tests exactly as specified in the manual. Release results only to authorized persons in a form consistent with the accepted principles of test interpretation. Release results only to authorized persons in a form consistent with the accepted principles of test interpretation. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

13 Training Test Administrators When testing a large number of clients or students, the examiner will need help from other individuals such as teachers, administrators, or counselors. When testing a large number of clients or students, the examiner will need help from other individuals such as teachers, administrators, or counselors. The training of these assistants needs to be specific to the test being administered. The training of these assistants needs to be specific to the test being administered. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.


Download ppt "Chapter 6 Process and Procedures of Testing Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6."

Similar presentations


Ads by Google