1. knowledge Dietary Managers Association 1 PART II - DMA Certification Exam Blueprint and Exam Development-

2. knowledge Dietary Managers Association 2 What Groups Are Involved in the Exam Development? Certifying Board for Dietary Managers (CBDM) Certifying Board Committees –Item Writers Committee –Standards Committee Certified Dietary Managers (CDMs) ACT (American College Testing)

3. knowledge Dietary Managers Association 3 I.EXAM BLUEPRINT: A. How is it Developed? Job Analysis - ACT coordinates survey with CDMs Major Job Tasks Identified – Certified Dietary Managers Exam percentages determined – Certifying Board Validation survey of job tasks and percentages – ACT coordinates survey with Certified Dietary Managers

4. knowledge Dietary Managers Association 4 B. How Often is Exam Updated? Last Validation survey was December, 2003 379 CDMs participated Exam Blueprint is updated/validated every 5 years

5. knowledge Dietary Managers Association 5 C. How is Exam Blueprint Used? Detailed outline of the exam content Determines the program outcomes and course competencies for the DMA curriculum Detailed outline for textbook Printed in the study guide Detailed outline for the study guide

6. knowledge Dietary Managers Association 6 II. Certification Exam A. How is it designed? There are 10 content areas: –Gather Nutrition Data –Apply Nutrition Data –Provide Foodservice –Provide Nutrition Education –Hire and Supervise –Develop Personnel and Communications –Coordinate Professional Interaction –Manage Supplies, equipment use, sanitation, and safety –Manage Production –Manage Business Operations

7. knowledge Dietary Managers Association 7 II. Certification Exam A. How is it designed? Each content area has an assigned percentage, based on the Job Analysis Survey The assigned percentage indicates the approximate number of questions on the exam, out of a total of 175 questions, associated with that content area.

8. knowledge Dietary Managers Association 8 II. Exam A. How is it designed?-Example Provide Foodservices 10%( Exam Blueprint Section III) –Means approximately 17 questions (10% of 175) will be on the exam that address this content area and the following sub topics: Check Meal Service for Food Quality, Portion Size, and Diet Accuracy Manage the Preparation and Service of Special Nourishments and Supplemental Feedings Develop CQI Procedures for Department Evaluate Food Acceptance Survey Utilize Appropriate Resources to Modify Standards Menus to Suit Patients Needs

9. knowledge Dietary Managers Association 9 II. Exam A. How is it designed? Examinees answer 200 questions of which 175 are scored Every exam includes 25 questions that are being pre-tested for reliability and validity These questions are not included in the exam score.

10. knowledge Dietary Managers Association 10 II. Certification Exam A. How is it designed? The content areas, exam percentages & approximate # of questions: –Gather Nutrition Data - 8.5 % or 15 questions –Apply Nutrition Data – 8.5% or 15 questions –Provide Foodservice – 10% or 17 questions –Provide Nutrition Education – 6.5% or 11 questions –Hire and Supervise – 9.0% or 16 questions –Develop Personnel and Communications – 8.3% or –Coordinate Professional Interaction –Manage Supplies, equipment use, sanitation, and safety –Manage Production –Manage Business Operations

11. knowledge Dietary Managers Association 11 II. Certification Exam B. How is content developed? CBDM Item Writers Committee –2-day training from ACT in Iowa City ACT assigns areas needing questions from the exam blueprint Item Writers submit questions to ACT Proofed by ACT staff

12. knowledge Dietary Managers Association 12 II. Certification Exam B. How is content developed? Sample criteria for a well-written question: –Single question –Four plausible, mutually exclusive options –Free from jargon, slang, non-standard abbreviations –Does not require a value judgment or arbitrary decision –Concerns a topic that is significant

13. knowledge Dietary Managers Association 13 II. Certification Exam B. How is content developed? CBDM Standards Committee reviews for: –Critical to practice –Accuracy, currency –Entry level ACT tests all new questions for reliability and validity Only questions with good statistics go into the exam bank

14. knowledge Dietary Managers Association 14 II. Certification Exam B. How is content developed? What is a good question? –Valid – question measures what CDMs need to know –Difficulty – each question has a difficulty rating; questions that are too difficult or too easy do not adequately test examinees knowledge or skill

15. knowledge Dietary Managers Association 15 II. Certification Exam C. How is test assembled ACTs computer randomly pulls questions from the CBDM test bank Questions are pulled from bank according to the assigned percentages on the exam blueprint –Gather Nutrition Data is 8.5%, so there will be approximately 15 questions on the Certification exam devoted to this section

16. knowledge Dietary Managers Association 16 II. Certification Exam D. How is Passing Score Determined? Criterion Referenced –Experts (CBDM members who are educators or practicing CDMs) develop a criterion referenced standard Ie. They determine what constitutes effective practice

17. knowledge Dietary Managers Association 17 II. Certification Exam D. How is Passing Score Determined? Criterion-Referenced Procedures –Most commonly used is Angoff –Each expert examines every test item –Estimates how many examinees will respond correctly (examinees whose level of knowledge is acceptable for entry-level practice) –When estimate for all items are summed and averaged, the results is the suggested standard for passing the test.

18. knowledge Dietary Managers Association 18 II. Certification Exam D. How is Passing Score Determined? Angoff Method –When estimate for all items are summed and averaged, the result is the suggested standard for passing the test.

19. knowledge Dietary Managers Association 19 SUMMARY How can you best prepare your students? –Focus on the Exam Blueprint –Share the Exam Blueprint –Have students write their own questions using the Exam Blueprint –Get involved in the Item Writers and Standards Committees

20. knowledge Dietary Managers Association 20 QUESTIONS??