Board Member Training 2006 Session 1: Continuing Competence Session 2: Impact of Technology Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc Annual ConferenceAlexandria, Virginia Council on Licensure, Enforcement and Regulation Expect the Unexpected: Are We Clearly Prepared?

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia About Us……. Steven K. Bryant, PhD Founder and President, AMP ( ) CEO, Nat’l Board for Respiratory Care ( ) William D. Hogan, ME Vice President, Marketing and Business Products AMP, 1993-Present

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia NBRC and State Regulation Use of Entry Level Exam by States State Licensure Liaison Group National RC Disciplinary Database Mandatory Continuing Competency Program, 2002

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia AMP and Technology Examination Development/Research Real Estate Program National Network of AMP Assessment Centers

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Consistent with……. CLEAR Guidelines, Modules 4 & 6 NOCA/NCCA Standards

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence “Luck is where preparation meets opportunity.”

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence Complete Situational Exercises

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia CLEAR Definition….. Success on licensure exams = Minimally competent at the time of testing

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence….. What about the future after licensure? What are our responsibilities?

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing competency programs… Attempt to address future Various options: Re-examination (same/different) Self-assessment Portfolio review Continuing education Others

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Re-Examination Not professionally/politically OK May not be valid for current job “Makes money” for agencies Extra development expense

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Self-Assessment Difficult to supervise Not secure Who really did it? May not be job-related

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Portfolio Reviews Similar problems to self-assessment References are all good May not be job-related

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Education Readily available Acceptable Lesser of other evils Professional associations love it

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence Continuing education has become the face of continued competence— are they really the same?

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence Probably not!! Validity evidence lacking Exams can measure job performance CE most preferred anyway

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia NOCA/NCCA Standards ….a process that documents or “contributes to” the continued competence of the certified occupation…..

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Respiratory care……. 48 states regulate the profession---all provide for completion of CE to satisfy continuing competency requirements

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia NBRC Mandatory CCP Re-examination Pass higher level exam Complete CE compatible with states

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Difficulties with imposing CCP Post-voluntary credentialing Post-licensure Two different worlds!

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence What Board Members really need to know: CC is difficult to document Most often method used is CE CE Programs offered by many Administrative pitfalls to avoid

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Administrative Pitfalls…… Approval of CE Programs Using what exists Lead time required Verification of completion

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence The controversy continues!!

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Continuing Competence Review Situational Exercises

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Speaker Contact Information Thank You! Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc Nieman Rd. Lenexa, KS sbryant or

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia CLEAR Board Training --Session Two The Impact of Technology on Board Meetings, Examination Development and Administration

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Impact of Technology “Technology is a wonderful thing---- when it works!!”

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Impact of Technology Technology Assisted Meetings Focused Displays Agendas/Background Info Virtual Meetings

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Sample of NBRC Board Book AGENDA Board of Trustees National Board for Respiratory Care, Inc. Saturday, May 6, :00 am – 3:00 pm Merrick I & II The Colonnade Hotel Coral Gables, FL 1.Call to Order/Secretary’s Roll Call 2.Introduction/Welcome of New Board Members and Guests Minutes 3.Approval of Minutes of November 12, 2005 Meeting 4.Officer Reports (optional – except President) a.President b.Vice President c.Secretary d.Treasurer 5.Public Advisor’s Report 6.Executive Committee Report 7.Examination Committee Reports (A single resolution to accept all Examination Committee Reports is requested after all have been presented.) aExamination Committee Chairmen b.Entry Level CRT Examination Committee c.Therapist Written Examination Committee d.Clinical Simulation Examination Committee e.Pulmonary Function Technology Examination Committee f.Neonatal/Pediatric Respiratory Care Examination Committee

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Use of Technology During Meetings Laptops for note taking Power Point and other aids Internet Connections Demonstrations Video Contacts

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Virtual Meetings Phone and computer may be needed Individual review of materials Committee meetings Board meetings

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Sample item

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Steps in Examination Development Job analysis/test specs Item development/test assembly Minimum passing level Validation/pre-testing

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Job Analysis/Role Delineation Survey-based Committee-based Content set by law Transportability

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Test Specifications More Important Job Duties Tasks/KSAs

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Test Development Items linked to tasks/KSAs Series of structured reviews Cueing

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Setting the MPL Angoff, Nedelsky, Others Panel of Experts State vs. National

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Validation/Pre-testing Content Predictive Pre-test Item Stats Not Mentioned in CLEAR Guidelines

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Costs of Testing Test for 1 vs. 10,000 Administration Using CBT

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Job analysis research Test development/items reviews Final test reviews Post-test statistics

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations Computer-based testing simply replaces a test booklet and answer sheet with a computer--- Real Impact of Technology Instant Results/Quick Re-tests Enhanced Security

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Technology and Examinations High-Stakes Testing vs. Web-tests/self assessments

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Some CBT Pitfalls Need Integrated System Reliance on ATG’s False Sense of “Security” Human Intervention Important Proctor Training Examination Storage

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Impact of Technology “Technology is a wonderful thing---- when it works!!”

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Impact of Technology Review Technology-Related Situational Exercises

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Speaker Contact Information Thank You! Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc Nieman Rd. Lenexa, KS sbryant or