Common Triggers for Progress Reports and Possible Solutions Bob DeLorme, EdS, RRT-NPS

Conflict of Interest I have no real or perceived conflict of interest that relates to this presentation. Any use of brand names is not in any way meant to be an endorsement of a specific product, but to merely illustrate a point of emphasis.

Objectives The presenter will: describe CoARC standardized progress reports, list deficiencies in program outcomes that commonly require a progress report, describe successful strategies for submitting an acceptable progress report.

CoARC Standard 3.13 Outcome assessment thresholds are established by CoARC and are related to expectations for graduate success. The program must, at a minimum, meet the assessment thresholds established by CoARC for the following program outcomes, regardless of location and instructional methodology used: a) Graduate performance on the national credentialing examination for entry into practice; b) Programmatic retention/attrition; c) Graduate satisfaction with program; d) Employer satisfaction with program; and e) Job placement (Standard 3.13).

CoARC Standard 3.13 a) Graduate performance on the national credentialing examination for entry into practice i.e. credentialing success; b) Programmatic retention/attrition; c) Graduate satisfaction with program; d) Employer satisfaction with program; and e) Job placement

CoARC Outcomes Thresholds This Should Not Be A Battle

Outcome Thresholds CRT Credentialing Success Based on Participation AND pass rates NBRC passing score (set by NBRC) 80% of total number of graduates obtaining NBRC CRT credential (3-year average)

Outcome Thresholds Retention\Attrition 40% attrition of the total number of students in the enrollment year (3-year average). 3 yr. avg. can not exceed 40%

Outcome Thresholds Positive (Job) Placement 70% positive placement (3-year average)

Outcome Thresholds Positive (Job) Placement Defined as a graduate within the three-year reporting period who is: a. Employed utilizing skills as defined by the scope of practice within the respiratory care profession. (i.e. full- or part-time, or per diem), or b. enrolled full- or part-time in another degree program, or c. serving in the military.

Outcome Thresholds Graduate Survey – Overall Satisfaction At least 80% of EMPLOYED graduate surveys rating overall satisfaction 3 or higher on a 5-point Likert scale. Also at least 50% of the EMPLOYED graduates have returned surveys (3-year average) The calculation is as follows: # surveys with scores greater than 3 # surveys returned - # surveys (questions) omitted

Outcome Thresholds Employer Survey – Overall Satisfaction At least 80% of returned employer surveys rating overall satisfaction 3 or higher on a 5- point Likert scale. The calculation is as follows: # surveys with scores greater than 3 # surveys returned - # surveys (questions) omitted

Outcome Thresholds Employer Survey – Participation 50% of the Employers have returned surveys (3-year average) The total number of employers of program graduates who return their employer survey. (3-year average)

Outcome Thresholds Graduate and Employer Surveys – Overall Satisfaction* *The Commission on Accreditation for Respiratory Care (CoARC) began collecting overall graduate satisfaction (OGS) and overall employer satisfaction (OES) survey data in the 2010 reporting year. Originally, the CoARC stated that no accreditation actions on overall graduate and employer satisfaction outcomes would take place until the 2013 reporting year. However, because the calculations of OGS and OES were reported incorrectly the CoARC will not take accreditation action on graduate and employer satisfaction outcomes until the submission of the 2015 annual report of current status (RCS).

Outcome Thresholds On-Time Graduation Rate Beginning with the Annual Report that was due July 1, 2011 all programs were required to report their on- time graduation rate. On time means within 30 day of expected graduation date with their original cohort. On-Time Graduation Rate is defined as the Total Number of On-time Graduates divided by the Total Number of Graduates.

Outcome Thresholds On-Time Graduation Rate 70% This is effective with the submission of the 2015 Annual Report of Current Status

Outcome Thresholds

Below CRT Threshold – What Happens? At the Nov meeting, CoARC looked at the data from 2010, 2011, and 2012 (i.e., 3 yr. Avg.). The 2013 RCS reported the data from January 1, 2010 through December 31, If first-time below threshold of 80% pass rate, a Standardize Progress Report (SPR) is required using the CoARC Standardized Progress Report. Report due 9/20/14 for 11/14 CoARC meeting.

At the 11/14 meeting, CoARC will now look at data from 2011, 2012, and 2013 plus review the Standardize Progress Report form; The program will now be using the data from 2011, 2012, and 2013 in its SPR report (July 2014 RCS); If still below threshold, a Progress Report Update (PRU) will be issued at the Nov 2014 meeting due 9/2015. Below CRT Threshold – What Happens?

Please make sure you use the correct forms for the Standardize Progress Report and the Progress Report Update. They are different forms requiring different info. Forms can be found at the CoARC’s web site. PR Update Due 9/20/2015 for the November 2015 Commission meeting. Below CRT Threshold – What Happens?

If You Feel Like This You Are Not Alone!

Below CRT Threshold – What Happens? The Nov 2015 Commission meeting will review the Progress Report Update along with the RCS from July 2015 (3-yr. avg. from 2012, 2013, and 2014). If still below threshold, during the November 2015 meeting CoARC will vote to place the program on Probation. A Probation Letter will be sent to the program and college administration.

Outcome Thresholds If Program is Placed on Probation: Program Required Response (Evidence for Compliance with Standard): Submit the Progress Report Update Form for achieving the CRT Credentialing Success threshold (see Submit an updated NBRC Annual School Summary Report (available at Submit the Programmatic Teach-Out

Outcome Thresholds If Program is Placed on Probation: If in the Nov meeting, the program is still not meeting Threshold for CRT Success, CoARC will vote to withhold or withdraw accreditation. Timeline would actually be four 3-year averages: , , and This is 6 consecutive years of data. A program may remain on probation for no longer than one year without demonstrable and remarkable extenuating circumstances, in which case probation may be extended for an additional year.

Outcome Thresholds CRT is a 3 yr. cycle, The following are 4 year cycles: Programmatic retention/attrition Graduate satisfaction Employer satisfaction Positive Job placement On-Time Graduation rates

Outcome Thresholds With the exception of CRT outcomes, all other thresholds use a 4 reporting-year cycle that would require: 1 Standardized Progress Report (1st year) 2 Progress Report Updates (2 & 3 rd years) 1 Probation Period requiring documentation (4 th year – may be extended an additional year).

Outcome Thresholds What are the Major Problem Areas? Credentialing Success, i.e. CRT pass rates and participation Attrition Positive Job Placement

Outcome Thresholds What are the Potential Causes? Is it a resource issue? Is there insufficient personnel, facilities, clinical sites, or equipment to meet programmatic goals? Is it a curricular issue? Are graduates adequately prepared to enter the profession? Is it an admissions issue? Are students really prepared to enter the program? Is it a retention/persistence issue? What factors are impeding the student’s ability to remain in the program?

Outcome Thresholds What are the Major Problem Areas? Credentialing Success i.e. CRT pass rates programs below 80% threshold 2012 – 32 programs below threshold 2013 – 41 programs below threshold Is it a participation problem, pass-rate problem, or both???

Outcome Thresholds Ways to Improve CRT Success? Add computerized instructional packages for review. Computerized practice exams. Multiple proprietary programs. Proprietary review courses SAEs and Secure exams Addition of a comprehensive exam at the end of the program..

Outcome Thresholds Attrition Attrition Threshold: 2011 – 13 programs exceeded 40% Threshold 2012 – 8 programs exceeded 40% Threshold 2013 – 14 programs exceeded 40% Threshold

Outcome Thresholds Ways to Improve Attrition Review acceptance criteria. Prerequisites requirement. GPA requirement Interviews or possibly a shadowing experience Add tutorials – have designated adjunct faculty who can work with students Computerized aided instructional packages Utilize College wide process for student who are having academic troubles.

Outcome Thresholds Job Placement? 2011 – 21 programs fell below the 70% threshold – 24 programs fell below the 70% threshold – 41 programs fell below the 70% threshold.

Outcome Thresholds How to Solve Job Placement? Is low placement due to low credentialing success? When are you surveying? Too soon? Are you counting PRN employees or graduates who go right into another program or degree? Are you offering placement services? Decrease class size.

Outcome Thresholds

QUESTIONS AND ANSWERS