1. DATA BASED ASSESSMENT OF RESEARCH DOCTORATE PROGRAMS The NEW NRC DATA BASED ASSESSMENT OF RESEARCH DOCTORATE PROGRAMS Not your father’s survey, but the mother of all surveys

2. TAKE HOME POINTS There is no ONE right way to do rankings. UA did fine! Solidly in step with our ABOR peers. Many programs near top. Much more than rankings. Most valuable as a benchmarking tool for improvement and accountability 2

3. nrc.arizona.edu

4. Many ways to develop rankings— NRC did it in FIVE ways. TWO OVERALL ‘QUALITY’ rankings, reported as ranges, with 90% confidence intervals 1.R = regression-based. Small # of raters, hence some are quirky. 2.S = survey-based weights derived from an idealized question about relative importance of variables Not all variables are used in these overall rankings Samples in your packet

5. 5 In your packet if you want further information

6. 6

7. 7

8. Samp Sample of program rankings: Geography 8

9. Plus 3 dimensions (the 20 variables fall into these categories): 3.Research Activity 4.Student Support and Outcomes Sample in your packet 5.Diversity of the Academic Environment 9

10. Example: Student Support & Outcomes 10

11. Related effort on PhDs.org will permit rankings with user determined weights

12. NRC says: “The production of rankings from measures of quantitative data turned out to be more complicated and to have greater uncertainty than originally thought. As a consequence, the illustrative rankings are neither endorsed nor recommended by the National Research Council (NRC) as an authoritative conclusion about the relative quality of doctoral programs... “The reader who seeks a single, authoritative declaration of the ‘best programs’ in given fields will not find it in this report.”

14. DEMO on NRC site I want to study LINGUISTICS (52 programs) In the EAST or WEST (31 programs) I want good probability of FINISHING (11) I need financial support (9) I’d like to study with diverse faculty (5) I care about faculty research, citations I should go to ARIZONA!

15. Communication Plan UA Internal Release External Release Workshops & visits with colleges & departments Groups such as Assessment Council, Faculty Senate, SPBAC