Presentation is loading. Please wait.

Presentation is loading. Please wait.

College Ranking Metrics Where Does UMKC Fit in the Rankings?

Similar presentations

Presentation on theme: "College Ranking Metrics Where Does UMKC Fit in the Rankings?"— Presentation transcript:

1 College Ranking Metrics Where Does UMKC Fit in the Rankings?

2 Why pay attention to rankings? Although rankings are terribly imprecise, some of the metrics used are important Prospective students pay attention and compare institutions on a number of indicators UMKC can use metrics to benchmark against peer institutions and identify areas for improvement

3 Select National University and College Rankings Undergraduate Education U.S. News & World Report Americas Best Colleges 2009 (The Center for College Affordability and Productivity) Americas Best Colleges 2008 college08-cx_rv_mn_0813intro.html college08-cx_rv_mn_0813intro.html Research Productivity and Graduate Education The Center for Measuring University Performance The Top American Research Universities National Research Council (New rankings due Spring 2009) Assessment of Research-Doctorate Programs (1995)

4 US News and World Report Rankings Schools are categorized by mission derived from Carnegie classification National Universities Offer full range of undergraduate majors, plus masters and Ph.D. programs, and emphasize faculty research 262 institutions, including UMKC Gather data from each college for up to 15 indicators of academic excellence Each factor is assigned a weight that reflects how much it matters Colleges are ranked against their peers based on their composite weighted score

5 US News Tier Structure Top SchoolsInstitutions ranked 1 to 130 Tier 3Institutions ranked 134 to 188 UMKC: Ranked 165 th Tier 4Institutions ranked 197 to 260

6 2009 U.S. News Methodology Measures and Their Weights

7 U.S. News Measures by Cluster Peer Assessment 25% Selectivity SAT/ACT Top 10% Acceptance 15% Faculty Resources Graduation & Retention Class Size Salaries Faculty Student/Faculty Freshman Persistence Graduation Grad Rate Performance 20% 25% Alumni Giving 5% Financial Resources 10%

8 Issues with U.S. News Metrics Peer assessment: reputational only, heaviest weight Graduation/retention rates: insensitive to different populations; reported only for limited subset of students (first-time, full-time freshmen) Faculty resources: class sizes used not necessarily ideal; model biased towards small colleges Student selectivity: ACT/SAT scores at entrance are input variables, not a reflection of institutional performance Financial resources: educational expenditures per student are difficult to compare across institutions Alumni Giving: a proxy for student satisfaction with their alma mater; only counts undergraduate giving over the past two years, and only counts former students who received a degree Best for small, homogeneous liberal arts colleges (i.e., Ivy League Universities and Private Liberal Arts Colleges)

9 Where Does UMKC Rank? UM-Kansas City2007 Edition2008 Edition2009 EditionWeightingTierIncrease 1% Overall Rank175th172nd165th 3rd Overall score2723 Peer Assessment Rank 176th158th 3rd Peer assessment score2.5 25.0% Graduation & Retention Rank192nd206th208th 4th Avg. freshman retention rate73%72% 4.0%9 students Six-year graduation rate47%45%43%16.0%7 students Graduation Rate Performance Rank 249th250th5.0%4th Predicted65%63%61% Actual47%45%43% Difference-18% Faculty Resources Rank131st116th90th 1st Classes under 20 students53%56%54%6.0%12 sections Classes of 50 or more students7% 6%2.0%11 sections Student/faculty ratio11/113/19/11.0% Faculty who are full-time82%83%84%1.0%27 positions Full-time faculty with terminal degree83%84%3.0%10 Faculty Faculty Salaries7.0% Selectivity Rank106th98th99th 1st ACT 25 th -75 th percentile21-2720-2721-287.5% Freshman in top 10% of HS class30%34% 6.0%8 students Acceptance rate75%71%60%1.5%34 students Financial Resources Rank131st132nd137th10.0%3rd Alumni Giving Rank229th233rd223rd 4th Avg. alumni giving rate5% 6%5.0%435 alumni

10 UMKCs Operational Peers GeorgeUniv. of Virginia UMKCMason Univ.UABLouisvilleSouth FloridaComm. Univ. Overall Rank165th149th145th170th Peer Assessment Score2. Graduation & Retention Rank208th151st230th223rd185th197th Avg. freshman persistence rate72%85%76%77%81% Six-year graduation rate43%59%38%44%49%47% Graduation rate performance Predicted61%56%53%56%52% Actual43%59%38%44%49%47% Difference-18%3%-15%-12%-3%-5% Faculty Resources Rank90th203rd115th211th234th143rd Classes under 20 students54%34%38%25%29%44% Classes of 50 or more students6%13% 14%11% Student/faculty ratio9/115/117/118/119/118/1 Faculty who are full-time84%78%97%84%97%84% Full-time faculty with terminal degree84%91%86%89%80% Selectivity Rank99th179th111th122nd133rd209th ACT 25 th -75 th percentile21-281020-121021-27 1010-1210960-1170 Freshmen in top 10% of HS class34%18%30%24%27%15% Acceptance rate60%56%77%70%50%62% Financial Resources Rank137th197th22nd72nd169th158th Alumni Giving Rank223rd190th148th118th148th182nd Avg. alumni giving rate6%8%11%13%11%9%

11 UMKCs Aspirational Peers Univ. ofSUNY atTempleUniv. of UMKCPittsburghBuffaloUniversityIllinois-ChicagoCincinnati Overall Rank165th58th121st134th 149th Peer Assessment Score2. Graduation & Retention Rank208th74th125th135th188th181st Avg. freshman persistence rate72%90%87%85%78%80% Six-year graduation rate43%75%63%59%52%50% Graduation rate performance Predicted61%67%59%51%58%51% Actual43%75%63%59%50%52% Difference-18%8%4%8%-8%1% Faculty Resources Rank90th107th149th178th217th186th Classes under 20 students54%43%35%42%37%47% Classes of 50 or more students6%15%22%5%19%8% Student/faculty ratio9/116/1 17/116/114/1 Faculty who are full-time84%92%85%73%91%99% Full-time faculty with terminal degree84%92%97%70%78%61% Selectivity Rank99th67th128th173rd118th128th ACT 25 th -75 th percentile21-281150-13401040-1260980-118021-2621-27 Freshmen in top 10% of HS class34%48%24%19%23%20% Acceptance rate60%56%52%63%64%75% Financial Resources Rank137th35th105th144th34th79th Alumni Giving Rank223rd95th174th166th214182nd Avg. alumni giving rate6%15%9%10%7%8%

12 UMKCs Peer Institutions (as identified by UM System) Cleveland State University* East Tennessee State University George Mason University Georgia State University* Indiana Univ. - Purdue Univ./Indy* SUNY at Buffalo Temple University* University of Akron University of Alabama - Birmingham* University of Arkansas at Little Rock University of Cincinnati* University of Houston - University Park* University of Illinois – Chicago* University of Louisville University of Memphis* University of Nevada - Las Vegas University of Pittsburgh* University of South Alabama University of South Florida University of Toledo* University of Wisconsin - Milwaukee* Virginia Commonwealth University* Wayne State University* Wright State University * Members of the Urban 21

13 Where Can Improvement be Made? Measures driven by single year data Peer Assessment SAT/ACT Scores Top 10% Freshmen Class Size Full-time Faculty Faculty with Terminal Degrees Acceptance Rate Student/Faculty Ratio Graduation Rate Performance Measures driven by multiple-year data Expenditures per Student (2 yr avg.) Faculty Compensation (2 yr avg.) Alumni Giving (2 yr avg.) Freshman Persistence (4 yr avg.) Graduation Rate (4 yr avg.)

14 Rating Factors

15 Issues with Ratings 569 schools ranked; every different type of four year institution is ranked together (apples and oranges) as a measure of student learning? Whos Who in America used as a dubious measure of the achievement of graduates (and as a proxy for academic quality) Ranking schools based on accumulated debt – also a proxy for the net worth of the students attending the institution Only one school in the top 50 has an enrollment over 10,000 (average N of top 50=2,285) Forbes methodology … reveals a profound bias in favor of wealth and class and against institutions that have distinctive missions – especially those that serve low income students and significant populations of minority students. (Patricia McGuire, Inside Higher Education, August 28, 2008)

16 UMKCs Operational Peers GeorgeUniv. of Virginia WeightingUMKCMason Univ.UABLouisvilleSouth FloridaComm. Univ. Overall Rank 539th382nd354th400th337th433rd Who's Who Rank25.0%188th355th482nd486th372nd436th Who's Who Score0.0043240.0021290.0010360.0010240.0018870.001360 Rate My Professor Rank25.0%352nd368th214th322nd Overall3.6303.7003.8103.7103.7503.730 Ease3.0003.2303.2703.1903.3103.250 RMP Score7.8907.8708.1607.940 Student National Awards Rank8.3%335th222nd143rd317th334th251st Student Awards ScoreNot Reported0.0005300.0010870.0000790.0000370.000345 Faculty National Awards Rank8.3%84th124th151st 141st147th Faculty Awards Score0.0021880.000939Not Reported 0.0005450.000349 Average Student Debt Rank16.7%555th113th175th48th15th239th Average Student Debt29,84312,98214,22211,3029,77015,345 Graduation Rate Rank16.7%538th481st546th549th506th486th Four Year Graduation Rate Predicted28%33%27%26%31%27% Actual16%26%14%13%22%21% Difference-12%-7%-13% -9%-6%

17 UMKCs Aspirational Peers Univ. ofSUNY atTempleUniv. of WeightingUMKCPittsburghBuffaloUniversityIllinois-ChicagoCincinnati Overall Rank 539th298th436th546th547th516th Who's Who Rank25.0%188th273rd194th283rd463rd366th Who's Who Score0.0043240.0029910.0042380.0028160.0012030.002008 Rate My Professor Rank25.0%352nd403rd493rd505th429th503rd Overall3.6303.4893.6213.6003.6303.590 Ease3.0003.0073.2203.1903.1203.150 RMP Score7.8907.4607.6437.6107.7707.620 Student National Awards Rank8.3%335th91st250th258th217th275th Student Awards ScoreNot Reported0.0022870.0003460.0003180.0005630.000232 Faculty National Awards Rank8.3%84th108th151st93rd146th151st Faculty Awards Score0.0021880.001290Not Reported0.001811 Not Reported Average Student Debt Rank16.7%555th166th244th495th436th249th Average Student Debt29,84314,11115,45223,17120,31115,535 Graduation Rate Rank16.7%538th282nd442nd431st531st504th Four Year Graduation Rate Predicted28%42%41%29%32%23% Actual16%46%35%27%20%16% Difference-12%4%-6%-2%-12%-7%

18 The Center for Measuring University Performance Rankings Determines the Top American Research Universities by their rank on nine different measures: Total Research Expenditures Federal Research Expenditures Endowment Assets Annual Giving National Academy Membership National Academy of Sciences, National Academy of Engineering, and Institute of Medicine membership directories Faculty Awards Fulbrights, Guggenheims, National endowment for the Humanities Awards, NSF CAREER Awards, Sloan Fellowships, etc. Doctorates Granted Postdoctoral Appointees SAT/ACT range

19 Issues with The Center Metrics Focused on research productivity and prestige, designed to assess research excellence, not educational excellence, so metrics focused on research productivity of faculty, not educational programs Funded research, especially federally funded research, seen as most prestigious; other types of scholarship and creative activity not as valued Some emphasis on faculty awards compensates for heavy emphasis on funded research Overall rankings reflect numbers of faculty and types of programs – Larger Universities with Medical Schools, Engineering Schools, and Agricultural Schools do best (i.e., large land grant Universities) These rankings not concerned with Universities with other missions (e.g., urban serving institutions)

20 UMKCs Operational Peers GeorgeUniv. of Virginia UMKCMason Univ.UABLouisvilleSouth FloridaComm. Univ. Total Research Rank150th131st26th72nd40th67th Total Research x100030,78042,630318,536128,347259,218146,105 Federal Research Rank149th110th15th76th40th60th Federal Research x100016,96036,475288,43467,104142,58097,322 Endowment Assets Rank115thN/A60th28th66th74th Endowment Assets x1000135,000N/A346,330680,251329,832265,653 Annual Giving Rank104th105th37th52nd70th50th Annual Giving x100023,35823,28375,27761,14246,34765,107 National Academy Members Rank117th72nd42nd72nd 58th National Academy Members028224 Faculty Awards Rank265th50th65th72nd42nd72nd Faculty Awards0865105 Doctorates Granted Rank126th68th79th77th57th54th Doctorates Granted61163143144184197 Post Doctoral Appointees Rank103rd182nd41st60th50th42nd Post Doctoral Appointees410232136179223 SAT or ACT RankN/A128th154th105th99th195th SAT range or ACT21-27490-600; 510-61020-2621-26510-600; 520-610480-590; 470-580

21 UMKCs Aspirational Peers Univ. ofSUNY atTempleUniv. of UMKCPittsburghBuffaloUniversityIllinois-ChicagoCincinnati Total Research Rank150th14th36th100th27th33rd Total Research x100030,780510,943267,27183,062318,279286,036 Federal Research Rank149th7th56th89th28th25th Federal Research x100016,960420,281151,89053,987198,163202,654 Endowment Assets Rank115th9th40th81st102nd18th Endowment Assets x1000135,0001,802,859499,632204,178162,7981,101,100 Annual Giving Rank104th21st96th74th73rd41st Annual Giving x100023,358116,55128,46241,88343,78070,706 National Academy Members Rank117th23rd72nd117th58th53rd National Academy Members0252046 Faculty Awards Rank265th13th42nd87th30th Faculty Awards02310412 Doctorates Granted Rank126th18th31st24th37th45th Doctorates Granted61412353383311264 Post Doctoral Appointees Rank103rd6th24th84th39th30th Post Doctoral Appointees4172232875235276 SAT or ACT RankN/A24th273rd138th154th SAT range or ACT21-27560-660; 580-670520-610; 550-640490-590; 500-60020-26

22 UM System Accountability Metrics UM System metrics found within various rankings: US News Rankings Freshmen persistence Rate six-year graduation rate Percent of tenured and tenure track faculty with terminal degrees Number of entering students in the top 10% of high school graduation class Ranked faculty salaries compared to peers and market Faculty and staff benefits compared to peers and market Freshman applicant acceptance rate Educational expenditures per FTE student Alumni giving percent Rankings Number of student awards Number of faculty awards Average undergraduate debt burden upon graduation Four-year graduation rate The Center Rankings Total externally sponsored research expenditures Total federally funded federal research expenditures Annual fundraising Number of faculty awards, fellowships and memberships Total degrees awarded by level (including doctorate)

Download ppt "College Ranking Metrics Where Does UMKC Fit in the Rankings?"

Similar presentations

Ads by Google