Presentation is loading. Please wait.

Presentation is loading. Please wait.

Nicki Horseman Lead HE analyst Times Higher Education.

Published byCorey Parks Modified over 7 years ago

Similar presentations

Presentation on theme: "Nicki Horseman Lead HE analyst Times Higher Education."— Presentation transcript:

1 Nicki Horseman Lead HE analyst Times Higher Education

2 Teaching Excellence Framework and Relative Teaching Performance

3 TEF recap Data available now What might relative teaching performance look like? What next?

4 TEF - Technical consultation for Year Two ‘build on existing high standards’ ‘allow for diverse forms of excellence to be identified and recognised’ ‘clear judgments about excellence for students, employers and other stakeholders’

5 Assessment based on: Context/metrics Data will be averaged over three years; also presented by individual year in total TEF Year Two will use existing NSS / DLHE; will take account of non-respondents in Year Three Additional evidence - 15 pages submitted by institution Student Outcomes Learning Environment Teaching Quality

6 Institutional Metric presentation to the assessment panel

7 So what data is available now (with benchmarks) AspectTEF proposalTHE Teaching QualityNSS Q1-4 Teaching on course; NSS Q5-9 Assessment and feedback NSS Q22 Overall Satisfaction Learning EnvironmentNSS Q10-12 Academic support; Non-continuation (T3) Projected Outcomes (T5) Student Outcomes and Learning Gain Employment (DLHE); potential highly-skilled jobs metric Graduate Destinations (DLHE)

8 Teaching Quality - NSS - Q1 (Staff are good at explaining things) v.s. Q22

9 Q22 Overall satisfaction Q1 Source: HEFCE NSS 2015 Summary Data Taught

10 Teaching Quality - NSS - Q1 (Staff are good at explaining things) v.s. Q22 Q22 Overall satisfaction Q1 Guild HE Source: HEFCE NSS 2015 Summary Data Taught

11 Teaching Quality - NSS - Q1 (Staff are good at explaining things) v.s. Q22 Q22 Overall satisfaction Q1 MillionPlus Guild HE Source: HEFCE NSS 2015 Summary Data Taught

12 Teaching Quality - NSS - Q1 (Staff are good at explaining things) v.s. Q22 Q22 Overall satisfaction Q1 University Alliance MillionPlus Guild HE Source: HEFCE NSS 2015 Summary Data Taught

13 Q22 Overall satisfaction Q1 Russell Group University Alliance MillionPlus Guild HE Teaching Quality - NSS - Q1 (Staff are good at explaining things) v.s. Q22 Source: HEFCE NSS 2015 Summary Data Taught

14 Q22 Overall satisfaction Q1 Russell Group University Alliance MillionPlus Guild HE Loughborough Swansea Teaching Quality - NSS - Q1 (Staff are good at explaining things) v.s. Q22 Source: HEFCE NSS 2015 Summary Data Taught

15 Learning Environment - T3 (continuation after first year) v.s. T5 (projected outcomes) T3 (continuation after first year) T5 (projected outcomes) Source: HESA PIs 2013/14

16 Learning Environment - T3 (continuation after first year) v.s. T5 (projected outcomes) T5 (projected outcomes) Russell Group Source: HESA PIs 2013/14 T3 (continuation after first year)

17 Learning Environment - T3 (continuation after first year) v.s. T5 (projected outcomes) T3 (continuation after first year) T5 (projected outcomes) Russell Group University Alliance Source: HESA PIs 2013/14

18 Learning Environment - T3 (continuation after first year) v.s. T5 (projected outcomes) T3 (continuation after first year) T5 (projected outcomes) Russell Group University Alliance Guild HE Source: HESA PIs 2013/14

19 Learning Environment - T3 (continuation after first year) v.s. T5 (projected outcomes) T3 (continuation after first year) T5 (projected outcomes) Russell Group University Alliance Guild HE MillionPlus Source: HESA PIs 2013/14

20 Learning Environment - T3 (continuation after first year) v.s. T5 (projected outcomes) T3 (continuation after first year) T5 (projected outcomes) Source: HESA PIs 2013/14

21 Learning Environment - T3 (continuation after first year) v.s. T5 (projected outcomes) T3 (continuation after first year) T5 (projected outcomes) Loughborough Swansea Source: HESA PIs 2013/14

22 Student Outcomes - Employment metrics Graduate destinations HESA PI Employment Guild HE Source: HESA PIs 2013/14; DLHE

23 Student Outcomes - Employment metrics Graduate destinations HESA PI Employment MillionPlus Guild HE Source: HESA PIs 2013/14; DLHE

24 Student Outcomes - Employment metrics Graduate destinations HESA PI Employment University Alliance MillionPlus Guild HE Source: HESA PIs 2013/14; DLHE

25 Student Outcomes - Employment metrics Graduate destinations HESA PI Employment Russell Group University Alliance MillionPlus Guild HE Source: HESA PIs 2013/14; DLHE

26 Student Outcomes - Employment metrics Graduate destinations HESA PI Employment Source: HESA PIs 2013/14; DLHE

27 Student Outcomes - Employment metrics Graduate destinations HESA PI Employment 46% 12% Source: HESA PIs 2013/14; DLHE

28 Student Outcomes - Employment metrics Graduate destinations HESA PI Employment 46% 12% ‘take account of … students’ characteristics and the subject they study’ Source: HESA PIs 2013/14; DLHE

29 Benchmarks and significance Benchmarks – given the characteristics of the students recruited to an institution, what is the expected performance based on the performance of the rest of the sector No widening participation or geographic factors Benchmarks involving entry standards – potential issues FactorNSSNon-continuationEmployment Subject  Entry qualifications  Age on entry  Ethnicity  Gender  Disability 

30 Student outcomes relative to benchmark Graduate destinations distance from benchmark HESA PI Employment E1 distance from benchmark Source: HESA PIs 2013/14; DLHE

31 Student outcomes relative to benchmark Graduate destinations distance from benchmark HESA PI Employment E1 distance from benchmark Swansea Loughborough Source: HESA PIs 2013/14; DLHE

32 Who performs well against benchmark? – Learning Environment and Teaching Quality

33

34 Student Outcomes and Teaching Quality

35

36 Significance tests (3 standard deviations) Institutions which are significantly above benchmark assessment in: Three out of three aspects: Loughborough, Swansea Three out of three aspects: Loughborough, Swansea Two out of three aspects (and neutral on 3 rd ): Aston, Coventry, Heriot-Watt, Huddersfield, Lancaster, Nottingham Trent Two out of three aspects (and neutral on 3 rd ): Aston, Coventry, Heriot-Watt, Huddersfield, Lancaster, Nottingham Trent

37 An overall picture How to give an overall picture of teaching excellence as framed by the TEF? Using three indicators as before: Q22 as a proxy for Teaching Quality T5 projected outcomes as a proxy for Learning Environment Graduate destination as a proxy for Student Outcomes and Learning Gain Working at an overall level without breaking down into detailed cohorts - one year’s data Relative teaching performance measures – performance relative to benchmark – to ‘take account of differences in student characteristics and mixture of subjects taught’. Z score each metric to form a common scale, combine with equal weights and scale from 100

38 Absolute Teaching Performance Key: Russell Group, University Alliance, MillionPlus, Guild HE

39 Relative Teaching Performance Key: Russell Group, University Alliance, MillionPlus, Guild HE

40 Relative Teaching Performance (using E1a) Key: Russell Group, University Alliance, MillionPlus, Guild HE

41 Relative Teaching Performance Key: Russell Group, University Alliance, MillionPlus, Guild HE

42 Relative Teaching Performance Outstanding Excellent Meets expectations Swansea Loughborough

43 Market share of non-UK Undergraduates (First Degree; order is relative teaching performance) Outstanding Excellent Meets expectations Source: HESA (THE WUR data)

44 Market share of non-UK Masters (order is relative teaching performance) Outstanding Excellent Meets expectations Source: HESA (THE WUR data)

45 Non-UK Undergraduate market share by region (order is relative teaching performance) Key: London, Midlands, N England, N Ireland, Scotland, S England, Wales Outstanding Excellent Meets expectations Source: HESA (THE WUR data)

46 Non-UK Masters market share by region (order is relative teaching performance) Outstanding Excellent Meets expectations Key: London, Midlands, N England, N Ireland, Scotland, S England, Wales Source: HESA (THE WUR data)

47 REF 2014 with intensity TEF Russell Group Teaching Excellence and REF

48 REF 2014 with intensity TEF Russell Group University Alliance Teaching Excellence and REF

49 REF 2014 with intensity TEF Russell Group University Alliance MillionPlus Teaching Excellence and REF

50 REF 2014 with intensity TEF Russell Group University Alliance MillionPlus Guild HE Teaching Excellence and REF

51 REF 2014 with intensity TEF Russell Group University Alliance MillionPlus Guild HE Teaching Excellence and REF

52 REF 2014 with intensity TEF Loughborough Swansea Kent Bath Surrey Teaching Excellence and REF

53 Summary Teaching Excellence Framework proposes an alternative perspective on quality

54 Summary Teaching Excellence Framework proposes an alternative perspective on quality Highlights diverse institutions

55 Summary Teaching Excellence Framework proposes an alternative perspective on quality Highlights diverse institutions ‘Non- aligned’ Interpretation and communication Midlands Northern England Clarity and transparency of judgements

Download ppt "Nicki Horseman Lead HE analyst Times Higher Education."

Similar presentations

Karl Donert, National Teaching Fellow HERODOT Project coordinator HERODOT: Benchmarking Geography.

Karl Donert, National Teaching Fellow HERODOT Project coordinator HERODOT: Benchmarking Geography.
THE ADMISSIONS POLICY. WHY AN ADMISSIONS POLICY ? To ensure that the University is compliant with the QAA Code of practice: Admissions to Higher Education.

THE ADMISSIONS POLICY. WHY AN ADMISSIONS POLICY ? To ensure that the University is compliant with the QAA Code of practice: Admissions to Higher Education.
How do I know that my work is PhD level? Professor Chris Park Director, The Graduate School.

How do I know that my work is PhD level? Professor Chris Park Director, The Graduate School.
Using data and case studies to inform and change admissions policy and practice Michael Hill Kingston University June 2003.

Using data and case studies to inform and change admissions policy and practice Michael Hill Kingston University June 2003.
Accreditation and its relationship to quality assurance Sarah Butler Assistant Director, Development and Enhancement Group Quality Assurance Agency for.

Accreditation and its relationship to quality assurance Sarah Butler Assistant Director, Development and Enhancement Group Quality Assurance Agency for.
Reflecting on the results of the 2013 National Student Survey Professor Kelvin Everest PVC for Student Experience November 2013.

Reflecting on the results of the 2013 National Student Survey Professor Kelvin Everest PVC for Student Experience November 2013.
Learning & Teaching Conference Embracing Diversity 9 January 2013 Paul White Pro Vice-Chancellor, Learning & Teaching.

Learning & Teaching Conference Embracing Diversity 9 January 2013 Paul White Pro Vice-Chancellor, Learning & Teaching.
Defining ‘Best Practice’ in PGT Dr Janet De Wilde Assistant Director, Head of STEM, HEA 08.05.2014.

Defining ‘Best Practice’ in PGT Dr Janet De Wilde Assistant Director, Head of STEM, HEA
MOOCs and the Quality Code Ian G. Giles PFHEA Medical Education

MOOCs and the Quality Code Ian G. Giles PFHEA Medical Education
ACADEMIC INFRASTRUCTURE Framework for Higher Education Qualifications Subject Benchmark Statements Programme Specifications Code of Practice (for the assurance.

ACADEMIC INFRASTRUCTURE Framework for Higher Education Qualifications Subject Benchmark Statements Programme Specifications Code of Practice (for the assurance.
Planning and Statistics Using the University’s Statistical Digest PLANNING AND STATISTICS V.1 1 The University’s Statistical Digest Information and Training.

Planning and Statistics Using the University’s Statistical Digest PLANNING AND STATISTICS V.1 1 The University’s Statistical Digest Information and Training.
The National Student Survey An introduction for course reps.

The National Student Survey An introduction for course reps.
How is HE differentiated in the UK? Is this changing? David Raffe and Linda Croxford University of Edinburgh Changing Inequalities and Access to a Differentiated.

How is HE differentiated in the UK? Is this changing? David Raffe and Linda Croxford University of Edinburgh Changing Inequalities and Access to a Differentiated.
LEAGUE TABLES AND NEW KPIs VC’s OPEN MEETING Anita Wright Head of Planning November 2013.

LEAGUE TABLES AND NEW KPIs VC’s OPEN MEETING Anita Wright Head of Planning November 2013.
Benchmarks and Benchmarking in the UK - Lessons Learned Catherine Connor Quality Enhancement Unit London Metropolitan University.

Benchmarks and Benchmarking in the UK - Lessons Learned Catherine Connor Quality Enhancement Unit London Metropolitan University.
University Strategy Marcus Williams. Contents 0.1 Strategic goals 0.2 Re-positioning 0.3 Campus infrastructure 0.4 Sussex off campus 0.5 Malaysia Office.

University Strategy Marcus Williams. Contents 0.1 Strategic goals 0.2 Re-positioning 0.3 Campus infrastructure 0.4 Sussex off campus 0.5 Malaysia Office.
Foundation Degrees Foundation Degree Forward Lichfield Centre The Friary Lichfield Staffs WS13 6QG — Tel:01543 301150 Fax:01543 301152 www.fdf.ac.uk —

Foundation Degrees Foundation Degree Forward Lichfield Centre The Friary Lichfield Staffs WS13 6QG — Tel: Fax: —
The REF assessment framework and guidance on submissions Linda Tiller, HEFCW 16 September 2011.

The REF assessment framework and guidance on submissions Linda Tiller, HEFCW 16 September 2011.
Key features of the University of Manchester Professor Cathy Cassell Deputy Director (Academic) Sarah Featherstone Head of Undergraduate Services Original.

Key features of the University of Manchester Professor Cathy Cassell Deputy Director (Academic) Sarah Featherstone Head of Undergraduate Services Original.
Applying to a competitive university. Aims and objectives To understand what a competitive university is Develop an understanding of what the benefits.

Applying to a competitive university. Aims and objectives To understand what a competitive university is Develop an understanding of what the benefits.

Similar presentations

Ads by Google