GSOE Impact Workshop Impact and the REF 19 th May 2010 Lesley Dinsdale.

Slides:

Advertisements

Similar presentations

On-going review process for the HR Excellence in Research Award Ellen Pearce.

Advertisements

RAE 2008: Goldsmiths Outcomes. Sample Quality Profile.

1 The Research Environment Post 2008 Some Possibilities Professor Peter Gilroy.

Implications for strategy Iain Richardson School of Engineering and the Built Environment

Overview of the Research Assessment Exercise Iain Richardson School of Engineering and the Built Environment

MSc Dissertation Writing

Working with the Research Excellence Framework Dr Ian Carter Director of Research and Enterprise Sussex Research Hive Seminars 10 March 2011.

Research Excellence Framework Jane Boggan Planning Division Research Staff Forum - January 2010.

Main Panel A: Subpanels and Chairs A1: Clinical Medicine - Christopher Day, Newcastle University A2: Public Health, Health services and Primary Care -

The REF – panels and UOAs British Academy, 27 Oct 2009 Graeme Rosenberg REF Manager.

Impact workshop Phil Hannaford VP Research and Knowledge Exchange.

REF2014 Pauline Muya Jo Lakey.

SAI Performance Measurement Framework

The Research Excellence Framework RIOJA meeting 7 July 2008 Graeme Rosenberg REF Pilot Manager.

The REF impact pilot findings Chris Taylor, Deputy REF manager.

Research Excellence Framework and equalities Belfast 29 November 2011 Ellen Pugh Senior Policy Adviser, ECU.

REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences.

Long live the REF!.  The RAE looks at three main areas: ◦ Outputs ◦ Environment ◦ Esteem  We are used evaluations of Environment and Esteem being “informed”

Special Meeting on ICT Education in Tertiary Institutions Towards a Regional Perspective on Quality and Academic Standards in ICT Education and Training.

Guidance on submissions Chris Taylor, Deputy REF Manager Graeme Rosenberg, REF Manager.

Communicating the outcomes of the 2008 Research Assessment Exercise A presentation to press officers in universities and colleges. Philip Walker, HEFCE.

The Research Assessment Exercise in the United Kingdom Paul Hubbard International colloquium “Ranking and Research Assessment in Higher Education” 13 December.

Research at York Presentation to Council Alastair Fitter Pro-Vice-Chancellor, Research.

RQF Trials and the Newcastle Experience Barney Glover.

What does ‘being returned’ to the REF mean?

The Research Excellence Framework Panel criteria [Main Panel Chair] Graeme Rosenberg.

Achieving and Demonstrating Research Impact John Scott.

REF2014 – results and the way forward SSHP Meeting 12 March 2015.

Demonstrating research impact in the REF Graeme Rosenberg REF Manager

The Research Excellence Framework. Purpose of REF The REF replaces the RAE as the UK-wide framework for assessing research in all disciplines. Its purpose.

The Research Excellence Framework. Presentation outline The REF assessment framework and guidance on submissions: - Overview - Staff - Outputs - Impact.

Consultation on panel criteria and working methods.

REF Information Session August Research Excellence Framework (REF)

The UK Experience of Quality Assurance in Research and Doctoral Education Dr Robin Humphrey Director of Research Postgraduate Training Faculty of Humanities.

Research Quality Assessment following the RAE David Sweeney Director, Research, Innovation, Skills.

The REF assessment framework and guidance on submissions Linda Tiller, HEFCW 16 September 2011.

Introduction to the Research Excellence Framework.

Research Assessment Exercise RAE Dr Gary Beauchamp Director of Research School of Education.

Page 1 RESEARCH EXCELLENCE FRAMEWORK : RESEARCH IMPACT ASESSMENT LESSONS FROM THE PILOT EXERCISE Professor John Marshall Director Academic Research Development.

The Research Excellence Framework Expert Advisory Groups round 1 meetings February 2009 Paul Hubbard Head of Research Policy.

Chair: Professor Dame Ann Dowling Sub-panel Chairs: Panel Advisers: SP07: Professor David Price Dr Karen Ness SP08: Professor Richard Catlow Ms Lesley.

The Research Excellence Framework: principles and practicalities Stephen Pinfield Thanks to Paul Hubbard and Graeme Rosenberg of HEFCE for providing much.

The Research Excellence Framework Impact: the need for evidence Professor Caroline Strange 22 June 2011.

THE IMPACT OF RAE ON SERIAL PUBLICATION Professor Judith Elkin UK Serials Group March 2004.

12/9/10 Pilot assessment impact- paperwork Findings of the expert panels- report + appendix Lessons learned- feedback from pilot institutions Examples.

The REF assessment framework (updated 23 May 2011)

1 Research Context and the RAE John Saunders Head of School, Aston Business School IDEAS Factory 23/24 October 2006.

Delivering Strength Across the Piece David Sweeney Director, Research, Education and Knowledge Exchange HEPI, Royal Society 31 March 2015.

20 September 2007© University of Reading SRC Report – July 2007 Individual Research Plans Systems Engineering Presentation for Academic Staff Prof.

Main Panel A Criteria and Working Methods Cardiff School of Biosciences Ole H Petersen Chair.

What is impact? What is the difference between impact and public engagement? Impact Officers, R&IS.

Research Excellence Framework 2014 Michelle Double Hyacinth Gale Sita Popat Edward Spiers Research and Innovation Support Conference.

REF IMPACT PILOT : BACKGROUND BRIEFING This presentation has been compiled by the NCCPE to distil the key background information about the REF impact pilot.

Impact and the REF Consortium of Institutes of Advanced Study 19 October 2009 David Sweeney Director (Research, Innovation and Skills)

Beyond the Repository: Research Systems, REF & New Opportunities William J Nixon Digital Library Development Manager.

Towards REF 2020 What we know and think we know about the next Research Excellence Framework Dr. Tim Brooks, Research Policy & REF Manager, RDCS Anglia.

A Practical Guide to Evidencing Impact

Impact and the REF Tweet #rfringe17

REF 2021 Briefing 25 January 2018.

Law Sub-panel Generic Feedback - Impact

REF 2021 Briefing Consultation on the draft guidance

Professor Nick Plant Dean of Research Quality and Impact January 2018

Research Update GERI May 2010.

Research Excellence Framework: Past and Future

Towards Excellence in Research: Achievements and Visions of

Research Support Conference, 21 June 2011

REF and research funding update

Understanding Impact Stephanie Seavers, Impact Manager.

REF 2021 EQUALITY TRAINING Professors Simonetta Manfredi Lucy Vickers.

Presentation transcript:

GSOE Impact Workshop Impact and the REF 19 th May 2010 Lesley Dinsdale

Key features of the REF Hefce announcement on initial decisions 25 th March 2010: Essentially a similar overall exercise as the RAE: Peer review is fundamental Institutional selection of staff and best four outputs to continue Institutional submission policies Codes of Practice: selection criteria, allowances for individual circumstances But assessment of esteem has been replaced by assessment of the impact of research

REF Structure of submissions OutputsEnvironment Impact Element: Assessed by: Expert review, possibly informed by bibliometrics in some sub panels RA5 type narrative Supported by indicators: income, students Narrative, case study approach giving exemplars Supported by indicators Profile against criteria: originality, significance, rigour Reported as: Profile. Criteria relating to outputs and impact Profile against criteria: reach and significance Individual, of staff submitted The UOA Weightings %?60/70?15/20?10/20?

Assessment of Impact: Proposals Assessed at the unit level, not individual Definition of impact for REF is wide but does not include academic impact Majority of assessment by case studies (1 per 10 FTE?) Supported by overarching impact statement

Assessment of Impact: Proposals Criteria: Impact occurred during survey period (Jan 2008 – survey date) Must relate to underpinning research (from date?) of a sufficient standard of rigour and originality Research may be a specific piece or a body of work Contribution by the institution to both the underpinning research and impact Impacts must be evidenced, including indicators where appropriate: potentially auditable Assessment criteria: reach and significance (breadth and depth)

Impact: Hefce pilot To test Hefce proposals for methodology – submissions and assessment criteria 29 universities, 5 UOAs including Social Policy and Social Work (UOA40) Mock impact submissions – case studies and impact statement, March 2010 Pilot assessment panels – 50/50 academic/users of research. Govt Chief Social Scientist Chair of UOA40 Panels to provide detailed report in Autumn 2010

Impact: UOB pilot experience and issues High (but not universal) buy-in from academic participants Submissions led by UOA Academic Coordinators with a small team – their detailed local knowledge and energy/enthusiasm was vital Identification of case studies (12 submitted in total) was local – no systematic corporate sources

Impact: UOB pilot experience and issues Evidencing impact: Can we demonstrate that peoples lives have been changed in some way? Some of the Hefce proposed indicators of impact are activities rather than impacts......new concept of intermediate impact Hefce do not intend to make this an impossible exercise!

Impact: UOB pilot experience and issues Many highly subject-specific issues : Particularly in the social sciences, there is not a linear progression from research to impact Govt commissioned work sometimes not published in a peer reviewed form? What about high-quality research findings that are rejected by policy makers for political reasons? What about negative research findings?