12/9/10 Pilot assessment impact- paperwork Findings of the expert panels- report + appendix Lessons learned- feedback from pilot institutions Examples.

Slides:



Advertisements
Similar presentations
UCET Annual Conference 2011 Shifting Sands and Stable Foundations: Insecurity and Instability in Teacher Education.
Advertisements

GSOE Impact Workshop Impact and the REF 19 th May 2010 Lesley Dinsdale.
Working with the Research Excellence Framework Dr Ian Carter Director of Research and Enterprise Sussex Research Hive Seminars 10 March 2011.
Research Excellence Framework Jane Boggan Planning Division Research Staff Forum - January 2010.
The REF – panels and UOAs British Academy, 27 Oct 2009 Graeme Rosenberg REF Manager.
The REF impact pilot findings Chris Taylor, Deputy REF manager.
Research Excellence Framework and equalities Belfast 29 November 2011 Ellen Pugh Senior Policy Adviser, ECU.
REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences.
Assessment Consultation Karen Mahony Development Officer.
Demonstration of sustained effective leadership in academic practice and academic development Evidence of impact on high quality student learning Draw.
Exercise Swaps Community Emergency Response Team.
LTEU Learning and Teaching Enhancement Unit Efficacy of Turnitin in Support of an Institutional Plagiarism Policy Institution-wide Research at Canterbury.
The Periodic Review Report at the Community College: Opportunities for Collaborative Institutional Renewal Valarie Avalone, Director of Planning Dr. Michael.
Supporting & promoting Equality & Diversity through REF Dianne Berry, Chair REF E&D Advisory Panel Ellen Pugh, Senior Policy Officer ECU.
Guidance on submissions Chris Taylor, Deputy REF Manager Graeme Rosenberg, REF Manager.
Year 1 School Based Training Have experience across all three key stages; Develop an understanding of the multiplicity of roles within the primary school;
The Research Assessment Exercise in the United Kingdom Paul Hubbard International colloquium “Ranking and Research Assessment in Higher Education” 13 December.
Process Mapping Library at the University of Kent Melissa Bradley, Humanities Faculty Administration Manager 5 th January 2012.
Access to HE Diploma Grading and Assessment University of the Arts London.
Achieving and Demonstrating Research Impact John Scott.
Demonstrating research impact in the REF Graeme Rosenberg REF Manager
The Research Excellence Framework. Purpose of REF The REF replaces the RAE as the UK-wide framework for assessing research in all disciplines. Its purpose.
The Research Excellence Framework. Presentation outline The REF assessment framework and guidance on submissions: - Overview - Staff - Outputs - Impact.
Consultation on panel criteria and working methods.
REF Information Session August Research Excellence Framework (REF)
Continuing Accreditation The Higher Learning Commission provides institutional accreditation through the evaluation of the entire university organization.
The revised Common Inspection Framework for further education and skills Charlie Henry HMI Principal Officer Special Educational Needs and Disability Natspec.
The REF assessment framework and guidance on submissions Linda Tiller, HEFCW 16 September 2011.
Introduction to the Research Excellence Framework.
The Research Excellence Framework Briefing event for REF institutional contacts Graeme Rosenberg REF Manager.
The Research Excellence Framework Briefing events for HEI contacts 21 May: Glasgow 23 May: Manchester 24 May: London 28 May: Cardiff 31 May: London.
Research Assessment Exercise RAE Dr Gary Beauchamp Director of Research School of Education.
Basic Workshop For Reviewers NQAAC Recognize the developmental engagements Ensure that they operate smoothly and effectively” Ensure that all team members.
HECSE Quality Indicators for Leadership Preparation.
Page 1 RESEARCH EXCELLENCE FRAMEWORK : RESEARCH IMPACT ASESSMENT LESSONS FROM THE PILOT EXERCISE Professor John Marshall Director Academic Research Development.
REF Impact Pilot Laura Tyler Marketing & New Media Manager University of Glasgow.
Results The final report was presented to NICE and published by NICE and WHO. See
Chair: Professor Dame Ann Dowling Sub-panel Chairs: Panel Advisers: SP07: Professor David Price Dr Karen Ness SP08: Professor Richard Catlow Ms Lesley.
Common Core State Standards Initiative Common Core State Standards Initiative State Board of Education January 28, 2010.
Research Quality Framework Presentation to APSR - ARROW - Repository Market Day 4 May 2007 Sandra Fox Department of Education Science and Training.
Main Panel D Criteria and Working Methods Main Panel D covers: Area Studies Modern Languages and Linguistics English Language and Literature History Classics.
The Research Excellence Framework Impact: the need for evidence Professor Caroline Strange 22 June 2011.
Institutional Effectiveness A set of ongoing and systematic actions, processes, steps and practices that include: Planning Assessment of programs and.
THE IMPACT OF RAE ON SERIAL PUBLICATION Professor Judith Elkin UK Serials Group March 2004.
The REF assessment framework (updated 23 May 2011)
Delivering Strength Across the Piece David Sweeney Director, Research, Education and Knowledge Exchange HEPI, Royal Society 31 March 2015.
Centre for University Teaching OLT Citations Information Session 2015.
Main Panel A Criteria and Working Methods Cardiff School of Biosciences Ole H Petersen Chair.
Workshop For Reviewers Operating the Developmental Engagements Prof. Dr. Hala SalahProf. Dr. Hoda ELTalawy.
What is impact? What is the difference between impact and public engagement? Impact Officers, R&IS.
APPG Equalities 29 th October 2014 Fair Financial Decision-Making: Follow up to the Equality & Human Rights Commission’s S31 assessment of the 2010 Spending.
Research Excellence Framework 2014 Michelle Double Hyacinth Gale Sita Popat Edward Spiers Research and Innovation Support Conference.
Current R& KE Issues David Sweeney
GOVERNING BODY SELF-EVALUATION TOOLKIT
Auditing Sustainable Development Goals
How an Assessment Framework helped revitalize Program Review at JCCC
Business environment in the EU Prepared by Dr. Endre Domonkos (PhD)
Impact and the REF Tweet #rfringe17
REF 2021 Briefing 25 January 2018.
COLLEGE OF ALAMEDA: INTEGRATED PLANNING & BUDGET MODEL
Teaching Excellence Development Fund
Law Sub-panel Generic Feedback - Impact
REF 2021 Briefing Consultation on the draft guidance
UMKC General Education Revision - Background June 7, 2016
One year on: developments since Duxford 2016
REF 2021 & ECRs: policy & planning in an uncertain landscape
Research Update GERI May 2010.
Research Support Conference, 21 June 2011
REF and research funding update
COLLEGE OF ALAMEDA: INTEGRATED PLANNING & BUDGET MODEL
Presentation transcript:

12/9/10 Pilot assessment impact- paperwork Findings of the expert panels- report + appendix Lessons learned- feedback from pilot institutions Examples good case studies Original and revised guidance given to Institutions All on

12/9/10 Main outcomes Case studies good way for assessing impact – across disciplines and using same approach and weighting Case studies varied widely in nature and whether based around individuals or teams Main criteria used – ‘reach’ and ‘significance’- OK Impact statements were less valuable in discriminating good impact- needed to be more strategic

12/9/10 Earth Systems & Environmental Science 4*3*2*1*U UOA average Institution A05000 Institution B50000 Institution C Institution D Institution E Institution F25 0 Institution G Institution H Institution I Institution J

12/9/10 English Language & Literature 4*3*2*1*U UOA profile Institution A Institution B Institution C Institution D Institution E Institution F Institution G Institution H Institution I Institution J Institution K Institution L Institution M

12/9/10 Issues identified with submissions Failure to demonstrate that the impact was based on high quality research (minimum 2*) Failure to provide transparent evidence- i)to link the impact with research, ii) demonstrate that impact had happened Many cases were ‘poorly narrated’ Use of public engagement, special advisory work and policy as examples of impact – all acceptable but link with individual, group or departments OWN research must be clearly illustrated

12/9/10 Users Panel chairs emphasised the vital role of users on panel Most Case studies evaluated by 3-4 panel members (ratio 50:50) users to academics Most users will be recruited in 2013 to take part in assessment in brought in for the Impact assessment Some concern from HEIs re availability of sufficient high quality informed users

12/9/10 Issues with process -future changes Templates need to be altered to put description of research first Examples needed to be given- guidance too abstract Weighting not yet decided – consulting with community. Likely to be 15-20%. Impact statements may go into environment section

12/9/10 Lessons for us Start now- time consuming and involves wide range academics, admin and support staff Impact is based on historical activity – need good institutional memory Will probably be 1 case study per 10 FTEs Need academic champion(s) in each UoA Involvement central administrators essential High level academic committee to over see draft examples and development to final stage

12/9/10 Timescales Main panels start to meet early 2011 March broad framework for Impact Assessment published July guidance on submissions published Autumn panels consulted on criteria January panel criteria and working methods published