HOW CONCENTRATED IS THE UK RESEARCH BASE? THE DISTRIBUTION OF EXCELLENCE AND DIVERSITY JONATHAN ADAMS 14 OCTOBER 2009.

Slides:



Advertisements
Similar presentations
RAE 2008: Goldsmiths Outcomes. Sample Quality Profile.
Advertisements

DUAL SUPPORT DUEL FOR SUPPORT Professor Sir Gareth Roberts University of Oxford.
June 2006 How good is our research? New approaches to research indicators.
Research funding and assessment: beyond 2008 Professor David Eastwood Vice Chancellor University of East Anglia, Chair 1994 Group, Chief Executive Designate.
Research Funding and Assessment: Beyond 2008 Government funding for Research: what is it for and how should it be distributed? Michael Driscoll Middlesex.
University Alliance Driving forward excellence in research: institutional strategies and approaches Professor Janet Beer, Vice-Chancellor, Oxford Brookes.
Research Funding and Assessment: The Future Professor David Eastwood Vice-Chancellor and Principal.
Working with the Research Excellence Framework Dr Ian Carter Director of Research and Enterprise Sussex Research Hive Seminars 10 March 2011.
Oct 2006 Research Metrics What was proposed … … what might work Jonathan Adams.
THE CASE FOR SMALLER RESEARCH – LED UNIVERSITIES IN THE RESEARCH AND INNOVATION LANDSCAPE Rama Thirunamachandran Deputy Vice-Chancellor and Provost Keele.
Transparency as a means to achieve institutional objectives Jim Port J M Consulting Ltd The big picture Transparency and public funding TRAC as an aid.
The Research Excellence Framework A beginner’s guide.
Paris, May 2007 How good is the research base? New approaches to research indicators Colloque de l’Académie des sciences "Évolution des publications scientifiques"
EPC Congress 2005 Research Funding Paul Hubbard Head of Research Policy, HEFCE.
Audit Commission Hertfordshire Housing Conference Housing Inspectorate Developments in inspection and assessment Roy Irwin Chief Inspector of Housing.
Celebrating our success Dr Jon Hunt, Deputy Director of RDSO.
The Impact of the REF2014 Professor Paul Boyle.
Communicating the outcomes of the 2008 Research Assessment Exercise A presentation to press officers in universities and colleges. Philip Walker, HEFCE.
The Research Assessment Exercise in the United Kingdom Paul Hubbard International colloquium “Ranking and Research Assessment in Higher Education” 13 December.
Research at York Presentation to Council Alastair Fitter Pro-Vice-Chancellor, Research.
EPSRC Collaboration Fund 23 June 2010 Sam Decombel Finance South East.
Strategy to Join the Elite The University of Manchester Experience Jan Wilkinson University Librarian & Director of the John Rylands Library.
What does ‘being returned’ to the REF mean?
Key Elements, Emerging Trends and Promising Practices in Monitoring and Evaluation of Development Results Lawrence S. Cooley, President Management Systems.
The Impact of Business and Management Research The ABS Journal Quality Guide: Version 4 Aidan Kelly, Charles Harvey, Huw Morris, Michael Rowlinson.
UNIVERSITY ACCOUNTABILITY An Ontario and New Zealand Perspective.
REF Information Session August Research Excellence Framework (REF)
About OFFA Our role: To promote and safeguard fair access to higher education for lower income and other under-represented groups following the introduction.
Reflections on the Independent Strategic Review of the Performance-Based Research Fund by Jonathan Adams Presentation to Forum on “ Measuring Research.
The UK Experience of Quality Assurance in Research and Doctoral Education Dr Robin Humphrey Director of Research Postgraduate Training Faculty of Humanities.
Beyond the RAE: New methods to assess research quality July 2008.
Keith Burnley, Executive Director, NWUA Maximising the Opportunities and Benefits of closer collaboration between Business and Higher Education.
Research Quality Assessment following the RAE David Sweeney Director, Research, Innovation, Skills.
Introduction to the Research Excellence Framework.
Research Assessment Exercise RAE Dr Gary Beauchamp Director of Research School of Education.
Guidance notes on the Intevention Logic and on Building a priority axis 27 September 2013.
The Evaluation of Publicly Funded Research Berlin, 26/27 September 2005 Evaluation for a changing research base Paul Hubbard Head of Research Policy, HEFCE,
The Research Excellence Framework Expert Advisory Groups round 1 meetings February 2009 Paul Hubbard Head of Research Policy.
HEFCE Annual Conference Royal Holloway, University of London 1 and 2 April 2009 Tim Melville-Ross Chair.
Widening participation to HE Linking London conference 2 nd July 2012 Victoria Waite Senior Policy Adviser – London and East
The REF assessment framework (updated 23 May 2011)
1 Research Context and the RAE John Saunders Head of School, Aston Business School IDEAS Factory 23/24 October 2006.
Delivering Strength Across the Piece David Sweeney Director, Research, Education and Knowledge Exchange HEPI, Royal Society 31 March 2015.
E u r o p e a n C o m m i s s i o nCommunity Research Global Change and Ecosystems EU environmental research : Part B Policy objectives  Lisbon strategy.
Improving Purchasing of Clinical Services* 21 st October 2005 *connectedthinking 
The Engineering and Physical Sciences Research Council Funding (EPSRC)
UUK update on student number controls Jovan Luzajic Senior policy and data analyst Universities UK.
For Information only From distributor to Intelligent Funder.
Impact and the REF Consortium of Institutes of Advanced Study 19 October 2009 David Sweeney Director (Research, Innovation and Skills)
DNPC05 Consultation Paper Balance of Revenue Recovery between LDZ System Charges and Customer Charges Steve Armstrong 27 th July 2009.
What could the Nordic Countries Learn from the UK? Professor Rebecca Lingwood 8 June 2016 Queen Mary University of London.
Current R& KE Issues David Sweeney
Government Green Paper on Executive Pay and Corporate Governance, November 2016 Jane Williams.
Teaching Excellence Framework Year Two
UGC RAE /9/20.
REF 2021 What we know and thought we knew, in preparation for the next Research Excellence Framework Dr. Tim Brooks, Research Policy & REF Manager, RDCS.
Law Sub-panel Generic Feedback - Impact
Competition for Evaluations & 2016 Conference
International Financing Institutions (IFI) Engagement
Research Excellence Framework: Past and Future
Adam Abdulwahab Evaluation network meeting Brussels, 25 February 2010
RCUK Research Outcomes Project
DUAL SUPPORT DUEL FOR SUPPORT
REF and research funding update
Support Tools for ESF Evaluation
How good is our research? New approaches to research indicators
Research Funding and Assessment: Beyond 2008
How does practice research fit into HEFCE’s future research policy?
Professor David Eastwood
Assessing the Relevance of Global and Regional Partnership Programs (GRPPs) Chris Gerrard Global Programs Coordinator, IEG November 13,
Presentation transcript:

HOW CONCENTRATED IS THE UK RESEARCH BASE? THE DISTRIBUTION OF EXCELLENCE AND DIVERSITY JONATHAN ADAMS 14 OCTOBER 2009

Previously among studies by Evidence HEFCs/UUK – Maintaining Research Excellence –Recognition of a peak supported by a research platform –Evolution of 3 to 4 to 5 grade units HEFCE – Role of QR funding –Strategic significance of the block grant Universities UK – Excellence and Diversity –Regional network of research competence –Importance of an evidence base for research policy OST/DIUS/BIS –Diversity as a critical element in research policy

RAE2008 – a novel outcome with dispersed rewards Gareth Roberts’ proposals on research profiling –Problem of the ‘cliff edge’ –Recognising dynamic excellence in the research base Unexpected differences between panels –The problem of interpreting methodology and standards –The absence of a commonly understood standard? –The dispersed map of reward-able research Decisions about funding allocations –2* = 1 (x 3 to) 3* = 3 (x 2.33 to) 4* = 7 –Greater relative rewards for modest gains than for very expensive world-class excellence (cf 2001)

How can we explore the spread of excellence? We have –Panel outcomes from RAE2008 – but opinions differ, so... –Bibliometric data on a consistent basis from 1981 We split the HE sector into crude groups –All HEIs –Russell Group –1994 Group –Universities with a shorter history of research investment And we created an elite ‘golden triangle’ band –Oxford (C12 th ), Cambridge (1209), UCL (1836), Imperial (C19 th ), LSE (1895)

Excellence is linked to selectivity

And excellence is concentrated UK output Total articles and reviews, Papers above world average impact Papers with impact exceeding four times world average Papers with at least one co-author from the HE research base 306, ,358 37% of HE total 16, % of HE total Papers with at least one co-author from the Russell Group 204,307 66% of UK HEIs’ total 79,505 70% of HE output 39% of Russell total 11,734 73% of HE output 5.7% of Russell total Papers with at least one co-author from a ’golden triangle’ HEI 87,157 28% of HEIs’ total 37,370 33% of HE output 43% of GT total 6,308 39% of HE output 7.2% of GT total

The problem with simplistic indicators They don’t really express the complexity of research performance Average impact (e.g. ‘crown indicator’) can be very misleading –Research Council studies reveal error of interpretation –Skewed data, median much smaller than average –Lots of papers are not cited –The interesting bit is about how much is really, really cited lots So we we prefer Impact Profiles ®

UK background and ‘golden triangle’ This is the small but critical excess of really highly cited research output

Even smaller differences separate the UK and USA research profiles

Excellence extends to other institutions

But the differences become very fine

And if we distil further, other complexity is revealed

Older institutions have no monopoly on quality, but the peak is distinctive For the 1994 Group, there are relatively fewer low-cited papers and relatively more high-cited papers than for many in the Russell Group

What does this imply? There is a very concentrated peak of exceptional excellence UK international competitiveness is associated with selectivity that increased concentration There is a regional network of exceptional quality, much in dynamic institutions created in the 1960s The balance that supports diversity & dynamism and the concentrated support of international excellence is very fine Model first, meddle second