Ranking and classification of universities based on advanced bibliometric mapping Leiden University 3rd International Symposium on University Rankings February 6-7, 2009 Anthony F.J. van Raan Center for Science and Technology Studies (CWTS) Leiden University

Hariolf Grupp 3 July 1950 – 20 January 2009

Contents of this presentation: Indicators and Ranking Classification Benchmarking Some fascinating statistics Latest developments

CWTS has a unique bibliometric data-system: 1000 universities worldwide are defined and ‘unified’ as accurate as possible; For these universities all bibliometric indicators are calculated and updated, for the universities as a whole (average over all fields) and for each of the 16 main fields: Ranking Comparison any of these universities with any selection: Benchmarking There are in the world ~500 largest universities with P > 700/y

Leiden Ranking 2009 properties 1. Target: Universities, worldwide Europe now on the internet, World will follow Extension with non-university institutions 2. Activity: Research 3. Method: Bibliometric analysis (100%) New approaches necessary to cover engineering, social sciences and humanities more adequately non-journal: political science, economy, psychology

4. Time period (now on the internet) latest version next month on the internet 5. Indicators P, P(0), C, CPP, CPP/FCSm, P*CPP/FCSm, P(t=20, 10, 5, 1%), largest 100, Differentiation into 16 main fields clinical medicine, chemistry,….psychology, humanities 7. Benchmarking with universities of choice LERU, US universities,… 8. Profiles for each benchmark university

Leiden Ranking , EU Top-100 rank by P, yellow list, first 30

Position 30-50….

Problem of field-specific representation

Problem of language

Is the difference in chosen variable (e.g., impact) between University A with rank 12 and University B with rank 14 significant? Most probably NOT Is therefore the concept of ranking useless? Certainly NOT The ranking is mathematically equivalent to the distribution function which contains crucial statistical information

Leiden Ranking , EU Top-100 rank by CPP, blue list, first 30

Position 30-50….

Field normalization CPP >> CPP/FCSm is absolutely necessary but CPP: is as it is….. FCSm: do we apply the right field-specific normalization? Problems: size of the field, appropriateness of the WoS-category, role of underlying distribution function (>small non-linearity)?

From basic to applied

Leiden Ranking , EU Top-100 rank by CPP/FCSm, green list, first 30

Position 30-50….

Fatal attraction

Leiden Ranking , EU Top-100 rank by P*{CPP/FCSm}, orange list, first 30

250 European Universities with P(y) > 350 Top-20 in ‘size’, Physics, ranked by crown indicator’ Ranking by field >>> Field-specific benchmarking universities by field

Current and recent benchmark projects Manchester, Leiden, Heidelberg, Rotterdam, Copenhagen, Zürich, Lisbon UNL, Amsterdam UvA, Amsterdam VU, Southampton Gent, Antwerp, Brussels VUB, UC London, Aarhus Examples:

How bibliometric classification works impact size disciplinary spectrum This classification addresses all important aspects concerning size, international scientific influence (both by field!) and disciplinary width

Large, Broad European University Focus: top 25 % in publication output and citation impact Top 25% Bottom 25% Impact ranking Publ.ranking Top 25%Bottom 25%

‘Top’ research university University has a top position in each discipline Bottom 25% Publ.ranking Top 25% Impact ranking Bottom 25% large university smaller university

Smaller Specialized European University Top 25% Bottom 25% Impact ranking Publ.ranking Top 25%Bottom 25% Specialized in Economy and related fields Among top 25 % in citation impact, but in the lower-50% of publication output ECON MATH PSYCH

Latest developments - 1 Of all 16 main fields a research forefront map is constructed: * *Only the top-10%-impact publications *Chemistry & Chemical Engineering *All European universities are positioned on this map in size and in impact

Latest developments – 2 We add a new research indicator: university-industry collaboration (UI intensity) P(UI)/P for the following fields All fields of science Medical & health sciences Physics & materials science Chemistry & chemical engineering Basic life sciences Electrical engineering

Latest developments – 3 Worldwide ranking including all other novelties

Thank you for your attention