1. Ranking and classification of universities based on advanced bibliometric mapping Leiden University 3rd International Symposium on University Rankings February 6-7, 2009 Anthony F.J. van Raan Center for Science and Technology Studies (CWTS) Leiden University

2. Hariolf Grupp 3 July 1950 – 20 January 2009

3. Contents of this presentation: Indicators and Ranking Classification Benchmarking Some fascinating statistics Latest developments

4. CWTS has a unique bibliometric data-system: 1000 universities worldwide are defined and ‘unified’ as accurate as possible; For these universities all bibliometric indicators are calculated and updated, for the universities as a whole (average over all fields) and for each of the 16 main fields: Ranking Comparison any of these universities with any selection: Benchmarking There are in the world ~500 largest universities with P > 700/y

5. Leiden Ranking 2009 properties 1. Target: Universities, worldwide Europe now on the internet, World will follow Extension with non-university institutions 2. Activity: Research 3. Method: Bibliometric analysis (100%) New approaches necessary to cover engineering, social sciences and humanities more adequately non-journal: political science, economy, psychology

6. 4. Time period 2000-2007 (now on the internet) latest version 2003-2007 next month 2004-2008 on the internet 5. Indicators P, P(0), C, CPP, CPP/FCSm, P*CPP/FCSm, P(t=20, 10, 5, 1%), largest 100, 250 6. Differentiation into 16 main fields clinical medicine, chemistry,….psychology, humanities 7. Benchmarking with universities of choice LERU, US universities,… 8. Profiles for each benchmark university

7. Leiden Ranking 2000-2007, EU Top-100 rank by P, yellow list, first 30

8. Position 30-50….

9. Problem of field-specific representation

10. Problem of language

13. Is the difference in chosen variable (e.g., impact) between University A with rank 12 and University B with rank 14 significant? Most probably NOT Is therefore the concept of ranking useless? Certainly NOT The ranking is mathematically equivalent to the distribution function which contains crucial statistical information

14. Leiden Ranking 2000-2007, EU Top-100 rank by CPP, blue list, first 30

15. Position 30-50….

16. Field normalization CPP >> CPP/FCSm is absolutely necessary but CPP: is as it is….. FCSm: do we apply the right field-specific normalization? Problems: size of the field, appropriateness of the WoS-category, role of underlying distribution function (>small non-linearity)?

17. From basic to applied

18. Leiden Ranking 2000-2007, EU Top-100 rank by CPP/FCSm, green list, first 30

19. Position 30-50….

22. Fatal attraction

24. Leiden Ranking 2000-2007, EU Top-100 rank by P*{CPP/FCSm}, orange list, first 30

26. 250 European Universities with P(y) > 350 Top-20 in ‘size’, Physics, ranked by crown indicator’ Ranking by field >>> Field-specific benchmarking universities by field

27. Current and recent benchmark projects Manchester, Leiden, Heidelberg, Rotterdam, Copenhagen, Zürich, Lisbon UNL, Amsterdam UvA, Amsterdam VU, Southampton Gent, Antwerp, Brussels VUB, UC London, Aarhus Examples:

32. How bibliometric classification works impact size disciplinary spectrum This classification addresses all important aspects concerning size, international scientific influence (both by field!) and disciplinary width

33. Large, Broad European University Focus: top 25 % in publication output and citation impact Top 25% Bottom 25% Impact ranking Publ.ranking Top 25%Bottom 25%

34. ‘Top’ research university University has a top position in each discipline Bottom 25% Publ.ranking Top 25% Impact ranking Bottom 25% large university smaller university

35. Smaller Specialized European University Top 25% Bottom 25% Impact ranking Publ.ranking Top 25%Bottom 25% Specialized in Economy and related fields Among top 25 % in citation impact, but in the lower-50% of publication output ECON MATH PSYCH

38. http://studies.cwts.nl/projects/leiden-ranking-2009 Latest developments - 1 Of all 16 main fields a research forefront map is constructed: *2003-2007 *Only the top-10%-impact publications *Chemistry & Chemical Engineering *All European universities are positioned on this map in size and in impact

39. Latest developments – 2 We add a new research indicator: university-industry collaboration (UI intensity) P(UI)/P for the following fields All fields of science Medical & health sciences Physics & materials science Chemistry & chemical engineering Basic life sciences Electrical engineering

40. Latest developments – 3 Worldwide ranking including all other novelties http://studies.cwts.nl/projects/leiden-ranking-2009

52. Thank you for your attention