Presentation is loading. Please wait.

Presentation is loading. Please wait.

What is Impact? How do you measure it? Wouter Gerritsma.

Similar presentations

Presentation on theme: "What is Impact? How do you measure it? Wouter Gerritsma."— Presentation transcript:

1 What is Impact? How do you measure it? Wouter Gerritsma

2 Programme  Publishing  Journals  Citations  Impact  Journal impact  Publishing strategy

3 What is impact?  I have published in Nature  My report has been used by the government  I've been cited 22 times  My article has downloaded 2421 times  I was invited to the late night news  I filed a patent over my invention

4 Impact of a single publication

5 Citation enhanced A&I databases  Web of Science  Scopus  Google Scholar (  PsychInfo, SciFinder (A&I databases in Digital Library)  ArXiv (Physics)  Spires (high energy physics)  Citeseer (ICT)  Other OA Initiatives

6 Web of Science  Search: ● Articles are found based on Authors, Addresses, etc. ● For each article Times cited is presented  Cited reference search: ● Searches in the reference lists of records ● Not all of your articles are found. Non-cited articles are missing

7 Beeldvullende foto met titel

8 How do we compare numbers  Scientist Z. Math has a publication from 2001 with 17 citations  Scientist M. Biology has a publication from 2009 with 24 citations

9 Baselines for Mathematics

10 Baselines for Molecular Biology

11 Bibliometric indicators: An example  Kroes-Nijboer, A; Venema, P; Bouman, J; van der Linden, E (2009) The Critical Aggregation Concentration of beta- Lactoglobulin-Based Fibril Formation. Food Biophysics 4(2): ● Citations from WoS: 10  Journal: Food Biophysics ● Categorised by ESI in Agricultural Sciences  Baseline data for Agricultural Science. ● Article from 2009 in Agricultural Sciences: ● On average: 4.25 citations; top 10%: 11 citations; top1%: 26 citations  Relative Impact: 10/4.25 = 2.35 Values Oct. 2012

12 Essential Science Indicators  Analytical database, covering 10 years + current year building  Comparisons between Countries, Institutes, Scientists and Journals  Hot papers / Highly cited papers  Research fronts  Baselines

13 Steps in a citation analysis 1.Look up the citation data (Web of Science) 2.Matching Journal(s) with appropriate research fields (Essential Science Indicators) 3.Collect baseline data (Essential Science Indicators) 4.Calculate the relative impact

14 Interpretation of RI for small groups  With publications per year RI ≤ 0.8 : below world average impact 0.8 < RI ≤ 1.2: world average impact 1.2 < RI ≤ 2.0: above world average impact 2.0 < RI ≤ 3.0: very good average impact RI > 3.0: excellent average impact

15 We do it also for groups

16 H-index  Balance between productivity and citedness  To rule out the effect of one or two highly cited papers  Applicable to authors, journals, research groups, compounds, subjects etc.  But there are some serious doubts about robustness Waltman, L. & N. J. van Eck (2011). The inconsistency of the h-index. Journal of the American Society for Information Science and Technology 63(2):

17 h-index

18 Omnipresent h-index

19 Journal Performance Indicators  Journal performance indicators are based on citations to articles  Journal Citation Reports (JCR)JCR ● a.o. standard Journal Impact Factors and 5-year Impact Factors  Scopus Journal Analyzer (SJA)SJA ● a.o. SCImago Journal Rank (SJR) and Source Normalized Impact per Paper (SNIP) ● Also available on

20 Journal Citation Reports (JCR) Reports three measures  Impact factor  Immediacy Index  Cited half life Adapted from: Amin, M and Mabe, M. (2000) Impact factors: use and abuse. Perspectives in Publishing, No. 1, 6 pp.

21 IF in 2010 for Agricultural Systems

22 Selecting journals on the basis of IF  Word of warning ● Our opinion: Be careful when using Journal Impact factors to judge the performance of a group or individual scientist ● Used for NWO grant applications and Tenure track at Wageningen UR

23 50% of articles generate 90% of all cites Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. BMJ 314(7079):

24 Journals from Agricultural Economics & Policy: Quartile Scores JCR Science Edition 2009 Q1 Q2 Q3 Q4

25 Journal quality and article impact , for Wageningen UR Journal QuartilePubsRIT10(%T10)T1(%T1) Q (34%)505(7%) Q (20%)61 (2%) Q (11%)10 (1%) Q (5%)6 (1%) Aggregate (27%)582(5%) Source: Wageningen Yield, Feb. 2012Wageningen Yield

26 Journal selection and impact universities globally

27 Changing publication

28 Sorting on IF possible in WUR catalogue


30 Alternatives for Impact Factor  All based on Scopus ● Scimago Journal Rank (SJR) ● Source Normalized Impact per Paper (SNIP)

31 Alternatives for JIF: SJR

32 Alternatives for JIF: SNIP

33 Altmetrics  Quickly developing ● ScienceCard ● Total-Impact ● Readermeter ● Microsoft Academic Search ● etc. Wouters, P. & R. Costas (2012). Users, narcissism and control. Utrecht, NL: SURFfoundation. en/publicaties/Pages/Users_narcissism_control.aspxen/publicaties/Pages/Users_narcissism_control.aspx.

34 Importance of social media for scientists

35 Nearly 300 article views in the 1st week

36 1400+ downloads after 3 months

37 Thank you! On the

Download ppt "What is Impact? How do you measure it? Wouter Gerritsma."

Similar presentations

Ads by Google