Presentation on theme: "Impact Factor and Citation Metrics: What do they Really Mean? Session 1206 Room 203A January 30, 2009 Debbie Chaves, Wilfrid Laurier University Brian Cameron,"— Presentation transcript:
Impact Factor and Citation Metrics: What do they Really Mean? Session 1206 Room 203A January 30, 2009 Debbie Chaves, Wilfrid Laurier University Brian Cameron, Ryerson University
Outline Measurement of the Business of Science Background on various methods Where things can go wrong What that means for librarians
Why Measure? Security of knowledge Predictability Comparison analysis Subject and domain dependent Quantifiability fallacy
Historical Background on Impact Factor Eugene Garfield, "Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas," Science 122, 3159 (July 15, 1955): 108
What is an Impact Factor ratio of articles published to articles cited during a rolling two-year window A/B A = citations in 2008 : articles cited in 2006-7 B = citable items published in 2006-7 year 2008 citations to 2006 + 2007 articles articles published in 2006 + 2007
Your (real) Impact Factor
Use of Impact Factors Collection development Choosing journals for publication Journal assessment/marketing by publishers Evaluation of scholarly research & individual performance, for purposes of tenure and promotion, and funding Evaluation of departments, institutions, and nations
Problems with IF Two-year window # of journals published in discipline ISI coverage Language Publication type Not representative Journal size
Other Issues Citation errors Citation clubs Citation bartering
Manipulation Review articles Case studies Editorial interference
h-index Hirsch, J. E. (2005). "An index to quantify an individual's scientific research output". PNAS 102 (46): 16569–16572.
h-index h-index, developed by Jorge Hirsch A scientist has index h if h of [their] N p papers have at least h citations each, and the other (N p - h) papers have at most h citations each.
Criticisms of the h-index Comparisons Age Insensitive Context Limitations of citation databases # of authors
From h to g Given a set of articles ranked in decreasing order of the number of citations that they received, the g-index is the (unique) largest number such that the top g articles received on average at least g citations.
What do the numbers really mean? Author inaccuracies ISI calculation inaccuracies What does an H-index of 1 really mean?
Citation Game-Playing – How to make it Work for YOU! Become famous so everyone gives you authorship on their paper HEP in ArXve submission timing Ride the bias – multiple authors: choose the middle Folia Phoniatrica et Logopaedica: 1 articles cited all the papers published in the last 2 years for IF=1.439 compared to 0.655 Find and ride the trend – Martin Fleischmann was once the most highly cited chemist in Britain
Nature 451 2008 pg 766-767
Search Web of Science for Wilfrid Laurier
Wilfrid Laurier as Author in 2007?
Ann Arbor as Author (MUCH worse in Google Scholar)
Ann Arbor as Author in 2007?
William H. Gates = Bill Gates
Researcher ID = A-1930-2009
Researcher ID Publication List
Anyone can write a letter
NATURE Vol 53 June 2008 pg. 718
Chemistry Department Scopus H-Index Created Feb 9, 2008 with the faculty at that time. Dependent on information included in SCOPUS. 09-Feb-08 Positionh-indexpatentstotal number of papers first-year publication last-year publication Publications/year president5013198420080.54 dean science15051198820082.55 assistant5014199920071.75 assistant506199820070.67 assistant15248199820075.33 assistant6013199820071.44 assistant7012199820071.33 assistant9014200020052.80 CAS304199920021.33 CAS103325197920070.89 professor8036196720070.90 associate7017199220051.31 CAS002200720082.00 CAS17024198420011.41 Average82.5019.931992.212006.141.73
Institutional Metrics http://webometrics.info
What does this mean for Librarians? Must be familiar and knowledgeable about the current calculations of Science Worthiness International students are aware Administrations and granting agencies will ask for these statistics but may not be aware of their limitations Avoid the citation culture
Take Home Message Avoid Disregard Syndrome Practice Citation Vigilance