1. Bibliometrics: the black art of citation rankings Roger Mills Head of Science Liaison and Specialist Services, Bodleian Libraries June 2010 These slides are available on http://www.ouls.ox.ac.uk/services/training/wiser

2. Overview of Session What are bibliometrics? How are they calculated? How can I use them? How will they be used in the REF?

3. Why bother? Because we have to! http://www.hefce.ac.uk/research/ref/pilot/ref.pdf

4. Or maybe not…

8. http://www.hefce.ac.uk/research/ ref/resources/REFguide.pdf

9. http://www.hefce.ac.uk/research/ ref/resources/REFguide.pdf

10. http://www.hefce.ac.uk/research/ref/Biblio/

13. http://www.hefce.ac.uk/pubs/hefce/2009/09_39/

15. http://www.springerlink.com/content/v111750n14086384/fulltext.pdf

16. http://www.ischool.utexas.edu/~palmquis/courses/biblio.html

18. http://www.slideshare.net/guest633b30/bibliometrics-and-scientometrics-1065282

19. © http://ceochef.files.wordpress.com/2008/07/pinch-of-salt.jpg

20. The power behind

25. Citation indexing Invented in 1961 by Eugene Garfield at the Institute for Scientific Information (ISI) Scientific abstracting/indexing services began in nineteenth century, recording author/title/publisher/source etc for articles and indexing them Garfield added details of all references quoted in the article and indexed them too, publishing results as Science Citation Index (SCI) – originally only in printed form Allowed for many new ways of linking articles

26. so For an article you’ve read: Find earlier articles that one was based on Find later articles which quoted it Find related articles which quote some of the same references as this one So you can trace the progress of ideas backwards, sideways and, uniquely, forwards in time And generate statistics on how influential those ideas / authors / journals have been

27. Computers save time Science Citation Index – now supplemented by Social Science Citation Index and Arts and Humanities Citation Index – online as Web of Science Delivered along with Journal Citation Reports on the platform Web of Knowledge. Built-in analysis tools available to all users For REF, universities may have access to raw data and specially-developed analysis tools

28. Analysis tools Who is citing? Which journals are citing? What is the relation between frequency of publication and frequency of citation? The h-index Citation maps Impact factors

29. Analyzing highest cited article

30. Citing articles

31. Highest citing authors

32. Highest citing journals

33. Citation report

37. Citation map

40. Impact Factors - Journal Citation Reports (JCR) For Sciences and Social Sciences (not humanities) A measure of the frequency with which the "average article" in a journal has been cited in a particular year. The impact factor will help you evaluate a journal's relative importance, especially when you compare it to others in the same field From within a record you can click on Journal Citation Reports to view the impact factor of the journal Or you can view and compare impact factors of all journals within your subject area

41. Link from record

48. Other services offering citation searching - SCOPUS Sciences and Social Sciences Results include journal articles and web pages Each reference to a paper shows the number of times an article has been cited

49. Citation analysis in Scopus

57. Citation searching in Google Scholar References include ‘cited by’ data based on articles known to Google Scholar Entries ranked by number of cites Not possible to save sets or analyse Still useful for tracking research

58. Specific article with link to citing works

59. Citing works

60. Track an author

61. Author’s works, highest cited first

62. So which database will be used for REF? Initial plan to use Web of Science only Pilot used WoS and Scopus WoS data handled by Symplectic, subcontractor for Evidence; Scopus by Hefce Pilot showed need for ‘normalization’ Final decision not yet made In our example: WoS finds1294 citations to 581 articles Scopus finds 1314 citations to 553 articles GS finds 927 citations to 1020 articles What is truth….

63. Where will it all end… And how much will it all cost… Watch this space!