1. Metrics What they are and how to use them
Chris Biggs and David Jenkins

2. Bibliometrics are the quantitative analysis of publication and citation data

3. Examples of bibliometric measures include citation counts, Journal Impact Factor and H-index

4. You can get bibliometrics from databases such as Scopus, Web of Science and Google Scholar

5. Altmetrics look at the mentions and uses of research that are not captured by traditional bibliometrics

6. Altmetrics include mentions, uses, downloads, views, shares from a wide variety of sources

7. Metrics are seen as important because
they acknowledge that a paper is relevant and known

8. Bibliometrics are seen as objective, inexpensive to produce/use, economical in terms of time and scalable

9. What do you think about metrics?

10. How are you using metrics?

11. What do you want to get out of this session?

12. Metrics can be used
on CVs, personal websites and on bid applications

13. Fawcett, Tom.
"An introduction to ROC analysis." Pattern recognition letters
27.8 (2006):

16. Citations measure what is cited not what is high quality

17. Journal Impact Factor
is designed to allow you to see how highly cited the average article in a journal is

18. Journal Impact Factor
is used as a proxy for importance and quality

19. No. of citations received in 2015 by articles published in the journal during 2013 and 2014
No. of articles published in the journal during 2013 and 2014
JIF 2015 =

20. You can get Journal Impact Factor from Journal Citation Reports

23. The H-index is designed to measure productivity and impact

24. “The definition of the index is that a scholar with an index of h has published h papers each of which has been cited in other papers at least h times”

25. H-index is criticised because it can’t be used to compare researchers in different disciplines, at different career stages or who have different outputs

26. The H-index measures consistency rather than outright impact

29. Altmetrics aim to cover
“the evaluation gap”

30. You can get altmetrics
from dedicated services or embedded in databases

31. Altmetrics can complement bibliometrics

32. Research can get high metrics for different reasons

36. Author profile systems 

37. The Benefits To make your research known
To increase chance of citation
To correct attributions
To ensure research is counted in research assessment
To increase chance of new collaboration
To increase chance of funding

38. Different functions have created different systems
Disambiguation – ORCID/Scopus ID/Researcher ID
Promotion/Visibility/Networking - Personal sites/Institutional sites/Academia.edu/ResearchGate/Facebook/LinkedIn
Reference Management tools – Mendeley
Open Access Publishing – Institutional Repository
Research Assessment – CRIS/Institutional Repository
Search Engines – Google Scholar

39. Different systems have different modus operandi
Institutional / Personal
Commercial / Not for profit
Open / Closed (… or shall I say walled garden)

40. Some profiles already exist, some need to be created, all need to be curated.

41. Scopus

42. 1 2 3

43. OU People Profile

44. ORCID

45. Google Scholar

46. ResearchGate

47. Mendeley

48. The Uses and Abuses of Metrics

49. A shortcut to evaluation
A shortcut to evaluation. Metrics appear to be objective, cost effective and useful where the evaluator isn't a domain expert.

50. Their success is not related to the quality of the information they provide, but more on the facility: a saving of the time necessary to make a real evaluation.

51. Funders might use metrics to evaluate bids.

52. Funders might use metrics to allocate monies.

53. Metrics were used to support assessment in the 2014 REF.

54. Metrics have been considered as a route to a more light touch REF.

55. Metrics and The Stern Review.

56. Universities might use metrics to recruit and promote.

57. This environment may encourage unwanted behaviours.

58. Universities might seek to associate themselves to highly cited researchers.

59. Journals might encourage authors to increase reference lists to increase Impact Factor.

60. Individuals will seek to publish in Journals with high impact factors.

63. Individuals might seek to increase citations by self-citations & citation cartels.

64. Individuals might seek to increase number of publications by salami slicing research.

65. Individuals might seek to increase their number of publications and citations as guest or gift authors. 

66. The Metric Tide. "Metrics hold real power: they are constitutive of values, identities and livelihoods."

67. The Metric Tide.
[We] propose the notion of responsible metrics as a way of framing appropriate uses of quantitative indicators in the governance, management and assessment of research.

68. Responsible Metrics. The Leiden Manifesto.

69. Responsible Metrics. San Francisco Declaration on Research Assessment.

70. What are your thoughts about metrics now?

71. Any questions?

72. Thank you!