COUNTER usage statistics: Measuring the benefits of the big deals Angela Conyers Evidence Base, Research & Evaluation Birmingham City University

Working with usage statistics NESLi2 analysis of usage statistics (JISC) Analysing Publisher Deals (Evidence Base) 2008 Assessing the value of the NESLi2 deals (JISC) Usage Statistics Portal Scoping Study (JISC) JUSP - Journal Usage Statistics Portal (JISC)

What do libraries want from usage data? Be sure it is right Ready access for reporting How well titles in a deal are being used: –High use, nil and low use Usage by subject area Analyse trends over time Evidence of value for money

Single point of access to usage data from multiple publishers No need to visit separate publisher sites to download usage statistics Usage comparison across publishers and years Establishing value for money JUSP Purpose and benefits

A collaborative project

138 UK higher education and research council libraries are in JUSP

18 publishers American Association for the Advancement of Science American Institute of Physics Annual Reviews BioOne British Medical Journal Publishing Group Edinburgh University Press Elsevier Emerald Future Medicine Institute of Physics Nature Publishing Group Oxford University Press Project MUSE Royal Society of Chemistry SAGE Springer Taylor & Francis Wiley-Blackwell 3 intermediaries Ebsco EJS Publishing Technology (ingentaconnect) Swets

COUNTER usage reports JR1 Journal Report 1: Number of Successful Full-Text Article Requests by Month and Journal JR1a Journal Report 1a: Number of Successful Full-Text Article Requests from an Archive by Month and Journal / /

Standardized Usage Statistics Harvesting Initiative (SUSHI) M2M way of gathering statistics Replaces the user- mediated collection of usage reports 12 JUSP SUSHI clients available SUSHI server to gather data from JUSP

Data is quality checked Full usage reports are given: – JR1 and JR1a usage reports from publishers – Addition of usage from intermediaries/gateways – Separation of JR1A archive use from use of current deal - Making sure it is right

Adding value to the JR1 Titles with the highest use from one publisher or all publishers in JUSP Titles in various usage ranges, from nil and low to very high Search facility – title or ISSN or keyword Trends over time (2009- ) Comparing usage of different publishers Assisting with the SCONUL return

Adding value to JUSP JUSP enhancements: Adding subscribed or core titles What titles are in the deal? Helping to judge the value of a deal

Adding subscribed or core titles How much are the subscribed titles being used? How much are other titles in the deal being used? Does usage show that the deal offers better value than individual subscribed titles? Adding subscribed or core titles

What titles are in the deal? Accounting for nil usage Does the JR1 report contain titles that are not available in the collection the library subscribes to? Does the JR1 report contain titles that are no longer part of the current deal e.g. name changes, publisher changes? What titles are in the deal?

How many titles are in the deal? Project Muse JR1 for 2011 for a library with the Basic Research Collection– 59% of titles in the JR1 are not in the library’s deal and will show nil use. Titles in the Premium Collection in the JR1498 Titles in the Basic Research Collection206 Titles in the JR1 not available to the Library292

JUSP enhancements Usage patterns of subscribed or core titles Identification of titles in the deal or collection within the JR1 report Adding more publishers

Measuring costs Cost per download All titles Subscribed titles Non-subscribed titles Cost per title All titles in the JR1 All titles in the deal/collection taken Subscribed titles Non-subscribed titles