Challenges of OA in the Next Frontier: ALM & Research Impact Assessment Jennifer Lin Product Manager, PLOS

2 PLOS Publication Growth Rate Freely available to all At moment of publication Free to access, Free to re-use DATA SHOWN: PLOS ONE

Information Overload is Filter Failure More distribution channels More published results More data Other Researchers Citations Journal Title How do I find relevant research?

THE NEXT FRONTIER FOR OA Effective discovery, navigation, and management of content is crucial PLOS

The Measurement Dilemma

Dissemination Publication Researchers work within a diverse ecosystem of channels to share, comment, critique new research: ALMs Article-Level Metrics captures this activity and measures it in a transparent and comprehensive manner. article access, scholarly and nonscholarly citations, blog and news coverage, social network sharing research community conversations Measurement of research

7 0.3% 100% 22.2% What do researchers do with articles? Article-Level Metrics from November 8, 2012 for 63,771 PLOS Papers

Engagement with PLOS ONE articles Analysis of 37,267 PLOS ONE articles by Martin Fenner

9 Engagement with all PLOS articles Proportion of articles covered by source Metrics for 63,771 PLOS articles published until November 8, 2012

Usage PLOS: views PDF downloads XML downloads PMC: views PDF downloads Citations PubMed Central CrossRef Scopus Web of Science ALM Article Example PLOS Comments Blogs & Media Nature Blogs Research Blogging Wikipedia PLOS ALM Suite Social Network CiteULike Connotea Mendeley Twitter Facebook

Article-Level Metrics: Diverse and efficient measurement Increased diversity without losing traditional value Accelerated measurement response Easier to own and manage Flexibly accommodates varied uses

12 ALMs allow you to “dig into the aspect of impact you want to explore” -Heather Joseph, SPARC

13 Article-Level Metrics are a better filter for discovery and evaluation

ALM Article Example ALMs on the Journals - Display

ALMs on the Journals - Signposts

Tito RY, Knights D, Metcalf J, Obregon-Tito AJ, Cleeland L, et al. (2012) Insights from Characterizing Extinct Human Gut Microbiomes. PLOS ONE 7(12): e doi: /journal.pone

21 Integration of ALMs into discovery and evaluation is work in progress

Rectangle size correlates with total views (HTML and PDF) from PLOS website. Color intensity correlates with number of Scopus citations. Doris Duke Foundation funded PLOS articles Article Usage and Citations by Subject Category ALMs reveal what articles are used

ALMs reveal where articles are used Alzheimer‘s Association funded PLOS articles Geolocation of 410 authors for 84 articles ALMs reveal how articles are used

ALMs reveal a view of impact ex: academic homepage

Researchers use ALMs in various ways to track and communicate the progress of their work*: With Whom? University administrators, funding organizations (program managers), research collaborators, public relations departments & other promotion outlets How? Quickly Expanding Utilization Formally: Curriculum Vitae grant & funding applications research assessments progress & merit report research reports Informally: blogs, presentations, twitter web postings, conversations personal article management tools * Author survey, July 2012

26 Use Article-Level Metrics for hiring, tenure, promotion decisions? ? How?

Publisher adoption is growing Many publishers have joined PLOS in displaying article-level metrics on their journal article, including: And many more forthcoming…

28 How do we fully realize the potential of ALMs? BUILD COMMUNITY - access to ALMs (make data standard, freely available) - ALM tools

Getting started as a librarian 29 Collect and track altmetrics For research articles published at your university For research of interest Display altmetrics on author bios Tell publishers that you want Article-Level Metrics for every published research article Tell ALM data sources that their data should be CC-0 Join the #altmetrics and altmetrics Google Group discussionsaltmetrics Google Group discussions Join community discussions to build standards for ALM data

Getting started as an institutional repository & university press 30 Collect and display altmetrics for the articles you publish Work with an altmetrics service provider or install an Open Source altmetrics application Take into account cost, technical expertise, but also who owns the data Join the #altmetrics and altmetrics Google Group discussionsaltmetrics Google Group discussions

For Further Information… Give us your feedback, join our ALM list PLOS ALM informational site: metrics.plos.org/ metrics.plos.org/ PLOS API and developer information: Scholarly research on ALMs & altmetrics PLOS ONE Collection: Follow us on