Presentation on theme: "Altmetrics: The Basics Linda M. Galloway, MLIS Librarian for Biology, Chemistry and Forensics Bibliographer for the Sciences & Technology Syracuse University."— Presentation transcript:
Altmetrics: The Basics Linda M. Galloway, MLIS Librarian for Biology, Chemistry and Forensics Bibliographer for the Sciences & Technology Syracuse University Library, Syracuse, NY SLA 2014 Quick Take - #5616 June 8, 2014
What are Altmetrics?? “the study of scholarly impact measures based on activity in online tools and environments” (Priem, Groth, and Taraborelli 2012 citable and accessible products not limited to publications, data sets, software, patents, and copyrights (“Grant Proposal Guide, Chapter II” 2013)
Quantifying Scholarly Output via Citation Metrics Number of Publications Citations to Publications Relative influence of Publications
Documents: 30 Citations: 253 H-index: 9 2009-2014, 3/5/2014 Scholarly Metrics as a proxy for Scholarly Influence…
Limitations to Traditional Metrics Take a long time to accumulate Often behind pay walls Measure influence narrowly Don’t capture a publication’s impact or influence in emerging forms of scholarly communication Variability depending on database used to calculate metrics
How do you measure researcher/faculty impact? # Citable products # Citations to those products h-Index Other measures of success and influence
Altmetrics Measure diverse impacts from articles, datasets, blog posts, slide shows, etc. Beyond citation counts! Readership Views Saves Downloads Scholarly (or popular) Buzz
What are Altmetrics? Indicators of Research Impact Journal article useViews, saves, downloads, full- text downloads, readership, usage, etc. Social Web useBlogs, Twitter (microblogs), social bookmarking, online reference managers Data & Software use/reuseCopies, citations Educational resource use/reuse Presentations, syllabi, course materials Broader Impacts of researchMass media reporting Altmetrics can complement and enhance citation metrics!
What can be measured? “Evidence of Use” – http://impactstory.orghttp://impactstory.org # of Tweets # of “Saves” in online reference managers Scholarly (and popular) blog interest and activity Activity in social networking platforms, tools Media interest/activity
Altmetrics can help evaluate the diffusion of research products How to measure the relative importance of various types of uses, re- uses and discussions of these products? Altmetric Data Groupings Scholarly activity Data & software (re)use Scholarly commentary Social activity Mass media
Meaningful Interactions CiteULike Delicious F1000 Figshare GitHub IR Mendeley Reddit SlideShare Twitter YouTube Vimeo Zotero What is tracked/counted?? Discussions Saves Views Citations Downloads Recommendations Copies Usage (clicks) Bookmarks Etc. Altmetrics measures diverse impacts from articles, datasets, blog posts, slide shows, etc.
Altmetric Tools track readership & influence Academia.eduAcademia.edu is a platform for academics to share research papers and interests. CiteULikeCiteULike permits users to store, organize and share scholarly papers F1000F1000 is a subscription-based recommendation service for curated articles in biology and medicine.
Altmetric Tools track readership & influence Google Scholar CitationsGoogle Scholar Citations is a service that allows authors to track their publications and influence using Google Scholar metrics. MendeleyMendeley is a free reference manager and social network that was recently acquired by Elsevier. Mendeley is described as “one of the world’s largest crowd-sourced research catalogs” ZoteroZotero is a robust and growing citation management and sharing resource. Collaborators can share libraries of references, etc.
Altmetrics & Researchers Metrics and their relationship to social media: Add value to traditionally published content – Crowdsourced peer review – Expose questions and comments – Enhance worth Increase readership Appear to follow the pattern of traditional metrics
Make Sense of the Diversity of Research Outputs Use an aggregator! Harvest data Automatic updates Showcase scholarly influence
Tools to gather data Commercial Altmetric.com –owned by Macmillan Publishers (also owns the Nature Publishing Group). “Provides article level metrics for researchers and publishers” Altmetric.com Plum Analytics – startup co-founded by former Summon developers; recently acquired by EBSCO. Collects article-level data for use by different constituencies to compare individuals, departments, universities. Plum Analytics
Tools to gather data Commercial Mendeley.com – Reference manager,.pdf organizer & social networking tool for researchers/authors. Collects & displays altmetrics. Recently purchased by Elsevier. Mendeley.com “Mendeley Institutional Edition (MIE) is an analytics tool built on top of Mendeley that helps librarians, research directors and other admins to understand the research activity and scholarship output of their community and to facilitate collaboration within it (Mendeley.com).”
Tools to gather data Non-profit ImpactStory – designed for the individual researcher, tools to visualize impact of research products. Helps “researchers to tell data-driven stories about their impacts” (ImpactStory, 2014). ImpactStory – Open source; data, code & governance all public
Valid data = Valid metrics Accurate attribution and discovery of research products is the most important consideration for all authors. Scholarly authors are assigned many identifiers such as Scopus Author ID, Web of Science Researcher ID, institutional ID’s Scholars should register for an ORCID - Open Researcher Identifier – this ID is supported by many publishers & platforms.ORCID Scholars can claim and make public their Google Scholar profile, and/or keep an institution profile updated.
Thank you!! Linda Galloway Contributors: Janet Pease Anne Rauh Syracuse University Libraries
References Adie, Euan, and William Roe. 2013. “Altmetric: Enriching Scholarly Content with Article-level Discussion and Metrics.” Learned Publishing 26: 11–17. doi:10.1087/20130103. Arslan, E., Akyokus, S., & Ganiz, M. C. (2013). An application of community discovery in academical social networks. In 2013 IEEE International Symposium on Innovations in Intelligent Systems and Applications (INISTA) (pp. 1–5). doi:10.1109/INISTA.2013.6577650 Bik, Holly M., and Miriam C. Goldstein. 2013. “An Introduction to Social Media for Scientists.” PLoS Biol 11: e1001535. doi:10.1371/journal.pbio.1001535. Bushman, Mike, and Andrea Michalek. 2013. “Are Alternative Metrics Still Alternative?” ASIS&T Bulletin (May). http://www.asis.org/Bulletin/Apr- 13/AprMay13_Buschman_Michalek.pdf.http://www.asis.org/Bulletin/Apr- 13/AprMay13_Buschman_Michalek.pdf Cameron, Brian D. 2005. “Trends in the Usage of ISI Bibliometric Data: Uses, Abuses, and Implications.” Portal: Libraries and the Academy 5 (1): 105–125. doi:10.1353/pla.2005.0003. CiteULike. 2013. “Frequently Asked Questions.” Accessed April 29. http://www.citeulike.org/faq/faq.adp.http://www.citeulike.org/faq/faq.adp Costas, R., Zahedi, Z., & Wouters, P. (2014). Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. arXiv:1401.4321 [cs]. Retrieved from http://arxiv.org/abs/1401.4321http://arxiv.org/abs/1401.4321 Eysenbach, G. 2011. “Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact.” Journal of Medical Internet Research 13: e123. Faculty of 1000. 2013. “About.” Accessed April 29. http://f1000.com/. Fenner, M. (2013). What Can Article-Level Metrics Do for You? PLoS Biol, 11(10), e1001687. doi:10.1371/journal.pbio.1001687 Gonzalez-Pereira, Borja, Vicente Guerrero-Bote, and Felix Moya-Anegon. 2009. “The SJR Indicator: A New Indicator of Journals’ Scientific Prestige.” arXiv:0912.4141. http://arxiv.org/abs/0912.4141.http://arxiv.org/abs/0912.4141 Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., & Terliesner, J. (2013). Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics, 1–19. doi:10.1007/s11192-013-1221-3 Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Larivière, V. (2013). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology, doi:10.1002/asi.23101 Hirsch, J. E. 2005. “An Index to Quantify an Individual’s Scientific Research Output.” Proceedings of the National Academy of Sciences of the United States of America 102: 16569–16572. doi:10.1073/pnas.0507655102.
References Jacso, Peter. 2006. “Deflated, Inflated and Phantom Citation Counts.” Online Information Review 30: 297–309. doi:http://dx.doi.org.libezproxy2.syr.edu/10.1108/14684520610675816. Kaur, J., Radicchi, F., & Menczer, F. (2013). Universality of scholarly impact metrics. Journal of Informetrics, 7(4), 924–932. doi:10.1016/j.joi.2013.09.002 Konkiel, S. (2013). Altmetrics: A 21st Century Solution to Determining Research Quality. Retrieved from https://scholarworks.iu.edu/dspace/handle/2022/17147 Mendeley Ltd. 2012. “Mendeley.” http://www.mendeley.com/. ORCID Inc. 2012. “ORCID.” http://about.orcid.org/. Piwowar, Heather. 2013. “Altmetrics: Value All Research Products.” Nature 493: 159–159. doi:10.1038/493159a. PLOS Biology: What Can Article-Level Metrics Do for You? (2013). Retrieved February 10, 2014, from http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001687 Priem, Jason. 2013. “Scholarship: Beyond the Paper.” Nature 495: 437–440. doi:10.1038/495437a. Priem, Jason, and Heather A. Piwowar. 2013. “ImpactStory: Tell the Full Story of Your Research Impact.” Accessed April 9. http://www.impactstory.org/. Priem, Jason, Dario Taraborelli, Paul Groth, and Neylon, Cameron. 2010. “Altmetrics: a Manifesto – Altmetrics.org.” Altmetrics: a Manifesto. 26. http://altmetrics.org/manifesto/. SCImago. 2007. “SJR - Scimago Journal & Country Rank.” http://www.scimagojr.com/. Shuai, Xin, Alberto Pepe, and Johan Bollen. 2012. “How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations.” arXiv:1202.2461. http://arxiv.org/abs/1202.2461.http://arxiv.org/abs/1202.2461 Sud, P., & Thelwall, M. (2014). Evaluating altmetrics. Scientometrics, 98(2), 1131–1143. doi:10.1007/s11192-013-1117-2 Thomson Reuters. 2012. “Journal Citation Reports Help.” http://admin-apps.webofknowledge.com.libezproxy2.syr.edu/JCR/help/h_toc.htm.