Metrics for Repository Impact Mark MacGillivray Cottage Labs

Who am I Co-founding partner, coder / manager. Developer / project manager on various projects, JISC and other funders. PhD student in the School of Informatics at the University of Edinburgh. Open Access, Biblio, Science working groups member at Open Knowledge Foundation.

What is Cottage Labs A core of developers working on software for higher education and research. Some of us are still affiliated with academic institutions, and we collaborate with many. Our goal is to help build the foundations of free and open access to scholarship. As information and software are now the key resources of our community, we should make our community self-sustaining by supporting open software development and open scholarship. With open licensing, we can share our software and data across our community.

What we do Software development, project management, report writing. ● Software infrastructure like SWORD ● Research infrastructure like dspace, DMP Online, Bibserver ● National infrastructure projects like DUO in Norway ● Identifiers report – recommendations on ORCID etc

Collecting metrics - resources All information about the resources themselves is inherently available. As long as the information exists and can be delivered in a usable format... So depending on quality of record metadata, all resource information can be used for metrics. This means it is possible to do things like “list all books with more than ten views” - if we know which things are books.

Collecting metrics - usage Uploads / Downloads / Views ● Time – when did it happen? Useful for daily / monthly reports etc. ● Location – IP address leads to LatLong / country / city / institute. Learn where the audience is. ● How – device type, browser / OS configuration. How are people interacting with the resources?

Collecting metrics - users Less well defined – more interesting – higher risk (data protection?) ● Who is interested in a resource? ● What do they want it for? ● When do they want it? ● Do they care about copyright / access permissions? ● Do they circumvent them? If so, how?

Metrics - compliance ● COUNTER ● IRUS-UK - Collecting and using compliant metrics could result in standardised reports

Our approach Index the hell out of it... Using indexing engines rather than databases to present and cut data based on queries. Then build UI to automate complex queries.

Recent work Total Impact / Impact Story Aggregates usage across various social media, and presents an overall score. Has an API, can be embedded in other apps.

Recent work XCRI-CAP course feed data. A current ongoing project... quite new. May or may not be interesting, will give a brief description.

Recent work Mimas Jorum A repository of repositories? A large collection of many Open Educational Resources. Undergoing heavy redevelopment.

Useful links