A centre of expertise in digital information managementwww.ukoln.ac.uk Maximising the Effectiveness of Your Online Resources: Monitoring the Impact Brian Kelly UKOLN University of Bath Bath, UK UKOLN is supported by: This work is licensed under a Attribution- NonCommercial-ShareAlike 2.0 licence (but note caveat) Resources bookmarked using ‘ scaseo ' tag Blog: Acceptable Use Policy Recording this talk, taking photos, discussing the content using Twitter, blogs, , etc. is permitted providing distractions to others is minimised. Acceptable Use Policy Recording this talk, taking photos, discussing the content using Twitter, blogs, , etc. is permitted providing distractions to others is minimised. Twitter:

A centre of expertise in digital information managementwww.ukoln.ac.uk 2 Contents Why Monitor and Evaluate? Automated Measures Qualitative Measures The Flaws in Metrics Questions and Conclusions

A centre of expertise in digital information managementwww.ukoln.ac.uk 3 Why Monitor and Evaluate? Why should you monitor? To find out what they’re saying To inform what you are doing today To help in planning for new developments Why should you evaluate? To be able to identify trends To be able to justify the ROI To provide evidence to overcome sceptics and doubters (internally and externally)

A centre of expertise in digital information managementwww.ukoln.ac.uk 4 Institutional Dashboard - iSoton The iSoton Web 2.0 dashboard

A centre of expertise in digital information managementwww.ukoln.ac.uk 5 Institutional Dashboard - IMA The dashboard for the Indianapolis Museum of Art (IMA)

A centre of expertise in digital information managementwww.ukoln.ac.uk 6 Institutional Dashboard - IMA The dashboard for the Indianapolis Museum of Art (IMA)

A centre of expertise in digital information managementwww.ukoln.ac.uk 7 Build Your Own Dashboard Blog post on “An information dashboard for your library service points (I) - Using , RSS and FriendFeed” Aaron Tay, Musings about librarianship blog

A centre of expertise in digital information managementwww.ukoln.ac.uk 8 My Dashboard: Addict-o-Matic

A centre of expertise in digital information managementwww.ukoln.ac.uk 9 My Dashboard: PeopleBrowsr The PeopleBrowsr service

A centre of expertise in digital information managementwww.ukoln.ac.uk 10 My Dashboard: Tweetdeck An example of using Tweetdeck

A centre of expertise in digital information managementwww.ukoln.ac.uk 11 My Dashboard: ! Could be used by people who wish to use rather than new tools Twilert delivery of tweets matching a search string I’ve an interest in rapid response to things said about my work

A centre of expertise in digital information managementwww.ukoln.ac.uk 12 Blog Comments & Trackbacks Post on Facebook Vanity URLs: Published on Sat 13 Jun 09 Cited Techcrunch article on how to do this Impact: Referrer link on TechCrunch Drive traffic back

A centre of expertise in digital information managementwww.ukoln.ac.uk 13 Blog Statistics (Clustr.com) Evidence of global impact?

A centre of expertise in digital information managementwww.ukoln.ac.uk 14 Administrator’s View Why the peaks? PDF tool Fb post (9 Nov 2007) Multiple reasons (IWMW, Fb posts, …) Some idle thoughts: Average of 4 comments / post If 1 minute spent reading, this is equivalent to 120 days. How does this compare to my writing effort (20 mins = 8 days writing)?

A centre of expertise in digital information managementwww.ukoln.ac.uk 15 Individual Posts Reasons for popularity of posts: 1Interest in Facebook Timeliness of posts (Fb pages just launched) Promotion on mailing lists 2Timely post on new service 3“Topless Swedish model” 4Areas of my interest

A centre of expertise in digital information managementwww.ukoln.ac.uk 16 Statistics For Individual Posts Steady stream of traffic for some posts e.g. on Facebook, “topless model”, … Other posts are mostly read in days after publication (& may have additional peaks) But what of implications of RSS statistics, delivery, …?

A centre of expertise in digital information managementwww.ukoln.ac.uk Google Reader Google Reader (and other popular RSS readers) allow full item to be read Implications for statistics?

A centre of expertise in digital information managementwww.ukoln.ac.uk Subscribers Some users may prefer to have blog posts delivered via Note you’ll not see them via blog Web statistics

A centre of expertise in digital information managementwww.ukoln.ac.uk Technorati Ranking Technorati provide details for: Blog authority (nos. of blogs which link to yours in 6 month period) Blog ranking But service seems flaky Was useful in spotting trends and comparing with one’s peers

A centre of expertise in digital information managementwww.ukoln.ac.uk Lies, Dammed Lies & Blog Statistics Blog statistics flawed? Still need evidence? How about: A survey Evidence of awards Analysis of comments …

A centre of expertise in digital information managementwww.ukoln.ac.uk 21 Recording Evidence What I do? Monitor incoming links, comments, etc. for evidence of impact Bookmark online resources on del.icio.us Make use of evaluation forms Record relevant messages Record information of UKOLN’s Impact database

A centre of expertise in digital information managementwww.ukoln.ac.uk 22 Questions