1. 35 th Consultative INIS Liaison Officers Meeting Vienna, Austria 28-29 October 2010 Usage Metrics Subgroup Status Report Debbie Cutler (augmented by Taghrid Atieh, INIS) Subgroup Chair, ETDE Operating Agent

2. Subgroup Established 12 th ETDE/INIS Joint Technical Committee Meeting  Held 21-22 October 2009, Vienna, Austria  Agenda item discussed the kinds of metrics being collected  Agreed that it would be useful to look at common metrics and what they represent  Joint subgroup established, with ETDE taking the lead

3. Subgroup Membership Denmark: Line Nissen Germany: Silke Rehme Japan: Hidemitsu Nakajima INIS Secretariat: Dobie Savic, Taghrid Atieh, Zbigniew (ZB) Majewski ETDE Operating Agent: Debbie Cutler, Chair

4. Draft Tasks Task 1: Define the usage metrics that are collected/shared currently and what it is they are intended to convey toward reaching agreement on a common understanding. These definitions could be different between INIS and ETDE but could aid in them becoming more similar Task 2: Share comments: on the usefulness of these metrics to date; other useful metrics that members may be aware of that are reported by other systems that ETDE/INIS might want to consider collecting; and, also share knowledge of other metrics-tracking software that may be worth considering for adoption. Task 3. Subgroup to recommend a core set of usage metrics that each system should maintain and how they can be useful in showing value. Task 4. Create a summary subgroup report for discussion at the 13 th JTC meeting (an interim report could be shared at the 35 th INIS ILO meeting and ETDE meetings).

5. Status Report Agreed that the subgroup was to focus on usage metrics coming from the web products each offer from their central systems (databases, home pages) Recognized that metrics are useful for different purposes, but mostly to show value and trends; definitions of key metrics would be valuable. The COUNTER project was suggested as a possible resource. Recognized that financial pressures exist and off-the-shelf packages could be sufficient for some needs and promote standardization where feasible. ETDE and INIS are both looking at a newer off-the-shelf package called Google Analytics that captures and visualizes website traffic-related metrics. INIS has already implemented this software, and ETDE will be doing so soon. The hope is that most of the website traffic metric needs could be met with this tool. Began sharing the kinds of usage metrics that ETDE and INIS are currently collecting, based on Member requests over time. In addition to web traffic, many more directly relate to the database itself. These are generally quite customized and take effort. It is anticipated that some customized database metrics will still be needed, but could perhaps be minimized. Later slides show some of the metrics ETDE and INIS are currently collecting and/or considering. Next Steps: Subgroup Chair will be leading further discussions on these tasks soon.

6. Current ETDE Metrics Database Production Statistics (not currently addressed by subgroup) Website traffic usage (ETDE and ETDEWEB sites): Annual; Pages Accessed, Referring sites, Distinct Hosts served, Database Sessions Monthly, Annually; By authentication method, by country Downloads, links taken NCL/Full text (including subject areas), DOI links, availability links Searches performed (Overall annual count) County of Information used Monthly, Annually; metadata viewed, links taken

7. Current INIS Metrics Database Productions Statistics (not currently addressed by subgroup) Database Use Statistics Monthly, by Country; Homepage, Searches, NCL downloads, Exports, Authority/Index use INIS home page statistics (now using Google Analytics) Visits, Page views, traffic sources (countries, search engines) referrals, etc. INIS Members’ area statistics Same as home page statistics above

8. Possible metrics to look at for usefulness 1-Referring sites 2-Repeated Visitor 3-Usage by country 4-Users type of organization 5-Path analysis 6-Subject Area 7-Publication Year 8-Place of Publication 9-Document Type

9. Possible metrics to look at for usefulness (cont.) 10-Language of Publication 11-Use of Advanced Search 12-Use of Simple Search 13-Use of Authorities/ Indexes 14-Full text download 15-Use of Help Files 16-Correlation between country of user and Subject Area 17-Correlation between country of user and Type of Publication

10. Questions/Feedback Contact: Debbie Cutler, Subgroup Chair Energy Technology Data Exchange (ETDE) cutlerd@osti.gov +1-865-576-1272 cutlerd@osti.gov