E-Metrics: Which Ones?

Outline comparison of international e-metrics projects survey results from NZ and Australia on e-metrics practice suggestions for metrics to be included in the CAUL & CONZUL statistics

Increasing $ spent on e-resources But no national statistics reflecting use

Why collect E-metrics? Comparing against other similar libraries Demonstrating the librarys contribution to learning/ research outcomes To inform internal management decisions To assess the cost-effectiveness of alternative products and services.

E-Metrics Projects ARL COUNTER Equinox (European Union) NISO – draft revised Z39.7 standard on library statistics ISO Library Statistics standard under development … and others

Equinox: Electronic Library Performance Indicators 1. % of the population reached by electronic library services 2. No. of sessions on each electronic library service per member of the target population 3. No. of remote sessions on electronic library services per member of the population to be served 4. No. of documents and entries (records) viewed per session for each electronic library service 5. Cost per session for each electronic library service 6. Cost per document or entry (record) viewed for each electronic library service 7. % of information requests submitted electronically

8. Library computer workstation use rate 9. No. of library computer workstation hours available per member of the population to be served 10. Rejected sessions as a percentage of total attempted sessions 11. % of total acquisitions expenditure spent on acquisition of electronic library services 12. No. of attendances at formal electronic library service training lessons per member of the population to be served 13. Library staff developing, managing and providing ELS and user training as a percentage of total library staff 14. User satisfaction with electronic library services

Selected E-Metrics SourcePatron Accessible Electronic Resources A,NR1 Number of electronic full-text journals A,NR2 Number of electronic reference sources A,NR3 Number of electronic books Use of Networked Resources and Services A,NU1 Number of electronic reference transactions A,E,C,NU2 Number of logins (sessions) on electronic databases A,C,NU3 No. of queries (searches) in electronic databases A,C,E,NU4 Items requested in electronic databases

C,NFull-text requests from electronic databases E,NNumber of remote sessions on electronic services A,N?U5 Virtual visits to librarys website and catalog NZWeb page hits Expenditures for Networked Resources and Related Infrastructure A,NC1 Cost of electronic full-text journals A, (N)C2 Cost of electronic reference sources A, (N)C3 Cost of electronic books A,NC4 Library expenditures for bibliographic utilities, networks, and consortia E% of total acquisitions $ spent on e-resources

Performance Measures or Ratios AP1 Percentage of electronic reference transactions of total reference E% of information requests submitted electronically AP2 % of virtual library visits of all library visits AP3 Percentage of electronic books to all monographs EDatabase logins (sessions) per FTE ENo. of library computer workstation hrs/FTE NZLibrary computer workstations per EFTS

Patron Accessible Electronic Resources A,N1.1 Number of electronic full-text journals A,N1.2 Number of electronic reference sources A,N1.3 Number of electronic books Aus + NZ n=25 Aus n=18 Col. 1 = Australia + NZ, Currently collect Col. 2 = Australia only, Currently collect + should collect (1 or 2)

A,N2.1 Number of electronic reference transactions A,E, C,N 2.2 Number of logins (sessions) on electronic databases A,C, N 2.3 No. of queries (searches) in electronic databases A,C, E,N 2.4 Items requested in electronic databases C,N2.5 Full-text requests from electronic databases E,N2.6 Number of remote sessions on electronic services A,N?2.7 Virtual visits to website and catalog NZ2.8 Web page hits Use of Networked Resources and Services

The Zen librarian searched for nothing on AltaVista and received 27,987,384 hits. Copyright 2002 Brian smith.

A,N2.1 Number of electronic reference transactions A,E, C,N 2.2 Number of logins (sessions) on electronic databases A,C, N 2.3 No. of queries (searches) in electronic databases A,C, E,N 2.4 Items requested in electronic databases C,N2.5 Full-text requests from electronic databases E,N2.6 Number of remote sessions on electronic services A,N?2.7 Virtual visits to website and catalog NZ2.8 Web page hits Use of Networked Resources and Services

Expenditures for Networked Resources and Related Infrastructure A,N3.1 Cost of electronic full-text journals A, (N) 3.2 Cost of electronic reference sources A, (N) 3.3 Cost of electronic books A,N3.4 Library expenditures for bibliographic utilities, networks, and consortia E3.5 % of total acquisitions $ spent on e- resources

Performance Measures or Ratios A4.1 Percentage of electronic reference transactions of total reference E4.2 % of information requests submitted electronically A4.3 Percentage of electronic books to all monographs E4.4 Database logins (sessions) per FTE E4.5 No. of library computer workstation hrs/FTE NZ4.6 Library computer workstations per EFTS

The Zen librarian used a palm stylus to mark the reference desk statistics sheet. Copyright 2002 Brian smith.

Recommended E-metrics for CAUL/CONZUL 2.2 Number of logins (sessions) on electronic databases 2.3 No. of queries (searches) in electronic databases 2.5 Full-text requests from electronic databases 3.5 % of total acquisitions $ spent on e-resources

Omitted from this survey Size of the librarys digital collection e-theses e-reserve digitized heritage resources Use of the librarys digital collection OPAC searches Turnaways (rejected sessions)