1. E-Use Measurement: A Detour Around the Publishers ALCTS | Summer 2005 Joe Zucca Assessment, Planning and Publications Librarian University of Pennsylvania Library

2. Avr. Login per Resident Student Use of E-Resources: Three Profiles by Residence logins per capita, by hour. Feb ‘03-May ’05 [49,857 logins total] Harnwell N=757 Kings Court N=358 Stouffer N=345 Hour of Day ALCTS Summer 2005

3. TITLES 3 HOUSES as a GROUP ALL DOMAINS LexisNexis Academic18 Factiva24 Onefile311 MEDLINE41 JSTOR512 ScienceDirect Journals62 Oxford English Dictionary727 PubMed Plus83 MLA International Bibliography925 PsycINFO10 CINAHL/ Nursing1117 ABI/Inform - Proquest1218 ISI Citation Indexes135 Encyclopaedia Britannica1437 Oxford Reference1528 The Top 15 Titles by Use, Comparative Ranks: 3 Houses and All Users ALCTS Summer 2005

4. Key Attributes of Metrics and Measurement Processes Metrics Comprehensive [Licensed Stuff, Local, Public] Processes-Architecture Scaleable, Efficient (high output for low effort), Sustainable, Distributed Processes-Data Granular, Normalized, Integrative, Anonymous Context-Sensitive [Location, Time, Demographic, Cost, Resource Type & Class, Need] ALCTS Summer 2005 Consistent [Uniform Across Resources, Replicable]

5. 1. User initiates a session using pages spawned by a database Schematic View of the Data Logging Process 5. Db logs event 5.1 Proxy server logs the event 2. Db swaps handle for authentic url 3. Proxy scan 3.1 Authentication challenge 4. Pass to vendor site 6. Data Farm ERMS ALCTS Summer 2005

6. Service Events Customers Staff Data Farm Project: Events, Data, Plumbing, Information People and Network Data Clean | Anonymize | Integrate Data Streams Inform Staff Borrow a Video Access an E-journal Catalog a Book Visit a Library Copy or Print Data Farm Environment ALCTS Summer 2005

7. E-Resource UseReference ContactCirculation Acquisitiions Funds Holdings Copier | Printer Use Gate Swipes Resolve ResourceResolve PeopleResolve Places Web Analytics Image Collection Use Data Farm Oracle Space: 14+ gb, in 75 tables, tracking events and their properties Staff Census LDAP Tech Processing Workflow ALCTS Summer 2005 Digital Library (erms) Print Library (Voyager) Building Use Metadata Administration Reference|Instruction (dynamic)

8. So, what do we do with the data? Dashboard Reports (static) Report Builders (dynamic) Data Bureau (ad hoc reports and fishing expeditions) Lower barriers between management information and people with management responsibility (or any other staff) Help to scale and institutionalize assessment Provide a distributed and multi-tiered environment for interacting with raw data and generating quantitative information ALCTS Summer 2005

9. Dashboards: Vital signs at a glance INTERACTIONS with DATA ALCTS Summer 2005

10. Report Builders INTERACTIONS with DATA ALCTS Summer 2005

11. Attempts at ranking for selection based on use and other factors ALCTS Summer 2005

12. A Hypothetical Scheme for Journal Selection Ranking Qualitative Scores Quantitative Scores Factor Rank Librarian rank Impact Penn Artcls. Use Metric Cost Effc Title 1 1 2.60 1 3 4 -1.54 1 Title 2 1 3.87 6 4 54 -1.72 2 Title 3 3 22.4 9 9 8 -1.89 3 Title n ALCTS Summer 2005

13. Ad Hoc | Mediated INTERACTIONS with DATA Van Pelt (public areas) 174,584 55.2% 55.2% Biomedical (public areas) 41,577 13.2% 68.4% Staff (Van Pelt-Dietrich and Biomedical) 41,356 13.1% 81.5% Electronic Classroom 14,535 04.6% 86.1% Fine Arts 13,671 04.3% 90.4% Lippincott 10,293 03.3% 93.6% Veterinary 5,708 01.8% 95.4% Dental 4,304 01.4% 96.8% Museum 3,598 01.1% 97.9% Chemistry 1,950 00.6% 98.6% Math 1,901 00.6% 99.2% Undergraduate Study Ctr 1,502 00.5% 99.6% Rare Book and Manuscript 954 00.3% 99.9% High Density Storage 209 00.1% 100.% Total Libraries 316,140 100% Distribution of E-resource Use Across the Libraries FY04 Logins Pct. Cml Pct. ALCTS Summer 2005

14. Items Charged and E-resource Log-ins Fall 2004 Ad Hoc Interactions with the Database ALCTS | Summer 2005

15. Relationship Between E-Resource Use and Item Circulation, Fall 2004 72 observations ALCTS | Summer 2005

16. Practical Applications of Data Farm Resources Budget defense (slow but steady rates of increase, curtailing the need to make major cuts in materials) Feeding the data-mavens and spreading best practices E-resource selection (driving trade-offs more typically than cuts) Print collection management Staffing | Facilities Planning Developing and testing web tools ALCTS Summer 2005

17. Key Attributes of Metrics and Measurement Processes [REPRISED] ALCTS Summer 2005 Metrics Comprehensive [Licensed Stuff, Local, Public] Processes-Architecture Scaleable, Efficient (high output for low effort), Sustainable, Distributed Processes-Data Granular, Normalized, Integrative, Anonymous Context-Sensitive [Location, Time, Demographic, Cost, Resource Type & Class, Need] Consistent [Uniform Across Resources, Replicable]

18. E-Use Measurement: A Detour Around the Publishers Joe Zucca zucca@pobox.upenn.edu University of Pennsylvania Library

19. ALCTS | Summer 2005 ScienceDirect Journals: Regression of View Counts (Elsevier) on Penn Login Counts. Feb-Nov 2003. [1,270 cases]

20. ALCTS | Summer 2005 R 2 = 0.9814 0 200 400 600 800 1000 1200 1400 1600 1800 0500100015002000 Penn Login Count [count-use] OCLC Login Count OCLC Databases: Regression of Vendor Login Counts on Penn Login Counts, jl2001-je2002. [48 cases]

21. Three E-Use Profiles by Residence: Top Ten Titles Used Logins per Capita, Feb ‘03-May ‘05 Harnwell N=757 Kings Court N=358 Stouffer N=345 LexisNexis Academic2.71.70.6 Factiva2.21.30.5 Onefile1.4 0.4 JSTOR1.20.70.5 MEDLINE (complete file)1.10.80.5 Oxford English Dictionary0.70.80.4 PubMed Plus0.80.70.2 MLA International Bibliography0.70.80.3 PsycINFO1.00.30.2 CINAHL0.70.40.5 ALCTS | Summer 2005

22. TITLESHarnwellKings CourtStouffer Total Logins LexisNexis Academic20115972012809 Factiva16724541642290 Onefile13816111882180 MEDLINE9162972001413 JSTOR8872611581306 ScienceDirect Journals8092261901225 Oxford English Dictionary565286126977 PubMed Plus61725082949 MLA Intrn’l Bibliography511301104916 PsycINFO73110253886 CINAHL/ Nursing563134171868 ABI/Inform68912143853 ISI Citation Indexes392204110706 Encyclopaedia Britannica35923545639 Oxford Reference35421564633 Three E-Use Profiles by Residence: Top 15 Titles Used (by login count) ALCTS | Summer 2005