Webmetrics Workshop American Library Association Chicago, IL June 24, 2004 Martha Kyrillidou Director, ARL Statistics and Measurement Program Association.

Slides:

Advertisements

Similar presentations

Usage statistics in context - panel discussion on understanding usage, measuring success Peter Shepherd Project Director COUNTER AAP/PSP 9 February 2005.

Advertisements

COUNTER: an overview Peter Shepherd Project Director COUNTER Usage Statistics Training Seminar, Oxford, 9 December 2005.

Measuring the Impact of Networked Electronic Resources: Developing an Assessment Infrastructure for Libraries, State, and Other Types of Consortia Presented.

DigiQUAL™ DigiQUAL™: a Digital Library Evaluation Service Presented at 7 th Northumbria by Martha Kyrillidou, ARL Bruce Thompson, Texas.

Global Developments in Assessment: LibQUAL+ ® and Beyond… 6th International JISC/CNI Conference York, U.K. July 6-7, 2006 Duane Webster Executive Director.

The COUNTER Code of Practice for Books and Reference Works Peter Shepherd Project Director COUNTER UKSG E-Books Seminar, 9 November 2005.

Brinley Franklin Vice Provost, University of Connecticut Libraries MINES for Libraries Measuring the Impact of Networked Electronic Services (MINES): The.

Library Assessment Conference: Building Effective, Sustainable, Practical Assessment August 5, 2008 LibQUAL+ Lite: A New Model for Conducting Service Quality.

DigiQUAL™ Regrounding LibQUAL+® for the Digital Library Environment: An Analysis of the DigiQUAL® Data Presented at 9 th Northumbria by.

Presented by Beverly Choltco-Devlin Reference and Electronic Resources Consultant Mid-York Library System September 25, 2009 REVVED UP FOR REFERENCE CONFERENCE.

TM Project web site Invited Address October, 2004 South Africa.

Measuring the Impact of Networked Electronic Services: Developing Assessment Infrastructure for Libraries, State, and Other Types of Consortia Presented.

The ARL E-Metrics Project Measures for Electronic Resources ACRL/NEC Information Technology Interest Group May 17, 2002 Brinley Franklin Director, University.

Making Library Assessment Work: Practical Approaches for Developing and Sustaining Effective Assessment Phase I Update ARL VISITING PROGRAM OFFICERS

ARL perspectives on accuracy in web analytics reporting on digital libraries CNI Fall 2013 Task Force Meeting Washington, DC December 9, 2013.

Technical Services Assessment in Pennsylvania Academic Libraries Rebecca L. Mugridge University at Albany, SUNY American Library Association ALCTS Affiliates.

LibQUAL + Surveying the Library’s Users Supervisor’s Meeting March 17, 2004.

Technological Tools for Assessment New Ways of Listening to Library Users Workshop Washington, DC November 4 - 5, 2005 Jonathan D. Sousa Technical Applications.

Project web site: old.libqual.org LibQUAL+™ from a Technological Perspective: A Scalable Web-Survey Protocol across Libraries Spring 2003 CNI Task Force.

of Research Libraries Assessing Library Performance: New Measures, Methods, and Models 24 th IATUL Conference 2-5 June 2003 Ankara,

Outcome Assessment Tools for the Library of the Future ACRL Conference 2005 April 7, 2005 Minneapolis, MN Martha Kyrillidou Director, ARL Statistics.

1 Usability of Digital Libraries Sanda Erdelez & Borchuluun Yadamsuren Information Experience Laboratory University of Missouri – Columbia USA Libraries.

Types of Assessment Satisfaction of the customer. Satisfaction of the worker. Workflow effectiveness and speed. Service delivery effectiveness and speed.

Martha Kyrillidou Brinley Franklin Terry Plum MINES for Libraries TM ASSOCIATION OF RESEARCH LIBRARIES Assessing the Value of Networked Electronic Services:

Demonstrating Value and Creating Value: Evidence-Based Library Management through MINES for Libraries™

Proposition: Digital Collections Are Easier to Find and Use through DLF Aquifer’s American Social History Online Katherine Kott, Aquifer Director Library.

Old.libqual.org What will ARL do for you? What will you do? January 2005 Shrivenham, UK.

ARL Statistics and Measurement Library Assessment Thessaloniki, Greece June 13-15, 2005 Brinley Franklin, University of Connecticut Martha.

LibQUAL+ ® Survey Results American Library Association (ALA) Midwinter Meeting Philadelphia, PA January 14, 2008 Martha Kyrillidou, Director Statistics.

Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site

Testing the LibQUAL+ Survey Instrument James Shedlock, AMLS, Dir. Linda Walton, MLS, Assoc. Dir. Galter Health Sciences Library Northwestern University.

E-Metrics Project Update American Library Assocation Orlando June 27, 2002 Sherrie Schmidt Dean of University Libraries Arizona State.

Web-Based Usage Surveys MINES for Libraries TM Brinley Franklin University of Connecticut Terry Plum Simmons GSLIS

ARL and SCONUL Assessment Initiatives: Synergies and Opportunities Stephen Town University of York, UK LibQUAL+ Exchange Florence, 2009.

VAMP – laying the foundations Claire Creaser Angela Conyers Suzanne Lockyer.

ARL Statistics and Measurement Program Effective, Sustainable and Practical Assessment Martha Kyrillidou Director, ARL Statistics and Service Quality Programs.

A.M.TammaroUniversity of Tbilisi, 5-15 July 2010 Evaluation of Digital library Anna Maria Tammaro University of Parma.

LibQUAL+™ Process Management: Using the Web as a Management Tool Amy Hoseth Massachusetts LSTA Orientation Meeting Boston, MA October 21, 2005 old.libqual.org.

Brinley Franklin Vice Provost University of Connecticut Libraries.

LibQUAL+™ Canada 2007 a national survey project sponsored by the Canadian Association of Research Libraries.

of Research Libraries Library Metrics in a Changing Environment National Seminar of Libraries in Malaysia, May 25-27, 2004 Bruce.

MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service.

1 Project web site Evaluating Library Service Quality: Use of LibQUAL+  IATUL Kansas City, MO June 2002 Julia Blixrud Association.

Le New Measures Initiative de l’American Library Association (ARL) A CREPUQ 1 février 2005 Montreal, Canada Martha Kyrillidou Director, ARL.

Use Measures for Electronic Resources: Theory and Practice A Librarian’s Perspective ALA / ALCTS June 27, 2005 Chicago, Illinois Brinley Franklin Vice.

TEXAS A&M UNIVERSITY LIBRARIES Colleen Cook, Texas A&M University Martha Kyrillidou, Association of Research Libraries.

Project web site: old.libqual.org LibQUAL+™ Process Management: Using the Web as a Management Tool ALA Midwinter Conference San Diego, California January.

LibQUAL+ ® Survey Administration LibQUAL+® Exchange Northumbria Florence, Italy August 17, 2009 Presented by: Martha Kyrillidou Senior Director, Statistics.

MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service.

March 14, 2009 ACRL 14 th National Conference Seattle, WA ClimateQUAL™: Organizational Climate and Diversity Assessment Presented by Martha Kyrillidou,

Brinley Franklin Vice Provost University of Connecticut Libraries MINES for Libraries.

TM Project web site Report Meeting Colleen Cook Bruce Thompson Martha Kyrillidou Jonathan Sousa June 21, 2003 ALA Toronto CANADA.

Center for Information and Communication Studies Scholarly Reading in a Digital Age: Some things change, some stay the same Carol Tenopir University of.

Old.libqual.org LibQUAL+ TM : A Total Market Survey Duane Webster ARL Executive Director January 2004 San Diego, CA.

Your LibQUAL+ ® Community: A Results Meeting American Library Association (ALA) Annual Conference Washington, DC June 25, 2007 Martha Kyrillidou, Director.

LibQUAL+ ® Survey Results Presented by: Martha Kyrillidou Senior Director, Statistics and Service Quality Programs Association of Research.

Brinley Franklin Vice Provost University of Connecticut Libraries.

LibQUAL+ TM Library Survey LIBQUAL+ “ Only customers judge quality – all other measures are irrelevant”

Brinley Franklin and Terry Plum August 18, 2005

ARL New Measures MINES for Libraries Measuring the Impact of Networked Electronic Services Brinley Franklin Vice Provost University of Connecticut Libraries.

Assessing Library Performance:

Brinley Franklin Vice Provost University of Connecticut Libraries.

الأستاذ المساعد بقسم المناهج وطرق التدريس

Standards for Use Measures for Electronic Resources

MINES for Libraries Measuring the Impact of Networked Electronic Services (MINES): The North American Experience Brinley Franklin Vice Provost, University.

The Story Behind the Numbers: Measuring the Impact of Networked Electronic Services (MINES) and the Assessment of the Ontario Council of University Libraries’

LibQUAL+TM : A Total Market Survey

LibQual+ Survey Results 2002

Developing the DigiQUAL Protocol for Digital Library Evaluation

Presentation transcript:

Webmetrics Workshop American Library Association Chicago, IL June 24, 2004 Martha Kyrillidou Director, ARL Statistics and Measurement Program Association of Research Libraries StatsQUAL™

ARL Roles

ARL Statistics and Measurement …To describe and measure the performance of research libraries and their contribution to teaching, research, scholarship and community service …

Web Presence

Future of New Measures Initiative Incorporation of some new data elements in traditional surveys Development of workshops and consulting services for performance measures Establishment of data gathering and statistical analysis tools

What do we mean by E-Metrics within ARL? DigiQUAL MINES for Libraries ARL Supplementary Statistics Project COUNTER

It’s…? “familiar” and digital

Developing DigiQUAL Survey Items Background: ServQUAL ->LibQUAL ->DigiQUAL –LibQUAL dimensions of library service quality DigiQUAL: 12 themes of DL service quality AccessibilityCollection buildingDL as community for usersCopyright NavigabilityResource use...developersRole of federations InteroperabilityEvaluating collections...reviewersDL sustainability

Building a Survey (cont.) Customize Survey Issue: Flexibility vs. Standardization

Implementing Survey - Incentives Issues: must be easily transferable, requires address - clear IRB

What is MINES for Libraries™ MINES is a research methodology consisting of a web-based survey form and a sampling plan. MINES measures who is using electronic resources, where users are located at the time of use, and their purpose of use. MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, MINES is different from other electronic resource usage measures that quantify total usage (e.g., COUNTER, EQUINOX, E-Metrics, ICOLC Guidelines, ISO and NISO standards) or measure how well a library makes electronic resources accessible (LibQual+TM).

MINES for Libraries™ Methodology A representative sampling plan, including sample size, is determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library. Random moment/web-based surveys are employed at each site. Participation is usually mandatory, negating non- respondent bias, and is based on actual use in real-time. Libraries with database-to-web gateways or proxy re- writers offer the most comprehensive networking solution for surveying all networked services users during survey periods.

What do we mean by E-Metrics within ARL? DigiQUAL MINES for Libraries ARL Supplementary Statistics Project COUNTER

Interpreting results from individual libraries in the context of other sites Analysis & Reporting - Issues