Assessing Library Performance:

Slides:

Advertisements

Similar presentations

Re-Shaping Library Service Programming: New Strategies for the New Millennium Daryl C. Youngman Kansas State University 23d Annual Conference International.

Advertisements

Del Mar College Planning and Assessment Process Office of Institutional Research and Effectiveness January 10, 2005.

William Paterson University Five Strategic Areas of Focus at the Cheng Library Fairleigh Dickinson University June 18, 2009 Anne Ciliberti

of Research Libraries Measures for Electronic Use: The ARL E-Metrics Project Statistics in Practice - Measuring & Managing IFLA.

Changes in Library Usage, Usability, & User Support Denise A. Troll Distinguished Fellow, Digital Library Federation Associate University Librarian, Carnegie.

Visual Literacy Standards Task Force Open Meeting ACRL Image Resources Interest Group Virtual meeting, ALA Midwinter 2011.

WASHBURNWASHBURN Friends of Mabee Library October 28, 2004 Standardized Assessment of Information Literacy Skills Presented by Judy Druse Martha Imparato.

of Research Libraries Next Generation Statistics for Libraries: CAUL Forum 20 January 2003 Sydney, NSW The ARL E-Metrics Project.

Library Statistics: what’s needed and what’s new Lynn Copeland Simon Fraser University Library Thurs. March 15, 2007 Vancouver Ass’n of Law Libraries.

Sub-theme Three The Self-Assessment Process and Embedding QA into the Life of an Institution by Terry Miosi, Ph.D. UAE Qualification Framework Project.

of Research Libraries Assessing Library Performance: New Measures, Methods, and Models 24 th IATUL Conference 2-5 June 2003 Ankara,

Library Assessment in North America Stephanie Wright, University of Washington Lynda S. White, University of Virginia American Library Association Mid-Winter.

The Assessment Environment in North American Research Libraries Stephanie Wright, University of Washington Lynda S. White, University of Virginia 7th Northumbria.

Outcome Assessment Tools for the Library of the Future ACRL Conference 2005 April 7, 2005 Minneapolis, MN Martha Kyrillidou Director, ARL Statistics.

Types of Assessment Satisfaction of the customer. Satisfaction of the worker. Workflow effectiveness and speed. Service delivery effectiveness and speed.

of Research Libraries The Role of Assessment in Research Libraries Initiative to Recruit a Diverse Workforce Leadership Symposium.

Collaborative Assessment: Using Balanced Scorecard to Measure Performance and Show Value Liz Mengel, Johns Hopkins University Vivian Lewis, McMaster University.

ARL Statistics and Measurement Library Assessment Thessaloniki, Greece June 13-15, 2005 Brinley Franklin, University of Connecticut Martha.

Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site

A SSOCIATION OF R ESEARCH L IBRARIES Measure Matters, and Measures that Matter Martha Kyrillidou ARL Statistics and Measurement Program FEDLINK.

Online Northwest Twentieth Annual Conference Corvallis, Oregon February 28, 2003 Julia Blixrud, ARL Director of Information Services LibQUAL+ TM: An Innovative,

CEEMAN AccreditationCape Town, CEEMAN Accreditation IQA Dr.Virginijus Kundrotas.

Training and Development Prof R K Singh AIMA CME.

of Research Libraries Library Metrics in a Changing Environment National Seminar of Libraries in Malaysia, May 25-27, 2004 Bruce.

Framework for the Creation of Digital Knowledge Resources to meet the Challenges for Digital Future: A Librarian’s Perspective Dr. Harish Chandra Librarian.

1 Project web site Evaluating Library Service Quality: Use of LibQUAL+  IATUL Kansas City, MO June 2002 Julia Blixrud Association.

Le New Measures Initiative de l’American Library Association (ARL) A CREPUQ 1 février 2005 Montreal, Canada Martha Kyrillidou Director, ARL.

Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.

1 Strategic Plan Review. 2 Process Planning and Evaluation Committee will be discussing 2 directions per meeting. October meeting- Finance and Governance.

Assessing Information Literacy with SAILS Juliet Rumble Reference & Instruction Librarian Auburn University.

MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service.

Old.libqual.org LibQUAL+ TM : A Total Market Survey Duane Webster ARL Executive Director January 2004 San Diego, CA.

Using LibQUAL+ to Rethink Public Services June 2003.

Shared Services Initiative Summary of Findings and Next Steps.

Planning and Executing Library Assessment: Basic Methods and Tools

AQIP Categories Category One: Helping Students Learn focuses on the design, deployment, and effectiveness of teaching-learning processes (and on the processes.

Zero-Textbook-Cost Degree Grant Program (Z Degrees)

Presenter: Sue Hackett

Achievement of KAI Targets in Brief (January - March 2014)

CILIP Performance Framework – Business metrics & KPI

James G. Neal ACRL National Conference 2 April 2011

9th Northumbria International Conference on

Phyllis Lynch, PhD Director, Instruction, Assessment and Curriculum

Department of Political Science & Sociology North South University

Information Literacy and Accreditation

Quantifying the value of our libraries. Are our systems ready?

Descriptive Analysis of Performance-Based Financing Education Project in Burundi Victoria Ryan World Bank Group May 16, 2017.

Why Accessibility Profession Matters IAAP UK Chapter

Quality Certification

Tell a Vision: 3 Vignettes

Timothy S. Brophy, Director of Institutional Assessment

Brinley Franklin Vice Provost University of Connecticut Libraries.

Information Technology (IT)

UNLV Data Governance Executive Sponsors Meeting

How to Design and Implement Research Outputs Repositories

Markku Laitinen, Planning Officer, National Library, Finland

Standards for Use Measures for Electronic Resources

Presented by: Skyline College SLOAC Committee Fall 2007

Service Quality Assessment in a Digital Library Environment

Albania 2021 Population and Housing Census - Plans

LibQUAL+TM : A Total Market Survey

Program Review Presentation March 17th, 2016

February 21-22, 2018.

LibQual+ Survey Results 2002

Finalization of the Action Plans and Development of Syllabus

6 Chapter Training Evaluation.

ISO 9001 Auditing Practices Group

Information Literacy: What is it and Why Should I Care?

The Association of Research Libraries

Presentation transcript:

Assessing Library Performance: New Measures, Methods, and Models 24th IATUL Conference • 2-5 June 2003 • Ankara, Turkey Julia C. Blixrud, ARL Assistant Executive Director, External Relations

Measures that Matter Input Output Outcome Impact Consistent with organizational mission, goals and objectives Integration with program review Balance customer, stakeholder, and employee interests and needs Establish accountability Collection and use of reliable and valid data

Forces and Challenges Increasing demand for libraries to demonstrate outcomes/impacts in areas of importance to institution Increasing pressure to maximize use of resources through benchmarking resulting in: Cost savings Reallocation

ARL New Measures Projects Demonstration project for service effectiveness measures (LibQUAL+™) Project to define usage measures for electronic information resources (includes institutional outcomes) Identification of measures that demonstrate a library’s contribution to student learning outcomes Investigation of role libraries play in support of the research process Identification of cost-drivers and development of cost-benefit studies (ILL/DocDel)

User Surveys Obtain direct responses to a series of questions from the community surveyed Identify user issues, concerns and needs Measure library performance from the user perspective, including satisfaction Acquire quantifiable data that can be statistically analyzed and generalizeable for the larger population Improve or change services Increase library visibility and marketing Contribute to broader institutional assessment/accreditation

LibQUAL+™ Project Goals Establishment of a library service quality assessment program at ARL Development of web-based tools for assessing library service quality Development of mechanisms and protocols for evaluating libraries Identification of best practices in providing library service

Survey Instrument 3 scales: Minimum Desired Perceived

Dimensions of Library Service Quality

Percentages of Acquisitions Dollars Devoted to Electronic Resources

ARL E-Metrics Project Three phases: Initial Phase (May-October 2000): What do we know? Inventory of current practices at ARL libraries as to statistics, measures, processes, and activities that pertain to networked resources and services. Second Phase (November 2000-June 2001): What can we collect? Identified and field tested an initial draft set of statistics and measures Final phase (July 2001-December 2001): What difference does this make? Build linkages to: educational outcomes/impact, research, technical infrastructure

Recommended Statistics & Measures Patron Accessible Electronic Resources (R1-3) Use of Networked Resources & Services (U1-5) Expenditures for Networked Resources & Related Infrastructure (C1-3) Library Digitization Activities (D1-3) Performance Measures (P1-3)

Characteristics of Each Recommended Measure Definition Rationale Unit of Measure Data source Frequency Process Related Issues

Focus on Electronic Resources Project COUNTER ICOLC Measuring Impact (Franklin/Plum)

Cost-Effectiveness ILL/DD study Technical Services Cost Study Activity Based Costing Balanced Scorecard Baldrige Quality Award

Outcomes Institutional Learning Research

Learning Outcomes Develop strategy to involve library in campus assessment activities to demonstrate the value of the library to the learning community Move from content view (books, subject knowledge) to competency view (what students are able to do) Understand learning outcomes of academic degree programs Develop curriculum segments through which the library achieves outcomes Information Literacy Competency Standards for Higher Education approved by the Association of College and Research Libraries in January 2000

Standardized Assessment of Information Literacy Skills Base Based on outcomes as defined by ACRL information literacy competency standards d on ACRL standards Contains items not specific to a particular institution or library Is easily administered Has been proven valid and reliable Assesses at institutional level Provides for both external and internal benchmarking

Research Outcomes (Surrogates) R&D expenditures PhDs awarded/year Post-doctoral appointments Research awards per year Academy memberships Faculty quality rankings

New Measure Challenges Resources (i.e., time and money) Buy-in (commitment to a culture of assessment Access to individuals to evaluate Expertise to conduct evaluation Project management experience Appropriate benchmarks Conceptual clarity Measurement & design requirements Instrument validity and reliability

Julia C. Blixrud Assistant Executive Director, External Relations Association of Research Libraries 21 Dupont Circle, Ste 800 Washington, DC 20036 jblix@arl.org 202-296-2296 ext. 133 202-872-0884 (fax) 202-251-4678 (cell)