Presentation is loading. Please wait.

Presentation is loading. Please wait.

Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site www.arl.org/libqual/

Published byAriel Horn Modified over 8 years ago

Similar presentations

Presentation on theme: "Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site www.arl.org/libqual/"— Presentation transcript:

1 Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site www.arl.org/libqual/

2 Opportunities and Pressures Increasing demand for libraries to demonstrate outcomes/impacts in areas of importance to institution Increasing pressure to maximize use of resources through benchmarking resulting in: –Cost savings –Reallocation

3 Antecedents Effective service delivery –“every unit … is valued in proportion to its contribution to the quality success of the campus” Danuta Nitecki

4 Why New Measures  Increased customer and stakeholder expectations  Greater demands for accountability  Exploding growth in use and applications of technology  Increasing competition for resources  Need for reliable and valid data –Benchmarking and best practice –Trends over time

5 ARL New Measures Initiative  Collaboration among member leaders with strong interest in this area  Specific projects developed with different models for exploration  Projects self-funded by interested members  Intent to make resulting tools and methodologies available to full membership and wider community  Freeze modifications to existing descriptive measures

6 LibQUAL+™ Description LibQUAL+ TM is a research and development project undertaken to define and measure library service quality across institutions and to create useful quality-assessment tools for local planning.

7  To fill a knowledge void in modeling the dimensions of library service quality from a user perspective  Based upon the model, to develop a web- delivered, effective total market survey instrument equivalent for service quality assessment in academic libraries  Using the derived instrument to recommend a process for an ongoing program of comparative outcome measurement for academic libraries The Purpose of the Research

8 Project Resources LibQUAL+ TM is an ARL/Texas A&M University joint effort. The project is supported in part by a 3-year grant from the U.S. Department of Education’s Fund for the Improvement of Post-Secondary Education (FIPSE).

9 Relationships: Perceptions, Service Quality and Satisfaction ….only customers judge quality; all other judgments are essentially irrelevant” Zeithaml, Parasuraman, Berry. (1999). Delivering quality service. NY: The Free Press.

10 LibQUAL+™ Project Goals Establishment of a library service quality assessment program at ARL Development of web-based tools for assessing library service quality Development of mechanisms and protocols for evaluating libraries Identification of best practices in providing library service

11 Process Overview

12 Dimensions of Library Service Quality

13 Survey Dimensions Access to Information Information AccessSelf RelianceProvision of Physical Collections Personal ControlReliabilityLibrary as Place Reliability Service AffectAffect of Service Spring 2002 (25-Item Survey) Spring 2001 (56-Item Survey) Spring 2000 (41-Item Survey)

14 LibQUAL+ TM Participants Year 1 Year 2 Year 3 Spring 2001Spring 2000 Spring 2002 12 Participants 43 Participants 164 Participants

15 Process Timeline August 2002 Gather information about LibQUAL+ TM survey Determine if have appropriate resources Identify budgetary requirements if any September 2002 Register for LibQUAL+ TM related workshops Identify and initiate steps to obtain human subjects research approval from IRB October – December 2002June/July 2002 Register for Spring 2003 survey Subscribe to ARL- QUALITY listserv Designate survey liaison/committee/project team Identify sample groups Identify best data source to obtain valid e-mail addresses for sample groups Meet with person(s) who will be drawing e-mail addresses to determine process feasibility Register for LibQUAL+ TM related workshops

16 Process Timeline January 2003 Need to have IRB approval by mid- January January 27-28, orientation session for participating libraries held during ALA Midwinter, Phildelphia, PA Attendance is required! Complete online demographics questionnaire Preview survey turned on Draw final e-mail address samples Spring 2003 survey open to public. Send out survey announcements Spring 2003 survey closed to public Participants complete online post hoc survey February 2003March-April 2003May 2003June 2003 Survey results distributed July 2003 LibQUAL+ TM evaluation questionnaire sent to participants

17 Sample Survey

18 Sample Survey…continued

19

20

21

22

23

24 Project Deliverables Print and web-based results include: –Aggregate Summaries –Demographics by Library –Item Summaries –Dimension Summaries –A copy of the survey instrument –Dimensions measured for survey implementation

25 Surveys Completed Spring 2002

26

27

28 LibQUAL+ Assessment Survey Aggregate (All Ranks) (All) Aggregate (All Ranks) Texas A&M University

29

30

31 Interpretation Frameworks Zone of tolerance Score norms

32 Technology Approach Reduced HTML requirements 2 load-balanced web/application server connected to 1 database Software use: ColdFusion, IIS webserver, SQL server, and Windows Advanced Server 2000

33 The Future: LibQUAL+

34 LibQUAL+ TM Brief History Experience with SERVQUAL in many libraries over the last 15 years Texas A&M SERVQUAL assessment New Measures Initiative called a meeting of interested ARL libraries (ALA Midwinter 2000) External funding through FIPSE, U.S. Department of Education (September 2000) Consortia and related associations participation Expressed interest by another 150 institutions for spring 2003 International Interest Other sectors outside higher education

35 Emergence of Consensus Antecedents Credibility Collaboration Tangibility Dissemination Evaluation External Validation Looking Forward: Maintenance of Consensus

36 Maintenance of Consensus Balance central control with local autonomy Issues of confidentiality/anonymity vs. desires for longitudinal study Normative issues/Best practices vs. “ranking” Long-term sustainability

37 Additional Information Visit the LibQUAL+ TM Web Page: old.libqual.org

Download ppt "Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site www.arl.org/libqual/"

Similar presentations

Evaluation Mary Rowlatt MDR Partners. Definition of project evaluation Evaluation focuses on whether the project was effective, achieved its objectives,

Evaluation Mary Rowlatt MDR Partners. Definition of project evaluation Evaluation focuses on whether the project was effective, achieved its objectives,
Listening To Our Users Queen’s 2010

Listening To Our Users Queen’s 2010
Pace University Assessment Plan. Outline I. What is assessment? II. How does it apply to Pace? III. Who’s involved? IV. How will assessment be implemented.

Pace University Assessment Plan. Outline I. What is assessment? II. How does it apply to Pace? III. Who’s involved? IV. How will assessment be implemented.
Assessment with LibQUAL+ ™ at the University of Vermont Vermont Library Association College and Special Libraries Section Conference April 7, 2006 Selene.

Assessment with LibQUAL+ ™ at the University of Vermont Vermont Library Association College and Special Libraries Section Conference April 7, 2006 Selene.
TM Project web site www.arl.org/libqual/ Invited Address October, 2004 South Africa.

TM Project web site Invited Address October, 2004 South Africa.
Project web site: old.libqual.org French Canadian 2003 Martha Kyrillidou Toni Olshen Fred Heath Claude Bonnelly Jean-Pierre Cote 5 th Northumbria International.

Project web site: old.libqual.org French Canadian 2003 Martha Kyrillidou Toni Olshen Fred Heath Claude Bonnelly Jean-Pierre Cote 5 th Northumbria International.
LibQUAL + Surveying the Library’s Users Supervisor’s Meeting March 17, 2004.

LibQUAL + Surveying the Library’s Users Supervisor’s Meeting March 17, 2004.
Asia Pacific Conference on Library & Information Education and Practice (A-LIEP) Nanyang Technological University, Singapore April 4, 2006 Bruce Thompson.

Asia Pacific Conference on Library & Information Education and Practice (A-LIEP) Nanyang Technological University, Singapore April 4, 2006 Bruce Thompson.
TM Project web site www.arl.org/libqual/ Quantitative Background for LibQUAL+ for LibQUAL+  A Total Market Survey Colleen Cook Bruce Thompson January.

TM Project web site Quantitative Background for LibQUAL+ for LibQUAL+  A Total Market Survey Colleen Cook Bruce Thompson January.
Assessment of Staff Needs and Satisfaction in an Evergreen Environment David Green NC Cardinal Consultant State Library of North Carolina.

Assessment of Staff Needs and Satisfaction in an Evergreen Environment David Green NC Cardinal Consultant State Library of North Carolina.
Assessment Leader Training General Education Student Learning Assessment GEO Training Series: 2 of 5 Spring 2012 February 13, 2012.

Assessment Leader Training General Education Student Learning Assessment GEO Training Series: 2 of 5 Spring 2012 February 13, 2012.
Project web site: old.libqual.org LibQUAL+™ from a Technological Perspective: A Scalable Web-Survey Protocol across Libraries Spring 2003 CNI Task Force.

Project web site: old.libqual.org LibQUAL+™ from a Technological Perspective: A Scalable Web-Survey Protocol across Libraries Spring 2003 CNI Task Force.
LibQUAL+ ® Survey Results www.libqual.org Presented by: Selena Killick ARL/SCONUL LibQUAL+ Administrator Cranfield University Introduction to LibQUAL+

LibQUAL+ ® Survey Results Presented by: Selena Killick ARL/SCONUL LibQUAL+ Administrator Cranfield University Introduction to LibQUAL+
Www.arl.orgAssociation of Research Libraries Assessing Library Performance: New Measures, Methods, and Models 24 th IATUL Conference 2-5 June 2003 Ankara,

of Research Libraries Assessing Library Performance: New Measures, Methods, and Models 24 th IATUL Conference 2-5 June 2003 Ankara,
Library Assessment in North America Stephanie Wright, University of Washington Lynda S. White, University of Virginia American Library Association Mid-Winter.

Library Assessment in North America Stephanie Wright, University of Washington Lynda S. White, University of Virginia American Library Association Mid-Winter.
Www.arl.org Outcome Assessment Tools for the Library of the Future ACRL Conference 2005 April 7, 2005 Minneapolis, MN Martha Kyrillidou Director, ARL Statistics.

Outcome Assessment Tools for the Library of the Future ACRL Conference 2005 April 7, 2005 Minneapolis, MN Martha Kyrillidou Director, ARL Statistics.
Old.libqual.org fairytale A fairytale about “ 22 items and a box ” presented by Martha Kyrillidou 19-20 January 2004 Glasgow, UK.

Old.libqual.org fairytale A fairytale about “ 22 items and a box ” presented by Martha Kyrillidou January 2004 Glasgow, UK.
New Ways of Listening To Our Users: LibQUAL+ Queen’s.

New Ways of Listening To Our Users: LibQUAL+ Queen’s.
Models of Online Learning – Identifying Components Week 3 Introduction to Web-Based Mentoring and Distance Education.

Models of Online Learning – Identifying Components Week 3 Introduction to Web-Based Mentoring and Distance Education.
Collaborative Assessment: Using Balanced Scorecard to Measure Performance and Show Value Liz Mengel, Johns Hopkins University Vivian Lewis, McMaster University.

Collaborative Assessment: Using Balanced Scorecard to Measure Performance and Show Value Liz Mengel, Johns Hopkins University Vivian Lewis, McMaster University.

Similar presentations

Ads by Google