1. Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas at Little Rock Seattle, WA, August 2008

2. Outline Introduction Strategic Planning Assessment Two case studies –K-State University –UALR Conclusions

3. Introduction “Are we any closer to knowing whether performance measures lead to library effectiveness than when the debate began 25 to 30 years ago?” Cullen (1998) Our response: –Yes, in the area of library planning

4. Who we are Dole –Planning and assessment: interests since Library School (UIUC) –Strategic Planning (PSU, SUNY SB, WU, UALR) Assessment (SUNY SB, WU) James, Martin, Rose – some previous experience with strategic planning or assessment

5. Literature Strategic Planning: vast Assessment: vast Integrated approach: little

6. Characteristics of Strategic Planning Strategic Planning links library’s priorities to -Priorities of the parent institution -Needs of library users -Allocation of resources

8. Assessment Input/Output Measures –Operating budgets –Collections, staffing, facilities Statistical analysis –Bibliometrics –Benchmarking

9. Assessment Outcomes measurement –Response to call for accountability in higher education –Difficult to do Service Quality/User Satisfaction –ARL New Measures

11. Organizational Change Changing a culture requires the constant redesign of the infrastructure and frame of reference that that define appropriate and inappropriate values, expectations and activities. Covey (2002, 163) Strategic planning can do this

12. Our Earlier Work Compared Planning and Assessment at K-State Research Extensive 23,000+ student 2000+ faculty 57 librarians 49 support staff $14.1 million operating budget UALR Doctoral/Research 12,000 students 800+ faculty 13 librarians 25 support staff $4.8 million operating budget

13. Strategic Planning K State –Strategic Planning Preceded Assessment UALR –Assessment Preceded Planning K-State’s plan is available: Kansas State

14. Strategic Planning at UALR 1970s, 80s, 90s –Planning, mainly brainstorming –Top-down –Unstructured approach –No assessment

15. Strategic Planning at UALR August 2006, strategic planning retreat –Outside consultant –Broad participation of library faculty & staff –Development of mission & vision statements 2006 – present –Working groups revised mission & vision –New groups formed to develop goals & strategies

17. Strategic Planning at UALR July 2007, 2 nd retreat -Working groups ALL agree that planning must include assessment -Assessment plan formed Focus groups, fall 2007 LibQUAL+®, spring 2008 July 2008, 3 rd retreat - Results of Assessment shared -Facilities to be focus for 2008-2009

19. UALR Focus Group Reports 35 participants, faculty and students Concepts –Library as place –Library as services –Library as people Questions –What is working –What needs improvement

20. Focus Group Responses Culture of good will Consumer mind sets Integration of services Interest in setting and facilities Interest in collections

21. LibQUAL+® Results 794 responses and 280 comments – students, faculty and staff Generally, satisfied with library staff and services Identify areas where more assessment should be done Self-study grids – focus group and LibQUAL+®

24. What Users say Needs Improvement Assessment Tool What Did We Do? When?If nothing why? Negative forces? Is it working? Computer terminals too crowded Need more electrical outlets Focus Group 2007- 2008LibQUAL+® Computer lab was doubled in size to provide additional computers and ADA resources Beginning of new fiscal year Students appear to be pleased with changes Update furniture and décor (6 comments) Floor fans noisy Focus Group 2007-2008LibQUAL+® Furniture for three public areas has been ordered Continued to run fans to assist in controlling humidity Beginning of new fiscal year This is an ongoing activity Furniture not received yet, Will observe to see how it received by patrons Continue to receive complaints Poor lighting (3 comments) Focus Group -2007Nothing at this time, needs more study Map showing where the rooms are and how to get there (2 comments) Room numbering is confusing Focus Group -2007Under discussion Nothing at this time UALR Assessment Grids

27. UALR’s plan is available at UALR's Plan

28. UALR: Integrated Approach What worked? –Data confirmed some assumptions Facilities need improvement What didn’t work? –No impact on Training Task Force –Waiting for data delayed planning Collections Task Force

29. Conclusions Integrated assessment and strategic planning –Not much in the literature K-State –1982-1999, planning alone –1999-present, assessment and planning UALR –2006 to present, integrate assessment and planning

30. Conclusions “Are we any closer to knowing whether performance measures lead to library effectiveness than when the debate began 25 to 30 years ago?” Cullen (1998) Our response: –Yes, in the area of library planning –Assesment data helped us to be effective in improving library faciltites

31. Questions Is the combination of strategic planning & assessment a new approach? Is it an example of the Culture of Assessment? (Lakos & Phipps) Have other libraries done the same things? Had the same results?

32. Questions? Comments? Thank you! wvdole@ualr.edu dkrose@ualr.edu