VAMP – laying the foundations Claire Creaser Angela Conyers Suzanne Lockyer

VAMP – laying the foundations2  Background to the project  Phase 1  Critical Review  Survey of SCONUL members  Synthesis and recommendations  Outcomes

VAMP – laying the foundations3 Value and Impact Programme  Key area of concern  WGPI role to support members  Three phase programme  Phase 1 – definition & scoping  Review available tools  Survey understanding & use  Inform future developments  Phase 2 – development  Phase 3 – delivery & dissemination

VAMP – laying the foundations4 Critical review  Effective academic library  SCONUL statistics  User surveys  One-off projects  Other sectors  Other countries  Selective, not comprehensive

VAMP – laying the foundations5 SCONUL resources  Annual Library Statistics  HELMS  Trends analysis  Quality Assurance resources  Benchmarking support  Information literacy  Impact project

VAMP – laying the foundations6 User surveys  SCONUL template  LibQual+ TM  In-house instruments  Rodski

VAMP – laying the foundations7 Projects  EQUINOX  JUBILEE  JUSTEIS  Evalued project & toolkit  E-measures project  Outcomes project

VAMP – laying the foundations8 Other sectors  British Library  Economic impact study  Public libraries  Public library service standards  Impact measures  Libraries impact project  Longitude II

VAMP – laying the foundations9 Other sectors  Health libraries  Further Education libraries  CoLRiC  fforwm  School libraries

VAMP – laying the foundations10 Worldwide activity  USA – ARL  LibQual+ tm and DigiQual tm  MINES tm  E-metrics  SAILS  Australia – CAUL  Performance Indicator database  Case studies  User surveys  Publications & guidelines  South Africa

VAMP – laying the foundations11 Members’ survey  Questionnaire  38 respondents  68% had undertaken value & impact  Follow-up interviews  Suggested percentage might be higher

VAMP – laying the foundations12 Key findings  Reasons:  Advocacy within institution  Improve services  Comparison with others  Instigated by head of service  Methodologies:  Customer satisfaction/service evaluation  Benchmarking

VAMP – laying the foundations13 Understanding  Value & Impact not understood as unified concept  Need for evidence  Linking to university mission  Differing stakeholder interests  Quantitative measures

VAMP – laying the foundations14 Institutional drivers  Questionnaire  Little institutional requirement  Underestimated?  May be implicit rather than explicit  Libraries go beyond institutional demand  Essential to management  Expected to increase

VAMP – laying the foundations15 Barriers  Methodology/statistics  Flexibility  Comparability  Resources – time and/or cost  Particularly for first time  Skills/knowledge  2 / 3 had little or no knowledge of relevant tools/frameworks  Stakeholder buy-in

VAMP – laying the foundations16 Advantages  Improved services  Advocacy  Increased funding  Impressive

VAMP – laying the foundations17 Synthesis of results  No general lack of tools  Lack of understanding of value and impact  Definitions needed:  Value  Impact  On institution  On users  Outcome

VAMP – laying the foundations18 Tools identified and used  Used by questionnaire respondents  SCONUL Statistics  SCONUL User survey  Libqual+ tm  Benchmarking methods  SCONUL/LIRG impact project

VAMP – laying the foundations19 Tools identified and used  Also mentioned  Evalued  E-measures project  British library contingent valuation  Health library work  Australian examples

VAMP – laying the foundations20 Tools identified and used  Which leaves…  EQUINOX  JUBILEE  JUSTEIS  Outcomes project  SCONUL QAA guidelines  SCONUL WGIL resources  Public library examples  USA examples (other than LibQual+ tm )  South Africa

VAMP – laying the foundations21 Gaps identified  Locating appropriate tools  Lack of knowledge, and confidence  Adaptable to local needs, but also allowing comparisons  Impact of the library  Value with respect to institutional aims  Promotion & dissemination

VAMP – laying the foundations22 Recommendations  Establish community of practice  Support for existing tools  In-depth assessment  Promotion & branding  Training  Guidelines on outcomes  Staffing & operational issues

VAMP – laying the foundations23 Outcomes  Workshops  Content development  Impact on learning and teaching & on research  Value, cost and library staff  Performance portal

VAMP – laying the foundations24 Performance Portal

Thank you