1. Current trends in library resource management, discovery, and resource sharing Marshall Breeding Independent Consultant, Founder and Publisher, Library Technology Guides http://www.librarytechnology.org/ http://twitter.com/mbreeding 12 March 2015 Open Session for Carnegie Mellon University Libraries

2. Library Technology Guides www.librarytechnology.org

3. Appropriate Automation Infrastructure  Current automation products out of step with current realities  Majority of library collection funds spent on electronic content  Majority of automation efforts support print activities  New discovery solutions help with access to e- content  Management of e-content continues with inadequate supporting infrastructure

4. Key Context: Technologies in transition  Client / Server > Web-based computing  Social and Collaborative Networks Integration of social computing into core infrastructure  Local computing shifting to cloud platforms Application Service Provider offerings standard New expectations for multi-tenant software-as-a-service  Full spectrum of devices full-scale / net book / tablet / mobile Mobile the current focus, but is only one example of device and interface cycles

5. Strategic shift for Academic Libraries  Collection Shift from Print > Electronic + Digital  E-journal transition largely complete  Circulation of print collections slowing  Large-scale investment in e-books  Technical infrastructure support:  Need better tools for access to complex multi-format collections  Strong emphasis on digitizing local collections  Demands for enterprise integration and interoperability

6. New Metadata management WorlkFlows  Moving away from individual record-by-record creation  Life cycle of metadata  Metadata follows the supply chain, improved and enhanced along the way as needed  Manage metadata in bulk when possible  E-book collections  Highly shared metadata  E-journal knowledge bases, e.g.  Great interest in moving toward semantic web and open linked data  Path emerging for linked data in resource management and discovery systems  AACR2 > RDA  MARC > BIBFRAME (http://bibframe.org/)

7. Appropriate Automation Infrastructure  Current automation products out of step with current realities  Majority of library collection funds spent on electronic content  Majority of automation efforts support print activities  New discovery solutions help with access to e- content  Management of e-content continues with inadequate supporting infrastructure

8. Technology Shift  Client / Server > Web-based computing  Beyond Web 2.0 Integration of social and academic identities and networks into core infrastructure  Local computing shifting to cloud platforms Application Service Provider offerings standard New expectations for multi-tenant software-as-a-service  Full spectrum of devices full-scale / net book / tablet / mobile Mobile the current focus, but is only one example of device and interface cycles

9. Software as a Service  Multi-Tenant SaaS is the modern approach  One copy of the code base serves multiple sites  Software functionality delivered entirely through Web interfaces  No workstation clients  Upgrades and fixes deployed universally  Usually in small increments

10. Data as a service  SaaS provides opportunity for highly shared data models  Bibliographic knowledgebase: one globally shared copy that serves all libraries  Discovery indexes: article and object-level index for resource discovery  E-resource knowledge bases: shared authoritative repository of e-journal holdings  General opportunity to move away from library-by- library metadata management to globally shared workflows

11. Traditional model of Automation  Oriented to Print collections  Single Library System  Includes branches or divisional facilities  Automation strategies often set when capabilities of automation systems were limited  Institutional solo of collection management

12. Fragmented Library Management  ILS for management of (mostly) print  Duplicative financial transactions between ILS Acquisitions and enterprise business systems (many shadow systems)  Proxy and Authentication services  E-book lending platform (multiple?)  Interlibrary loan (borrowing and lending)  Self-service and AMH infrastructure  Electronic Resource Management  PC Scheduling and print management  Event scheduling  Digital Collections Management platforms (CONTENTdm, DigiTool, etc.)  Discovery-layer services for broader access to library collections  No effective integration services / interoperability among disconnected systems, non-aligned metadata schemes

13. Reconceptualization of Automation  Current organization of functionality based on past assumptions  Possible new organizing principles  Fulfillment = Circulation + ILL + DCB + e-commerce  Resource management = Cataloging + Acquisitions + Serials + ERM  Customer Relationship Management = Reference + Circulation + ILL (public services)  Enterprise Resource Planning = Acquisitions + Collection Development

14. Academic Libraries need a new model of library management  Not an Integrated Library System or Library Management System  The ILS was designed to help libraries manage print collections  Generally did not evolve to manage electronic collections  Other library automation products evolved:  Electronic Resource Management Systems – OpenURL Link Resolvers – Digital Library Management Systems -- Institutional Repositories

15. Integrated (for print) Library System Circulation BIB Staff Interfaces: Holding / Items Circ Transact UserVendorPolicies $$$ Funds CatalogingAcquisitionsSerialsOnline Catalog Public Interfaces: Interfaces Business Logic Data Stores

16. LMS / ERM: Fragmented Model Circulation BIB Staff Interfaces: Holding / Items Circ Transact UserVendorPolicies $$$ Funds CatalogingAcquisitionsSerialsOnline Catalog Public Interfaces: Application Programming Interfaces ` License Management License Terms E-resource Procurement Vendors E-Journal Titles Protocols: CORE

17. Informal management of Electronic Resources Circulation BIB Staff Interfaces: Holding / Items Circ Transact UserVendorPolicies $$$ Funds CatalogingAcquisitionsSerialsOnline Catalog Public Interfaces: Application Programming Interfaces Budget License Terms Titles / Holdings Vendors Access Details

18. Comprehensive Resource Management  No longer sensible to use different software platforms for managing different types of library materials  ILS + ERM + OpenURL Resolver + Digital Asset management, etc. very inefficient model  Flexible platform capable of managing multiple type of library materials, multiple metadata formats, with appropriate workflows  Support for management of metadata in bulk  Continuous lifecycle chain initiated before publication

19. Gaps in Automation  Almost no systematic automation support for references and research services  Customer Relationship Management?  Resource sharing / Interlibrary loan management  Collection development support

20. Library Services Platform  Library-specific software. Designed to help libraries automate their internal operations, manage collections, fulfillment requests, and deliver services  Services  Service oriented architecture  Exposes Web services and other API’s  Facilitates the services libraries offer to their users  Platform  General infrastructure for library automation  Consistent with the concept of Platform as a Service  Library programmers address the APIs of the platform to extend functionality, create connections with other systems, dynamically interact with data

21. Library Services Platform Characteristics  Highly Shared data models  Knowledgebase architecture  Some may take hybrid approach to accommodate local data stores  Delivered through software as a service  Multi-tenant  Unified workflows across formats and media  Flexible metadata management  MARC – Dublin Core – VRA – MODS – ONIX  Bibframe  New structures not yet invented  Open APIs for extensibility and interoperability

22. Consolidated index Search Engine Unified Presentation Layer Search: Digital Coll ProQuest EBSCO … JSTOR Other Resources New Library Management Model ` API Layer Library Services Platform Learning Management Enterprise Resource Planning Stock Management Self-Check / Automated Return Authentication Service Smart Cad / Payment systems Discovery Service

23. Library Services Platform Options Category WorldShare Management Services AlmaIntota Sierra Services Platform Kuali OLE Responsible Organization OCLCEx LibrisProQuest Innovative Interfaces, Inc Kuali Foundation Key precepts Global network-level approach to management and discovery. Consolidate workflows, unified management: print, electronic, digital; Hybrid data model Knowledgeba se driven. Pure multi- tenant SaaS Service-oriented architecture Technology uplift for Millennium ILS. More open source components, consolidated modules and workflows Manage library resources in a format agnostic approach. Integration into the broader academic enterprise infrastructure Software model Proprietary Open Source

24. Open Systems  Achieving openness has risen as the key driver behind library technology strategies  Libraries need to do more with their data  Ability to improve customer experience and operational efficiencies  Demand for Interoperability  Open source – full access to internal program of the application  Open API’s – expose programmatic interfaces to data and functionality

25. Leveraging the Cloud  Moving legacy systems to hosted services provides some savings to individual institutions but does not result in dramatic transformation  Globally shared data and metadata models have the potential to achieve new levels of operational efficiencies and more powerful discovery and automation scenarios that improve the position of libraries overall.

26.  Traditional Proprietary Commercial ILS  Aleph, Voyager, Millennium, Symphony, Polaris,  BOOK-IT, DDELibra, Libra.se  LIBERO, Amlib, Spydus, TOTALS II, Talis Alto, OpenGalaxy  Traditional Open Source ILS  Evergreen, Koha  New generation Library Services Platforms  Ex Libris Alma  Kuali OLE (Enterprise, not cloud) (in development)  OCLC WorldShare Management Services,  ProQuest Intota (in development)  Innovative Interfaces Sierra (evolving) Competing Models of Library Automation

27. Changing models of Resource Sharing

28. Bibliographic Database Library System Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Search: Integrated Library System Patrons use Circulation features to request items from other branches Floating Collections may reduce workload for Inter-branch transfers Model: Multi-branch Independent Library System

29. Library Consortia  Groups of libraries want to work together to share an automation system  Number of participants limited by the perceived capacities of the automation system

30. Consortial Borrowing Systems  Each library system operates its own automation environment  Relies on manual and automated processes to allow patrons to discovery and request materials among participants  INN-Reach (Innovative Interfaces)  ShareIT (Auto-Graphics)  Relais ILL  URSA (SirsiDynix, now defunct)

31. Bibliographic Database Library System A Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System B Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System C Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System D Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System F Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System E Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Resource Sharing Application Bibliographic Database Discovery and Request Management Routines Staff Fulfillment Tools Inter-System Communications NCIP SIP ISO ILL Z39.50 NCIP Search: Consortial Resource Sharing System

32. Shared Infrastructure  Common discovery  Retention of local automation systems  Technical complex with moderate operational benefits  Common discovery + Resource Management Systems  Shared Resource management with local discovery options

33. Bibliographic Database Shared Consortia System Library 2 Library 3 Library 4 Library 5 Library 7 Library 8 Library 9 Library 10 Holdings Library 1Library 6 Shared Consortial ILS Search: Model: Multiple independent libraries in a Consortium Share an ILS ILS configured To support Direct consortial Borrowing through Circulation Module

34. Progressive consolidation of library services  Centralization of technical infrastructure of multiple libraries within a campus  Resource sharing support  Direct borrowing among partner institutions  Shared infrastructure between institutions  Examples: 2CUL (Columbia University / Cornell University)  Orbis Cascade Alliance (37 independent colleges and universities to merge into shared LSP)

35. 2CUL Shared Services : Collection Development Technical Services Shared Infrastructure? :

36. Orbis Cascade Alliance  37 Academic Libraries  Combined enrollment of 258,000  9 million titles  1997: implemented dual INN-Reach systems  Orbis and Cascade consortia merged in 2003  Moved from INN-Reach to OCLC Navigator / VDX in 2008  Current strategy to move to shared LMS based on Ex Libris Alma

37. The Evolution of Library Resource Discovery

38. Challenge: More integrated approach to information and service delivery  Library Web sites offer a menu of unconnected silos:  Books: Library OPAC (ILS online catalog module)  Search the Web site  Articles: Aggregated content products, e-journal collections  OpenURL linking services  E-journal finding aids (Often managed by link resolver)  Subject guides (e.g. Springshare LibGuides)  Local digital collections ETDs, photos, rich media collections  Metasearch engines  Discovery Services – often just another choice among many  All searched separately

39. Online Catalog  Books, Journals, and Media at the Title Level  Not in scope:  Articles  Book Chapters  Digital objects  Web site content  Etc. Scope of Search Search: Search Results ILS Data

40. Next-gen Catalogs or Discovery Interface (2002-2009)  Single search box  Query tools  Did you mean  Type-ahead  Relevance ranked results (for some content sources)  Faceted navigation  Enhanced visual displays  Cover art  Summaries, reviews,  Recommendation services

41. Next-gen Catalogs or Discovery Interface  Single search box  Query tools  Did you mean  Type-ahead  Relevance ranked results  Faceted navigation  Enhanced visual displays  Cover art  Summaries, reviews,  Recommendation services  Books, Journals, and Media at the Title Level  Other local and open access content  Not in scope:  Articles  Book Chapters  Digital objects  Scope of Search

42. Discovery Interface search model Search: Digital Collections ProQuest EBSCOhost … MLA Bibliography ABC-CLIO Search Results Real-time query and responses ILS Data Local Index Metasearch Engine

43. Discovery from Local to Web-scale  Initial products focused on technology  AquaBrowser, Endeca, Primo, Encore, VuFind,  LIBERO Uno, Civica Sorcer, Axiell Arena  Mostly locally-installed software  Current phase is focused on pre-populated indexes that aim to deliver Web-scale discovery  Primo Central (Ex Libris)  Summon (Serials Solutions)  WorldCat Local (OCLC)  EBSCO Discovery Service (EBSCO)  Encore Synergy (no index, though)

44. Web-scale Index-based Discovery Search: Digital Collections Web Site Content Institutional Repositories … E-Journals Reference Sources Search Results Pre-built harvesting and indexing Consolidated Index ILS Data Aggregated Content packages (2009- present) Usage- generated Data Customer Profile Open Access Profile of Library Subscriptions

45. Bento Box Discovery Model Search: Digital Collections Web Site Content Institutional Repositories E-Journals Search Results Pre-built harvesting and indexing Consolidated Index ILS Data Aggregated Content packages Open Access VuFind / Blacklight

46. Web-scale Search Problem Search: Search Results Pre-built harvesting and indexing Consolidated Index ?? ? Non Participating Content Sources Non Participating Content Sources Problem in how to deal with resources not provided to ingest into consolidated index Digital Collections Web Site Content Institutional Repositories … E-Journals ILS Data Aggregated Content packages

47. Challenge for Relevancy  Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR  Difficult to order records in ways that make sense  Many fairly equivalent candidates returned for any given query  Must rely on use-based and social factors to improve relevancy rankings

48. Evaluating Index-based Discovery Services  Intense competition: how well the index covers the body of scholarly content stands as a key differentiator  Difficult to evaluate based on numbers of items indexed alone.  Important to ascertain now your library’s content packages are represented by the discovery service.  Important to know what items are indexed by citation and which are full text  Important to know whether the discovery service favors the content of any given publisher

49. Open Discovery Initiative  NISO Work Group to Develop Standards and Recommended Practices for Library Discovery Services Based on Indexed Search  Informal meeting called at ALA Annual 2011  Co-Chaired by Marshall Breeding and Jenny Walker  Term: Dec 2011 – March 2014

50. Balance of Constituents LibrariesPublishersService Providers 50 Marshall Breeding, Vanderbilt University Jamene Brooks-Kieffer, Kansas State University Laura Morse, Harvard University Ken Varnum, University of Michigan Sara Brownmiller, University of Oregon Lucy Harrison, College Center for Library Automation (D2D liaison/observer) Michele Newberry Lettie Conrad, SAGE Publications Beth LaPensee, ITHAKA/JSTOR/Portico Jeff Lang, Thomson Reuters Linda Beebe, American Psychological Assoc Aaron Wood, Alexander Street Press Jenny Walker, Ex Libris Group John Law, Serials Solutions Michael Gorrell, EBSCO Information Services David Lindahl, University of Rochester (XC) Jeff Penka, OCLC (D2D liaison/observer)

51. Convergence  Discovery and Management solutions will increasingly be implemented as matched sets  Ex Libris: Primo / Alma  Serials Solutions: Summon / Intota  OCLC: WorldCat Local / WorldShare Platform  Except: Kuali OLE, EBSCO Discovery Service  Both depend on an ecosystem of interrelated knowledge bases  API’s exposed to mix and match, but efficiencies and synergies are lost

52. Web-scale Search Problem Search: Search Results Pre-built harvesting and indexing Consolidated Index ?? ? Non Participating Content Sources Non Participating Content Sources Problem in how to deal with resources not provided to ingest into consolidated index Digital Collections Web Site Content Institutional Repositories … E-Journals ILS Data Aggregated Content packages

53. Citations / Metadata > Full Text  Citations or structured metadata provide key data to power search & retrieval and faceted navigation  Indexing Full-text of content amplifies access  Important to understand depth indexing  Currency, dates covered, full-text or citation  Many other factors

54. A&I Content in Discovery Services  Will discovery services eventually become powerful enough to displace need for abstracting and indexing services?  Specialized vocabulary and other metadata make positive contributions to the discovery process  Specialized and scoped search methodologies  Researchers value this tools

55. Challenge for Relevancy  Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR  Difficult to order records in ways that make sense  Many fairly equivalent candidates returned for any given query  Must rely on use-based and social factors to improve relevancy rankings  Objectivity: Does relevancy reflect bias or publisher preferences

56. Socially-powered discovery  Leverage use data to increase effectiveness of discovery  Usage data can identify important or popular materials to inform relevancy engines  Identify related materials that may not otherwise be uncovered through keyword matching  Be careful to avoid introducing bias loops

57. Challenges for Collection Coverage  To work effectively, discovery services need to cover comprehensively the body of content represented in library collections  What about publishers that do not participate?  Is content indexed at the citation or full-text level?  What are the restrictions for non-authenticated users?  How can libraries understand the differences in coverage among competing services?

58. Evaluating the Coverage of Index- based Discovery Services  Intense competition: how well the index covers the body of scholarly content stands as a key differentiator  Difficult to evaluate based on numbers of items indexed alone.  Important to ascertain now your library’s content packages are represented by the discovery service.  Important to know what items are indexed by citation and which are full text  Important to know whether the discovery service favors the content of any given publisher

59. Open Discovery Initiative  NISO Work Group to Develop Standards and Recommended Practices for Library Discovery Services Based on Indexed Search  Informal meeting called at ALA Annual 2011  Co-Chaired by Marshall Breeding and Jenny Walker  Term: Dec 2011 – March 2014 http://www.niso.org/workrooms/odi/

60. Balance of Constituents LibrariesPublishersService Providers 60 Marshall Breeding, Vanderbilt University Jamene Brooks-Kieffer, Kansas State University Laura Morse, Harvard University Ken Varnum, University of Michigan Sara Brownmiller, University of Oregon Lucy Harrison, College Center for Library Automation (D2D liaison/observer) Michele Newberry Lettie Conrad, SAGE Publications Roger Schonfeld, ITHAKA/JSTOR/Portico Jeff Lang, Thomson Reuters Linda Beebe, American Psychological Assoc Aaron Wood, Alexander Street Press Jenny Walker, Ex Libris Group John Law, Serials Solutions Michael Gorrell, EBSCO Information Services David Lindahl, University of Rochester (XC) Jeff Penka, OCLC (D2D liaison/observer)

61. Convergence  Discovery and Management solutions will increasingly be implemented as matched sets  Ex Libris: Primo / Alma  Serials Solutions: Summon / Intota  OCLC: WorldCat Local / WorldShare Platform  Except: Kuali OLE, EBSCO Discovery Service  Both depend on an ecosystem of interrelated knowledge bases  API’s exposed to mix and match, but efficiencies and synergies are lost

62. Why integrate resource management and discovery?  Obviates the need to constantly synchronize local inventory metadata representations into derivative discovery environment  Transactional efficiency for real-time status and user- initiated requests and services  Strategic Knowledge base: resource management, linking, scoping of discovery  Conceptual and technical cohesion  Possible cost savings relative to purchasing separately  Simplified support and business relationships

63. Counter trend Many libraries continue separate discovery strategies  Open source discovery + licensed Web-scale index  EBSCO Discovery Service: strategy to integrate with any back-end ILS or LSP

64. Why not integrate management and discovery?  Less dependence on single supplier  Best of breed in each product category  Increased customizability and local integration

65. Trend Demise of the local catalog  Many library services platforms do not include the concept of an online catalog dedicated to local physical inventory  Designed for discovery services as public-facing interface  Implication: Discovery service must incorporate detailed functionality for local materials and related services

66. Reassess expectations of Technology  Many previous assumptions no longer apply  Technology platforms scale infinitely  No technical limits on how libraries share technical infrastructure  Cloud technologies enable new ways of sharing metadata  Build flexible systems not hardwired to any given set of workflows

67. Reassess workflow and organizational options  ILS model shaped library organizations  New Library Services Platforms may enable new ways to organize how resource management and service delivery are performed  New technologies more able to support strategic priorities and initiatives

68. Time to engage  Transition to new technology models just underway  More transformative development than in previous phases of library automation  Opportunities to partner and collaborate  Vendors want to create systems with long-term value  Question previously held assumptions regarding the shape of technology infrastructure and services  Provide leadership in defining expectations

69. Questions and discussion