1. Overview of the state of library automation: Framing the OLE Initiative Tuesday Sept 9, 2008 Duke University Marshall Breeding Director for Innovative Technologies and Research Vanderbilt University http://staffweb.library.vanderbilt.edu/breeding http://www.librarytechnology.org/

2. Abstract A brief overview and history of the problem space we are addressing through the OLE Project. A brief overview and history of the problem space we are addressing through the OLE Project. Address to an audience savvy regarding the library automation arena. Address to an audience savvy regarding the library automation arena. Summarize the state of the ILS world, key problems with commercial ILS, etc. Summarize the state of the ILS world, key problems with commercial ILS, etc.

3. Part I. Broad Industry and Product Trends

4. Upheavals Industry Consolidation Industry Consolidation Abrupt transitions for major library automation products Abrupt transitions for major library automation products Increased industry control by external financial investors Increased industry control by external financial investors Demise of the traditional OPAC Demise of the traditional OPAC Frustration with ILS products and vendors Frustration with ILS products and vendors Open Source alternatives hit the mainstream Open Source alternatives hit the mainstream Breeding, Marshall: Perceptions 2007 an international survey of library automation. http://www.librarytechnology.org/perceptions2007.plhttp://www.librarytechnology.org/perceptions2007.pl January 2008.

5. LJ Automation System Marketplace Annual Industry report published in Library Journal Annual Industry report published in Library Journal 2008: Opportunity out of turmoil 2008: Opportunity out of turmoil 2007: An industry redefined 2007: An industry redefined 2006: Reshuffling the deck 2006: Reshuffling the deck 2005: Gradual evolution 2005: Gradual evolution 2004: Migration down, innovation up 2004: Migration down, innovation up 2003: The competition heats up 2003: The competition heats up 2002: Capturing the migrating customer 2002: Capturing the migrating customer

6. Library Automation M&A History

7. Product and Technology Trends Innovation below expectations Innovation below expectations Conventional ILS less tenable Conventional ILS less tenable Proliferation of products related to e- content management Proliferation of products related to e- content management New genre of discovery-layer interfaces New genre of discovery-layer interfaces

8. Web 2.0 / Collaborative Computing Currently implemented ad hoc Currently implemented ad hoc Many libraries putting up blogs, wikis, and fostering engagement in social networking sites Many libraries putting up blogs, wikis, and fostering engagement in social networking sites Proliferation of silos with no integration or interoperability with larger library Web presence Proliferation of silos with no integration or interoperability with larger library Web presence Next Gen: Build social and collaborative features into core automation components Next Gen: Build social and collaborative features into core automation components

9. Part II. A Mandate for Openness

10. Opportunities for Openness Open Source Open Source –Alternative to traditionally licensed software Open Systems Open Systems –Software that doesn’t hold data hostage

11. Open Source Alternatives Explosive interest in Open Source driven by disillusionment with current vendors and near-evangelical promotion of this software licensing model Explosive interest in Open Source driven by disillusionment with current vendors and near-evangelical promotion of this software licensing model Beginning to emerge as a practical option Beginning to emerge as a practical option TOC (Total Cost of Ownership) still roughly equal to proprietary commercial model TOC (Total Cost of Ownership) still roughly equal to proprietary commercial model Still a risky strategy for libraries – traditional licensing also risky Still a risky strategy for libraries – traditional licensing also risky

12. A result of industry turmoil Disruptions and business decisions to narrow options have fueled the open source movement Disruptions and business decisions to narrow options have fueled the open source movement Benefit to libraries in having additional options Benefit to libraries in having additional options Traditionally licensed and open source ILS alternatives will coexist in the ILS arena Traditionally licensed and open source ILS alternatives will coexist in the ILS arena

13. Open Source ILS enters the mainstream Earlier era of pioneering efforts to ILS shifting into one where open source alternatives fall in the mainstream Earlier era of pioneering efforts to ILS shifting into one where open source alternatives fall in the mainstream Off-the-shelf, commercially supported product available Off-the-shelf, commercially supported product available Still a minority player, but gaining ground Still a minority player, but gaining ground

14. Open Source ILS options Koha Koha –Commercial support from LibLime Evergreen Evergreen –Commercial support from Equinox Software OPALS OPALS –Commercial support from Media Flex NewGenLib NewGenLib –Open Source ILS for the developing world

15. Observations on Open Source ILS Current Open Source ILS products similar in modular organization and functionality to existing systems. Evolving to achieve the same level of features and capacity present in established commercial systems. Current Open Source ILS products similar in modular organization and functionality to existing systems. Evolving to achieve the same level of features and capacity present in established commercial systems. Initial wave of Open Source ILS commitments happened in the public library arena. Recent activity among academic libraries: Initial wave of Open Source ILS commitments happened in the public library arena. Recent activity among academic libraries: –WALDO Consortium (Voyager > Koha) –University of Prince Edward Island (Unicorn > Evergreen) Do the current open source ILS products provide a new model of automation, or an open source version of what we already have? Do the current open source ILS products provide a new model of automation, or an open source version of what we already have? JISC – SCONUL study did not show strong interest in open source ILS in the UK. JISC – SCONUL study did not show strong interest in open source ILS in the UK.

16. Impact of Open Source ILS Library automation industry cannot be complacent Library automation industry cannot be complacent Some libraries moving from traditionally licensed products to open source products with commercial support plans Some libraries moving from traditionally licensed products to open source products with commercial support plans Disruption of ILS industry Disruption of ILS industry –new pressures on incumbent vendors to deliver more innovation and to satisfy concerns for openness New competition / More options New competition / More options

17. More Open Systems Pressure for traditionally licensed products to become more open Pressure for traditionally licensed products to become more open APIs (Application Programming Interfaces) let libraries access and manipulate their data outside of delivered software APIs (Application Programming Interfaces) let libraries access and manipulate their data outside of delivered software A comprehensive set of APIs potentially give libraries more flexibility and control in accessing data and services and in extending functionality than having access to the source code. A comprehensive set of APIs potentially give libraries more flexibility and control in accessing data and services and in extending functionality than having access to the source code. Customer access to APIs does not involve as much risk to breaking core system functions, avoids issues of version management and code forking associated with open source models. Customer access to APIs does not involve as much risk to breaking core system functions, avoids issues of version management and code forking associated with open source models.

18. A Continuum of Openness

19. Closed Systems Circulation Acquisitions Cataloging Staff Interfaces: End User Interfaces: Data Stores: Functional modules: No programmable Access to the system. Captive to the user Interfaces supplied by the developer Programmer access:

20. Standard RDBM Systems Circulation Acquisitions Cataloging Staff Interfaces: End User Interfaces: Data Stores: Functional modules: Database administrators can access data stores involved with the system: Read-only? Read/write? Developer shares database schema Programmer access:

21. Open Source Model Circulation Acquisitions Cataloging Staff Interfaces: End User Interfaces: Data Stores: Functional modules: All aspects of the system available to inspection and modification. Programmer access:

22. Open API Model Circulation Acquisitions Cataloging Staff Interfaces: End User Interfaces: Data Stores: Functional modules: Core application closed. Third party developers code against the published APIs or RDBMS tables. Programmer access: Published APIs

23. Open Source / Open API Model Circulation Acquisitions Cataloging Staff Interfaces: End User Interfaces: Data Stores: Functional modules: Core application closed. Third party developers code against the published APIs or RDBMS tables. Programmer access: Published APIs

24. Depth of Openness Evaluate level of access to a products data stores and functional elements: Evaluate level of access to a products data stores and functional elements: –Open source vs Traditional licenses Some traditional vendors have well established API implementations Some traditional vendors have well established API implementations –SirsiDynix Unicorn (API available to authorized customer sites that take training program) –Ex Libris: consistent deployment of APIs in major products, recent strategic initiative: “Open Platform Program” –Innovative Interfaces: Patron API

25. Universal open APIs? Some progress on API to support discovery layer interfaces, but no comprehensive framework yet. Some progress on API to support discovery layer interfaces, but no comprehensive framework yet. Many industry protocols work like APIs: Many industry protocols work like APIs: –Z39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etd It would be ideal if there were an open set of APIs that were implemented by all automation system products. It would be ideal if there were an open set of APIs that were implemented by all automation system products. –Third party components and add-ons would then work across all products. DLF ILS-Discovery Interface protocol. Targets interoperability between ILS and new genre of interfaces DLF ILS-Discovery Interface protocol. Targets interoperability between ILS and new genre of interfaces AKA: Berkeley Accords AKA: Berkeley Accords

26. Opportunity out of the Upheavals More options More options –Commercial + Open Source More vendors More vendors –New open source support companies provide new competition Traditionally licensed and open source automation systems will co-exist. We have an interest in the success of both alternatives. Traditionally licensed and open source automation systems will co-exist. We have an interest in the success of both alternatives. More library involvement More library involvement –Libraries re-energized to make significant contributions to the body of library automation software

27. Part III. Moving toward new generation of library automation

28. Rethinking the ILS Fundamental assumption: Print + Digital = Hybrid libraries Fundamental assumption: Print + Digital = Hybrid libraries Traditional ILS model not adequate for hybrid libraries Traditional ILS model not adequate for hybrid libraries Libraries currently moving toward surrounding core ILS with additional modules to handle electronic content Libraries currently moving toward surrounding core ILS with additional modules to handle electronic content New discovery layer interfaces replacing or supplementing ILS OPACS New discovery layer interfaces replacing or supplementing ILS OPACS Working toward a new model of library automation Working toward a new model of library automation –Monolithic legacy architectures replaced by fabric of SOA applications –Comprehensive Resource Management “It's Time to Break the Mold of the Original ILS” Computers in Libraries Nov/Dec 2007

29. ILS: a legacy concept? ILS = Integrated Library System ILS = Integrated Library System (Cataloging + Circulation + OPAC + Serials + Acquisitions) Focused on print and physical inventory Focused on print and physical inventory Electronic content at the Journal Title or collection level Electronic content at the Journal Title or collection level Emerged in the 1960’s – 1970’s Emerged in the 1960’s – 1970’s Functionality has evolved and expanded, but basic concepts and modules remain intact Functionality has evolved and expanded, but basic concepts and modules remain intact Note: Some companies work toward evolving the ILS to competently handle both print and digital content (e.g. Innovative Interfaces) Note: Some companies work toward evolving the ILS to competently handle both print and digital content (e.g. Innovative Interfaces)

30. ILS: ever diminishing role Many libraries putting much less emphasis on ILS Many libraries putting much less emphasis on ILS Just an inventory system for physical materials Just an inventory system for physical materials Investments in electronic content increasing Investments in electronic content increasing Management of e-content handled outside of the ILS Management of e-content handled outside of the ILS Yet: libraries need comprehensive business automation more than ever. Mandate for more efficient operations. Do more with less. Yet: libraries need comprehensive business automation more than ever. Mandate for more efficient operations. Do more with less.

31. Dis-integration of Library Automation Functionality ILS -- Print and Physical inventory ILS -- Print and Physical inventory OpenURL Link resolver OpenURL Link resolver Federated Search Federated Search Electronic Resource Management Module Electronic Resource Management Module Discovery layer interface Discovery layer interface

32. Is non-integrated automation sustainable? Major burden on library personnel Major burden on library personnel Serial procurement / installation / configuration / maintenance cycles take many years to result in a comprehensive environment Serial procurement / installation / configuration / maintenance cycles take many years to result in a comprehensive environment Inefficient data models Inefficient data models Disjointed interfaces for library users Disjointed interfaces for library users Very long cycle to gain comprehensive automation Very long cycle to gain comprehensive automation

33. New genre of discovery layer interfaces Traditional ILS OPAC inadequate for today’s Web-savvy library users Traditional ILS OPAC inadequate for today’s Web-savvy library users Scope too narrow Scope too narrow Complex, non-intuitive interface Complex, non-intuitive interface Yet: Necessary for some types of research Yet: Necessary for some types of research Working toward a single point of entry for all the content and services offered by the library Working toward a single point of entry for all the content and services offered by the library

34. Common Next-Gen Interface features Decoupled interface Decoupled interface Advanced search engines Advanced search engines Relevancy ranked results Relevancy ranked results Faceted Navigation Faceted Navigation Graphically enriched displays Graphically enriched displays Real-time interaction with ILS Real-time interaction with ILS Advanced user services and information delivery features Advanced user services and information delivery features

35. Current Products Aquabrowser (Medialab, Bowker / Serials Solutions) Aquabrowser (Medialab, Bowker / Serials Solutions) Primo (Ex Libris) Primo (Ex Libris) Encore (Innovative Interfaces) Encore (Innovative Interfaces) WorldCat Local (OCLC) WorldCat Local (OCLC) BiblioCommons BiblioCommons Visualizer (VTLS) Visualizer (VTLS) eXtensive Catalog (University of Rochester) eXtensive Catalog (University of Rochester) VUFind (open source / Villanova University) VUFind (open source / Villanova University) Scriblio (open source) Scriblio (open source) http://www.librarytechnology.org/discovery.pl

36. Deep search Entering post-metadata search era Entering post-metadata search era Increasing opportunities to search the full contents Increasing opportunities to search the full contents –Google Library Print, Google Publisher, Open Content Alliance, Microsoft Live Book Search, etc. –High-quality metadata will improve search precision Commercial search providers already offer “search inside the book” Commercial search providers already offer “search inside the book” No comprehensive full text search for books quite yet No comprehensive full text search for books quite yet Beginning to appear in library search environments Beginning to appear in library search environments –U of Mich ( http://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.html ) http://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.html Deep search highly improved by high-quality metadata Deep search highly improved by high-quality metadata See: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: deeper search”

37. Architecture and Standards Need to have an standard approach for connecting new generation interfaces with ILS and other repositories Need to have an standard approach for connecting new generation interfaces with ILS and other repositories Proprietary and ad hoc methods currently prevail Proprietary and ad hoc methods currently prevail Digital Library Federation Digital Library Federation –ILS-Discovery Interface Group http://www.librarytechnology.org/blog.pl?ThreadID=43 Initial foray into a broader set of protocols that open up other aspects of the ILS Initial foray into a broader set of protocols that open up other aspects of the ILS

38. Moving toward a new Generation of Library Automation Are Legacy ILS concepts sustainable? Are Legacy ILS concepts sustainable? New automation environment based on current library realities and modern technology platforms New automation environment based on current library realities and modern technology platforms Equal footing for digital and print Equal footing for digital and print Service oriented architecture Service oriented architecture

39. Breaking down the modules Traditional ILS Traditional ILS –Cataloging –Circulation –Online Catalog –Acquisitions –Serials control –Reporting Modern approach: SOA Modern approach: SOA

40. Service Oriented Architecture http://www.sun.com/products/soa/benefits.jsp

41. Legacy ILS + e-content modules Federated Search Circulation Acquisitions Cataloging Serials OpenURL Linking Electronic Resource Mgmt System Staff Interfaces: End User Interfaces: Data Stores: Functional modules:

42. SOA model for business automation Underlying data repositories Underlying data repositories –Local or Global Reusable business services Reusable business services Composite business applications Composite business applications

43. SOA for library workflow processes Data Stores: Reusable Business Services Composite Applications Granular tasks:

44. Comprehensive Resource Management Broad conceptual approach that proposes a library automation environment that spans all types of content that comprise library collections. Broad conceptual approach that proposes a library automation environment that spans all types of content that comprise library collections. Traditional ILS vendors: Under development but no public announcements Traditional ILS vendors: Under development but no public announcements Open Source projects in early phases Open Source projects in early phases Projection: 2-3 years until we begin see library automation systems that follow this approach. 5-7 years for wider adoption. Projection: 2-3 years until we begin see library automation systems that follow this approach. 5-7 years for wider adoption.

45. Open Library Environment (OLE) project Andrew W. Mellon Foundation Andrew W. Mellon Foundation –Research in Information Technology program –Solicited proposal / Lead institution Duke University selected to lead project Duke University selected to lead project Core Participants: Kansas University, Lehigh University, National Library of Australia, Library and Archives Canada, University of Pennsylvania, Marshall Breeding Core Participants: Kansas University, Lehigh University, National Library of Australia, Library and Archives Canada, University of Pennsylvania, Marshall Breeding Advisory Participants: University of Chicago, Wittier College, University of Maryland, ORBIS Cascade Alliance, Rutgers University Advisory Participants: University of Chicago, Wittier College, University of Maryland, ORBIS Cascade Alliance, Rutgers University Status: Proposal complete, pending formal approval from the Andrew W. Mellon Foundation Status: Proposal complete, pending formal approval from the Andrew W. Mellon Foundation http://oleproject.org

46. Preparing for next generation library automation Reassess workflows Reassess workflows Separate streams for print and digital? Separate streams for print and digital? Integrated processing of print and digital? Integrated processing of print and digital? Opportunities to take advantage of SOA-based composite business applications Opportunities to take advantage of SOA-based composite business applications Assemble a more ideal set of tools for managing serials and periodicals Assemble a more ideal set of tools for managing serials and periodicals

47. Questions and Discussion