© January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany consulting technology digitization services

© January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany docWORKS/METAe, a tool for converting documents into structured digital objects Accessible e-books, Paris, January 28th, 2008 Claus Gravenhorst, Director Strategic Initiatives

3 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Background Only a fraction of the world-wide cultural and scientific heritage is available in electronic form Limited access to digitised documents No common metadata standard for ingest and long-term preservation In-house digitisation: set up and operation of an efficient workflow based on a patchwork of various digitisation tools is complicated and expensive Manual work takes the largest part of these costs Outsourced digitisation: limited control and administration mechanisms regarding quality, quantity and adherence to schedules Cost for a digitised page is still high

4 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Challenges Increase the amount of accessible content in a reasonable timeframe – Enable digitisation on a larger scale Enable quick and enhanced access by high structured documents – for everyone Provide integrated digitisation/conversion technologies as well as efficient workflows to lower the total cost of content creation Provide a standardized output format Open up new dimensions for research, presentation and distribution of digital content

5 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Goals of new technologies Automate the digitisation and conversion process to create more content at lower costs, less than 10 EuroCent a book page! Increase the added value of digital content through automated tagging and metadata extraction Provide effective workflow environments for integration of various “state of the art” technologies Full integration into the given environment and workflow of content owners Scalability for enabling the setup of networked and distributed production environments

6 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Workflow: Value Chain Image pre- processing Layout analysis OCR (text) ISR (structure) Metadata Extraction Automated QA QA Feedback: + Resolution + Deskew + OCR accuracy + Page sequence Items: + Books + Newspapers + Journals + Manuscripts + etc... Source: + Original + Microfilm + Digital Image + PDF Scan from originals and microfilm Import from digital image or PDF files Non-proprietary format OS Independent METS/ALTO compliant XML data compatible with multiple presentation systems Improved navigation and search through structured information reversemigration Automated workflow for the conversion of printed items into fully structured digital objects based on common open metadata standards

7 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Traditional OCR THE AMERICAN MISSIONARY. Vo.. XXXII JANUARY, 1878 No. 1 American Missionary Association xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

8 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Physical and Logical Structure

9 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Structure Analysis FRONT MAIN BACK

10 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Structure Analysis Chapter 1 Chapter 2 Subchapter1 Subchapter 2

11 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Physical and Logical Structure Preface Table of Contents Title Page Statement Page

12 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books METS/ALTO – open metadata standard Advantages of fully tagged objects based on XML and open metadata standards: Supporting open metadata standards like METS, DC, MODS, NISO MIX, ALTO Full description of the original -> “Digital Original” With logical structures search results are improved (chapter-, article-based) and more easily accessed (chapter titles, headlines, pictures with captions, footnotes, etc.) Enables data exchange with any XML based 3rd party system Provides the source for transformation to other formats being used for distribution (various eBook-formats up to the XML based open eBook format EPUB (International Digital Publishing Forum -IDPF), navigation and adapted visual or audio-visual presentation (e.g. DAISY) Supporting Digital long-term preservation Enables migration to meet future standards

13 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books METS Metadata Encoding and Transmission Standard document TIFFALTO ALTO – Analyzed Layout and Text Object METS/ALTO XML object A document processed in docWORKS is converted into one METS XML file. It reflects the whole physical and logical structure, manages all links to the image files and the related ALTO XML files. There is exactly one ALTO file for one image file. ALTO is based on a standardized page description schema and contains all information of a page (print space, margins, coordinates, OCR results). METS/ALTO – open metadata standard

14 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Workflow: Institution-based, integrated Re-Scan Conversion Imaging Layout Analysis OCR ISR Post OCR Correction Reject Condition Delivery QA random Final Output Book Delivery QA+Correction offshore Scanning Image Metadata Database Repository Metadata Z Automated Quality Assurance Document UID Barcode ISBN

15 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Selected Reference CCS technology is in use at digitisation service providers as well as ivy-league cultural and scientific institutions around the world: British Library Institution-based centre, fully operated by CCS staff Process aligned with standards, data bases and workflows in use at the library Employment of robotic scanning technology (colour) 1 million pages per month, 25 million in 2 years Full production since begin of September 2007 Out of copyright books, 19th century Output in METS/ALTO, JPEG2000 and PDF (e-book)

16 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Conclusion and Perspective docWORKS/METAe reached a high degree of automation and supports a broad range of document types Improved accessibility through highly structured digital objects for everyone docWORKS in use at in-house digitisation centres of various content owners all around the world Growing demand of the publishing industry Scalable technology enables mass digitisation Constantly increasing the level of automation Major goal is lowering the cost of digitisation while assuring high quality standards

17 © January/2008 CCS Content Conversion Specialists GmbH Weidestr. 134, Hamburg, Germany e-books Contact CCS Content Conversion Specialists GmbH information:accessible Weidestr. 134, D Hamburg, Germany +49 (0) phone +49 (0) fax +49 (0) mobile Internet: Claus Gravenhorst Director Strategic Initiatives