Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 July 2004 – METS Opening Day UK www.ccs-gmbh.de1 docWORKS/METAe The Engine for Automated Metadata Extraction and XML Tagging Claus Gravenhorst Content.

Published byKerry Lloyd Modified over 7 years ago

Similar presentations

Presentation on theme: "1 July 2004 – METS Opening Day UK www.ccs-gmbh.de1 docWORKS/METAe The Engine for Automated Metadata Extraction and XML Tagging Claus Gravenhorst Content."— Presentation transcript:

1 1 July 2004 – METS Opening Day UK www.ccs-gmbh.de1 docWORKS/METAe The Engine for Automated Metadata Extraction and XML Tagging Claus Gravenhorst Content Conversion Specialists

2 2 July 2004 – METS Opening Day UK www.ccs-gmbh.de2 CCS – Offices What is docWORKS/METAe? Production tool for conversion of printed documents into fully tagged digital objects The METAe edition of docWORKS is the result of the EU-funded project METAe Start of project: September 2000 End of project: August 2003 Product launch: March 2003, CeBIT exhibition

3 3 July 2004 – METS Opening Day UK www.ccs-gmbh.de3 CCS – Offices The project group 1.Leopold-Franzens-Universität Innsbruck (Co-ordinator), Austria 2.Universität Linz, Institut für Angewandte Informatik, University of Linz, Austria 3.Mitcom Neue Medien GmbH (ABBYY Europe), Germany 4.CCS Compact Computer Systeme, Germany 5.Universidad de Alicante, Spain 6.Friedrich-Ebert-Stiftung, Germany 7.Cornell University Library. Department of Preservation and Conservation, USA 8.Bibliothèque nationale de France 9.The National Library of Norway, Rana division, Norway 10.Biblioteca Statale A. Baldini, Italy 11.Dipartimento di Sistemi e Informatica, University of Florence, Italy 12.Karl-Franzens-Universität Graz, Universitätsbibliothek, Austria 13.Scuola Normale Superiore, Centro di Ricerche Informatiche per i Beni Culturali, Italy 14.Higher Education Digitisation Service HEDS, UK

4 4 July 2004 – METS Opening Day UK www.ccs-gmbh.de4 CCS – Offices Challenges  Digitization and retro-conversion of printed or textual material is getting more and more important: Keep knowledge and cultural heritage alive Preserve the origin Enable quick and enhanced access by high structured documents Open up new dimensions of research Provide standardized output formats

5 5 July 2004 – METS Opening Day UK www.ccs-gmbh.de5 CCS – Offices Goals  Automate the conversion process  Make digitization more effective and safer  Increase the added value of digitized collections  Provide a standardized output format in order to allow transformation of metadata into various applications and systems

6 6 July 2004 – METS Opening Day UK www.ccs-gmbh.de6 CCS – Offices docWORKS – System Overview document METS/ALTO METS/TEI PDF TIFF, JPEG Image Pre-Processing Layout Analysis Character Recognition Structural Analysis Scanning Import Correction Export Rules DB docWORKS engineInputOutput

7 7 July 2004 – METS Opening Day UK www.ccs-gmbh.de7 CCS – Offices docWORKS – recording as much metadata as possible! Available data Descriptive metadata Administra- tive metadata Structural metadata - logical Structural metadata - physical Formats Library records, e.g. MARC TIFF Images METS DC or MODS linking to catalogue record METS incl. NISO (mix) METS Structural map ALTO (Analyzed Layout and Text Object) docWORKS engine Import of subsets, linking to record Creates descriptive records for articles, pictures,… Records metadata Suggests labels of logical elements and structures Provides suggestion for physical structure User mode AutomatedSemi- automated Correction recommended Fully- automated after defining a profile Automated Correction recommended Automated Correction in special cases

8 8 July 2004 – METS Opening Day UK www.ccs-gmbh.de8 CCS – Offices docWORKS – Matching of Image Files and Page Numbers Image- file PaginationPage- Number 000001.tifNot countedNp 000002.tifNot countedNp 000003.tifCountedI 000004.tifCountedII 000005.tifCountedIII 000006.tifCountedIV 000007.tifCountedV 000008.tifCountedVI 000009.tifCounted1 000010.tifCounted, not paginated(2) 000011.tifCounted3 000012.tifCounted4 placeholderMissing page5 placeholderMissing page6 000013.tifCounted7 000014.tifCounted8

9 9 July 2004 – METS Opening Day UK www.ccs-gmbh.de9 CCS – Offices docWORKS – Structural Analysis FRONT MAIN BACK

10 10 July 2004 – METS Opening Day UK www.ccs-gmbh.de10 CCS – Offices docWORKS – Structural Analysis Chapter 1 Chapter 2 Subchapter 1 Subchapter 2

11 11 July 2004 – METS Opening Day UK www.ccs-gmbh.de11 CCS – Offices docWORKS – Structural Analysis Preface Table of contents Title page Statement page

12 12 July 2004 – METS Opening Day UK www.ccs-gmbh.de12 CCS – Offices docWORKS – Document layers  Various document layers are differentiated automatically and while using certain levels enable well directed searches as well as the presentation of electronic text without unnecessary items Body text independently from its presentation Margin notes, footnotes Pictures and captions Advertisement Annex and supplements Navigation layer: Table of contents, running title, document index, page number, volume index Book: Separation of „intellectual“ and „artifical“ content

13 13 July 2004 – METS Opening Day UK www.ccs-gmbh.de13 CCS – Offices docWORKS – Digitization of books and journals (METAe)

14 14 July 2004 – METS Opening Day UK www.ccs-gmbh.de14 CCS – Offices docWORKS – Digitization of books and journals (METAe)

15 15 July 2004 – METS Opening Day UK www.ccs-gmbh.de15 CCS – Offices docWORKS – Digitization of scientific documents

16 16 July 2004 – METS Opening Day UK www.ccs-gmbh.de16 CCS – Offices docWORKS – Manual editing of descriptive metadata / volume

17 17 July 2004 – METS Opening Day UK www.ccs-gmbh.de17 CCS – Offices docWORKS – Manual editing of descriptive metadata / illustration

18 18 July 2004 – METS Opening Day UK www.ccs-gmbh.de18 CCS – Offices docWORKS – Basic Workflow Digitization Scanning Digitization Scanning DB OPAC MARC Quality Control Images Quality Control Images Conversion Quality Control Output Quality Control Output Export Presentation XML/METS PDF Presentation XML/METS PDF

19 19 July 2004 – METS Opening Day UK www.ccs-gmbh.de19 CCS – Offices docWORKS – Scalable Client / Server architecture Server 1 Server 2 Server n.... Scan Import Scan Import Quality Control Quality Control Server 3  Auto-Import  Image Preprocessing  Layout Analysis  OCR  Structural Analysis  Export

20 20 July 2004 – METS Opening Day UK www.ccs-gmbh.de20 CCS – Offices docWORKS – METS / ALTO METS document TIFFALTO ALTO – Analyzed Layout and Text Object

21 21 July 2004 – METS Opening Day UK www.ccs-gmbh.de21 CCS – Offices docWORKS – METS Header MODS or DC, descriptive metadata NISO 39.087 (mix), technical metadata Structural Map: Physical Structure Structural Map: Logical Structure

22 22 July 2004 – METS Opening Day UK www.ccs-gmbh.de22 CCS – Offices docWORKS – ALTO Styles - Paragraph (alignment, linespacing, etc.) - Font (name, size, bold, italic, etc.) Layout - Printspace - TopMargin - InnerMargin - OuterMargin - BottomMargin Objects in 5 areas above: - Text block - Text lines - Strings [coordinates, string (as printed), substitution (hyphenation)] - Spaces - Composed block - Picture - Table - Formula

23 23 July 2004 – METS Opening Day UK www.ccs-gmbh.de23 CCS – Offices docWORKS – METS / physical structure METS DC FILEGRP PHYS LOGICAL DC FILEGRP PHYS LOGICAL ORDER 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 … LABEL II III IV V VI 2 3 4 5 6 … ORDERLABEL I II III IV V VI 1 2 3 4 5 6 …

24 24 July 2004 – METS Opening Day UK www.ccs-gmbh.de24 CCS – Offices docWORKS – METS / physical structure par fptr METS DC FILEGRP PHYS LOGICAL DIV (page) FILEID ALTO FILEID IMAGE

25 25 July 2004 – METS Opening Day UK www.ccs-gmbh.de25 CCS – Offices docWORKS – METS / logical structure seq fptr METS DC FILEGRP PHYS LOGICAL DIV (paragraph) DIV (volume) DCMD_PHYS DCMD_ELEC DIV (issue) DCMD_ISSUE# DIV (contrib.) DCMD_#CONT# FILEID ALTO Those who have read the History of Columbus will, doubtless, remember the character and exploits... XSLT text block BEGIN FILEID Coordinates DIV (chapter) DCMD_CHAP#

26 26 July 2004 – METS Opening Day UK www.ccs-gmbh.de26 CCS – Offices docWORKS – ALTO / page layout and text content

27 27 July 2004 – METS Opening Day UK www.ccs-gmbh.de27 CCS – Offices docWORKS – ALTO / hyphenated word

28 28 July 2004 – METS Opening Day UK www.ccs-gmbh.de28 CCS – Offices docWORKS – ALTO / hyphenated word

29 29 July 2004 – METS Opening Day UK www.ccs-gmbh.de29 CCS – Offices docWORKS – Workshop UK 2004  University Library of Southampton September 28/29, free of charge  1st day Product information Output, metadata standards Workflow, use cases  2nd day „Hands on“ – Working with your own samples Individual consultancy sessions  Contact Simon Brackenbury - s.c.brackenbury@soton.ac.uk Hartmut Janczikowski - hartmut.janczikowski@ccs-gmbh.de

30 30 July 2004 – METS Opening Day UK www.ccs-gmbh.de30 CCS – Offices Thank you! Claus Gravenhorst claus.gravenhorst@ccs-gmbh.de Content Conversion Specialists www.ccs-gmbh.de http://meta-e.uibk.ac.at/

Download ppt "1 July 2004 – METS Opening Day UK www.ccs-gmbh.de1 docWORKS/METAe The Engine for Automated Metadata Extraction and XML Tagging Claus Gravenhorst Content."

Similar presentations

Home-Grown Digital Library System Built Upon Open Source XML Technologies and Metadata Standards David Lacy Villanova University

Home-Grown Digital Library System Built Upon Open Source XML Technologies and Metadata Standards David Lacy Villanova University
1 Metadata Tools for JISC Digitisation Projects of still images and text Ed Fay BOPCRIS, Hartley Library University of Southampton.

1 Metadata Tools for JISC Digitisation Projects of still images and text Ed Fay BOPCRIS, Hartley Library University of Southampton.
METS Awareness Training An Introduction to METS Digital libraries – where are we now? Digitisation technology now well established and well-understood.

METS Awareness Training An Introduction to METS Digital libraries – where are we now? Digitisation technology now well established and well-understood.
Putting together a METS profile. Questions to ask when setting down the METS path Should you design your own profile? Should you use someone elses off.

Putting together a METS profile. Questions to ask when setting down the METS path Should you design your own profile? Should you use someone elses off.
Delivering textual resources. Overview Getting the text ready – decisions & costs Structures for delivery Full text Marked-up Image and text Indexed How.

Delivering textual resources. Overview Getting the text ready – decisions & costs Structures for delivery Full text Marked-up Image and text Indexed How.
DOCUMENT TYPES. Digital Documents Converting documents to an electronic format will preserve those documents, but how would such a process be organized?

DOCUMENT TYPES. Digital Documents Converting documents to an electronic format will preserve those documents, but how would such a process be organized?
Microsoft Word 2013 An Overview. Your Environment Quick Access Toolbar Customizable toolbar for one-click shortcuts Tabs Backstage View Tools located.

Microsoft Word 2013 An Overview. Your Environment Quick Access Toolbar Customizable toolbar for one-click shortcuts Tabs Backstage View Tools located.
Services Digitisation & Content Management. 600 People – India.

Services Digitisation & Content Management. 600 People – India.
PDF (Portable Document Format) for Digital Preservation and Delivery John Laurie Digital Initiatives Librarian The University of Auckland Library National.

PDF (Portable Document Format) for Digital Preservation and Delivery John Laurie Digital Initiatives Librarian The University of Auckland Library National.
These ain’t “Old News”! Creating access to historic newspapers Christine Guenther OCLC Product Manager, Digital Services Preservation Service Centers Bethlehem,

These ain’t “Old News”! Creating access to historic newspapers Christine Guenther OCLC Product Manager, Digital Services Preservation Service Centers Bethlehem,
Joachim Bauer Senior System Engineer, CCS

Joachim Bauer Senior System Engineer, CCS
Object Re-Use and Exchange Mellon Retreat, Nassau Inn, Princeton, NJ, March 29 2007 Herbert Van de Sompel, Carl Lagoze The OAI Object Re-Use & Exchange.

Object Re-Use and Exchange Mellon Retreat, Nassau Inn, Princeton, NJ, March Herbert Van de Sompel, Carl Lagoze The OAI Object Re-Use & Exchange.
Extraction of text data and hyperlink structure from scanned images of mathematical journals Ann Arbor, March 19, 2002 Masakazu Suzuki (Kyushu University)

Extraction of text data and hyperlink structure from scanned images of mathematical journals Ann Arbor, March 19, 2002 Masakazu Suzuki (Kyushu University)
Publishing Workflow for InDesign Import/Export of XML

Publishing Workflow for InDesign Import/Export of XML
6/15/20151 Opportunities for Collaboration: The HEARTH Project Joy Paulson and Nathan Rupp Cornell University Digital Library Federation Spring Forum New.

6/15/20151 Opportunities for Collaboration: The HEARTH Project Joy Paulson and Nathan Rupp Cornell University Digital Library Federation Spring Forum New.
Ingest and Loading DigiTool Version 3.0. Ingest and Loading 2 Ingest Agenda Ingest Overview and Introduction Ingest activity steps Transformers Task Chains.

Ingest and Loading DigiTool Version 3.0. Ingest and Loading 2 Ingest Agenda Ingest Overview and Introduction Ingest activity steps Transformers Task Chains.
William Y. Arms Corporation for National Research Initiatives March 22, 1999 Object models, overlay journals, and virtual collections.

William Y. Arms Corporation for National Research Initiatives March 22, 1999 Object models, overlay journals, and virtual collections.
Challenges for the DL and the Standards to solve them Alan Hopkinson Technical Manager (Library Systems) Learning Resources Middlesex University.

Challenges for the DL and the Standards to solve them Alan Hopkinson Technical Manager (Library Systems) Learning Resources Middlesex University.
JSTOR & OCR - A Case Study Kiffany Francis. What is JSTOR? “JSTOR is a not-for- profit organization with a dual mission to create and maintain a trusted.

JSTOR & OCR - A Case Study Kiffany Francis. What is JSTOR? “JSTOR is a not-for- profit organization with a dual mission to create and maintain a trusted.
UNIVERSITY OF MACEDONIA ECONOMIC AND SOCIAL SCIENCES Support and Inclusion of students with disabilities at higher education institutions in Montenegroz.

UNIVERSITY OF MACEDONIA ECONOMIC AND SOCIAL SCIENCES Support and Inclusion of students with disabilities at higher education institutions in Montenegroz.

Similar presentations

Ads by Google