NLM Update and Still Image Serving April 27, 2016 John Doyle, Doron Shalvi, TA Nguyen National Library of Medicine.

Slides:



Advertisements
Similar presentations
Support.ebsco.com EBSCOhost Digital Archives Viewer Tutorial.
Advertisements

EBSCO Discovery Service
Permanent Hosting, Archiving and Indexing of Digital Resources and Assets Raman Ganguly Computer Center University of Vienna.
Home-Grown Digital Library System Built Upon Open Source XML Technologies and Metadata Standards David Lacy Villanova University
E-Content Service Group Virtual Meeting Digital Preservation: How to Get Started.
Catherine Worrall Slide Library Co-ordinator, University College Falmouth.
Computers: Tools for an Information Age Writing Your Own Web Page: Using HTML and Web Authoring Tools.
Vital Implementation Update Vital Implementation Update 11 th January 2006 Paul Bevan – Glen Robson –
Opening Up Worldwide Access to Key BC Historical Documents: BC Historical Newspapers Mike Conroy, Community Digital Projects Analyst UBC Library.
OCLC Digital Archive Overview Judith Cobb LIPA Meeting July 2006.
Building The Rare book Collection at Rijeka University Library in the Digital Age Ines Cerovac, Senka Tomljanović, Rijeka University Library Seminar The.
Fedora 3.0 and METS: A Partnership for the Organization, Presentation and Preservation of Digital Objects Open Repositories Georgia Tech, Atlanta,
Building a Digital Library with Fedora International Conference on Developing Digital Institutional Repositories Hong Kong December 9, 2004.
The Fedora Project April 28-29, 2003 CNI, Washington DC Thornton Staples University of Virginia Sandy Payette Cornell Information Science.
Ingest and Loading DigiTool Version 3.0. Ingest and Loading 2 Ingest Agenda Ingest Overview and Introduction Ingest activity steps Transformers Task Chains.
All Things to All People Combining Resources to Build an Integrated Digital Repository Preservation and Access for Electronic College and University Records.
WMS: Democratizing Data
Progress in Access Technologies: NLM Video Search Jennifer Marill Chief, Technical Services Division Edward Luczak Systems Architect, Office of Computer.
Sai Deng, Metadata Catalog Librarian, Wichita State University Libraries Tse-Min Wang, Graduate Student in CS, Wichita State University Digital Imaging.
OCLC Online Computer Library Center CONTENTdm 4.3 Claire Cocco Global Product Manager CONTENTdm October 3, 2007.
Technology Bootcamp January 18, 2014 Large-Scale Digital Libraries Digitization Process Krystyna K. Matusiak, Ph.D. Assistant Professor Library & Information.
The New DRS (DRS 2) Introduction. What is DRS? Digital repository for preservation and access –Maintains integrity of deposited content –Preserves content.
A Digital Preservation Repository for Duke University Libraries Jim Coble Digital Repository Developer Open Repositories 2013.
Greg Harris President & CEO We Can Work It Out Establishing the World’s First Rock and Roll Library.
1 LeMO: A Virtual Exhibition of 20th Century German History Lutz Nentwig Fraunhofer Institute for Software and Systems Engineering ISST, Berlin in cooperation.
SobekCM’s Community Ecosystems & Socio-Technical Practices Presented by Mark V. Sullivan June 10 th, 2014 Sobek image created by Jeff Dahl and is shared.
Adventures in Digital Asset Management: Fedora at the National Library of Wales Glen Robson National Library of Wales
FEDORA at Northwestern University Bill Parod Academic Technologies Northwestern University
Web-based workflow software to support book digitization and dissemination The Mounting Books project books.northwestern.edu Open Repositories 2009 Meeting,
OCLC Online Computer Library Center CONTENTdm ® Digital Collection Management Software Ron Gardner, OCLC Digital Services Consultant ICOLC Meeting April.
Columbia Digital Preservation Planning & Implementation Status Report, August 2010.
Document Solutions Document Solutions Confidential Property of FileMark Corporation Document Solutions Document Solutions Apr 15, 2008 SMART Document Solutions.
Implementing an Integrated Digital Asset Management System: FEDORA and OAIS in Context Paul Bevan DAMS Implementation Manager
Max Planck Institute for Psycholinguistics Tool development report H. Brugman MPI Nijmegen.
NLM Digital Collections Update for DCFedoraUsersGroup January 22, 2013 John Doyle National Library of Medicine.
1 Mastering the Internet and HTML Images and Image Tags.
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
Computer Science 101 Images in Web Pages. Image Files Two common formats, GIF and JPEG GIF images are more flexible for use as icons JPEG images are sharper.
Using YouTube and United Streaming in the Classroom.
OCLC Online Computer Library Center Digital Preservation with OCLC Digitization Standards: Issues & Updates Taylor Surface, OCLC.
Overview of IU Digital Collections Search Hui Zhang Jon Dunn Indiana University Digital Library Program IU Digital Library Brown Bag October 19, 2011.
Integrating a Statewide Web Gateway With Digital Collections ______________________ Eric Weig and Beth Kraemer University of Kentucky and KCVL.
UVa's Digital Library CSG - September 2005 Slides courtesy of: Leslie Johnston Director, Digital Access Services, UVA Library Tim Sigmon University of.
Unit no. 5 Digital Library Adolf Knoll National Library of the Czech Republic © Adolf Knoll, National Library of the Czech Republic.
The University of Florida Digital Collections Focus on Architecture Laurie N. Taylor
PatentScope - Electronic Publication World Intellectual Property Organization.
Best Practices for Digital Imaging and Metadata Roy Tennant The Library, University of California, Berkeley
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
The New DRS Introduction. What is DRS? Digital repository for preservation and access – Maintains integrity of deposited content – Preserves content for.
Collecting History: Profiles in Science Alexa T. McCray National Library of Medicine Bethesda, MD Stanford University August 21, 1999.
Time-Based Media Use Cases in an Integrated Access Environment, or …
A Multi-Tiered Architecture for Distributed Data Collection and Centralized Data Delivery Stacy Kowalczyk and James Halliday April 28, 2008.
Research Data Management At the Smithsonian Using Sidora CNI December 10, 2013.
Digital Preservation Panel Medusa at the University of Illinois at Urbana-Champaign: A Digital Preservation Service Based on PREMIS Kyle Rimkus, Preservation.
Finding and Using Digital Images Alastair Dunning, AHDS Executive Office King’s College London, Bradford 12 th December 2005.
Permanent Hosting, Archiving and Indexing of Digital Resources and Assets Markus Höckner Computer Center University of Vienna.
The library is open Digital Assets Management & Institutional Repository Russian-IUG November 2015 Tomsk, Russia Nabil Saadallah Manager Business.
NLW. Object Classes Class 1  1 MARC Record  1 Image  No METS Class 2  1 MARC Record  Many images  No METS Class 3  1 MARC Record  Many.
Time-Based Media Use Cases in an Integrated Access Environment, or …
Ball State University Digital Media Repository …a project of the University Libraries Customization, Web Services, and Storage at Ball State using CONTENTdm.
IU BORN-DIGITAL ASSETS February 2, Agenda Project overview Findings from external drive analysis Similar projects and potential models Options for.
OCCAM’S READER: WHY DO WE WISH TO SHARE E-BOOKS? Cen Cheng, Michigan State University, 6/10/16.
Digital Collections Update
OverDrive Digital Library Basics
Library Technology Conference: Building Exhibits
Integrating Koha and IIIF to manage a digital library
EBSCOhost Digital Archives Viewer
Why IIIF? Shane Huddleston Jeff Mixter Dave Collins Product Manager
NLM Digital Repository The Search for a New Book viewer
Presentation transcript:

NLM Update and Still Image Serving April 27, 2016 John Doyle, Doron Shalvi, TA Nguyen National Library of Medicine

Content Overview Current Counts: –Books: 2.8M pages, 17k volumes –Videos: 227 –Citations: 3.7M –Still Images: 68k

Coming Soon: Born-Digital Historical Software -NDSR Project -NLM-created software as cultural heritage -GratefulMed Tutorial -MS-DOS program PDF Resources -Acquired and catalogued for collection -Normalized PDF/A derivative added -IR-type file access, no integrated viewer

Coming… Not Quite As Soon Digitized Archival Collections - Profiles in Science - collection & exhibit - Modern Manuscripts - Oral Histories Web-Harvested Content - Archive-It subscription

Digitization Changes Texts -Upgrade of scanning solution -Hardware – better ergonomics, more scanners -Software – more flexibility -Change from JPG to TIFF for master files Films -Working with AV consultant -Specifications -Workflow recommendations -Pilot digitization project later this year -Outsource digitization & transcription -Storage TBD!

Metadata Overhaul -Revised MARC-to-repository metadata maps -Refresh of values from ILS -Replacement of datastreams -Solr and Blacklight updates -Provides metadata support for still images, also upcoming new content types

Still Images - Background Images from the History of Medicine -Approximately 70k images -Illustrating social and historical aspects of medicine from Middles Ages to present -1/3 are portraits -Each image separately cataloged -Online public access via Luna Imaging, Inc. software since – decision to move off of Luna ASAP

8 Image Data Model Voyager Catalog Record Fedora Video Object DC DMDINDEX descriptive metadata Master TIFF Thumbnail (JPG) NLM Digital Repository XSLT Transform Blacklight Discovery UI Solr Search Server Loris Image Server Browse and search for images View image Download TIFF, JPG, DC JPEG2000 Preview (JPG) RELS-EXT Kakadu Image Magick JPEG2000 JPG

9 Image Subsystem Architecture Loris IIIF Server Fedora repository Blacklight server Solr Search OpenSea Dragon TIFF JPEG2000 Thumbnail JPG Preview JPG Filesystem Browser Apache HTTP Server Blacklight viewer JPEG2000 JPG TIFF Thumbnail Preview Thumbnail Preview TIFF

Blacklight Image Resource Page

OpenSeaDragon Image Viewer

Local Customizations ■ Loris – Adjust cache to work with both HTTP and HTTPS – Fix issue of not resolving JPEG2000 using kdu – Fix permission issues for local cache, log generation – Downgrade local environment to Python 2.7 – 10 GB cache, FIFO – JPEG2000 (could use TIFF) ■ OpenSeaDragon – Port to Blacklight – Open directly into full screen mode – Custom button controls – 3x max zoom – Workaround for hang on exiting large images

IIIF Server ■ IIIF 2.0, ■ Request: img/info.jsonhttps://iiif.nlm.nih.gov/nlm%3Anlmuid img/info.json ■ Response: {"profile": [" {"supports": ["canonicalLinkHeader", "profileLinkHeader", "mirroring", "rotationArbitrary", "sizeAboveFull"], "qualities": ["default", "bitonal", "gray", "color"], "formats": ["jpg", "png", "gif", "webp"]}], "tiles": [{"width": 128, "scaleFactors": [1, 2, 4, 8]}, {"width": 256, "scaleFactors": [16, 32]}], "protocol": " "sizes": [{"width": 94, "height": 74}, {"width": 188, "height": 147}, {"width": 375, "height": 293}, {"width": 750, "height": 586}, {"width": 1500, "height": 1172}, {"width": 3000, "height": 2343}], "height": 2343, "width": 3000, " "

Issues encountered ■ Missing and corrupt master images ■ Master TIFF file contains multiple images ■ Missing, incomplete, incorrect catalog records ■ Kakadu could not recognize some TIFFs – save as a new TIFF using ImageMagick ■ Increase JVM heap size (1G) for Kakadu to process large TIFFs (137 MB)

img/full/full/0/default.jpg

img/1300,1600,400,400/full/90/default.jpg

Demonstration

Still Images – Future Development Collection Maintenance - Replacement of master images - Metadata updates IIIF - Presentation API - Upgrade of Book Viewing solution OAI-PMH Providing