S m a r t e r D o c u m e n t M a n a g e m e n t SM NLM Invitational Planning Meeting Bethesda, Maryland August 1, 2005 Robert Buckley Imaging & Services Technology Center JPEG 2000 and Color Image Archiving

1 August Key Messages  JPEG2000 for video archivists n As a compression architecture n As a format architecture  Who is using JPEG2000 n DP, NDNP n DCI  Activities to watch (and join) n ISO – JPSearch n ICC – Digital Motion Picture WG n CIE – Archival Colour TC

1 August Embedding JPEG2000 in Applications Format Application Activities Imagestream Color Spec Metadata

1 August What is JPEG 2000?  JPEG 2000 is a wavelet-based image-compression standard, developed by the same ISO committee that previously developed JPEG, although with a different group of participants and contributors.  JPEG 2000 was conceived as a next generation image compression standard that would improve on the performance of JPEG while, more significantly, adding features and capabilities not available with Baseline JPEG compression.

1 August Why use JPEG 2000?  Open Standard n Royalty free  One master supports multiple derivatives n One file for both lossless and lossy data n Progressive display and scalable rendering n One algorithm for both lossless and lossy compression  Region-of-Interest (ROI) on coding and access  Easily handles large images n Multiple components and high bit-depth images  Generous metadata support

1 August JPEG 2000 Standard - Parts 1-6 Part 1: Core Coding System Part 2: Extensions Part 3: Motion JPEG2000 Part 4: Conformance Testing Part 5: Reference Software Part 6: Compound Image File Format ISO/IEC / ITU-T Rec. T.800

1 August JPEG 2000 Standard - Parts 8-13 Part 8: JPSEC Secure JPEG2000 Part 9: JPIP Interactivity Tools Part 10: JP3D 3D & Floating Pt Part 11:JPWL Wireless Part 12: ISO Media File Format Part 13: Entry-Level JPEG2000 Encoder Encode Under Development Published Key

1 August One Master  Multiple Derivatives  A single JPEG2000 master can serve multiple uses n Scale by resolution u Thumbnail image u Screen resolution image u Print quality image n Scale by quality u Lossless  Lossy u Preset file size  Key enabling technologies n Wavelet transform n Embedded block coding

1 August One Master  Multiple Derivatives ThumbnailLow res image Medium res image Packets reordered by layer Master ImageDerived Image Codestream truncated by quality Region of Interest Selected

1 August JPEG 2000 Codestream  The number of bits allocated to parameters in the JPEG 2000 codestream allow images up to 4 Gpixels square, with 16,384 components and 38 bits per component.  Part 1 defines 5 profiles that restrict the size and use of various codestream structures n Examples: image size, codeblock size, tile size  Part 4 defines 3 compliance classes that limit what a decoder has to support n Compliance Class 2 guarantees support for images up to 16 Kpixels square, with 256 components and 16 bits per component

1 August Embedding JPEG2000 in Applications Format Application Activities Color Spec Metadata Imagestream

1 August Basic JPEG 2000 File  JPEG 2000 Signature Box n Identifies file as member of the JPEG 2000 file format family, same for all files  File Type Box n Specifies brand, version, compatibility, profile  Header Box n Contains image parameters and color spec  Codestream Box n Contains image stream  Metadata boxes n XML-formatted or user-specific metadata JPEG 2000 Signature File Type Header Codestream XML UUID Box Stack

1 August JPEG 2000 File Format Family  JP2 (JPEG 2000 Core, Part 1) n Single image, continuous codestream  JPX (JPEG 2000 Extensions, Part 2) n Multiple codestreams, possibly fragmented  MJ2 (Motion JPEG 2000, Part 3) n Timed sequence of JPEG 2000 images n Intra-frame coding only  JPM (JPEG 2000 Multi-Layer, Part 6) n MRC model for compound document images n Multiple images (binary and contone) and pages

1 August Metadata  The JPEG 2000 File Format family provides a frame- work for embedding domain-specific metadata in a file n XML boxes for XML-formatted metadata u e.g. DIG 35, Dublin Core, GML, MIX u Searchable text coming n UUID boxes for non-XML metadata u e.g. IPTC, GeoTIFF nMPEG-7 Binary Box for metadata in BiM format  Examples nAssociate metadata with the entire image or with specific regions of the image nJPEG2000-specific preservation metadata in Z39.87

1 August Color Specification  Direct n Identify the color space or encoding by name u Index into a list of enumerated color spaces n Examples u sRGB, ProPhoto RGB (ROMM RGB), CIELAB  Indirect n Give the transform to a standard color encoding u Use pre-defined transform elements for which you supply the parameters n Example u ICC profiles define the transform to a PCS or Profile Connection Space, i.e. XYZ or CIELAB u ICC has started a Digital Motion Picture WG

1 August Color Spaces

1 August Color Spaces Adobe RGB 98 sRGB (Rec. 709) x y ProPhoto RGB XYZ

1 August Embedding JPEG2000 in Applications Format Application Activities ImageStream Color Spec Metadata

1 August JPEG2000 – Digital Photography  ANSI defined a JPEG2000 profile for Digital Still Cameras n Based on JP2 (JPEG2000 Part 1) file format n Readers conform at least to Compliance Class 1 Format JP2 Application Digital Photography Activity ANSI JPEG 2000 Color Spec Metadata 8-bit sRGB, sYCC, sGray Restricted ICC profile Profile-1 DIG-35 with extensions, uses XML box

1 August National Digital Newspaper Program Format JP2 Application Production Activity NDNP JPEG bit Gray RDF/DC  NDNP is an NEH/LoC Program to enhance access to all American newspapers n Two-year pilot began May 2005 n Each page to be delivered as TIFF and JPEG2000 images Resolution progressive, visually lossless RDF/Dublin Core, uses XML box 8-bit sGray, Restricted ICC

1 August Digital Cinema Format MXF Application Distribution Activity DC Initiative JPEG bit XYZ’ Metadata Profile-3: 2K - up to 2048 x 1080 Profile-4: 4K - up to 4096 x bit non-linear XYZ  Digital Cinema uses JPEG 2000 for image compression in the DC Distribution Master n Compressed image size limited to  1.25 MBytes at 24 fps Frame and image parameters

1 August JPSearch  Linked to JPEG2000 but not part of the standard n Destined to become ISO  Start with Technical Report and Whitepaper n Technical report u to provide the JPEG user community with a clear understanding of the entire image retrieval process u to identify the components involved in search process, the linkages between them, and the components and links that should be standardized n Whitepaper u To articulate the benefits of a standardized image search framework and components  Drafts produced at July 2005 JPEG2000 meeting n Technical report proposes 4-layer framework for digital image search u user—query—result—content n Whitepaper proposes ISO MPEG-7 content description technology

1 August Motion Picture and Archival Color  ICC – Digital Motion Picture WG n Status: Started in early 2004 n Rationale: Current ICC technology is print-centric n Charter u Codify an open, vendor-neutral, cross-platform color management system architecture for DMP production that will enable utilization of ICC color management  CIE - Archival Colour TC n Status: In planning stage n Rationale: No activity specifically aimed at color preservation n What it would do u Develop a Technical Report that documents the needs of archival color and that can be communicated to other standards and development organizations.

1 August Conclusions  JPEG2000 is a privileged format for access and distribution n Offers a compression and format architecture  Your profile waiting to be developed n Leverage DCI work  There are related activities worth following n JPSearch and CIE Archival Color