MUMT611: Music Information Acquisition, Preservation, and Retrieval An Overview of MPEG-21 Alexandre Savard MUMT611: Music Information Acquisition, Preservation, and Retrieval January 2006 Every one here is presenting a different kind of multimedia framework to be used in many different situations. As we think about… Do we need an other One today??? During this presentation I will convince you that maybe we need an other one. In fact I will convince you that mine is better

Content Introduction Background / Motivation Multimedia Framework User Model Digital Item MPEG-21 Overview A nine parts description Conclusion Stress a bit more on both background and motivation Definition of the Multimedia Framework Gives us a better understanding of what is MPEG-21 Then I will make a nine parts overview of MPEG-21 before Concluding

Background / Motivation Multiplication of the different types of digital content Number of access devices increases Organization of data / metadata / meta-metadata Control the use and the access of the datas Denis presentation shows an exemple We can clearly notice a How recent development technologies push… of busines models The market is full of new access device. Usable Physical goods It is Clear that new model for distribution and trading digital content electronically are required.

Multimedia Framework MPEG-21 aims at defining a normative open framework for multimedia delivery and consumption Based on two essential concepts The User The Digital Item The goal of MPEG-21 is to define an open framework (any type of digital content) To be used by all the player in the delivery and consumption chain. This framework is based on two concept definition of a fundamental unit the concept of user interacting with the digital item

Multimedia Framework Defining the technology needed to support Users to exchange, access, consume, trade and otherwise manipulate Digital Items in an efficient, transparent and interoperable way. The goal of MPEG-21 can thus be rephrased to:

User Model Can be Someone or an Entity Defined by its interaction Individuals, consumers, communities, organizations, governments, corporations… Defined by its interaction with the digital item Can interact with an other User Can be someone or an entity that interact in the MPEG-21 environment. The digital item becomes the object of the interaction. It is the reason why here is defined as well who are… USER INTERACTION between them

Digital Item Any type of digital material or any combination of them Pictures, videos, texts, web pages, software… An other aspect of the digital revolution is that not only people are CONSUMING more but also PRODUCING Digital Item is quite a large set of very different kind of material. pictures, videos, texts, web pages, or COMBINATION A Single flexible definition of it has to be suitable to for every forms that digital item can take.

MPEG-21 Part 1: Vision, Technologies and Strategy Technical report to describe the architectural elements of the multimedia framework It is the primary step of the entire project. It has been completed and formally approved in September 2001.

MPEG-21 Part 2: Digital Item Declaration Set of abstract terms and concepts to form a useful model for defining Digital Items. Normative description of the syntax of each of the DID elements

MPEG-21 Part 2: Digital Item Declaration Elements of the DID Container Item Component / Descriptor / Resource Condition / Choice / Selection Here is an NON-EXHAUSTIVE list of some of the most important elements that we can found in the DID CONTAINERS groups the Items or even other containers ITEMS are declarative representation of Digital Item RESOURCE can be any picture, video clip, audio clip

MPEG-21 Part 2: Digital Item Declaration This figure presents the relationship of the principle elements within the DID model.

This figure presents the Actual format for MPEG-21.

MPEG-21 Part 3: Digital Item Identification Uniquely identify Digital Items and different types of Digital Item Frameworks are identified by encapsulating Uniform Resource Identifiers The DDI is mainly a proposition to Here what is called the URI are COMPAT STRING of CHARACTER for identifying an abstract or a physical resource.

MPEG-21 Part 3: Digital Item Identification This figure presents the Relationship between Digital Item Declaration and Digital Item Identification

MPEG-21 Part 3: Digital Item Identification Here is an Example Of all the Metadata and Identifiers within an MPEG-21 Music Album The cover, backcover each track with their lirics and the metadata related to it.

MPEG-21 Part 4: Intellectual Property To define an interoperable framework to manage and protect the intellectual property Include standardized ways of exchanging message between IPMP tools. One of the problem mpeg-4’s IPMP was that Many similar devices and player built by different manufacturer are not interworking Efforts are currently ongoing to define the requirements for the IPMP.

MPEG-21 Part 5: Rights Expression Language Declaration of rights and permissions defined as a machine-readable language Composed of four fundamental entities and the relationships among them It provide a MECHANISM to support use of the Digital Item in PUBLISHING DISTRIBUTING CONSUMING in a way that protect digital content

MPEG-21 Part 5: Rights Expression Language Issued to the PRINCIPAL which can be the USER Associated with the RESOURCE or the DIGITAL ITEM itself Subject to some CONDITIONS

MPEG-21 Part 6: Rights Data Dictionary Provides a definition of all the terms used in the Rights Expression Language Further Terms may be defined It is extendable At the beginning there were something like 400 definition extended to 1000.

MPEG-21 Part 7: Digital Item Adaptation Provides all the network and terminal resources where multimedia content can be created and shared A Digital Item is subject to: a Descriptor Adaptation Engine a Resource Adaptation Engine To SHIELD the USER from NETWORK and INSTALLATION issues.

MPEG-21 Part 7: Digital Item Adaptation Whole Concept of Digital Item ADAPTATION Here you have a digital that pass through both the descriptor adaptation engine and the ressource engine. It results in a modified digital item.

MPEG-21 Part 7: Digital Item Adaptation Specific items for standardization User Characteristics Terminal Capabilities Network Characteristics Natural Environment Characteristics Resource Adaptability Session Mobility Preferences exemples of NEC illumination, auditory noise-levels HARDWARE-RELATED specs Description of Bandwidth, delay and error

MPEG-21 Part 8: Reference Software First systems-related specifications in MPEG-21 DI browser: www.enikos.com The development of the Reference Software have been based on the requirements that have been defined for an architecture for processing Digital Items.

MPEG-21 Part 8: Reference Software User can edit the resources

MPEG-21 Part 9: File Format Complex collection of information Still / Dynamic media Digital Item Information Metadata Layout Information Inherit several concepts from MPEG-4 Finally MPEG-21 is That include

Bibliography All my information comes form the Formal report PART 1 of the MPEG-21 project.

Conclusion Can be a good exemple for us.