1. MPEG 7 &MPEG 21

2. Contents Why MPEG 7? Objective of MPEG 7
MPEG 7 for Content description
Advantage & Disadvantage of MPEG 7
Application area of MPEG 7
Why MPEG 21?
Objective
Advantage & Disadvantage
Comparison of MPEG 7 & 21
Question-Answer
References

3. Why MPEG 7? Due to the increasing availability of multimedia content.
More and more situation where it is necessary to have information about the content.
Difficulty to manage information.
Difficult to find, select, filter what is needed.
vsp.ee.nthu.edu.tw/Course/EE6650/handout/MPEG-7.PPT

4. MPEG 7 As Multimedia Content Descriptor-

5. MPEG7 Objective-
Standardize content-based descriptions for various types of audio-visual information, allowing quick and efficient content identification, and addressing a large range of applications.
MPEG-1, -2, and -4 represent the content itself (“ the bits”)
MPEG-7 should represent information about the content (“the bits about the bits”)

6. MPEG-7

7. MPEG-7 For Content Description
Data
Structure
Features
Models
Semantics
Images
Video
Audio
Multimedia
Formats
Layout
Regions
Segments
Grids
Mosaics
Relationships
(Spatio-temporal)
Color
Texture
Shape
Motion
Speech
Timbre
Melody
Clusters
Classes
Analytic models
Probability
Classifiers
Objects
Events
Actions
People
Labels

8. Advantage of MPEG-7
Once the extraction of the features that are going to be searchable is complete, the MPEG-7 standard specifies how to describe them.
It uses the XML language to create descriptions of the content of the multimedia files in a universally accessible manner.
It allows content owners to store these descriptions separately from the content.

9. Content Extraction Process-

10. Content Description -

11. Disadvantage of MPEG-7
It does not address how to extract the search items from the multimedia files.
The features and content extraction can be automated, but requires separate software that is only applicable to a limited number of files.

12. Application Area of MPEG-7
Architecture, real estate, and interior design (e.g., searching for ideas)
Broadcast media selection (e.g., radio channel, TV channel)
E-Commerce (e.g., personalized advertising, on-line catalogues, directories of e-shops)
Education (e.g., repositories of multimedia courses, multimedia search for support material)
Home Entertainment (e.g., systems for the management of personal multimedia collections, including manipulation of content, e.g. home video editing, searching a game karaoke)

13. Continue………………
Investigation services (e.g.,human characteristics recognition, forensics)
Journalism (e.g. searching speeches of a certain politician using his name, his voice or his face)
Multimedia editing (e.g., personalized electronic news service, media authoring)
Remote sensing (e.g., cartography, ecology, natural resources management)
Shopping (e.g., searching for clothes that you like)
Social (e.g. dating services)

14. MPEG21

15. Why MPEG 21? Built on top of MPEG-4 and MPEG-7 standards
Much more than just an audio visual standard
Meant to be a tool for delivering data in a broader sense
Emphasis put on being able to distribute data over a wide range of networks and devices
ISO discusses MPEG-21 as a "Multimedia Framework" used to distribute "Digital Items“
Digital items store both binary and text data
Makes use of XML

16. MPEG 21- Framework

17. Digital Item Adaptation -

18. Status- Standard is still in being developed Started in 2000
Coordinatted by the ISO Motion Picture Group
Isn’t expected to be completed for several more years

19. Objective-
Describe an open framework which allows the integration of all components of a delivery chain necessary to generate, use, manipulate, manage, and deliver multimedia content across a wide range of networks and devices.”
“Define the technology needed to support Users to exchange, access, consume, trade and otherwise manipulate Digital items in an efficient, transparent and interoperable way.

20. Continue
Underlying idea is to “bringring technology and content standards together”
ISO puts emphasis on facilitating digital commerce and ensuring intellectual property rights
Goals are both both ambitious and vague

21. MPEG 21 Parts-

22. Advantage of MPEG 21-
Allow users to transfer still and video images between networks and devices (digital cameras, digital video cameras, PCs, webTV, PDAs, printers, etc.) using a single standard
Add additional information such as voice and text to images if needed
Embed descriptive data in digital items that can be used to search for them on networks or databases

23. Distribution of Digital Item -

24. Continue…………
Store many different types of data and search keys in a single digital item
Make each component of a digital item extractable in such a way that it maintains information about itself and its relation to other components
Only allow authorized users to view or edit certain components of a digital item

25. Continue……………..
Allow vendors to send a digital items that contain information about products as well as forms that users could fill out to make purchases
Allow user navigation of digital items (e.g. click on a map to see flight routes to a certain city)
Enable digital items to automatically check periodically over a network to see if they should update themselves to reflect new developments

26. Continue………………
Allow vendors to send a digital items that contain information about products as well as forms that users could fill out to make purchases
Allow user navigation of digital items (e.g. click on a map to see flight routes to a certain city)
Enable digital items to automatically check periodically over a network to see if they should update themselves to reflect new developments

27. Continue……………… Allow video games to be run from a digital item
Combine diverse types of media in a original and interactive ways
Store both MIDI and audio tracks in a single digital item
Store lyrics and score information along with audio. Videos, set designs, Max patches, etc. could also be stored
Useful for collaborative compositions. Could edit all components together or separately
Secure streaming of multiple types of information

28. Disadvantage…………….
MPEG 21 define only syntax and semantics of description but does not cover the algorithm that is used to optimized the problem.

29. MPEG 7 VS MPEG 21
MPEG 7-
Not focus compression and decompression of digital video
Multimedia content description interface
A standard for describing multimedia content
Metadata describe Intellectual content
Meta data describe imagery ,sound ,color etc.
Enable complex search and discovery of media object

30. Continue…………..
MPEG 21-
Not focus on Compression and decompression of Digital video
A frame work for delivery and consumption of media object
Define the supply and delivery chain of media object
Define the business rule and business relationship
Define and manage property right over media object

31. Thank You

32. References:-
1.vsp.ee.nthu.edu.tw/Course/EE6650/handout/MPEG-7.PPT