Chapter 1 Chapter 1 Introduction Multimedia Systems

Key Points Digital multimedia is any combination of two or more media, represented in a digital form, sufficiently well integrated to be presented via a single interface, or manipulated by a single computer program. Digital multimedia is any combination of two or more media, represented in a digital form, sufficiently well integrated to be presented via a single interface, or manipulated by a single computer program. Multimedia can be delivered offline (e.g. on CD- ROM) or online (e.g. on the World Wide Web). Multimedia can be delivered offline (e.g. on CD- ROM) or online (e.g. on the World Wide Web). Multimedia has a wide range of application, from entertainment to education and business. Multimedia has a wide range of application, from entertainment to education and business.

Key Points There are many precedents for the integration of media, but the addition of interactivity is a novel contribution of digital multimedia. There are many precedents for the integration of media, but the addition of interactivity is a novel contribution of digital multimedia. Access to multimedia is not universal. Access to multimedia is not universal. The issues raised by censorship ( 監察 ) have a very long history and have not been satisfactorily resolved. The issues raised by censorship ( 監察 ) have a very long history and have not been satisfactorily resolved. The challenge and opportunity of multimedia remains. The challenge and opportunity of multimedia remains.

Introduction What is Medium (pl. media) What is Medium (pl. media) Something in a middle position. Something in a middle position. A substance regarded as the means of transmission of a force or effect. A substance regarded as the means of transmission of a force or effect. An intervening substance though which something is transmitted or carried on ( 介 質 ). An intervening substance though which something is transmitted or carried on ( 介 質 ). A means of mass communication such as newspaper,magazine or television ( 傳媒 ). A means of mass communication such as newspaper,magazine or television ( 傳媒 ). Something gives our senses access to further form of information. Something gives our senses access to further form of information.

Introduction What is Multimedia (Multiple-Media) What is Multimedia (Multiple-Media) A combination of text, graphics, images, video and audio to enrich its content and enhance communication. A combination of text, graphics, images, video and audio to enrich its content and enhance communication.

Introduction What is digital Multimedia What is digital Multimedia Any combination of two or more media, represented in a digital form, well integrated to be presented via a single interface, or manipulated by a single computer program. Any combination of two or more media, represented in a digital form, well integrated to be presented via a single interface, or manipulated by a single computer program. Examples Examples Forensic ( 法院的 ) multimedia Forensic ( 法院的 ) multimedia Entertainment and education: Video game Entertainment and education: Video game Digital Encyclopedia Britannica ( 大英百科 ) Digital Encyclopedia Britannica ( 大英百科 ) CD titles CD titles Sale presentation and promotions Sale presentation and promotions Scientific visualization. Scientific visualization.

Introduction Delivery of Multimedia Delivery of Multimedia Multimedia can be delivered Multimedia can be delivered Offline (e.g. on CD-ROM) Offline (e.g. on CD-ROM) Online (e.g. on the World Wide Web). Online (e.g. on the World Wide Web). Online delivery provides live multimedia content such as video conferencing and broadcast multimedia (compression & databases). Online delivery provides live multimedia content such as video conferencing and broadcast multimedia (compression & databases). TV, movies: linear and noninteractive TV, movies: linear and noninteractive

Multimedia Production Making of multimedia requires software Making of multimedia requires software not only for preparation of individual media elements not only for preparation of individual media elements but for their integration into a finished production but for their integration into a finished production Authoring systems Authoring systems programs that allow a designer to assemble different media in space and time, and add interactive behavior to them. programs that allow a designer to assemble different media in space and time, and add interactive behavior to them.

Storyboards A means of making and communicating multimedia design A means of making and communicating multimedia design Sequence of still pictures showing composition of shots at key points in production Sequence of still pictures showing composition of shots at key points in production Non-linearity added to storyboard Non-linearity added to storyboard

Terminologies Multimedia production and multimedia applications Multimedia production and multimedia applications Production: present material in a fixed way Production: present material in a fixed way Application: generate multimedia dynamically Application: generate multimedia dynamically Different sorts of perception such as reading text, looking at pictures, listening to sound. Different sorts of perception such as reading text, looking at pictures, listening to sound. Cognitive scientists call these different sorts of perception modalities. Cognitive scientists call these different sorts of perception modalities.

Interactivity Control the content and flow of information Control the content and flow of information Providing choices in computer program is much easier than providing choices via hardware such as VCR Providing choices in computer program is much easier than providing choices via hardware such as VCR

User Interfaces Fig. 1.1, dialog box Fig. 1.1, dialog box Text entry areas, pop-up menus, buttons Text entry areas, pop-up menus, buttons Disadvantages Disadvantages Users who are not already familiar with the interface convention might find it harder to use than a specially designed simpler one (Fig. 1.2) Users who are not already familiar with the interface convention might find it harder to use than a specially designed simpler one (Fig. 1.2) Everything looks the same Everything looks the same Innovative interface Innovative interface

User Interfaces (2) Interface elements that have become most familiar to users Interface elements that have become most familiar to users Menu commands with keyboard shortcuts Menu commands with keyboard shortcuts Playback controls Playback controls Mimic the operation on VCR and de facto standard icons (Fig. 1.2) Mimic the operation on VCR and de facto standard icons (Fig. 1.2) Additional control Additional control Strip with a marker that can be pulled through it Strip with a marker that can be pulled through it A new interface convention A new interface convention

Social and ethical ( 倫理 ) considerations Access to multimedia: Consumption Access to multimedia: Consumption Depends Depends on access to appropriate hardware on access to appropriate hardware on possession of necessary skills on possession of necessary skills is not universal is not universal Availability of computers Availability of computers Reliable infrastructure: power supplies, ubiquitous ( 到處存在 ) telecommunications Reliable infrastructure: power supplies, ubiquitous ( 到處存在 ) telecommunications Telecommunication charge rate Telecommunication charge rate Computer skill Computer skill Physical disability or learning difficulties Physical disability or learning difficulties Voice synthesizers Voice synthesizers Braille ( 點字 ) keyboards Braille ( 點字 ) keyboards Difficulty in distinguishing between certain colors Difficulty in distinguishing between certain colors Security Security Social awareness Social awareness

Access to Multimedia: Production Access right Access right Write access Write access Read access Read access Inexpensive tools for constructing Web sites Inexpensive tools for constructing Web sites Means of production and distribution of traditional media is tightly restricted. Means of production and distribution of traditional media is tightly restricted. Recorder music: multinational corporations Recorder music: multinational corporations Film: enormous cost Film: enormous cost

Control of Multimedia Most popular sites on WWW are home sites of ISP Most popular sites on WWW are home sites of ISP Web portals Web portals Search engines Search engines One-to-many One-to-many Broadcasting, publication and marketing Broadcasting, publication and marketing Few-to-few: WWW Few-to-few: WWW

Control of Content Control over what people may read, see, hear or do Control over what people may read, see, hear or do Rapid growth of Internet Rapid growth of Internet Censorship ( 檢查 ) Censorship ( 檢查 ) Mechanisms exist for controlling publication, exhibition, performance and so Mechanisms exist for controlling publication, exhibition, performance and so Platform for Internet Content Selection (PICS) Platform for Internet Content Selection (PICS) Restricts reception, not distribution Restricts reception, not distribution Allow user to prevent unacceptable material reaching them Allow user to prevent unacceptable material reaching them Labels are associated with each Web page. Labels are associated with each Web page. Undesirable material is rejected by screening software Undesirable material is rejected by screening software A standard format for content labelling A standard format for content labelling Recreational Software Advisory Council (RSAC) Recreational Software Advisory Council (RSAC) Crude measures of violence, sex, nudity and language Crude measures of violence, sex, nudity and language

Control of Content PICS allows labels to be attached by PICS allows labels to be attached by Page’s author Page’s author Third party Third party You have to trust labelling service You have to trust labelling service PICS label for searching program PICS label for searching program

A New Medium Very brief history of multimedia Very brief history of multimedia Web pages Web pages After several years, can support elaborate layout, typography, animation, video, sound, and interactivity After several years, can support elaborate layout, typography, animation, video, sound, and interactivity SETI SETI Search for Extraterrestrial Intelligence Search for Extraterrestrial Intelligence Internet: a collection of connected computers Internet: a collection of connected computers