1. So what is a multimedia document sgazziano@johncabot.edu 1 A natural extension of a conventional textual document in the multimedia area. It is defined as a digital document that is composed of one or multiple media elements of different types (text, image, video, etc.) as a logically coherent unit. Can be a single picture or a single MPEG video file, but more often it is a complicated document such as a Web page consisting of both text and images.

2. An example of a multimedia doc tool sgazziano@johncabot.edu 2

3. Multimedia Retrieval: Techniques sgazziano@johncabot.edu 3 Find text on Queen Elizabeth riding a horse Find images of E II R horseriding Find videos of HM The Queen mounting a horse Find audio related to above content Any result ? How did you do it ?  What did you use for text  What did you use for images  What did you use for videos  What did you use for audio  Can google tell the difference between the Queen and the horse pic?  Can something else do ?

4. Pattern recognition, a definition. sgazziano@johncabot.edu 4

5. Pattern recognition examples sgazziano@johncabot.edu 5

6. Multimedia Retrieval Techniques sgazziano@johncabot.edu 6 Can you find audio about The Beatles song ”All you need is love” using audio (not text)”All you need is love” Can you find the movie using this pic ? (or any other pic)

7. Multimedia Retrieval Techniques sgazziano@johncabot.edu 7 Find audio about The Beatles song ”All you need is love” using audio (not text)”All you need is love” Find the movie using this pic ? Any result ? How did you do it ? Why do we have to use TEXT search for image, audio, video media ???

8. Multimedia Retrieval Techniques sgazziano@johncabot.edu 8 Despite the various techniques proposed in literature, there exist three major approaches to multimedia retrieval,  text-based approach,  content-based approach, and  hybrid approach. Their main difference lies in the type of index used for retrieval: the first approach uses text (keywords) as index, the second one uses low-level features extracted from multimedia data, and the last one uses the combination of text and low-level features. As a result, they differ from each other in many other aspects ranging from feature extraction to similarity measures.

9. Multimedia Retrieval Techniques sgazziano@johncabot.edu 9 text-based approach,  The most common content-based approach  Part of the «semantic web», usually done on specialized databases,  You would search a TV video or audio on the broadcaster database using either «tags», or transcription of the audio, or titles and labels.  It’s always text search

10. Multimedia Retrieval Techniques sgazziano@johncabot.edu 10 Let us try a non-textual content-based approach. Search for «all you need is love» using audio only. What would you use ?«all you need is love»

11. Multimedia Retrieval Techniques sgazziano@johncabot.edu 11 Let us try a non-textual content-based approach. Search for «all you need is love» using audio only. What would you use ?«all you need is love» Try now a «location based» search. Locate the nearest bookshop in english: what would you use?

12. Multimedia Retrieval Techniques sgazziano@johncabot.edu 12 Let us try a non-textual content-based approach. Search for «all you need is love» using audio only. What would you use ?«all you need is love» Try now a «location based» search. Locate the nearest bookshop in english: what would you use? Can you name other examples of «non-text» multimedia retrieval ?

13. Creating multimedia documents sgazziano@johncabot.edu 13 Tools from the Internet, like SlideShare, Prezi, and SlideRocket. Interactive animations and videos can be easily created using Xtranormal Movie Maker, Stupeflix VideoMaker, and GoAnimate. Multimedia-rich timelines can be created using tools like Dipity, xTimeLine, and Learning Tools Timeline Tool. A list of assorted tools is also here.SlideSharePreziSlideRocketXtranormal Movie MakerStupeflix VideoMakerGoAnimateDipityxTimeLineLearning Tools Timeline Toollist of assorted tools is also here Office suites then save as ? Personal experience (you name it) Try convert the “Bhutan” pres. into the most multimedial doc you can think of.

14. IPR and copyright issues sgazziano@johncabot.edu 14 Intellectual Property Rights  are the rights given to persons over the creations of their minds.  They usually give the creator an exclusive right over the use of his/her creation for a certain period of time.  See the World Trade Organization (WTO) pages for referenceWorld Trade Organization (WTO) pages

15. IPR and Copyright sgazziano@johncabot.edu 15 Copyright and rights related to copyright. The rights of authors of literary and artistic works (such as books and other writings, musical compositions, paintings, sculpture, computer programs and films) are protected by copyright, for a minimum period of 50 years after the death of the author. Also protected through copyright and related (sometimes referred to as “neighbouring”) rights are the rights of performers (e.g. actors, singers and musicians), producers of phonograms (sound recordings) and broadcasting organizations. The main social purpose of protection of copyright and related rights is to encourage and reward creative work. Industrial property. Protection of distinctive signs, in particular trademarks and geographical indications (which identify a good as originating in a place where a given characteristic of the good is essentially attributable to its geographical origin). Other types of industrial property are protected primarily to stimulate innovation, design and the creation of technology. In this category fall inventions (protected by patents), industrial designs and trade secrets. A functioning intellectual property regime should also facilitate the transfer of technology in the form of foreign direct investment, joint ventures and licensing. The protection is usually given for a finite term (typically 20 years in the case of patents).

16. OK: can I copy it or not ?? sgazziano@johncabot.edu 16 Usually: NO. (what part of it you don’t understand?)  Unauthorized use of intellectual property rights, called "infringement" with respect to patents, copyright, and trademarks, and "misappropriation" with respect to trade secrets, may be a breach of civil law or criminal law, depending on the type of intellectual property, jurisdiction, and the nature of the action. Unless the protection is formally and clearly waived under special circumstances like no-profit or educational use, GNU, Creative Commons, CopyleftGNUCreative CommonsCopyleft Commercial use of copyrighted material is generally prosecuted: country specific laws apply.

17. Is that right ? sgazziano@johncabot.edu 17 YES, because … NO, because … Discuss the issues 

18. Computer and Network Security sgazziano@johncabot.edu 18 Security v/s Criminal is not a new thing, since the beginning of History Networks and Computer pose new issues What is the worst threat to the information Society Digital Economy today What was the worst experience you perdonally had (on your PC or on the net), or that you had first hand knowledge