A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM.
Published byModified over 5 years ago
Presentation on theme: "A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM."— Presentation transcript:
2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search
3 A. Frank Multimedia Resources – תמונות Pictures, Photos, Maps, Graphics, Animations שמע – Audio, Sounds מוסיקה– Music, MP3 הקלטות – Radio, Podcasts, Speeches חוזי– Video, Flash, Vlogs סרטים – Movies, TV
4 A. Frank MM Search & Information Retrieval (MMIR) Search & information retrieval of multimedia objects is hard!! Using SEs to find relevant, quality MM objects can be difficult and frustrating. Sample query: find a movie that has a large mouse chasing a Persian cat with twins watching from above? Common MM search is text-based; object text can be derived from: –caption of the MM object –text surrounding the MM object –filenames of MM object and the containing page –manual/automatic annotations Recently, tag-based MM search is effective (social computing). However, long due, content-based MM search on the Web is forthcoming.
5 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search
22 A. Frank Video: Clipblast! Organizes and makes the video Web relevant, fast and simple to navigate. Video Search and Navigation technology makes it easy to search, browse and personalize the video that viewers want, when they want it. Crawls the entire Web for all video content available, indexing more video content providers than any other video search engine. Largest video distribution platform ever.
36 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search
37 A. Frank “Content-based“ Image Search/Retrieval “Content based” image DB or Web site(s) that contain a large number of images. Image analysis techniques used to describe images by their extracted visual features such as color, texture, shape and orientation. These objects can be represented by sets of image features and then compared with the sets extracted from other images. Feature sets are described by their statistics, and the computer searches for statistically likely matches. Queries can be formulated in terms of visual features or by similarity options.
38 A. Frank Image: Squid Has about 1100 images of marine creatures in its database. Each image shows one distinct species on a uniform background. Every image is processed to recover the boundary contour, which is then represented by three global shape parameters and the maxima of the curvature zero-crossing contours in its Curvature Scale Space (CSS) image.
43 A. Frank Image: retriever Experimental service which lets you search and explore in a selection of Flickr images by drawing a rough sketch. Matches the most pronounced shapes and slabs of colors. The results are usually fairly good, sometimes even stunning, But it doesn't do object/face recognition of any kind, so if drawing an outline sketch of a chair, it almost certainly won't get you one back.
55 A. Frank Video: Blinkx World's largest and most advanced video search engine. Use of visual analysis and speech recognition to better understand rich media content. Advanced image and audio analysis techniques are used to automatically extract information about a video in real time and to create a rich index about the video content. Automatically and implicitly conducts searches based on the content being viewed by each individual user. With the advent of blinkx TV, users can now search and access news, movie trailers, popular multimedia segments and other video formats on demand.
59 A. Frank References Kate Greene, Better, More Accurate Image Search, Technology Review, April 9, 2007, http://www.technologyreview.com/Infotech/18501/ http://www.technologyreview.com/Infotech/18501/ Kate Greene, Surfing TV on the Internet, Technology Review, April 18, 2007, http://www.technologyreview.com/Infotech/18545/ http://www.technologyreview.com/Infotech/18545/ Amit Agarwal, 10 Interesting Things You Can Do with YouTube or Google Videos, Digital Inspiration (Blog), July 27, 2006, http://labnol.blogspot.com/2006/07/10-interesting-things-you- can-do-with.html http://labnol.blogspot.com/2006/07/10-interesting-things-you- can-do-with.html