CS315 Search and Retrieval of Multimedia P. Takis Metaxas.

Slides:

Advertisements

Similar presentations

National Technical University of Athens Department of Electrical and Computer Engineering Image, Video and Multimedia Systems Laboratory

Advertisements

Multimedia Components (Develop & Delivery System)

MASTERY OBJECTIVE: Learn parts of an html document Learn basic html tags HTML-An Introduction.

THE ESP GAME, & PEEKABOOM LUIS VON AHN CARNEGIE MELLON UNIVERSITY.

Ying Wang EDN 303 Fall Objectives Explain the role of an operating system and list the main operating systems used on today’s computers Define and.

AN IMPROVED AUDIO Jenn Tam Computer Science Dept. Carnegie Mellon University SOAPS 2008, Pittsburgh, PA.

Information Retrieval in Practice

1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.

CAPTCHA Presented By Sayani Chandra (Roll )

Lecture 26: Vision for the Internet CS6670: Computer Vision Noah Snavely.

1 CS 502: Computing Methods for Digital Libraries Lecture 20 Multimedia digital libraries.

CS335 Principles of Multimedia Systems Content Based Media Retrieval Hao Jiang Computer Science Department Boston College Dec. 4, 2007.

A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM.

Peekaboom: A Game for Locating Objects in Images

Human Computation CSC4170 Web Intelligence and Social Computing Tutorial 7 Tutor: Tom Chao Zhou

Overview of Search Engines

Lecture-8/ T. Nouf Almujally

Application Software Productivity Tools for Educators

Software and Multimedia

DIVINES – Speech Rec. and Intrinsic Variation W.S.May 20, 2006 Richard Rose DIVINES SRIV Workshop The Influence of Word Detection Variability on IR Performance.

211 Multimedia Web Design Lesson 1 – Web Functionality & Purpose.

Application Software.

Multimedia Databases (MMDB)

CP2022 Multimedia Internet Communication1 HTML and Hypertext The workings of the web Lecture 7.

What is Multimedia? The interactive incorporation of many media to accomplish some (educational) objective The end of teaching? (as we know it) The end.

Business Software What is database software? p. 145 Allows you to create, access, and manage data Add, change, delete, sort, and retrieve data Next.

 Commercial- to sell or promote company products  Portal- provide a variety of everyday services  Informational- provide useful info & news  Educational-

1 CS 430 / INFO 430 Information Retrieval Lecture 23 Non-Textual Materials 2.

Web Programming : Building Internet Applications Chris Bates CSE :

Ideas Session Willer Travassos, Jan. 24th. GWAP Games with a purpose (GWAP) uses the computational power of humans to perform tasks that computers are.

After you have registered in your course, logged in and used the Installation Wizard, to check your computer you can take advantage of all the resources.

Spoken Dialog Systems and Voice XML Lecturer: Prof. Esther Levin.

Multimedia ITGS. Multimedia Multimedia: Documents that contain information in more than one form: Text Sound Images Video Hypertext: A document or set.

1 CS 430: Information Discovery Lecture 22 Non-Textual Materials: Informedia.

Prof. Thomas Sikora Technische Universität Berlin Communication Systems Group Thursday, 2 April 2009 Integration Activities in “Tools for Tag Generation“

Vidispine Data Model Vidispine Bootcamp. Overview Collection Storage File Item Shape Item Component Shape Component Metadata abstract entity physical.

Multimedia streaming Application Anandi Giridharan Electrical Communication Engineering, Indian Institute of Science, Bangalore – , India Querying.

WEB MINING. In recent years the growth of the World Wide Web exceeded all expectations. Today there are several billions of HTML documents, pictures and.

CC 2007, 2011 attribution - R.B. Allen Multimedia and Hypermedia.

 The combination of sound, animation, graphics, video, and color into a document  The combination of text with graphics, sound, video, or animation.

Data and Applications Security Developments and Directions Dr. Bhavani Thuraisingham The University of Texas at Dallas Lecture #15 Secure Multimedia Data.

CSCI-100 Introduction to Computing Hardware Part II.

Chapter 22 - Browsing The World Wide Web Introduction Description Of Functionality –Obtain textual information, recorded sounds, or graphical images from.

Search Engine using Web Mining COMS E Web Enhanced Information Mgmt Prof. Gail Kaiser Presented By: Rupal Shah (UNI: rrs2146)

Internet Applications (Cont’d) Basic Internet Applications – World Wide Web (WWW) Browser Architecture Static Documents Dynamic Documents Active Documents.

MULTIMEDIA Multimedia is the field concerned with the computer- controlled integration of text, graphics, drawings, still and moving images (Video), animation,

MIT Artificial Intelligence Laboratory — Research Directions The START Information Access System Boris Katz

Human Computation (aka Crowdsourcing) LUIS VON AHN Slides taken from a talk by.

Quiz Week 8 Topical. Topical Quiz (Section 2) What is the difference between Computer Vision and Computer Graphics What is the difference between Computer.

Natural Language and Speech (parts of Chapters 8 & 9)

CS315 Multimedia Search and Retrieval. Types of Multimedia Multimedia: Beyond text communication Stored in a variety of formats Audio Today most popular.

1 What is Multimedia? Multimedia can have a many definitions Multimedia means that computer information can be represented through media types: – Text.

Layer 6 Presentation Layer. Overview Now that you have learned about Layer 5 of the OSI model, it is time to look at Layer 6, the presentation layer.

INTRODUCTION TO INFORMATION SYSTEMS LECTURE 9: DATABASE FEATURES, FUNCTIONS AND ARCHITECTURES PART (2) أ/ غدير عاشور 1.

Convert-It audio converter is fast, complete, easy yet powerful software that allows you to convert between a large collection of audio file formats.

Glencoe Introduction to Multimedia Chapter 2 Multimedia Online 1 Internet A huge network that connects computers all over the world. Show Definition.

Instructor: Dr. Wen-Hung Liao 2/21/2017

THE ESP GAME, AND OTHER STUFF

CS115/MAS115: Computing for The Socio-Techno Web

Data and Applications Security Developments and Directions

Web Design and Development

Software and Multimedia

Next-Generation Search Engines -Perspective and challenges

Software and Multimedia

Multimedia Information Retrieval

Mrs. Beth Cueni Carnegie Mellon

Creating Transcripts of Your Narrated PowerPoints Richard Oliver Department of Information Systems 2018 Quality in Online Education Conference.

Multimedia Information Retrieval

I UNDERSTAND CONCEPTS OF MULTIMEDIA

Interactive media.

Presentation transcript:

CS315 Search and Retrieval of Multimedia P. Takis Metaxas

Types of Multimedia Multimedia vs Hypermedia Multimedia: Beyond text communication Stored in a variety of formats Audio Today most popular formats: Image Today most popular formats: Animation Today most popular formats: Video Today’s most popular formats:

Searching for Audio Tagged audio files News organizations (e.g., NPR, BBC, …) iTunes etc services Raw audio Signal processing To Speech recognition processing To Text (inaccurate) Perform text search Tune recognition Signal processing Pattern matching E.g., midomi.com

Searching for Video Tagged by humans News organizations YouTube.com TED.com MIT’s Lecture Browser Lectures have additional challenges [ Glass+ Recent Progress in the MIT Spoken Lecture Processing] Project Extract audio track Convert into text Analyze text to reveal structure Segment based on structure

Searching for Images Use surrounding text Filenames, html, nearby text Tagged by humans Expensive! Slow! Computer Vision techniques Still a tough problem Feedback based MRS9.1 – not very successful Tagged through games! The ESP game (now part of gwap.com) [von Ahn, Dabbish: Labelling Images with a Computer Game] The Peekaboom game (newer version called squigl) [von Ahn, Liu, Blum: A game for locating objects in images]

Inspiration: Harness human cycles! Captcha: program that can tell whether its user is a human or a computer Can generate and grade test that Most humans can pass Current computer programs will fail