1. WP5: Semantic Multimedia
(Raphaël Troncy, CWI)
Partners: CWI, QMUL, DCU, INA, GU, KU, JRS, ITI

2. WP5.3 Status
QMUL: Creation of a web-based application for Image Classification and Relevance Feedback for image retrieval.
The system is divided into two main modules:
Client side: The system will be able to handle Image Classification (Module 1) and will incorporate User Relevance Feedback (Module 2)
Server side: To include video shot detection and KF extraction.
Functionalities:
Text based query input, handle video stream and perform shot detection (and KF extraction)
Initial classification result based on Biologically Inspired classifiers and User Relevance Feedback techniques are used for improving the image classification
Demonstration of QMUL tomorrow (WP 4 session)

3. WP5.3 Status
KU: SemFs - a virtual filesystem for accessing RDF metadata
Paper accepted to the I-Know'06 conference (Graz, September).
Apply SemFs to the SmatWebDataset
Demonstration of KU tomorrow (WP 5 session)
GU: Development of an interactive video retrieval system
The system allows capturing the interaction data from the users and will make use of it in inferring user intentions
Semantics of interaction is captured and will be used to proactively fetch information for the user
A prototype (standalone application) has been implemented and will be used for experimenting with the TREC VID activity

4. WP5.3 Status http://e-culture.multimedian.nl/tutorials/framed.html
CWI: /facet - A Browser for Heterogeneous Semantic Web Repositories
Based on the facetted paradigm
Allows to do simple (keyword based) and advanced search (RDF properties based)
Online Demonstration and Tutorial:
Paper accepted to the ISWC'06 conference (Athens, US, Nov).
Demonstration of CWI tomorrow
Finalists in the Top 5 of the Semantic Web Challenge 2006
CWI: CHIP - Build Your Art And History Profile

5. /facet: Features
/facet extends the facet browsing paradigm of Semantic Web data in four ways:
Users are able to select and navigate through facets of resources of any type and to make selections based on properties of other, semantically related, types.
We address a disadvantage of hierarchy-based navigation by adding a keyword search interface that dynamically makes semantically relevant suggestions.
The interface of /facet allows the inclusion of facet-specific display options that go beyond the hierarchical navigation that characterizes current facet browsing.
The browser works on any RDFS dataset without any additional configuration.

6. WP5.3 Status
DCU ?
JRS, ITI: no activity reported for the first 6 months ?
INA + CWI: Provide real world queries from INA customers
Cross WP discussions … will be discussed tomorrow

7. WP5.3 Deliverables AP.3.5.17 CWI, (QMUL/DFKI ?) 2006/12/31
Report specification of Semantic Retrieval
AP CWI, (QMUL/DFKI ?) 2006/12/31:
First implementation and evaluation of Semantic Retrieval

8. WP5.3: Future Plans New collaborations/ideas ?
CWI/WP3: use feature extraction results in order to adapt multimedia presentations to users / devices (ambient intelligence)
CWI/JRS: commonalities between a video manual annotation tool and a video search / browsing tool
CWI/GU: recommended system for video/photo
commonalities between the 2 systems
store user profiles, interoperability
INA/DFKI/CWI: align rich semantic metadata to French video and propose pre-structuring path / navigation in a collection
Apart from contractual work, what would you like to DO ? HAVE ?

9. WP5.3: D5.3 proposed TOC 1. Introduction (ALL) 2. Semantic Retrieval
Images classification system (QMUL)
3. Semantic Browsing
/facet: Browsing Heterogeneous RDF repositories (CWI)
SemFs - a virtual filesystem for accessing RDF metadata (KU)
4. Semantic Interaction with Multimedia
CHIP – An Art Recommended System (CWI)
NoName (GU): implicit vs explicit relevance
example: EGO – Efficient Group Organization (GU): Images are grouped
Ambient intelligence (CWI)
5. Conclusion
Other partner contributions: DCU ? JRS ? ITI ? INA ?

10. WP 5.3: Action Points
AP 5.3.1: CWI: distribute the TOC of D5.3 by 22/09/2006
AP 5.3.2: ALL: comment and agree on the TOC of D5.3 by 29/09/2006
AP 5.3.3: ALL: chapters due to 15/11/2006
AP 5.3.4: CWI: first complete draft of D5.3 by 30/11/2006