Working meeting of WP4 Task WP4.1 Richard Arndt, KU JRS, ITI, CWI, DFKI, UEP

Status of previous APs AP3.4.11 (UEP, KU, ITI, CWI) Survey on modelling upper Ontologies Date: 2006-06-30 Status: Completed AP3.4.12 (UEP, KU, CWI and ITI) Survey on existing upper Ontologies Date: 2006-07-15 Status: Completed

Status of previous APs APs related to the design of the multimedia ontology AP3.4.13 (ITI and KU) Define ontology for MPEG-7 visual descriptors AP3.4.15 (KU) Define Ontology for MPEG-7 audio descriptors AP3.4.18 (CWI, KU) Define Ontology for MPEG-7 multimedia descriptors AP3.4.20 (KU, JRS, ITI and CWI) Define Ontology for MPEG-7 structuring descriptors AP3.4.22 (UEP, CWI and ITI) Define Ontology for MPEG-7 based administrative meta data Date: 2006-06-30 Status: Completed through definition of a methodology to translate MPEG-7 description tools into DOLCE  DOLCE-aligned multimedia ontology (Collaboration between KU and UEP)

Status of previous APs Additional work concerning design of multimedia ontology AP3.4.13 Define ontology for MPEG-7 visual descriptors New version of Visual descriptor Ontology (ITI) AP3.4.17 Define the Ontologies for textual descriptors LingInfo ontology (DFKI) AP3.4.20 Define Ontology for MPEG-7 structuring descriptors Definition of an OWL ontology that covers a part of the DAVP MPEG-7 profile of JRS (Collaboration between JRS and CWI)

Concept of the new Multimedia Ontology Modelling approach: Use of DOLCE and its two design patterns for Descriptions & Situations (D&S) and Information Objects (OIO) as a modelling basis Creation of multimedia design patterns based on D&S and OIO to formalize MPEG-7 decomposition descriptors (e.g. spatial image segmentation) MPEG-7 annotation descriptors (e.g. visual descriptors, segment masks, media information) Complex and/or nested MPEG-7 data types, ... Patterns allow translation of MPEG-7 descriptors into DOLCE vocabulary  Extensible multimedia ontology due to DOLCE-alignment Details: Tomorrow in the plenary meeting ...

Status of previous APs AP3.4.24 (KU, UEP, CWI) Investigate the MPEG – 7 semantics part Result: Semantics part not feasible to express domain dependent knowledge  Semantics will be expressed by domain ontologies AP3.4.25 (KU) Define additional semantic descriptions Result: Not necessary any longer  Multimedia ontology will be linked with domain ontologies by applying an already defined design pattern

Status of previous APs AP3.4.27 (DFKI) Provide example data + domain for annotation Date: 2006-05-31 Status: Completed AP3.4.28 (UEP, ITI, KU, CWI and JRS) Conduct a functional study of manual annotation tools (requirements and survey of existing tools) Date: 2006-06-31 Status: Completed AP3.4.29 (KU) Specify the architecture and choose development tools Date: 2006-07-30 Status: Ongoing (M-OntoMat Annotizer 2.0, cooperation between ITI and KU)

Open APs Implementation of multimedia ontology Date: 2006-09-30 Ontology will be implemented according to the needs of the project  We need to know which MPEG-7 description tools are needed for content description in WP3  Implementation will start after this

Open APs AP3.4.30 Implementation of first prototype of the annotation tool Date: 2006-11-15 Implementation will start immediately after this meeting Parallel development of two tools for: Image annotation (M-OntoMat Annotizer 2.0, ITI and KU) Video annotation (JRS annotation tool, JRS and CWI) M-OntoMat Annotizer 1.0 and JRS annotation tool will be demonstrated tomorrow

APs to prepare M12 Deliverables Multimedia Ontology Infrastructure AP1 (KU, UEP) Date: 2006-09-15 Write a detailed description of the design patterns and their usage (part of D4.1) AP2 (JRS, KU, ITI, CWI) Date: 2006-09-15 Determine which MPEG-7 descriptors are needed for the annotation tool prototypes AP3 (UEP) Date: 2006-10-15 Use the design patterns of the multimedia ontology to implement the descriptors from AP2 in an OWL ontology Create a Protégé project and submit it to the K-Space SVN repository Implement the design patterns based on the DOLCE OWL code Implement the descriptors

APs to prepare M12 Deliverables Multimedia Ontology Infrastructure AP4 (UEP, DFKI) Date: 2006-10-15 Ensure that the example domain ontology which was provided by DFKI can be used in combination with the OWL multimedia ontology to annotate the example images Integrate the domain ontology in the multimedia ontology SVN repository Add some example annotations to the SVN repository that demonstrate how the annotation is carried out (part of D4.1)

APs to prepare M12 Deliverables Annotation Tool AP1 (KU, ITI) Date: 2006-11-15 Implement the M-OntoMat Annotizer 2.0 plugin for OntoMat 0.82 according to the architecture draft. First prototype of M-OntoMat Annotizer 2.0 has to provide Semantic annotation of image segments according to the new multimedia ontology infrastructure Export to RDF (and probably storage in the new WP5 metadata store) AP2 (JRS, CWI) Date: 2006-11-15 Implement a prototype for video annotation The tool should be compliant with the new multimedia ontology infrastructure, If possible. AP3 (KU, ITI, JRS, CWI) Describe the architecture of the tools and their functionalities (part of D4.1)

Goals for the next 6 months Cooperation with WP3 to determine MPEG-7 descriptors (or other annotations) that are used to describe multimedia content Integration of the WP3 descriptors in the OWL multimedia ontology Extension of the functionalities of the annotation tools M-OntoMat Annotizer 2.0: Extraction of low level features for segments Querying of annotated data JRS Video Annotation Tool: ??