1. Working meeting of WP4 Task WP4.1
Richard Arndt, KU
JRS, ITI, CWI, DFKI, UEP

2. Status of previous APs
AP (UEP, KU, ITI, CWI) Survey on modelling upper Ontologies Date: Status: Completed
AP (UEP, KU, CWI and ITI) Survey on existing upper Ontologies Date: Status: Completed

3. Status of previous APs
APs related to the design of the multimedia ontology
AP (ITI and KU) Define ontology for MPEG-7 visual descriptors
AP (KU) Define Ontology for MPEG-7 audio descriptors
AP (CWI, KU) Define Ontology for MPEG-7 multimedia descriptors
AP (KU, JRS, ITI and CWI) Define Ontology for MPEG-7 structuring descriptors
AP (UEP, CWI and ITI) Define Ontology for MPEG-7 based administrative meta data
Date: Status: Completed through definition of a methodology to translate MPEG-7 description tools into DOLCE  DOLCE-aligned multimedia ontology (Collaboration between KU and UEP)

4. Status of previous APs
Additional work concerning design of multimedia ontology
AP Define ontology for MPEG-7 visual descriptors New version of Visual descriptor Ontology (ITI)
AP Define the Ontologies for textual descriptors LingInfo ontology (DFKI)
AP Define Ontology for MPEG-7 structuring descriptors Definition of an OWL ontology that covers a part of the DAVP MPEG-7 profile of JRS (Collaboration between JRS and CWI)

5. Concept of the new Multimedia Ontology
Modelling approach:
Use of DOLCE and its two design patterns for Descriptions & Situations (D&S) and Information Objects (OIO) as a modelling basis
Creation of multimedia design patterns based on D&S and OIO to formalize
MPEG-7 decomposition descriptors (e.g. spatial image segmentation)
MPEG-7 annotation descriptors (e.g. visual descriptors, segment masks, media information)
Complex and/or nested MPEG-7 data types, ...
Patterns allow translation of MPEG-7 descriptors into DOLCE vocabulary  Extensible multimedia ontology due to DOLCE-alignment
Details: Tomorrow in the plenary meeting ...

6. Status of previous APs
AP (KU, UEP, CWI) Investigate the MPEG – 7 semantics part Result: Semantics part not feasible to express domain dependent knowledge  Semantics will be expressed by domain ontologies
AP (KU) Define additional semantic descriptions Result: Not necessary any longer  Multimedia ontology will be linked with domain ontologies by applying an already defined design pattern

7. Status of previous APs
AP (DFKI) Provide example data + domain for annotation Date: Status: Completed
AP (UEP, ITI, KU, CWI and JRS) Conduct a functional study of manual annotation tools (requirements and survey of existing tools) Date: Status: Completed
AP (KU) Specify the architecture and choose development tools Date: Status: Ongoing (M-OntoMat Annotizer 2.0, cooperation between ITI and KU)

8. Open APs Implementation of multimedia ontology Date: 2006-09-30
Ontology will be implemented according to the needs of the project  We need to know which MPEG-7 description tools are needed for content description in WP3  Implementation will start after this

9. Open APs
AP Implementation of first prototype of the annotation tool Date:
Implementation will start immediately after this meeting
Parallel development of two tools for:
Image annotation (M-OntoMat Annotizer 2.0, ITI and KU)
Video annotation (JRS annotation tool, JRS and CWI)
M-OntoMat Annotizer 1.0 and JRS annotation tool will be demonstrated tomorrow

10. APs to prepare M12 Deliverables Multimedia Ontology Infrastructure
AP1 (KU, UEP) Date: Write a detailed description of the design patterns and their usage (part of D4.1)
AP2 (JRS, KU, ITI, CWI) Date: Determine which MPEG-7 descriptors are needed for the annotation tool prototypes
AP3 (UEP) Date: Use the design patterns of the multimedia ontology to implement the descriptors from AP2 in an OWL ontology
Create a Protégé project and submit it to the K-Space SVN repository
Implement the design patterns based on the DOLCE OWL code
Implement the descriptors

11. APs to prepare M12 Deliverables Multimedia Ontology Infrastructure
AP4 (UEP, DFKI) Date: Ensure that the example domain ontology which was provided by DFKI can be used in combination with the OWL multimedia ontology to annotate the example images
Integrate the domain ontology in the multimedia ontology SVN repository
Add some example annotations to the SVN repository that demonstrate how the annotation is carried out (part of D4.1)

12. APs to prepare M12 Deliverables Annotation Tool
AP1 (KU, ITI) Date: Implement the M-OntoMat Annotizer 2.0 plugin for OntoMat 0.82 according to the architecture draft. First prototype of M-OntoMat Annotizer 2.0 has to provide
Semantic annotation of image segments according to the new multimedia ontology infrastructure
Export to RDF (and probably storage in the new WP5 metadata store)
AP2 (JRS, CWI) Date: Implement a prototype for video annotation
The tool should be compliant with the new multimedia ontology infrastructure, If possible.
AP3 (KU, ITI, JRS, CWI) Describe the architecture of the tools and their functionalities (part of D4.1)

13. Goals for the next 6 months
Cooperation with WP3 to determine MPEG-7 descriptors (or other annotations) that are used to describe multimedia content
Integration of the WP3 descriptors in the OWL multimedia ontology
Extension of the functionalities of the annotation tools
M-OntoMat Annotizer 2.0:
Extraction of low level features for segments
Querying of annotated data
JRS Video Annotation Tool: ??