1. Export experiments in WebODE. October 10th 2005 1 © Raúl García-Castro Export experiments in WebODE Raúl García-Castro October 10th, 2005 Interoperability Working Days October 10th-11th, 2005

2. Export experiments in WebODE. October 10th 2005 2 © Raúl García-Castro Index WebODE at a glance Execution of the benchmark suite Comments on how WebODE exports Comments on the experimentation

3. Export experiments in WebODE. October 10th 2005 3 © Raúl García-Castro WebODE Java based Ontological Engineering Workbench that gives support to Methontology. Provides a very expressive knowledge model. Covers and gives support to most of the activities involved in the ontology development process with different types of ontology-related services. Developed by the Ontology Engineering Group at UPM. http://delicias.dia.fi.upm.es/webode

4. Export experiments in WebODE. October 10th 2005 4 © Raúl García-Castro XCARIN RDF(S) XCARIN DAML+OIL ODEDesigner WebPicker Inference engine Export services OWL Import services OWL Other languages OKBC Prolog OIL FLogic ODE Ontology Management API CacheConsistencyAxiom ODEval DAML+OIL ODEMapster OntoTagger ODE Evolution Manager Other languages ODEMerge Ontology languages ODELinger RDF(S) UMLXMLUMLXML Jess Java DB ServerApplication Server WebODE Architecture Ontology Editor

5. Export experiments in WebODE. October 10th 2005 5 © Raúl García-Castro WebODE Knowledge Model Concepts –Class attributes –Instance attributes Groups of concepts Relations –Taxonomical Between concepts (subclass-of, not-subclass-of) Between concepts and groups (disjoint-subclass-partition, exhaustive-subclass-partition) –Mereological (transitive-part-of, intransitive-part-of) –Ad-hoc Properties of relations –Built-in properties (reflexive, irreflexive, symmetric, asymmetric, antisymmetric, transitive) –Ad-hoc properties Imported terms Constants Synonyms Abbreviations Formulae (axioms, rules, procedures) References Instance sets Instances (of concepts or of relations)

6. Export experiments in WebODE. October 10th 2005 6 © Raúl García-Castro Index WebODE at a glance Execution of the benchmark suite Comments on how WebODE exports Comments on the experimentation

7. Export experiments in WebODE. October 10th 2005 7 © Raúl García-Castro Execution of the benchmark suite The version of WebODE used was: WebODE 2.0 Build 101. No modifications were needed in the tool for performing the experimentation. Diminish the experimentation effort, as the benchmark suite had to be run several times to check improvements after modifications. Facilitate the use of the benchmark suite to all the WebODE developers. We decided to automate the execution of the benchmark suite and developed a Java program for running every benchmark in the benchmark suite in order to:

8. Export experiments in WebODE. October 10th 2005 8 © Raúl García-Castro Process followed in the experimentation To define the expected RDF(S) ontologies that should be obtained when exporting the WebODE ontologies. The expected ontologies were defined in the RDF/XML syntax of RDF(S). To run the Java program. It performs the following actions for each benchmark: –To insert into WebODE the ontology defined in the benchmark using WebODE's ontology management API methods. –To export the WebODE ontology to RDF(S). To compare the exported RDF(S) ontologies with the expected RDF(S) ontologies. This comparison was performed manually.

9. Export experiments in WebODE. October 10th 2005 9 © Raúl García-Castro Experimentation results IdDescriptionKnowledge AddedKnowledge LostResult Class benchmarks E01One class--OK E02Several classes--OK Metaclass benchmarks E03One class instance of another class that is instance of a third one --- E04One class instance of several classes--- E05Several classes instance of the same class--- E06One class instance of another class and viceversa--- E07One class that is instance of itself--- Subclass benchmarks E08One class subclass of another class that is subclass of a third one --OK E09One class subclass of several classes--OK E10Several classes subclass of the same class--OK E11One class subclass of another class and viceversa--- E12One class that is subclass of itself---

10. Export experiments in WebODE. October 10th 2005 10 © Raúl García-Castro Experimentation results 2 IdDescriptionAddedLost Class and object property benchmarks E13One class that has an object property with another--- E14One class that has the same object property with several classes--- E15Several classes that have the same object property with the same class--- E16One class that has an object property with itself--- Class and datatype property benchmarks E17One class that has a datatype property with a literal--- E18One class that has the same datatype property with several literals--- Datatype property benchmarks E19One datatype property--- E20Several datatype properties--- E21One datatype property that has as domain a class--- E22One datatype property that has as domain several classes--- E23Several datatype properties that have as domain the same class--- E24One datatype property that has as range “string”--- E25Several datatype properties that have as range “string”--- E26One datatype property that has as domain a class and as range “string”--OK E27One datatype property that has as domain several classes and as range “string” ---

11. Export experiments in WebODE. October 10th 2005 11 © Raúl García-Castro Experimentation results 3 IdDescriptionAddedLost Object property benchmarks E28One object property--- E29Several object properties--- E30One object property that has as domain a class--- E31One object property that has as domain several classes--- E32Several object properties that have as domain the same class--- E33One object property that has as range a class--- E34One object property that has as range several classes--- E35Several object properties that have as range the same class--- E36One object property that has as domain a class and as range another class--OK E37One object property that has as domain a class and as range several classes --- E38One object property that has as domain several classes and as range a class --- E39One object property that has as domain several classes and as range several classes --- E40One object property that has as domain and as range the same class--OK

12. Export experiments in WebODE. October 10th 2005 12 © Raúl García-Castro Experimentation results 4 IdDescriptionAddedLost Instance benchmarks E41One instance of a class--OK E42One instance of several classes--- E43Several instances of a class--OK Instance and object property benchmarks E44One instance that has an object property with another instance of the same class --OK E45One instance that has the same object property with several instances of the same class --OK E46Several instances that have the same object property with the same instance of the same class --OK E47One instance that has an object property with himself--OK E48One instance that has an object property with another instance of another class--OK E49One instance that has the same object property with several instances of another class --OK E50Several instances that have the same object property with the same instance of another class --OK Instance and datatype property benchmarks E51One instance that has a datatype property with a literal--OK E52One instance that has the same datatype property with several literals--OK

13. Export experiments in WebODE. October 10th 2005 13 © Raúl García-Castro Index WebODE at a glance Execution of the benchmark suite Comments on how WebODE exports Comments on the experimentation

14. Export experiments in WebODE. October 10th 2005 14 © Raúl García-Castro Comments on WebODE’s RDF(S) export Export of concepts Benchmarks: E01-E02, E08-E10, E13, E16-E18, E41, E43-E52... concept1... When WebODE exports an ontology containing concepts, it inserts a rdfs:label property into the class with the name of the concept. Example: Export concept: concept1:

15. Export experiments in WebODE. October 10th 2005 15 © Raúl García-Castro Comments on WebODE’s RDF(S) export Export of relations Benchmarks: E13, E16-E18, E44-E52... termRelation1... When WebODE exports an ontology containing relations, it inserts a rdfs:label property into the property with the name of the relation. Example: Export relation: relation1:

16. Export experiments in WebODE. October 10th 2005 16 © Raúl García-Castro Comments on WebODE’s RDF(S) export Concepts with instance attributes Benchmarks: E17, E18, E51, E52... concept1 instanceAttr1... When WebODE exports an ontology containing concepts with instance attributes: It inserts a rdfs:label property into the property with the name of the attribute. It exports all its own datatypes as rdfs:Literal. It does not export the values of the instance attribute. Example: Export concept: concept1, with instance attribute instanceAttr1:

17. Export experiments in WebODE. October 10th 2005 17 © Raúl García-Castro Comments on WebODE’s RDF(S) export Export of instances Benchmarks: E41, E43-E52... instance1... When WebODE exports an ontology containing instances, it inserts a rdfs:label property into the instance with the name of the instance. Example: Export instance: instance1 of concept concept1:

18. Export experiments in WebODE. October 10th 2005 18 © Raúl García-Castro Comments on WebODE’s RDF(S) export Export of instance sets Benchmarks: E41, E43-E52 WebODE does not export instance sets in ontologies.

19. Export experiments in WebODE. October 10th 2005 19 © Raúl García-Castro Index WebODE at a glance Execution of the benchmark suite Comments on how WebODE exports Comments on the experimentation

20. Export experiments in WebODE. October 10th 2005 20 © Raúl García-Castro Comments on improvements on the tools There are no comments on improvements of WebODE, as it has already been improved to pass all the benchmarks.

21. Export experiments in WebODE. October 10th 2005 21 © Raúl García-Castro Comments on modifications performed on the tool Some errors in WebODE were fixed: In E17 and E18, WebODE exported instance attribute values in concepts as properties of the class, what was incorrect. Now, WebODE doesn't export instance attribute values in concepts. In E52, WebODE exported multiple values in an instance as a rdf:Bag containing the values, but the property that represented the instance attribute had a range of rdfs:Literal. Now, WebODE inserts an instance-property-value triple for each instance value.

22. Export experiments in WebODE. October 10th 2005 22 © Raúl García-Castro Comments on the benchmark suites There were some benchmarks whose ontologies could not be modelled in WebODE. This is because WebODE cannot represent: Metaclasses (E03-E07). Cycles in class hierarchies (E11, E12). Relations between concepts with an arity greater than two (E14, E15). Instances of several classes (E42). Instance attributes and concept relations (datatype properties and object properties respectively) not attached to a concept (E19-E40). Because of this last one, the different combinations of instance attributes and concept relations in WebODE could not be tested. The benchmark suite should be modified to include benchmarks that test datatype and object properties attached to classes in order to be able to test this in WebODE.

23. Export experiments in WebODE. October 10th 2005 23 © Raúl García-Castro Export experiments in WebODE Raúl García-Castro October 10th, 2005 Interoperability Working Days October 10th-11th, 2005