Horus Technical Overview DAML PI Meeting 18 July 2001 Brian Kettler Horus Technical Lead ISX Corporation For Official Use Only

Topics n Horus Toolkit Key Requirements 5 Component Toolkits Ontologies Future Plans n Horus-DAML Interchange Horus is a joint project of the Intelink Management Office and DARPA. Contractors are BBN Technologies (prime), ISX Corporation, and Logicon (Sterling Federal Systems)

Key Requirements for Horus n Store assertions from marked up Intelink documents and other data sources (e.g., databases) assertions defined with respect to ontologies assertions aggregated into knowledge objects metadata stored for assertions e.g., data source, drilldown (URLs, etc.), collection dates, validity dates, etc. n Retrieve knowledge objects (and constituent assertions) in response to queries n Allow users to link knowledge objects n Support development of web-based portals to browse, query, and link knowledge objects support drilldown to original web pages, databases

Horus Version 1.0 (FY00) n Demonstration prototype Intelink Conference demo in 9/00 Demo version running now on Intelink-S n Military Units and Terrorist Events domain n Portals built by Horus Team n EJB/Java servlets infrastructure n Support for SHOE ontologies/markup n KB implemented with Parka and Oracle

Horus Toolkit Version 2 (FY01) n Support DAML+OIL/RDF(S) languages for ontology definition and markup not necessarily all of DAMLs ontology constructs support future language changes n More automation for document markup n Toolkit architecture allows modular configuration and upgrade versus Horus V1 System approach increased flexibility/extensibility leverage emerging DAML tools more easily n Tools for portal developers to add new data sources more easily

Horus Toolkit Technical Architecture Knowledge Base Data Access Toolkit Ontology Toolkit Portal Toolkit User (Consumer) User (Producer) User (Ontology Author) User (Site DBA) User (KB Admin) Markup Toolkit Automatic Markup Tool (Aerotext+) Manual Markup Tool Document Submitter Tool Markup Submitter Tool Reference Resolution Tool Ontology Authoring Tools (DAML Pgm) Ontology Validation Tools (DAML Pgm) Ontology Import Tool Ontology Export Tools HKO Manager & Repository Ontology Manager & Repository Assertion Management Tools KB Maint/ Admin Toos Markup Processor (RDF-API+) DS to Ontology Map Tool DS to KB Update Tool Product Generation (PGT) DB Class Viewer Tool (CVT) HKO Query Tool (HQT) Data Source Query Tool (DSQT) XML Transform Tool (XTT) Portal Ontology Submission Tool Data Sources Oracle Parka

Ontology Tools (ISX, DAML) Knowledge Base Data Access Toolkit Ontology Toolkit Portal Toolkit User (Consumer) User (Producer) User (Ontology Author) User (Site DBA) User (KB Admin) Markup Toolkit Automatic Markup Tool (Aerotext+) Manual Markup Tool Document Submitter Tool Markup Submitter Tool Reference Resolution Tool Ontology Authoring Tools (DAML Pgm) Ontology Validation Tools (DAML Pgm) Ontology Import Tool Ontology Export Tools HKO Manager & Repository Ontology Manager & Repository Assertion Management Tools KB Maint/ Admin Toos Markup Processor (RDF-API+) DS to Ontology Map Tool DS to KB Update Tool Product Generation (PGT) DB Class Viewer Tool (CVT) HKO Query Tool (HQT) Data Source Query Tool (DSQT) XML Transform Tool (XTT) Portal Ontology Submission Tool Data Sources Oracle Parka

Ontology Tools n Ontology Authoring Tools GUI for authoring/editing an ontology in DAML support extension of ontologies through importing Currently using COTS XML authoring tools (e.g, XML Spy) Future: Investigate DAML tools for ontology authoring (e.g., Protégé, OilEd, etc.) n Ontology Validation Tool Future: Check syntax/semantics of DAML ontologies (e.g., investigate DAML tools such as Chimera) n Ontology Submission Tool GUI to submit an ontology (URL) to the KB (also done automatically) n Ontology Import Tool Reads in a DAML ontology to organize the Horus Knowledge Base Future: import ontologies from XML DTDs/Schemas, etc. n Ontology Export Tool Future: Export an ontology in other languages

Markup Tools (Logicon) Knowledge Base Data Access Toolkit Ontology Toolkit Portal Toolkit User (Consumer) User (Producer) User (Ontology Author) User (Site DBA) User (KB Admin) Markup Toolkit Automatic Markup Tool (Aerotext+) Manual Markup Tool Document Submitter Tool Markup Submitter Tool Reference Resolution Tool Ontology Authoring Tools (DAML Pgm) Ontology Validation Tools (DAML Pgm) Ontology Import Tool Ontology Export Tools HKO Manager & Repository Ontology Manager & Repository Assertion Management Tools KB Maint/ Admin Toos Markup Processor (RDF-API+) DS to Ontology Map Tool DS to KB Update Tool Product Generation (PGT) DB Class Viewer Tool (CVT) HKO Query Tool (HQT) Data Source Query Tool (DSQT) XML Transform Tool (XTT) Portal Ontology Submission Tool Data Sources Oracle Parka

Markup Tools n Document Submitter GUI to submit a new document (URL) to the markup process n Automatic Markup Tool Generates markup automatically from text in document (using Lockheeds Aerotext product) concepts matched in text converted to knowledge objects in DAML rules engineered to match concepts n Manual Markup Tool GUI to validate/modify knowledge objects can take input from Automatic Markup Tool user provided form generated from ontologies n Markup Submitter Tool GUI to submit a document with DAML markup to the KB n Reference Resolution Tool Matches incoming markup assertions (from docs, DB) to existing knowledge objects

Knowledge Base Tools (ISX) Knowledge Base Data Access Toolkit Ontology Toolkit Portal Toolkit User (Consumer) User (Producer) User (Ontology Author) User (Site DBA) User (KB Admin) Markup Toolkit Automatic Markup Tool (Aerotext+) Manual Markup Tool Document Submitter Tool Markup Submitter Tool Reference Resolution Tool Ontology Authoring Tools (DAML Pgm) Ontology Validation Tools (DAML Pgm) Ontology Import Tool Ontology Export Tools HKO Manager & Repository Ontology Manager & Repository Assertion Management Tools KB Maint/ Admin Toos Markup Processor (RDF-API+) DS to Ontology Map Tool DS to KB Update Tool Product Generation (PGT) DB Class Viewer Tool (CVT) HKO Query Tool (HQT) Data Source Query Tool (DSQT) XML Transform Tool (XTT) Portal Ontology Submission Tool Data Sources Oracle Parka

Knowledge Base Tools n Horus Ontology Manager and Repository Persistently stores ontologies as Java Objects API to query ontologies (similar idea to DAML-API) EJB interface (Oracle for Entity EJB persistence) n Horus Knowledge Object Manager and Repository Persistently stores assertions (takes DAML as input) assertions grouped into Knowledge Objects via HOIDs metadata stored on a per-assertion basis Uses Parka KBMS and Oracle DBMS inheritance-based inference in Parka, Oracle for bulk retrieval Avoids closed world assumptions re constraint enforcement (e.g., domain, range) XML-based query interface (KBQL) with DAML output supports highly structured queries EJB interface to update/query functions

Data Access Tools (Logicon) Knowledge Base Data Access Toolkit Ontology Toolkit Portal Toolkit User (Consumer) User (Producer) User (Ontology Author) User (Site DBA) User (KB Admin) Markup Toolkit Automatic Markup Tool (Aerotext+) Manual Markup Tool Document Submitter Tool Markup Submitter Tool Reference Resolution Tool Ontology Authoring Tools (DAML Pgm) Ontology Validation Tools (DAML Pgm) Ontology Import Tool Ontology Export Tools HKO Manager & Repository Ontology Manager & Repository Assertion Management Tools KB Maint/ Admin Toos Markup Processor (RDF-API+) DS to Ontology Map Tool DS to KB Update Tool Product Generation (PGT) DB Class Viewer Tool (CVT) HKO Query Tool (HQT) Data Source Query Tool (DSQT) XML Transform Tool (XTT) Portal Ontology Submission Tool Data Sources Oracle Parka

Data Access Tools n Data Source to Ontology Mapping Tool GUI for a user (DBA) to link elements of a DB schema to elements of DAML ontologies user specifies JDBC connection information to DB user specifies DB tables/fields and mapping to ontology classes/properties stores mapping persistently – used by other Horus tools n Data Source to KB Update Tool Uses DB-to-Ontology mapping to update the KB sends DAML to the KB for new data, after reference resolution (if required) using Reference Resolution Tool can be run by user, triggered by cron job, etc. n Product Generation Tool Provides drilldown information from a data source generates a product as XML from DB XSL applied to XML to generate HTML

Portal Tools (Logicon) Knowledge Base Data Access Toolkit Ontology Toolkit Portal Toolkit User (Consumer) User (Producer) User (Ontology Author) User (Site DBA) User (KB Admin) Markup Toolkit Automatic Markup Tool (Aerotext+) Manual Markup Tool Document Submitter Tool Markup Submitter Tool Reference Resolution Tool Ontology Authoring Tools (DAML Pgm) Ontology Validation Tools (DAML Pgm) Ontology Import Tool Ontology Export Tools HKO Manager & Repository Ontology Manager & Repository Assertion Management Tools KB Maint/ Admin Toos Markup Processor (RDF-API+) DS to Ontology Map Tool DS to KB Update Tool Product Generation (PGT) DB Class Viewer Tool (CVT) HKO Query Tool (HQT) Data Source Query Tool (DSQT) XML Transform Tool (XTT) Portal Ontology Submission Tool Data Sources Oracle Parka

Portal Tools n Class Viewer Tool Java servlet that displays class hierarchies from ontologies ontology obtained from KB Ontology Manager Used by other Horus tools (Manual Markup, DS to Ontology Mapping tool, etc.) n Horus Query Tool Java servlet that presents a query form, dynamically generated from class/properties in an ontology, and displays query results ontology obtained from KB Ontology Manager query sent in XML (KBQL) to KB HKO Manager and DAML results displayed as HTML (via XTT/XSL) n Data Source Query Tool Java servlet that displays product dynamically generated from DB for drilldown product generated by Product Generation Tool and converted to HTML (via XTT/XSL)

Horus Ontologies n Developed in DAML n Authored by Horus Team, with inputs from subject matter experts at Joint Analysis Center (Molesworth, UK) Focus domain is Geopolitical (Balkans) Studied applicable ontologies JAC E-Point Taxonomy, JIVA K-MAPS, IMO general/security metadata, DAML-ized CIA World Factbook Studied domain exemplars – e.g., Eurasian Intelligence Digests n COTS Tools (e.g., XML Spy) used to encode ontologies in DAML n Developed 10 new DAML ontologies for Horus/JAC 278 Classes, 137 ObjectProperties, 117 DatatypeProperties unclassified, For Official Use Only n Details on access for DAML PIs forthcoming…

Horus Ontology Hierarchy n Horus generic ontologies Horus Base Horus Locus Horus Person- Organization Horus Common Horus Installation Military Unit n JAC specific ontologies JAC Upper-Level JAC Geopolitical Issue JAC Geopolitical Influence JAC Geopolitical

Horus-DAML Program Interchange n DAML to Horus DAML Program is source of language, tools, and ontologies n Horus to DAML Horus is source of requirements for real-world systems (e.g., a DAML use case) Horus is a testbed for DAML technology e.g., scalability, usability, etc. Horus is a source of DAML tools too

Horus Tools for DAML n Markup Manual Markup Tool Automatic Markup Tool (Aerotext) n Data Access Tools map schema to DB generate DAML from DB n KB (Parka/Oracle) store/retrieve assertions n Portal Tools servlets to access KB and DBs servlets to navigate ontologies

Potential DAML Tools for Horus (*=have used already) n Parsers have used RDF-API*, SIRPAC* some memory issues with RDF-API (large # of triples with metadata) n Ontology Authoring Tools Authoring - e.g., Protégé, OilEd need ones to support end user (SME) authoring Visualization – e.g., Dumpont*, graphical Validation – e.g., Chimera Need APIs to launch these tools easily from Horus Tools n Markup Tools Authoring – e.g., Teknowledge Powerpoint/Word Visualization – e.g., HyperDAML* Validation – e.g., BBN DAML Validator* need support for streaming Need APIs to launch these tools easily from Horus Tools

Other Horus Needs – KB Technologies n KB Validation find invalid assertions using ontologies and flag to KBA, etc. levels of validation: vs. ontology (e.g., domain/range) to organizational (e.g., authorization) consolidate HKOs/assertions n KB Processing tools that exploit assertions in KB temporal/spatial reasoning, fusion, other kinds of analysis/processing other kinds of inference e.g., support for inverse and transitive properties rules may investigate XSB, etc. n KB Distribution multiple, distributed KBs

Other Horus Needs – Language Issues n Metadata/Tagging e.g., using RDF reification (bags, aboutEach) n URLs across networks (e.g., SIPRNET, JWICS) both for fixed pages (e.g., w3c.org) and ontologies/markup n Enumerated types (e.g., Country Codes) several options DAML enumeration in ontology predefined/preloaded KB instances XSD datatype n Query languages we invented a simple XML one (KBQL) geared towards Horus implementation somewhat n Support for rules

Conclusions n Horus completing second year of development new toolkit approach for Horus-enabling user sites support for DAML language consumer/producer of DAML tools n Horus is a good use case for DAML e.g., centralized KB, toolkit approach real users to be evaluating Horus-enabled portals this Fall need to support much better than demo quality use user-authored ontologies (with some training/support) versioning, etc. document markup navigation, search, and linking through portals n Future Work new tools packaging/distribution of tools over Intelink new user sites n Continued interchange with DAML Program planned