September 23, 2007NSF TANGO BYU/RPI1 TANGO Table Analysis for Generating Ontologies David W. Embley (BYU) & George Nagy (RPI) under NSF Awards and INFORMATION & KNOWLEDGE MANAGEMENT Dr. Maria Zemankova (a) Table Interpretation (b) Query by Table

September 23, 2007NSF TANGO BYU/RPI2 TABLE INTERPRETED TABLE MINI ONTOLOGY GROWING ONTOLOGY Wang Notation & XML Wang Notation Tool Ontology Editor Annotated Semantic Web Pages Standard Ontology Language (OWL) Ontology Based Web Services Form Based Specification Extraction Ontologies Relational Databases Query By Table TANGO STEPS

September 23, 2007NSF TANGO BYU/RPI3 TABLE INTERPRETED TABLE MINI ONTOLOGY GROWING ONTOLOGY Wang Notation & XML Wang Notation Tool Ontology Editor Annotated Semantic Web Pages Standard Ontology Language (OWL) Ontology Based Web Services Form Based Specification Extraction Ontologies Relational Databases Query By Table This presentation

September 23, 2007NSF TANGO BYU/RPI4 (a) Table Interpretation HTML web pages Construct Wang notation Matlab table Extract table Wang Notation XML table Confirm or correct Mini Ontology

September 23, 2007NSF TANGO BYU/RPI5 Median Income table

September 23, 2007NSF TANGO BYU/RPI6 Median Income table displayed from Canada Statistics displayed in TANGO Wang Notation Tool

September 23, 2007NSF TANGO BYU/RPI7 Wang Notation Abstract table is specified by ordered pair (C,  ) - (category, delta) C is a finite set of labeled domains (header, sub headers of tables, etc)  represents each individual value within a table corresponding to C.

September 23, 2007NSF TANGO BYU/RPI8 Categories Two categories in previous table. CATEGORY 1: (Region_Virtual,{(Canada,phi), (Newfoundland and Labrador,phi), (Prince Edward Island,phi), (Nova Scotia,phi), (New Brunswick,phi), (Quebec,phi), (Ontario,phi), (Manitoba,phi), (Saskatchewan,phi),(Alberta,phi),(British Columbia,phi),(Yukon Territory,phi), (Northwest Territories,phi), (Nunavut,phi)}) CATEGORY 2: (Year_Virtual, {(2001,phi), (2002,phi), (2003,phi), (2004,phi), (2005,phi)})

September 23, 2007NSF TANGO BYU/RPI9 Content (leaf) cells Delta Notation for two (of 15) rows: delta({Year_Virtual.2001,Region_Virtual.Canada})=53,500 delta({Year_Virtual.2002,Region_Virtual.Canada})=55,000 delta({Year_Virtual.2003,Region_Virtual.Canada})=56,000 delta({Year_Virtual.2004,Region_Virtual.Canada})=58,100 delta({Year_Virtual.2005,Region_Virtual.Canada})=60,600 delta({Year_Virtual.2001,Region_Virtual.Newfoundland and Labrador})=41,400 delta({Year_Virtual.2002,Region_Virtual.Newfoundland and Labrador})=43,200 delta({Year_Virtual.2003,Region_Virtual.Newfoundland and Labrador})=44,800 delta({Year_Virtual.2004,Region_Virtual.Newfoundland and Labrador})=46,100 delta({Year_Virtual.2005,Region_Virtual.Newfoundland and Labrador})=47,600

September 23, 2007NSF TANGO BYU/RPI10 XML Representation: Schema for (1) table (2) categories (3) data cells (4) augmentation … XML file for this table has ~350 lines of Object Identifier tags

September 23, 2007NSF TANGO BYU/RPI11 Verification tool: category headers for a selected content cell

September 23, 2007NSF TANGO BYU/RPI12 Verification tool: content cells for a selected header

September 23, 2007NSF TANGO BYU/RPI13 Verification tool: hierarchical category structure for a selected content cell

September 23, 2007NSF TANGO BYU/RPI14 (b) Query by Table Income Ontology from many tables Database Income 2002 $ $ $ $3400 QBT Interpret Query Table

September 23, 2007NSF TANGO BYU/RPI15 Query Table Composed in MS-Excel by a person seeking information from an ontology compiled from many web tables

September 23, 2007NSF TANGO BYU/RPI16 Display of automatically processed Query Table for human verification

September 23, 2007NSF TANGO BYU/RPI17 Wang notation for Query Table

September 23, 2007NSF TANGO BYU/RPI18 QBT identifies requested data

September 23, 2007NSF TANGO BYU/RPI19 URLs of tables in the Example Database Median Total Income : Number of Induced Abortions: Number of Divorces: Infant Mortality Rate: Trips By Canadians in Canada: Number of Homicides: Population: Number of Persons with Diabetes: Number of Persons with Asthma: University Degrees Awarded to Males: University Degrees Awarded to Females: Food services and drinking places (13 tables):

September 23, 2007NSF TANGO BYU/RPI20 Fields in the Example Database IDENTIFIER REGION YEAR NUMBER_OF_ABORTIONS ABORTION_RATE NUMBER_OF_DIVORCES INFANT_MORTALITY_RATE NUMBER_OF_TRIPS MEDIAN_TOTAL_INCOME POPULATION NUMBER_OF_HOMICIDES GENDER INCIDENCE_OF_DIABETES UNIVERSITY_DEGREES_AWARDED INCIDENCE_OF_ASTHMA RESTAURANT_OPERATING_REVENUE RESTAURANT_OPERATING_EXPENSES RESTAURANT_OPERATING_PROFIT_MARGIN RESTAURANT_OPERATING_WAGES

September 23, 2007NSF TANGO BYU/RPI21 QBT fills in requested data from Example Database

September 23, 2007NSF TANGO BYU/RPI22 A current puzzle How can QBT tell that these two query tables represent the same request? NB: Although plausible, both of these tables exemplify poor layout. YearRegionGenderDiabetics 2002 Alberta Male XX Female XX Ontario Male XX Female XX Year Region Diabetics MaleFemale 2002 Alberta XX Ontario XX

September 23, 2007NSF TANGO BYU/RPI23 Next steps Complete the conversion of Wang/XML table descriptions to mini ontologies Improve the interface for generating cumulative ontology from mini ontologies Implement database generation from ontology Embed logging routines for statistical evaluation of time/error trade-offs