Presentation is loading. Please wait.

Presentation is loading. Please wait.

Toward Tomorrow’s Semantic Web An Approach Based on Information Extraction Ontologies David W. Embley Brigham Young University Funded in part by the National.

Similar presentations


Presentation on theme: "Toward Tomorrow’s Semantic Web An Approach Based on Information Extraction Ontologies David W. Embley Brigham Young University Funded in part by the National."— Presentation transcript:

1

2 Toward Tomorrow’s Semantic Web An Approach Based on Information Extraction Ontologies David W. Embley Brigham Young University Funded in part by the National Science Foundation

3 Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

4 Grand Challenge Semantic Understanding Can we quantify & specify the nature of this grand challenge?

5 Grand Challenge Semantic Understanding “If ever there were a technology that could generate trillions of dollars in savings worldwide …, it would be the technology that makes business information systems interoperable.” (Jeffrey T. Pollock, VP of Technology Strategy, Modulant Solutions)

6 Grand Challenge Semantic Understanding “The Semantic Web: … content that is meaningful to computers [and that] will unleash a revolution of new possibilities … Properly designed, the Semantic Web can assist the evolution of human knowledge …” (Tim Berners-Lee, …, Weaving the Web)

7 Grand Challenge Semantic Understanding “20 th Century: Data Processing “21 st Century: Data Exchange “The issue now is mutual understanding.” (Stefano Spaccapietra, Editor in Chief, Journal on Data Semantics)

8 Grand Challenge Semantic Understanding “The Grand Challenge [of semantic understanding] has become mission critical. Current solutions … won’t scale. Businesses need economic growth dependent on the web working and scaling (cost: $1 trillion/year).” (Michael Brodie, Chief Scientist, Verizon Communications)

9 What is Semantic Understanding? Understanding: “To grasp or comprehend [what’s] intended or expressed.’’ Semantics: “The meaning or the interpretation of a word, sentence, or other language form.” - Dictionary.com

10 Can We Achieve Semantic Understanding? “A computer doesn’t truly ‘understand’ anything.” But computers can manipulate terms “in ways that are useful and meaningful to the human user.” - Tim Berners-Lee Key Point: it only has to be good enough. And that’s our challenge and our opportunity! …

11 Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

12 Information Value Chain Meaning Knowledge Information Data Translating data into meaning

13 Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

14 Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement (ontology)  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

15 Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement (ontology)  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

16 Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement (ontology)  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

17 Data  Attribute-Value Pairs Fundamental for information Thus, fundamental for knowledge & meaning

18 Data  Attribute-Value Pairs Fundamental for information Thus, fundamental for knowledge & meaning  Data Frame Extensive knowledge about a data item ̶ Everyday data: currency, dates, time, weights & measures ̶ Textual appearance, units, context, operators, I/O conversion Abstract data type with an extended framework

19 Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

20 ? Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

21 ? Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

22 ? Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

23 ? Olympus C-750 Ultra Zoom Sensor Resolution4.2 megapixels Optical Zoom10 x Digital Zoom4 x Installed Memory16 MB Lens ApertureF/8-2.8/3.7 Focal Length min6.3 mm Focal Length max63.0 mm

24 Digital Camera Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

25 ? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916) 972-9117

26 ? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916) 972-9117

27 ? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916) 972-9117

28 ? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916) 972-9117

29 Car Advertisement Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916) 972-9117

30 ? Flight # Class From Time/Date To Time/Date Stops Delta 16 Coach JFK 6:05 pm CDG 7:35 am 0 02 01 04 03 01 04 Delta 119 Coach CDG 10:20 am JFK 1:00 pm 0 09 01 04 09 01 04

31 ? Flight # Class From Time/Date To Time/Date Stops Delta 16 Coach JFK 6:05 pm CDG 7:35 am 0 02 01 04 03 01 04 Delta 119 Coach CDG 10:20 am JFK 1:00 pm 0 09 01 04 09 01 04

32 Airline Itinerary Flight # Class From Time/Date To Time/Date Stops Delta 16 Coach JFK 6:05 pm CDG 7:35 am 0 02 01 04 03 01 04 Delta 119 Coach CDG 10:20 am JFK 1:00 pm 0 09 01 04 09 01 04

33 ? Monday, October 13, 2003 Group AWLTGFGAPts. USA300 11 1 9 Sweden210 5 3 6 North Korea120 3 4 3 Nigeria030 0 11 0 Group BWLTGFGAPts. Brazil201 8 2 7 …

34 ? Monday, October 13, 2003 Group AWLTGFGAPts. USA300 11 1 9 Sweden210 5 3 6 North Korea120 3 4 3 Nigeria030 0 11 0 Group BWLTGFGAPts. Brazil201 8 2 7 …

35 World Cup Soccer Monday, October 13, 2003 Group AWLTGFGAPts. USA300 11 1 9 Sweden210 5 3 6 North Korea120 3 4 3 Nigeria030 0 11 0 Group BWLTGFGAPts. Brazil201 8 2 7 …

36 ? Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

37 ? Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

38 ? Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

39 Treadmill Workout Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

40 ? PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,000 feet USGS QuadMirror Lake Latitude40.711ºN Longitude110.876ºW

41 ? PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,000 feet USGS QuadMirror Lake Latitude40.711ºN Longitude110.876ºW

42 ? PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,000 feet USGS QuadMirror Lake Latitude40.711ºN Longitude110.876ºW

43 Maps PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,100 feet USGS QuadMirror Lake Latitude40.711ºN Longitude110.876ºW

44 Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

45 Information Extraction Ontologies SourceTarget Information Extraction Information Exchange

46 What is an Extraction Ontology?  Augmented Conceptual-Model Instance Object & relationship sets Constraints Data frame value recognizers  Robust Wrapper (Ontology-Based Wrapper) Extracts information Works even when site changes or when new sites come on-line

47 CarAds Extraction Ontology [1-9]\d{0,2}[kK] … [1-9]\d{0,2}[kK] …

48 Extraction Ontologies: An Example of Semantic Understanding  “Intelligent” Symbol Manipulation  Gives the “Illusion of Understanding”  Obtains Meaningful and Useful Results

49 Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

50 A Variety of Applications  Information Extraction  Semantic Web Page Annotation  Free-Form Semantic Web Queries  Task Ontologies for Free-Form Service Requests  High-Precision Classification  Schema Mapping for Ontology Alignment  Record Linkage  Accessing the Hidden Web  Ontology Discovery and Generation  Challenging Applications (e.g. BioInformatics)

51 Application #1 Information Extraction

52 '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, 566-3800 or 566-3888 Constant/Keyword Recognition Descriptor/String/Position(start/end) Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr|566-3800|136|143 PhoneNr|566-3888|148|155

53 Heuristics  Keyword proximity  Subsumed and overlapping constants  Functional relationships  Nonfunctional relationships  First occurrence without constraint violation

54 Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr|566-3800|136|143 PhoneNr|566-3888|148|155 Keyword Proximity   '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, 566-3800 or 566-3888

55 Subsumed/Overlapping Constants '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, 566-3800 or 566-3888 Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr|566-3800|136|143 PhoneNr|566-3888|148|155

56 Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr|566-3800|136|143 PhoneNr|566-3888|148|155 Functional Relationships '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, 566-3800 or 566-3888

57 Nonfunctional Relationships '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, 566-3800 or 566-3888 Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr|566-3800|136|143 PhoneNr|566-3888|148|155

58 First Occurrence without Constraint Violation '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, 566-3800 or 566-3888 Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr|566-3800|136|143 PhoneNr|566-3888|148|155

59 Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr|566-3800|136|143 PhoneNr|566-3888|148|155 Database-Instance Generator insert into Car values(1001, “97”, “CHEVY”, “Cavalier”, “7,000”, “11,995”, “556-3800”) insert into CarFeature values(1001, “Red”) insert into CarFeature values(1001, “5 spd”)

60 Application #2 Semantic Web Page Annotation

61 Annotated Web Page (Demo)

62 OWL CarAds...... 0 1 …… …… Mileage …… …… 2 …… 237 241 ……. ……

63 Application #3 Free-Form Semantic Web Queries

64 Find Ontology “Tell me about cruises on San Francisco Bay. I’d like to know scheduled times, cost, and the duration of cruises on Friday of next week.”

65 Formulate Query Friday, Oct. 29thcost duration Selection Constants San Francisco Bay scheduled times Projection = Result   () Join Path

66 StartTimePriceDurationSource 10:45 am, 12:00 pm, 1:15, 2:30, 4:00$20.00, $16.00, $12.00 1 10:00 am, 10:45 am, 11:15 am, 12:00 pm, 12:30 pm, 1:15 pm, 1:45 pm, 2:30 pm, 3:00 pm, 3:45 pm, 4:15 pm, 5:00 pm $17.00, $16.00, $12.00 1 Hour2

67 Application #4 Task Ontologies for Free-Form Service Requests

68 Basic Idea  Service Request  Match with Task Ontology Domain Ontology Process Ontology  Complete, Negotiate, Finalize I want to see a dermatologist next week; any day would be ok for me, at 4:00 p.m. The dermatologist must be within 20 miles from my home and must accept my insurance.

69 Domain Ontology

70 Appointment … context keywords/phrase: “appointment |want to see a |…” Dermatologist … context keywords/phrases: “([D|d]ermatologist) | …” I want to see a dermatologist next week; any day would be ok for me, at 4:00 p.m. The dermatologist must be within 20 miles from my home and must accept my insurance.

71 Appointment … context keywords/phrase: “appointment |want to see a |…” Dermatologist … context keywords/phrases: “([D|d]ermatologist) | …” I want to see a dermatologist next week; any day would be ok for me, at 4:00 p.m. The dermatologist must be within 20 miles from my home and must accept my insurance.

72 Appointment … context keywords/phrase: “appointment |want to see a |…” Dermatologist … context keywords/phrases: “([D|d]ermatologist) | …” I want to see a dermatologist next week; any day would be ok for me, at 4:00 p.m. The dermatologist must be within 20 miles from my home and must accept my insurance.

73 Appointment … context keywords/phrase: “appointment |want to see a |…” Dermatologist … context keywords/phrases: “([D|d]ermatologist) | …” I want to see a dermatologist next week; any day would be ok for me, at 4:00 p.m. The dermatologist must be within 20 miles from my home and must accept my insurance.

74 Appointment … context keywords/phrase: “appointment |want to see a |…” Dermatologist … context keywords/phrases: “([D|d]ermatologist) | …” I want to see a dermatologist next week; any day would be ok for me, at 4:00 p.m. The dermatologist must be within 20 miles from my home and must accept my insurance. Date … NextWeek(d1: Date, d2: Date) returns (Boolean{T,F}) context keywords/phrases: next week | week from now | … Distance internal representation : real; input (s: String) context keywords/phrases: miles | mile | mi | kilometers | kilometer | meters | meter | centimeter | … Within(d1: Distance, “20”) returns (Boolean {T or F}) context keywords/phrases: within | not more than |  | … return (d1  d2) … end;

75

76

77 Process Ontology

78 Specification Satisfaction Date(“28 Dec 04”) and NextWeek(“28 Dec 04”, “5 Jan 05”) Dermatologist(Dermatologist0) is at Address(“Orem 600 State St.”) and Within(DistanceBetween(“Provo 300 State St.”, “Orem 600 State St.”), “22”)  i 2 (Dermatologist(Dermatologist0) accepts Insurance(i 2 ) and Equal(“IHC”, i 2 ))

79 Application #5 High-Precision Classification

80 An Extraction Ontology Solution

81 Document 1: Car Ads Document 2: Items for Sale or Rent Density Heuristic

82 Document 1: Car Ads Year: 3 Make: 2 Model: 3 Mileage: 1 Price: 1 Feature: 15 PhoneNr: 3 Expected Values Heuristic Document 2: Items for Sale or Rent Year: 1 Make: 0 Model: 0 Mileage: 1 Price: 0 Feature: 0 PhoneNr: 4

83 Vector Space of Expected Values OV______ D1D2 Year 0.98 16 6 Make 0.93 10 0 Model 0.91 12 0 Mileage 0.45 6 2 Price 0.80 11 8 Feature 2.10 29 0 PhoneNr 1.15 1511 D1: 0.996 D2: 0.567 ov D1 D2

84 Grouping Heuristic Year Make Model Price Year Model Year Make Model Mileage … Document 1: Car Ads { { { Year Mileage … Mileage Year Price … Document 2: Items for Sale or Rent { {

85 Grouping Car Ads ---------------- Year Make Model -------------- 3 Price Year Model Year ---------------3 Make Model Mileage Year ---------------4 Model Mileage Price Year ---------------4 … Grouping: 0.875 Sale Items ---------------- Year Mileage -------------- 2 Mileage Year Price ---------------3 Year Price Year ---------------2 Price ---------------1 … Grouping: 0.500 Expected Number in Group = floor(∑ Ave ) = 4 (for our example) Sum of Distinct 1-Max Object Sets in each Group Number of Groups * Expected Number in a Group 1-Max 3+3+4+4 4*4 = 0.875 2+3+2+1 4*4 = 0.500

86 Application #6 Schema Mapping for Ontology Alignment

87 Problem: Different Schemas Target Database Schema {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} Different Source Table Schemas {Run #, Yr, Make, Model, Tran, Color, Dr} {Make, Model, Year, Colour, Price, Auto, Air Cond., AM/FM, CD} {Vehicle, Distance, Price, Mileage} {Year, Make, Model, Trim, Invoice/Retail, Engine, Fuel Economy}

88 Solution: Remove Internal Factoring Discover Nesting: Make, (Model, (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)*)* Unnest: μ (Model, Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table Legend ACURA

89 Solution: Replace Boolean Values Legend ACURA β CD Table Yes, CD Yes, β Auto β Air Cond β AM/FM Yes, AM/FM Air Cond. Auto

90 Solution: Form Attribute-Value Pairs Legend ACURA CD AM/FM Air Cond. Auto,,,,,,,,

91 Solution: Adjust Attribute-Value Pairs Legend ACURA CD AM/FM Air Cond. Auto,,,,,,,

92 Solution: Do Extraction Legend ACURA CD AM/FM Air Cond. Auto

93 Solution: Infer Mappings Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} Each row is a car. π Model μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table π Make μ (Model, Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table π Year Table Note: Mappings produce sets for attributes. Joining to form records is trivial because we have OIDs for table rows (e.g. for each Car).

94 Solution: Infer Mappings Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} π Model μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table

95 Solution: Do Extraction Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} π Price Table

96 Solution: Do Extraction Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} Yes, ρ Colour←Feature π Colour Table U ρ Auto ← Feature π Auto β Auto Table U ρ Air Cond. ← Feature π Air Cond. β Air Cond. Table U ρ AM/FM ← Feature π AM/FM β AM/FM Table U ρ CD ← Feature π CD β CD Table Yes,

97 Application #7 Record Linkage

98 “Kelly Flanagan” Query

99  Gather evidence from each of several different facets Attributes Links Page Similarity  Combine the evidence A Multi-faceted Approach

100  Phone number, email address, state, city, zip code  Data-frame recognizers Attributes

101 Links

102 “adjacent cap-word pairs”: Cap-Word (Connector | Preposition (Article)? | (Capital-LetterDot))? Cap-Word. Page Similarity

103 C1C1 C 2 …..C i …..C j …CnCn C1C1 1C 12 C 1i C 1j C 1n C2C2 1C 2i C 2j C 2n :: : : CiCi 1C ij C in : : : CjCj 1C jn : : CnCn 1 P(C i and C j refer to a same person | evidence for a facet f ) 0 if no evidence for a facet f C ij = Training set to compute the conditional probabilities Confidence Matrix for Each Facet

104 0.96 + 0 + 0.78 - 0.96 * 0 - 0.96 * 0.78 - 0.78 * 0 + 0.96 * 0 * 0.78 = 0.9912 Confidence Matrix for AttributesConfidence Matrix for LinksConfidence Matrix for Page Similarity Final Matrix

105  Input: final confidence matrix  Output: citations grouped by same person  The idea: {C i, C j } and {C j, C k } then {C i, C j, C k } The threshold we use for “highly confident” is 0.8. Grouping Algorithm

106 Experimental Results

107 Application #8 Accessing the Hidden Web

108 Obtaining Data Behind Forms Web information is stored in databases Databases are accessed through forms Forms are designed in various ways

109 Hidden Web Extraction System Input Analyzer Retrieved Page(s) User Query Site Form Output Analyzer Extracted Information Application Extraction Ontology “Find green cars costing no more than $9000.”

110 Application #9 Ontology Discovery & Generation

111 TANGO: Table Analysis for Generating Ontologies  Recognize and normalize table information  Construct mini-ontologies from tables  Discover inter-ontology mappings  Merge mini-ontologies into a growing ontology

112 Recognize Table Information Religion Population Albanian Roman Shi’a Sunni Country (July 2001 est.) Orthodox Muslim Catholic Muslim Muslim other Afganistan 26,813,057 15% 84% 1% Albania 3,510,484 20% 70% 30%

113 Construct Mini-Ontology Religion Population Albanian Roman Shi’a Sunni Country (July 2001 est.) Orthodox Muslim Catholic Muslim Muslim other Afganistan 26,813,057 15% 84% 1% Albania 3,510,484 20% 70% 30%

114 Discover Mappings

115 Merge

116 Application #10 Challenging Applications (e.g. BioInformatics)

117 Large Extraction Ontologies

118 Complex Semi-Structured Pages

119 Additional Analysis Opportunities  Sibling Page Comparison  Semi-automatic Lexicon Update  Seed Ontology Recognition

120 Sibling Page Comparison

121 Attributes

122 Sibling Page Comparison

123

124 Semi-automatic Lexicon Update Additional Protein Names Additional Source Species or Organisms

125 nucleu s; zinc ion binding; nucleic acid binding; zinc ion binding; nucleic acid binding; linear; NP_079345; 9606; Eukaryota; Metazoa; Chorata; Craniata; Vertebrata; Euteleostomi; Mammalia; Eutheria; Primates; Catarrhini; Hominidae; Homo; NP_079345; Homo sapiens; human; GTTTTTGTGTT……….ATAAGTGCATTAAC GGCCCACATG; FLJ14299 msdspagsnprtpessgs gsgg………tagpyyspy alygqrlasasalgyq; hypothetical protein FLJ14299; 8; eight; “8:?p\s?12”; “8:?p11.2”; “8:?p11.23”; : “37,?612,?680”; “37,?610,?585”; Seed Ontology Recognition

126

127 Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

128 Limitations and Pragmatics  Data-Rich, Narrow Domain  Ambiguities ~ Context Assumptions  Incompleteness ~ Implicit Information  Common Sense Requirements  Knowledge Prerequisites  …

129 Busiest Airport in 2003? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.)

130 Busiest Airport in 2003? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.)

131 Busiest Airport in 2003? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.)

132 Busiest Airport in 2003? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.) Ambiguous Whom do we trust? (How do they count?)

133 Busiest Airport in 2003? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.) Important qualification

134 Dow Jones Industrial Average High Low Last Chg 30 Indus 10527.03 10321.35 10409.85 +85.18 20 Transp 3038.15 2998.60 3008.16 +9.83 15 Utils 268.78 264.72 266.45 +1.72 66 Stocks 3022.31 2972.94 2993.12 +19.65 44.07 10,409.85 Graphics, Icons, …

135 Dow Jones Industrial Average High Low Last Chg 30 Indus 10527.03 10321.35 10409.85 +85.18 20 Transp 3038.15 2998.60 3008.16 +9.83 15 Utils 268.78 264.72 266.45 +1.72 66 Stocks 3022.31 2972.94 2993.12 +19.65 44.07 10,409.85 Reported on same date Weekly Daily Implicit information: weekly stated in upper corner of page; daily not stated.

136 Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

137 Some Key Ideas  Data, Information, and Knowledge  Data Frames Knowledge about everyday data items Recognizers for data in context  Ontologies Resilient Extraction Ontologies Shared Conceptualizations  Limitations and Pragmatics

138 Some Research Issues  Building a library of open source data recognizers  Precisely finding and gathering relevant information Subparts of larger data Scattered data (linked, factored, implied) Data behind forms in the hidden web  Improving concept matching Indirect matching Calculations, unit conversions, alternative representations, …  …

139 Some Research Challenges  Web Page Understanding Suppose extraction is ~85% accurate Generate a page grammar ̶ Increased recall (more extracted) ̶ Increased precision (fewer false positives) ̶ Fast extraction from same-site sibling pages  Universal Rules for Schema Matching Must rules be domain-specific? Can some rules be “universal”?  Boundaries of Usefulness: When should machine learning not be used?  Application to Significant Problems Like those above Many more … www.deg.byu.edu (Machine Learning)


Download ppt "Toward Tomorrow’s Semantic Web An Approach Based on Information Extraction Ontologies David W. Embley Brigham Young University Funded in part by the National."

Similar presentations


Ads by Google