Presentation is loading. Please wait.

Presentation is loading. Please wait.

An Adaptive Machine Learning Framework with User Interaction for Ontology Matching Hoai-Viet To 1, Ryutaro Ichise 2, and Hoai-Bac Le 1 1 Ho Chi Minh University.

Similar presentations


Presentation on theme: "An Adaptive Machine Learning Framework with User Interaction for Ontology Matching Hoai-Viet To 1, Ryutaro Ichise 2, and Hoai-Bac Le 1 1 Ho Chi Minh University."— Presentation transcript:

1 An Adaptive Machine Learning Framework with User Interaction for Ontology Matching Hoai-Viet To 1, Ryutaro Ichise 2, and Hoai-Bac Le 1 1 Ho Chi Minh University of Science, Vietnam 2 National Institute of Informatics, Japan 1/29/20141

2 Ontology Matching (OM) Problem Ontology is a hierarchical structure used to organize concepts. Ontology plays an important role in semantic web development. Ontology matching finds correspondences between concepts from two ontologies. Ontology matching is an important process when we want to integrate heterogeneous information source in new semantic web environment. 1/29/20142

3 Machine Learning Framework for OM We introduced a machine learning framework for ontology matching problem in [Ichise, 2008] Our hypothesis: the use of semi-supervised learning method will reduce the manual annotation cost. 1/29/20143 C a1 C a2 C a3 C b1 C b2 C b3 Pre-alignment Correct mapping: C a1 C b1 C a2 C b1 … Incorrect mapping C a1 C b2 C a1 C b3… IDSim 1 …Sim n Class C a1 C b1 0.5…0.7 1 C a1 C b2 0.3 … ……………

4 Semi-supervised Learning with User Interaction Basic idea: propagate label through unlabeled data Problem: few samples of labeled data low confidence prediction. ? 1/29/20144 User Interaction ? Blue Red

5 Adaptive Machine Learning Framework Use multiple learning strategies + user interaction Ontology Storage Ontology Parser Similarity Calculator Ontology Parser Similarity Calculator LEARNER Pre-alignment training 1/29/20145 LEARNER training Initialize labeling User Interaction labeling

6 Similarity measures are based on those used in machine learning framework proposed in [Ichise, 2008], which: include 24 string-based similarity measures calculate similarity between: concept feature, concept structure feature, and concept hierarchical feature. Our system: Machine Learning Framework for Ontology Matching with User Interaction (MalfomUI) 1/29/20146 Adaptive Machine Learning Framework

7 Experiments Purpose: Compare the performance of our learning framework with other matching systems. General setting: Dataset from directory track of OAEI 2008s campaign. [Caracciolo et. al., 2008] The dataset is constructed from three internet directories: Yahoo, Google, Looksmart. Simple equivalent relation. The dataset includes 4487 labeled matching tasks, in which there are 2160 positive samples and 2327 negative samples. Base learner: Naïve Bayes 1/29/20147

8 Experiments Pre-Experiment – Supervised Learning method: Used as baseline to compare with semi-supervised learning method. Study the effect of training-set size on the performance of the supervised learning method. 1/29/20148

9 Experimental Results MalUI-5 to MalUI-4000: 1/29/20149 Training set size

10 Experiments Experiment – Semi-supervised learning with user interaction Study the performance of semi-supervised learning method with user interaction. User annotate 20 samples at initialize phase and then label 4 samples more in 2 feedback round. 1/29/201410

11 Experimental Results MalUI-RF: Comparison with other matching systems [Caracciolo et. al., 2008] 1/29/201411

12 Semi-supervised learning with user feedback can reduce the cost of manual annotation. * In MalfomUI-RF experiment, users need to label 28 samples in total. 1/29/ MalUI -30 MalUI -100 MalUI MalUI MalUI –RF Precision Recall F-Measure Experimental Results

13 Conclusion Conclusions: Our adaptive machine learning framework is effective: it requires less annotation cost but gains approximately good performance. Machine learning approaches with user interaction are promising for ontology matching systems. Future works: Integrate more similarity measures to cover real datasets. Consider more complicate semi-supervised models. 1/29/201413


Download ppt "An Adaptive Machine Learning Framework with User Interaction for Ontology Matching Hoai-Viet To 1, Ryutaro Ichise 2, and Hoai-Bac Le 1 1 Ho Chi Minh University."

Similar presentations


Ads by Google