Download presentation

Presentation is loading. Please wait.

Published byJavon Wanless Modified over 3 years ago

1
Proximity Searching in High Dimensional Spaces with a Proximity Preserving Order Edgar Chávez Karina Figueroa Gonzalo Navarro UNIVERSIDAD MICHOACANA, MEXICO UNIVERSIDAD DE CHILE, CHILE

2
Content 1.About the problem 2.Basic concepts 3.Previous work 4.Our technique 5.Experiments 6.Conclusion and future wok

3
Proximity Searching Huge Database Exact searching is not possible Expensive distance

4
Applications Retrieval Information Classification People finder through the web Clustering Currently used on –Classification of Spider’s web –Face recognition on Chilean’s Web

5
Problems (metric spaces) Index Extraction of characteristics Complex objects High dimension Memory limited Huge databases

6
Terminology Queries –Range query –K nearest neighbor Properties Symmetry Strict possitiveness Triangle inequality

7
Previous work Pivot based Partition based Pivot distance q

8
Previous work Pivot based Partition based centro q

9
Our technique Permutation Permutant p3 p2 p5 P4 P6 u P1

10
Our technique Exact matching elements have the same permutation Similar elements must have a similar permutation (we guess) Spearman footrule metric –Measures the similarity of the permutations –Promissority elements first

11
Spearman Footrule metric Example 3-1, 6 - 2, 3-2, 4-1, 5-5, 6-4 Difference of positions

12
Searching process (1a. part) Preprocessing time Permutant p1 p2 p3 p3,p1,p2 p3,p2,p1 p2,p1,p3 p2,p3,p1

13
Searching process (2a. part) Query time Permutant p1 p2 p3 p3,p1,p2 p3,p2,p1 p2,p1,p3 p2,p3,p1 q p2,p1,p3 Sorting elements by Spearman Footrule metric p2,p1,p3 p2,p3,p1 ….. p3,p1,p2

14
Experiments 93% retrieved, comparing 10% of database 90% retrieved, comparing 60% of database Pivot based algorithm Retrieved 48% %retrieved

15
Experiments 100% retrieved, comparing 15% of database 100% retrieved, comparing 90% of database %retrieved

16
How good is our prediction? retrieved Dimension 256, using 256 pivots Percentage of the database compared Metric algorithms are using one of them

17
Similarities between permutations Almost the same value

18
Conclusion A new probabilistic algorithm for proximity searching in metric space. Our technique is based on permutations. Close elements will have similar permutations. This technique is the fastest known algorithm for high dimension. Permutations are good predictor

19
Future Work Can Non-metric spaces be tackled with this technique? Approximated all K Nearest neighbor algorithm. Improving other metric indexes.

20
Thank you UNIVERSIDAD MICHOACANA, MEXICO UNIVERSIDAD DE CHILE, CHILE Kfiguero@dcc.uchile.cl

Similar presentations

OK

Information retrieval Finding relevant data using irrelevant keys Example: database of photographic images sorted by number, date. DBMS: Well structured.

Information retrieval Finding relevant data using irrelevant keys Example: database of photographic images sorted by number, date. DBMS: Well structured.

© 2018 SlidePlayer.com Inc.

All rights reserved.

To make this website work, we log user data and share it with processors. To use this website, you must agree to our Privacy Policy, including cookie policy.

Ads by Google