Presentation is loading. Please wait.

Presentation is loading. Please wait.

Distributed Query Processing Using Partitioned Inverted Files Claudine Badue April 08, 2003 Workshop SIAM.

Similar presentations


Presentation on theme: "Distributed Query Processing Using Partitioned Inverted Files Claudine Badue April 08, 2003 Workshop SIAM."— Presentation transcript:

1 Distributed Query Processing Using Partitioned Inverted Files Claudine Badue April 08, 2003 Workshop SIAM

2 u LI u LGI xxx xxxx xxxx xxxx xxxx xxxx xxx xxxx P4P4 P1P1 P2P2 P3P Documents TermsTerms A D C H G O N Z... Local Index (LI) and Lexicographical Global Index (LGI) xxx xxxx xxxx xxxx xxxx xxxx xxx xxxx Documents P4P4 P1P1 P2P2 P3P3 TermsTerms A D C H G O N Z...

3 Random Global Index (RGI) TermsTerms P4P4 P1P1 P2P2 P3P Documents xxxA xxxxD xxxxC xxxxH xxxxG xxxx O xxxN xxxxZ...

4 Network of Workstations Model Disk 1Disk 2 Disk 3Disk p Network Switch Memory p Processor p Memory 3 Processor 3 Memory 2Memory 1 Processor 2Processor 1...

5 Client-Server Paradigm Client 1... Ranking Server... I/O Server Client 2Client 3Client cProc 1Proc rProc 1Proc 2Proc d

6 Query Processing (LI) a, b, c d 1, d 3, d 7, d 5, d 8, d 2 Processor 1Processor 2Processor 3Processor 4 d 1, d 2 d3d3 d 7, d 8 d5d5 a, b, c Ranking Server

7 Query Processing (LGI) Processor 1Processor 2Processor 3Processor 4 Ranking Server d 5, d 1, d 3 d 1, d 2, d 8, d3d 2, d 5, d 6 a b, cd, f a aaa, d, f d 5, d 1, d 3 d 8, d 2, d 1, d 3 aa aa, b, c aaa d 8, d 2

8 Query Processing (RGI) Processor 1Processor 2Processor 3Processor 4 Ranking Server a b, c d, f a aaa, d, f d 5, d 1, d 3 d 8, d 1, d 3, d 2 aa aa, b, c aaa d 2, d 5, d 6 d 1, d 2, d 8, d3 d 8, d 2 d 5, d 1, d 3 d2d2 d 2, d 5, d 6

9 Comparison of strategies

10 Issues to Explore u Identify and explore the tradeoffs of the distinct index layouts on disk u Identify the most cost effective layouts u Evaluate how the architecture of the system impact the final searching costs


Download ppt "Distributed Query Processing Using Partitioned Inverted Files Claudine Badue April 08, 2003 Workshop SIAM."

Similar presentations


Ads by Google