Presentation is loading. Please wait.

Presentation is loading. Please wait.

Galago for Information Retrieval. Galago Java based information retrieval toolkit Download both Binary and Source.

Similar presentations


Presentation on theme: "Galago for Information Retrieval. Galago Java based information retrieval toolkit Download both Binary and Source."— Presentation transcript:

1 Galago for Information Retrieval

2 Galago Java based information retrieval toolkit Download both Binary and Source at:

3 Tasks Document Index Query Parse Evaluation

4 Tasks - Index Hello I love information retrieval so much! Doc-001: hello; i; love; information…… Index with words Doc-001: hello; i; love; informate…… Index with stemmed words Doc-001: html; head; body…… Index with extents galago.bat build D:\test_collection\Wiki\index D:\test_collection\Wiki\wiki-small.corpus

5 How galago index work Index Folder documentLengths documentNames Parts (folder) postings stemmedPostings extents

6 How galago index work postings stemmedPostings extents galago.bat dump-keys galago.bat dump-index

7 Tasks - Search Text Folder: D:\test_collection\Wiki\wiki-small.corpus Index Folder: D:\test_collection\Wiki\index galago.bat search D:\test_collection\Wiki\index D:\test_collection\Wiki\wiki-small.corpus

8 IR experiment Information retrieval tasks + Evaluation (TREC style) Query: 1 test query Retrieved and ranking result: 1 Q0 Zend_Framework_a5ef galago 1 Q0 KULA-LP_fb galago 1 Q0 KKJK_7f galago 1 Q0 WNUZ_d galago 1 Q0 KZEN_8c0c galago Judgements: 1 Q0 KULA-LP_fb Q0 WNUZ_d Q0 KBON_ Q0 Nicky_Wroe_5d Q0 Chemult_(Amtrak_station)_ac76 1 Eval Result: num_ret num_rel 1 5 num_rel_ret 1 3 map ndcg ndcg R-prec

9 IR experiment galago.bat batch-search --index=D:\test_collection\Wiki\index --count=100 D:\test_collection\Wiki\test.query Batch search task, send multiple queries to Galago: Query: 1 test query

10 IR experiment Save your result in a file, e.g. wiki.query.eval Retrieved and ranking result: 1 Q0 Zend_Framework_a5ef galago 1 Q0 KULA-LP_fb galago 1 Q0 KKJK_7f galago 1 Q0 WNUZ_d galago 1 Q0 KZEN_8c0c galago

11 IR experiment You can evaluate your retrieve and ranking performance: Judgements: 1 Q0 KULA-LP_fb Q0 WNUZ_d Q0 KBON_ Q0 Nicky_Wroe_5d Q0 Chemult_(Amtrak_station)_ac76 1 You need a judgment file e.g. wiki.query.judgments galago.bat eval D:\test_collection\Wiki\wiki.query.eval D:\test_collection\Wiki\wiki.query.judgments

12 Advanced, read and update the source code! You can make it better by updating org.galagosearch.core.tools.App.java And ……


Download ppt "Galago for Information Retrieval. Galago Java based information retrieval toolkit Download both Binary and Source."

Similar presentations


Ads by Google