Presentation is loading. Please wait.

Presentation is loading. Please wait.

Combining Query Translation and Document Translation in Cross- Language Retrieval Aitao Chen & Fredric C. Gey* School of Information Management and Systems.

Published byJamal Elley Modified over 9 years ago

Similar presentations

Presentation on theme: "Combining Query Translation and Document Translation in Cross- Language Retrieval Aitao Chen & Fredric C. Gey* School of Information Management and Systems."— Presentation transcript:

1 Combining Query Translation and Document Translation in Cross- Language Retrieval Aitao Chen & Fredric C. Gey* School of Information Management and Systems *UC Data Archive & Technical Assistance University of California at Berkeley CLEF 2003 Workshop: 21-22 August, 2003, Trondheim, Norway

2 Talk Outline Development of new resources Fast approximate document translation Combining query translation and document translation Conclusions

3 New Resources Finnish and Swedish stoplists Base Finnish and Swedish lexicons for decompounding Statistical translation lexicons derived from parallel texts Finnish and Swedish statistical stemmers automatically generated from parallel texts English spelling normalizer

4 Development of Swedish Stoplist (by someone who doesn’t know Swedish) Look for Swedish words whose English translations are English stopwords in Swedish textbooks (e.g., grammar) written in English. en park (a park) ett piano (a piano) Jag vet inte mycket om honom (I don’t know much about him) efter skolan (after school) Hans och Greta (Hans and Greta) (Source: Swedish: A comprehensive grammar by P. Holmes & I. Hinchliffe)

5 Development of Swedish Base Lexicon A base lexicon should contain all and only the words and their variants that are not compounds. Compile a list of Swedish words (e.g., from the Swedish document collection). Remove the words that are 4 or fewer characters long. Remove the long words that can be decomposed into short words in the initial wordlist. animation animationen dator datoranimation datorgrafik datorteknologi datorvirus grafik teknologi virus dator animation dator grafik dator teknologi dator virus Remove the compounds that are decomposed.

6 Development of Statistical Translation Lexicons from Parallel Texts parallel texts (EU Official Journal) PDF  texts conversion paragraph & sentence alignment statistical MT toolkit statistical association 1.English  Dutch 2.English  Finnish 3.English  Swedish 4.Dutch  English 5.Finnish  English 6.Swedish  English 1.Italian  Spanish 2.German  Italian 3.Finnish  German statistical translation lexicons

7 Development of Statistical Stemmers dator datorn datorer datorersom datornät datornernä diamanten diamanterna diamanter diamant informatik diamond diamonds computer computers diamond computer Swedish words diamanten diamanterna diamanter diamant dator datorn datorer datorersom datornät datornernä informatik “computer” cluster “diamond” cluster statistical English translations dator diamant

8 Fast Approximate Document Translation Spanish documents Spanish-English MT List of Spanish words List of English words Bilingual Spanish-English wordlist English translations 1 2 3 4 Word-by-word

9 Query Translation-based Multilingual Retrieval English French German English docsFrench docsGerman docs merger combined ranked list of documents German French English Query Documents Spanish IR Spanish docs L&H

10 Documentation Translation-based Multilingual Retrieval English unified ranked list of documents German French English Query Documents EnglishSpanish IR

11 Evaluation of Multilingual Retrieval Run IDTrans. methodMerging methodAverage precision bkmul4en1query-transraw score0.3783 bkmul4en2doc-transnone0.4082 bkmul4en3query & doc-transraw score0.4260 Run IDTrans. methodMerging methodAverage precision bkmul8en1query-transraw score0.3317 bkmul8en2doc-transnone0.3401 bkmul8en3query & doc-transraw score0.3733 Multilingual-4: English, TD Multilingual-8: English, TD

12 Query Translation v.s. Document Translation celíacos dietasDiets for Celiacs Las Dietas para Celiacs English words in topic 186 Spanish doc words query translation document translation (word-by-word) Nahrungen für Celiacs diät zöliakie celiacs diets diets coeliac diseases German doc words Average precision: 0.0003 (mul4en1)Average precision: 0.6750 (mul4en2) (Spanish)(German)(English) Dutch Netherlands Hollandais Hollande (French) query translation Néerlandais Pays-Bas Dutch Netherlands French document words (English) English words in topic 161 Average precision: 0.2213 (mul4en1)Average precision: 0.6167 (mul4en2) document translation (word-by-word) 0.0 1.0

13 Manual v.s. Automatic Stemming LanguageNo stemmingManual (Snowball)Automatic (parallel texts) Finnish0.38010.49720.4304 Swedish0.36300.41210.3844 LanguageNo StemmingManual (Muscat)Automatic (L&H MT) French0.39050.45280.4521 Italian0.38010.43240.4322 Spanish0.46870.51660.5285 CLEF 2003 CLEF2001-2002 (topic fields: TD. No decompounding or query expansion) (topic fields: TD. No query expansion)

14 Evaluation of Decompounding, Stemming and Query Expansion in Monolingual Retrieval baseline decomp stemexpan decomp+stem decomp+expanstem+expan decomp+stem+expan.4342.3727.3801.3630.4744.4294.4204.4331.4480.4220.4974.4121.4673.4867.4071.4224.5304 (22.16%).5678 (52.35%).5633 (48.20%).5465 (50.55%).4955.5111.4972.4727.5126.5473.4469.4880.4962.4804.5541.4838 Topics (TD) Dutch German Finnish Swedish

15 Conclusions Fast approximate document-translation worked well. Combining document-translation with query- translation was even better. Decompounding with stemming and query expansion worked well for languages with rich compounds. Statistical stemmers derived from parallel texts were not as effective as manually built stemmers for Finnish and Swedish. But there is still room for improving statistical stemmers.

16 Berkeley Text Retrieval System is available for research purpose. Send request to aitao@sims.berkeley.edu Software

17 THANK YOU

Download ppt "Combining Query Translation and Document Translation in Cross- Language Retrieval Aitao Chen & Fredric C. Gey* School of Information Management and Systems."

Similar presentations

Even More TopX: Relevance Feedback Ralf Schenkel Joint work with Osama Samodi, Martin Theobald.

Even More TopX: Relevance Feedback Ralf Schenkel Joint work with Osama Samodi, Martin Theobald.
Joint Parsing and Alignment with Weakly Synchronized Grammars David Burkett, John Blitzer, & Dan Klein TexPoint fonts used in EMF. Read the TexPoint manual.

Joint Parsing and Alignment with Weakly Synchronized Grammars David Burkett, John Blitzer, & Dan Klein TexPoint fonts used in EMF. Read the TexPoint manual.
Complex queries in the PATENTSCOPE search system Cyberspace September 2013 Sandrine Ammann Marketing & Communications Officer.

Complex queries in the PATENTSCOPE search system Cyberspace September 2013 Sandrine Ammann Marketing & Communications Officer.
Skövde, Jan 19. -2004Information Access: Leif Grönqvist1 Systematic Evaluation of Swedish IR Systems using a Relevance Judged Document Collection Leif.

Skövde, Jan Information Access: Leif Grönqvist1 Systematic Evaluation of Swedish IR Systems using a Relevance Judged Document Collection Leif.
SINAI-GIR A Multilingual Geographical IR System University of Jaén (Spain) José Manuel Perea Ortega CLEF 2008, 18 September, Aarhus (Denmark) Computer.

SINAI-GIR A Multilingual Geographical IR System University of Jaén (Spain) José Manuel Perea Ortega CLEF 2008, 18 September, Aarhus (Denmark) Computer.
Statistical Machine Translation Part II – Word Alignments and EM Alex Fraser Institute for Natural Language Processing University of Stuttgart 2008.07.22.

Statistical Machine Translation Part II – Word Alignments and EM Alex Fraser Institute for Natural Language Processing University of Stuttgart
Sheffield at ImageCLEF 2003 Paul Clough and Mark Sanderson.

Sheffield at ImageCLEF 2003 Paul Clough and Mark Sanderson.
Current and Future Research Directions University of Tehran Database Research Group 1 October 2009 Abolfazl AleAhmad, Ehsan Darrudi, Hadi.

Current and Future Research Directions University of Tehran Database Research Group 1 October 2009 Abolfazl AleAhmad, Ehsan Darrudi, Hadi.
The Challenges of Multilingual Search Paul Clough The Information School University of Sheffield ISKO UK conference 8-9 July 2013.

The Challenges of Multilingual Search Paul Clough The Information School University of Sheffield ISKO UK conference 8-9 July 2013.
Multilingual experiments of CLEF 2003 Eija Airio, Heikki Keskustalo, Turid Hedlund, Ari Pirkola University of Tampere, Finland Department of Information.

Multilingual experiments of CLEF 2003 Eija Airio, Heikki Keskustalo, Turid Hedlund, Ari Pirkola University of Tampere, Finland Department of Information.
7/16/2002JCDL 2002, Ray Larson The “Entry Vocabulary Index” Approach to Multilingual Search Ray R. Larson, Fredric Gey, Aitao Chen, Michael Buckland University.

7/16/2002JCDL 2002, Ray Larson The “Entry Vocabulary Index” Approach to Multilingual Search Ray R. Larson, Fredric Gey, Aitao Chen, Michael Buckland University.
Information Retrieval Concerned with the: Representation of Storage of Organization of, and Access to Information items.

Information Retrieval Concerned with the: Representation of Storage of Organization of, and Access to Information items.
Information Access I Measurement and Evaluation GSLT, Göteborg, October 2003 Barbara Gawronska, Högskolan i Skövde.

Information Access I Measurement and Evaluation GSLT, Göteborg, October 2003 Barbara Gawronska, Högskolan i Skövde.
1 The Web as a Parallel Corpus  Parallel corpora are useful  Training data for statistical MT  Lexical correspondences for cross-lingual IR  Early.

1 The Web as a Parallel Corpus  Parallel corpora are useful  Training data for statistical MT  Lexical correspondences for cross-lingual IR  Early.
LEARNING WORD TRANSLATIONS Does syntactic context fare better than positional context? NCLT/CNGL Internal Workshop Ankit Kumar Srivastava 24 July 2008.

LEARNING WORD TRANSLATIONS Does syntactic context fare better than positional context? NCLT/CNGL Internal Workshop Ankit Kumar Srivastava 24 July 2008.
Cross-Language Retrieval INST 734 Module 11 Doug Oard.

Cross-Language Retrieval INST 734 Module 11 Doug Oard.
 Official Site: facility.org/research/evaluation/clef-ip-10http://www.ir- facility.org/research/evaluation/clef-ip-10.

 Official Site: facility.org/research/evaluation/clef-ip-10http:// facility.org/research/evaluation/clef-ip-10.
Search is not only about the Web An Overview on Printed Documents Search and Patent Search Walid Magdy Centre for Next Generation Localisation School of.

Search is not only about the Web An Overview on Printed Documents Search and Patent Search Walid Magdy Centre for Next Generation Localisation School of.
LREC 2008 1 Combining Multiple Models for Speech Information Retrieval Muath Alzghool and Diana Inkpen University of Ottawa Canada.

LREC Combining Multiple Models for Speech Information Retrieval Muath Alzghool and Diana Inkpen University of Ottawa Canada.
A New Approach for Cross- Language Plagiarism Analysis Rafael Corezola Pereira, Viviane P. Moreira, and Renata Galante Universidade Federal do Rio Grande.

A New Approach for Cross- Language Plagiarism Analysis Rafael Corezola Pereira, Viviane P. Moreira, and Renata Galante Universidade Federal do Rio Grande.

Similar presentations

Ads by Google