CLEF 2008 Workshop September 17-19, 2008 Aarhus, Denmark.

Slides:

Advertisements

Similar presentations

SINAI-GIR A Multilingual Geographical IR System University of Jaén (Spain) José Manuel Perea Ortega CLEF 2008, 18 September, Aarhus (Denmark) Computer.

Advertisements

The XLDB Group at GeoCLEF 2005 Nuno Cardoso, Bruno Martins, Marcirio Chaves, Leonardo Andrade, Mário J. Silva XLDB Group - Department of Informatics Faculdade.

Thomas Mandl: Robust CLEF Overview 1 Cross-Language Evaluation Forum (CLEF) Thomas Mandl Information Science Universität Hildesheim

Disambiguating Queries for Geographic Information Retrieval Carolyn Hafernik Thesis Proposal May 10, 2006 Computer Science Advisor: Lisa Ballesteros.

The XLDB Group at GeoCLEF 2005 Nuno Cardoso, Bruno Martins, Marcírio Chaves, Leonardo Andrade, Mário J. Silva

Passage Retrieval & Re-ranking Ling573 NLP Systems and Applications May 5, 2011.

Measuring Monolinguality Chris Biemann NLP Department, University of Leipzig LREC-06 Workshop on Quality Assurance and Quality Measurement for Language.

3rd Answer Validation Exercise ( AVE 2008) QA subtrack at Cross-Language Evaluation Forum 2008 UNED Anselmo Peñas Álvaro Rodrigo Felisa Verdejo Thanks.

Ontology-Based Free-Form Query Processing for the Semantic Web Mark Vickers Brigham Young University MS Thesis Defense Supported by:

Automatic Acquisition of Lexical Classes and Extraction Patterns for Information Extraction Kiyoshi Sudo Ph.D. Research Proposal New York University Committee:

Toward Semantic Web Information Extraction B. Popov, A. Kiryakov, D. Manov, A. Kirilov, D. Ognyanoff, M. Goranov Presenter: Yihong Ding.

 Ad-hoc - This track tests mono- and cross- language text retrieval. Tasks in 2009 will test both CL and IR aspects.

AQUAINT Kickoff Meeting – December 2001 Integrating Robust Semantics, Event Detection, Information Fusion, and Summarization for Multimedia Question Answering.

LREC Combining Multiple Models for Speech Information Retrieval Muath Alzghool and Diana Inkpen University of Ottawa Canada.

Answer Validation Exercise - AVE QA subtrack at Cross-Language Evaluation Forum 2007 UNED (coord.) Anselmo Peñas Álvaro Rodrigo Valentín Sama Felisa Verdejo.

Evaluating the Contribution of EuroWordNet and Word Sense Disambiguation to Cross-Language Information Retrieval Paul Clough 1 and Mark Stevenson 2 Department.

CLEF – Cross Language Evaluation Forum Question Answering at CLEF 2003 ( Bridging Languages for Question Answering: DIOGENE at CLEF-2003.

CLEF Ǻrhus Robust – Word Sense Disambiguation exercise UBC: Eneko Agirre, Oier Lopez de Lacalle, Arantxa Otegi, German Rigau UVA & Irion: Piek Vossen.

TREC 2009 Review Lanbo Zhang. 7 tracks Web track Relevance Feedback track (RF) Entity track Blog track Legal track Million Query track (MQ) Chemical IR.

“How much context do you need?” An experiment about context size in Interactive Cross-language Question Answering B. Navarro, L. Moreno-Monteagudo, E.

1 The Domain-Specific Track at CLEF 2008 Vivien Petras & Stefan Baerisch GESIS Social Science Information Centre, Bonn, Germany Aarhus, Denmark, September.

Combining Lexical Semantic Resources with Question & Answer Archives for Translation-Based Answer Finding Delphine Bernhard and Iryna Gurevvch Ubiquitous.

D L T French Question Answering in Technical and Open Domains Aoife O’Gorman Documents and Linguistic Technology Group Univeristy of Limerick.

1 Cross-Lingual Query Suggestion Using Query Logs of Different Languages SIGIR 07.

MMRetrieval.net A Multimodal Search Engine. Multimodal Information  Single language text-only retrieval reach a limit.  Content-based Image Retrieval.

CLEF 2004 – Interactive Xling Bookmarking, thesaurus, and cooperation in bilingual Q & A Jussi Karlgren – Preben Hansen –

1 Named Entity Recognition based on three different machine learning techniques Zornitsa Kozareva JRC Workshop September 27, 2005.

“ SINAI at CLEF 2005 : The evolution of the CLEF2003 system.” Fernando Martínez-Santiago Miguel Ángel García-Cumbreras University of Jaén.

CLEF 2006 Poster Boaster Session Cross-Language Evaluation Forum CLEF Workshop 2006.

Applying the KISS Principle with Prior-Art Patent Search Walid Magdy Gareth Jones Dublin City University CLEF-IP, 22 Sep 2010.

The CLEF 2003 cross language image retrieval task Paul Clough and Mark Sanderson University of Sheffield

MIRACLE Multilingual Information RetrievAl for the CLEF campaign DAEDALUS – Data, Decisions and Language, S.A. Universidad Carlos III de.

Interactive Probabilistic Search for GikiCLEF Ray R Larson School of Information University of California, Berkeley Ray R Larson School of Information.

Péter Schönhofen – Ad Hoc Hungarian → English – CLEF Workshop 20 Sep 2007 Performing Cross-Language Retrieval with Wikipedia Participation report for Ad.

Extracting Metadata for Spatially- Aware Information Retrieval on the Internet Clough, Paul University of Sheffield, UK Presented By Mayank Singh.

IIIT Hyderabad’s CLIR experiments for FIRE-2008 Sethuramalingam S & Vasudeva Varma IIIT Hyderabad, India 1.

Multilingual Retrieval Experiments with MIMOR at the University of Hildesheim René Hackl, Ralph Kölle, Thomas Mandl, Alexandra Ploedt, Jan-Hendrik Scheufen,

A merging strategy proposal: The 2-step retrieval status value method Fernando Martínez-Santiago · L. Alfonso Ure ña-López · Maite Martín-Valdivia.

UA in ImageCLEF 2005 Maximiliano Saiz Noeda. Index System  Indexing  Retrieval Image category classification  Building  Use Experiments and results.

Collocations and Information Management Applications Gregor Erbach Saarland University Saarbrücken.

Thomas Mandl: GeoCLEF Track Overview th Workshop of the Cross-Language Evaluation Forum (CLEF) Århus, 18 th Sept

How robust is CLIR? Proposal for a new robust task at CLEF Thomas Mandl Information Science Universität Hildesheim 6 th Workshop.

GeoCLEF Breakout Notes Fred Gey, Ray Larson, Paul Clough.

CLEF 2007 Workshop Budapest, Hungary, 19–21 September 2007 Nicola Ferro Information Management Systems (IMS) Research Group Department of Information Engineering.

CLEF Kerkyra Robust – Word Sense Disambiguation exercise UBC: Eneko Agirre, Arantxa Otegi UNIPD: Giorgio Di Nunzio UH: Thomas Mandl.

1 Flexible and Efficient Toolbox for Information Retrieval MIRACLE group José Miguel Goñi-Menoyo (UPM) José Carlos González-Cristóbal (UPM-Daedalus) Julio.

Thomas Mandl: GeoCLEF Track Overview Cross-Language Evaluation Forum (CLEF) Thomas Mandl, (U. Hildesheim) 8 th Workshop.

Stiftung Wissenschaft und Politik German Institute for International and Security Affairs CLEF 2005: Domain-Specific Track Overview Michael Kluck SWP,

7th May Primary Research Team & Capabilities Dept. of Parallel and Distributed Computing Research and Development Areas: –Large-scale HPCN, Grid.

INAOE at GeoCLEF 2008: A Ranking Approach based on Sample Documents Esaú Villatoro-Tello Manuel Montes-y-Gómez Luis Villaseñor-Pineda Language Technologies.

Combining Text and Image Queries at ImageCLEF2005: A Corpus-Based Relevance-Feedback Approach Yih-Cheng Chang Department of Computer Science and Information.

Thomas Mandl: Robust CLEF Overview 1 Cross-Language Evaluation Forum (CLEF) Thomas Mandl Information Science Universität Hildesheim

1 Question Answering and Logistics. 2 Class Logistics  Comments on proposals will be returned next week and may be available as early as Monday  Look.

Diana Inkpen, University of Ottawa, CLEF 2005 Using various indexing schemes and multiple translations in the CL-SR task at CLEF 2005 Diana Inkpen, Muath.

1 The Domain-Specific Track at CLEF 2007 Vivien Petras, Stefan Baerisch & Max Stempfhuber GESIS Social Science Information Centre, Bonn, Germany Budapest,

Analysis of Experiments on Hybridization of different approaches in mono and cross-language information retrieval DAEDALUS – Data, Decisions and Language,

Information and Communication Technologies 1 Overview of GeoCLEF 2007 IR techniques IE/NLP techniques GIR techniques Systems Resources Experiments Translation.

1 Predicting Answer Location Using Shallow Semantic Analogical Reasoning in a Factoid Question Answering System Hapnes Toba, Mirna Adriani, and Ruli Manurung.

Information Retrieval and Extraction 2009 Term Project – Modern Web Search Advisor: 陳信希 TA: 蔡銘峰＆許名宏.

1 SINAI at CLEF 2004: Using Machine Translation resources with mixed 2-step RSV merging algorithm Fernando Martínez Santiago Miguel Ángel García Cumbreras.

CLEF Budapest1 Measuring the contribution of Word Sense Disambiguation for QA Proposers: UBC: Agirre, Lopez de Lacalle, Otegi, Rigau, FBK: Magnini.

Multilingual Search using Query Translation and Collection Selection Jacques Savoy, Pierre-Yves Berger University of Neuchatel, Switzerland

Measuring Monolinguality

F. López-Ostenero, V. Peinado, V. Sama & F. Verdejo

Reading Report on Hybrid Question Answering System

Experiments for the CL-SR task at CLEF 2006

Donna M. Gates Carnegie Mellon University

UNED Anselmo Peñas Álvaro Rodrigo Felisa Verdejo Thanks to…

Cheshire at GeoCLEF 2008: Text and Fusion Approaches for GIR

Presentation transcript:

CLEF 2008 Workshop September 17-19, 2008 Aarhus, Denmark

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. Participation Participant Monolingual TasksBilingual TasksTOTAL DEENPTX2DEX2ENX2PT alivale*99 cheshire csusm dfki*55 hagen51015 icl99 inaoe*12 jaen*7613 pittsburgh*44 valencia66 xldb12 24 TOTAL

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. Monolingual vs Bilingual English 3 Bilingual 76% wrt Monolingual

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. 4

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. Monolingual vs BilingualGerman 5 Bilingual 86% wrt Monolingual

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. 6

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. Monolingual vs Bilingual Portuguese 7 Bilingual 90% wrt Monolingual

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. 8

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. Approaches  CHESHIRE (1 st all bilingual tasks, 1 st monolingual Portuguese)  OKAPI/BM25, Logistic Regression, fusion approaches  Geographic Indexing Subsystem using World Gazetteer (not used this year?)  LEC Power Translator  Hagen (1 st monolingual German)  GIRSA (GIR by semantic annotation)  Text and location names indexed separately  Results of IR and QA combined  DFKI (1 st monolingual English)  Lucene  NER Topic parsing (event part and geographic part)  Geographic ontology (using geographic taxonomies such as GeoNames, World Gazetteer)  Event ontology (using Wikipedia) 9  XLDB (2 nd monolingual Portuguese)  REMBRANDT, language-dependent named- entity recognition (uses Wikipedia)  QueryCol, query reformulation: blind relevance feedback, query expansion using geographic ontology  MG4J: text index/retrieval, implicit and explicit geographical indexes  Jaen (2 nd bilingual English)  Lemure  SINTRAM (Sinai Translation Module)  Location index (Ling Pipe for NER using GeoNames),  Query reformulation module  AliVale (2 nd monolingual English)  Jaen + Fuzzy Borda result merging  CSUMS (last in all the tasks[!])  TERRIER index/retrieval (DFR)

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. Some other approaches  UPV  Lucene  GeoWorSE  Stanford NER system, Geo WordNet  Geo index, text index, WordNet index  ICL/KMI  Lucene  Geografic index, text index  NER Sheffield’s GATE  Pedia Crawler for geographic co-occurrence  Data fusion  Pittsburgh  Query pattern analysis (geo-part, topic-part)  Lingpipe NER  WikiGEO  INAOE  Lemure  Re-ranking using geographic expansion process  GeoNames, Lingpipe 10

CLEF 2008 Workshop Aarhus, September 17-19, 2008 T. Mandl et al. Conclusions 11