Evaluating Arabic Retrieval from English or French Queries: The TREC-2001 Cross-Language Information Retrieval Track

TitleEvaluating Arabic Retrieval from English or French Queries: The TREC-2001 Cross-Language Information Retrieval Track
Publication TypeJournal Articles
Year of Publication2002
AuthorsOard D, Gey FC, Dorr BJ
JournalProceedings of the Post Workshop of LREC
Date Published2002///
Abstract

The Cross-language information retrieval track at the 2001 Text Retrieval Conference (TREC-2001) produced the first large informationretrieval test collection for Arabic. The collection contains 383,872 Arabic news stories, 25 topic descriptions in Arabic, English and
French from which queries can be formed, and manual (ground truth) relevance judgments for a useful subset of the topic-document
combinations. This paper describes the way in which the collection was created, explains the evaluation measures that the collection is
designed to support, and provides an overview of the results from the first set of experiments with the collection. The results make it
possible to draw some inferences regarding the utility of the collection for post hoc evaluations.