FIRE 2024

Forum for Information Retrieval Evaluation

DAIICT , Gandhinagar

12th - 15th December

Please apply for access to the FIRE Information-Retrieval Text Research Collection.
We request you to read, complete, sign and mail, or email, us the organisational-access form. The mailing address is mentioned in the form. Organisations may use the individual form to manage access rights internally and these individual-access forms need not be sent to us.

NOTE: We link only the new / updated test collections each year. Use the previous year's sets where test collections are missing in this matrix.


2012


AD HOC
Assamese Queries
Bengali Corpus Queries Qrel (version-I)
Qrel (version-II)
Results Runs
English Queries Qrel (version-I)
Qrel (version-II)
Results Runs
Gujarati Queries Qrel (version-I)
Hindi Queries Qrel (version-I)
Qrel (version-II)
Results Runs
Odia Corpus Queries Qrel (version-I)
Marathi Queries
Punjabi Queries
Tamil Queries
Telugu Queries
MET
Corpus


† In this year's Bengali collection, documents in the range 2004 September-December and 2007 January-September, of the Anandabazar Patrika set, have been restored.




2011


AD HOC
Bengali Corpus Queries Qrels Results Runs
English Corpus Queries Qrels Results Runs
Gujarati Corpus Queries Qrels Runs
Hindi Corpus Queries Qrels (version-I)
Qrels (version-II)
Runs
Marathi Queries Qrels Results Runs
Tamil Corpus Queries
Telugu Queries
CL!TR
Corpus
MLAF
Corpus
RISOT
Corpus


Credits: DAIICT; Gujarati (Gujarat Samachar) and Hindi (Indiatimes) corpus (Khushboo A. Singhal) and query translation (Rini Joshi). CDAC Noida; Hindi query translation (Gour Mohan). IIT Kharagpur; Tamil Corpus (Dinamalar) and query translation (Rajendra Prasath). IIIT Hyderabad; Telugu query translation (Ram Bhupal Reddy).




2010


AD HOC
Bengali Corpus Queries
Queries
Qrels Results
English Corpus Queries Qrels Results
Gujarati Queries
Hindi Corpus Queries
Queries
Qrels Results
Marathi Corpus Queries Qrels Results
Tamil Queries
Telugu Queries
MLAF
Corpus
Queries
Qrels
Qrels
Training set
Test set
THREAD-ID to DOCNO table
Wikipedia-Entity Retrieval
Corpus Queries Qrels


† Transliterated, ‡ Ad hoc retrieval, ♠ Classification of messages.
Credits: Query translations; Gujarati (Kalyani Patel). CFILT, IIT Bombay; Marathi (Ashish Almeida). AU-KBC; Tamil and Telugu (Pattabhi R. K. Rao).




2008


AD HOC
Bengali Queries Qrels
English Queries Qrels
Hindi Corpus Queries Qrels
Marathi Queries Qrels
Tamil Queries
Telugu Queries


To be announced soon.

To be announced soon.