FIRE 2023
Forum for Information Retrieval Evaluation
Goa Business School, Goa University, Panjim
15th-18th December
Please apply for access to the FIRE Information-Retrieval Text Research Collection.
† In this year's Bengali collection, documents in the range 2004 September-December and 2007 January-September, of the Anandabazar Patrika set, have been restored.
Credits: DAIICT; Gujarati (Gujarat Samachar) and Hindi (Indiatimes) corpus (Khushboo A. Singhal) and query translation (Rini Joshi). CDAC Noida; Hindi query translation (Gour Mohan). IIT Kharagpur; Tamil Corpus (Dinamalar) and query translation (Rajendra Prasath). IIIT Hyderabad; Telugu query translation (Ram Bhupal Reddy).
† Transliterated, ‡ Ad hoc retrieval, ♠ Classification of messages.
Credits: Query translations; Gujarati (Kalyani Patel). CFILT, IIT Bombay; Marathi (Ashish Almeida). AU-KBC; Tamil and Telugu (Pattabhi R. K. Rao).
| We request you to read, complete, sign and mail, or email, us the organisational-access form. The mailing address is mentioned in the form. Organisations may use the individual form to manage access rights internally and these individual-access forms need not be sent to us. |
NOTE: We link only the new / updated test collections each year. Use the previous year's sets where test collections are missing in this matrix. |
2012
| AD HOC | |||||
| Assamese | Queries | ||||
| Bengali | Corpus † | Queries | Qrel (version-I) Qrel (version-II) | Results | Runs |
| English | Queries | Qrel (version-I) Qrel (version-II) | Results | Runs | |
| Gujarati | Queries | Qrel (version-I) | |||
| Hindi | Queries | Qrel (version-I) Qrel (version-II) | Results | Runs | |
| Odia | Corpus | Queries | Qrel (version-I) | ||
| Marathi | Queries | ||||
| Punjabi | Queries | ||||
| Tamil | Queries | ||||
| Telugu | Queries | ||||
| MET | |||||
| Corpus | |||||
† In this year's Bengali collection, documents in the range 2004 September-December and 2007 January-September, of the Anandabazar Patrika set, have been restored.
2011
| AD HOC | |||||
| Bengali | Corpus | Queries | Qrels | Results | Runs |
| English | Corpus | Queries | Qrels | Results | Runs |
| Gujarati | Corpus | Queries | Qrels | Runs | |
| Hindi | Corpus | Queries | Qrels (version-I) Qrels (version-II) | Runs | |
| Marathi | Queries | Qrels | Results | Runs | |
| Tamil | Corpus | Queries | |||
| Telugu | Queries | ||||
| CL!TR | |||||
| Corpus | |||||
| MLAF | |||||
| Corpus | |||||
| RISOT | |||||
| Corpus | |||||
Credits: DAIICT; Gujarati (Gujarat Samachar) and Hindi (Indiatimes) corpus (Khushboo A. Singhal) and query translation (Rini Joshi). CDAC Noida; Hindi query translation (Gour Mohan). IIT Kharagpur; Tamil Corpus (Dinamalar) and query translation (Rajendra Prasath). IIIT Hyderabad; Telugu query translation (Ram Bhupal Reddy).
2010
| AD HOC | |||||
| Bengali | Corpus | Queries Queries † | Qrels | Results | |
| English | Corpus | Queries | Qrels | Results | |
| Gujarati | Queries | ||||
| Hindi | Corpus | Queries Queries † | Qrels | Results | |
| Marathi | Corpus | Queries | Qrels | Results | |
| Tamil | Queries | ||||
| Telugu | Queries | ||||
| MLAF | |||||
| Corpus | Queries ‡ | Qrels ‡ Qrels ♠ | Training set Test set ♠ | ||
| THREAD-ID to DOCNO table | |||||
| Wikipedia-Entity Retrieval | |||||
| Corpus | Queries | Qrels | |||
† Transliterated, ‡ Ad hoc retrieval, ♠ Classification of messages.
Credits: Query translations; Gujarati (Kalyani Patel). CFILT, IIT Bombay; Marathi (Ashish Almeida). AU-KBC; Tamil and Telugu (Pattabhi R. K. Rao).
2008
| AD HOC | |||||
| Bengali | Queries | Qrels | |||
| English | Queries | Qrels | |||
| Hindi | Corpus | Queries | Qrels | ||
| Marathi | Queries | Qrels | |||
| Tamil | Queries | ||||
| Telugu | Queries | ||||
