posted by user: grupocole || 2002 views || tracked by 8 users: [display]

InFile 2010 : Evaluation of Information Filtering Systems in a Competitive Intelligence Framework


When May 22, 2010 - May 22, 2010
Where Valletta, Malta
Submission Deadline Feb 28, 2010
Notification Due Mar 22, 2010
Final Version Due Apr 4, 2010
Categories    NLP   information retrieval

Call For Papers

[Apologies for multiple postings]

Evaluation of Information Filtering Systems in a Competitive
Intelligence Framework Workshop
22 May 2010
Held in conjunction with LREC 2010, Malta


The constant growth of publicly available information has entailed a
consequently similar growth in the research areas devoted to the
automated organization of this information. In particular, Information
Filtering systems have been developed to tackle the issues of many
applications of business intelligence, from mail categorization to news
routing and technology watch. However, the theoretically challenging
models of these systems have seldom been evaluated in real usage
context. Indeed, standard evaluation benchmarks usually introduce
artefacts that simplify the task. For instance, in the context of
competitive intelligence, systems must filter documents without any
global information on a “collection” but can use feedback from the user,
and must be efficient enough to deal with a real-time document stream.
Furthermore, with the increase of globalized access and availability of
the information, sources may be found in many languages, and the
multilinguality issue must also be considered. TREC Adaptive Filtering
Track and INFILE track at CLEF for multilingual information filtering
have tried to propose evaluation frameworks closer to the usage.

The goal of this workshop is to study different aspects of Information
Filtering Evaluation and to bring together researchers from the
community of Information Filtering to develop new evaluation frameworks
and confront current models with these new evaluation models.
Submissions are expected to propose new insights on evaluation
methodologies and resources for Information Filtering or to present
Information Filtering models that will meet the requirements of a real
usage evaluation (in particular, researchers that submit papers
presenting Information Filtering Models are encouraged to evaluate their
model using an existing benchmark such as the INFILE benchmark,
available at


Both theoretical and practical research papers are welcome from both
research and industrial communities addressing the main workshop theme,
in any aspect including:
- Resources and methodologies for Evaluation of Information Filtering
Systems in real usage context
- New models for Information Filtering, that tackle one or several
issues of this kind of evaluation: efficiency, adaptability,
multilinguality, etc.
- Results of the Evaluation of Information Filtering Systems
- User studies of the use of Information Filtering Systems in
Competitive Intelligence

Submission information

Papers will be submitted to the workshop via the START LREC Conference
Manager, under
Authors should submit a PDF file of no more than 10 pages, following the
LREC conference formatting details. Papers will be reviewed by three
members of the Program Committee,
Accepted papers will be published in the workshop Proceedings.
When submitting a paper from the START page, authors will be asked to
provide essential information about resources (in a broad sense, i.e.
also technologies, standards, evaluation kits, etc.) that have been used
for the work described in the paper or are a new result of your research.
For further information on this new initiative, please refer to

Important dates

Paper submission deadline 28 February 2010
Notification of acceptance 22 March 2010
Final version of accepted paper 4 April 2010
Workshop half-day 22 May 2010

Workshop Organizers

Romaric Besançon
BP 6 92265 Fontenay-aux-roses CEDEX
Tel: +33 1 46 54 80 16
Fax: +33 1 46 54 75 80

Djamel Mostefa
55-57,rue Brillat Savarin 75013 Paris
Tel: +33 1 43 13 33 33

Program Committee
Romaric Besançon, CEA LIST
Stéphane Chaudiron Université Lille 3
Khalid Choukri, ELDA
Christian Fluhr,
Meriama Laïb, CEA LIST
Djamel Mostefa, ELDA
Ismail Timimi, Université Lille 3

Language Resources Production and Evaluation
ELDA - Evaluations and Language resources Distribution Agency
55-57, rue Brillat Savarin Tel : +33 1 43 13 33 33
75013 Paris - France Fax : +33 1 43 13 33 30
Homepages: /
ELRA Catalogue:
LREC Conferences:
Evaluation Portal:

Related Resources

ICRE--EI, Scopus 2021   2021 5th International Conference on Reliability Engineering (ICRE 2021)--EI Compendex, Scopus
ITE 2021   2nd International Conference on Integrating Technology in Education
IJCAI 2021   30th International Joint Conference on Artificial Intelligence
AICA 2020   O'Reilly AI Conference San Jose
ICSRS--Scopus & EI Compendex 2021   2021 5th International Conference on System Reliability and Safety (ICSRS 2021)--Scopus & EI Compendex
EACL 2021   The 16th Conference of the European Chapter of the Association for Computational Linguistics
AEIS--Ei Compendex, Scopus 2021   2021 International Conference on Advanced Enterprise Information System (AEIS 2021)--Ei Compendex, Scopus
ECIR 2021   European Conference on Information Retrieval
WSIM--Ei, Scopus 2021   2021 International Workshop on Information Management (WSIM 2021)--Ei Compendex, Scopus
ICCIA--EI Compendex, Scopus 2021   2021 6th International Conference on Computational Intelligence and Applications (ICCIA 2021)--EI Compendex, Scopus