With the aim of encouraging and promoting the development of Human Language Technologies (HLT) for modern iberian languages, the goal of this workshop is creating a discussion forum about different aspects regarding the evaluation of Natural Language Processing systems, emphasizing the main problems that modern iberian languages implied: Spanish, Catalan, Basque, Galician and Portuguese.

The implementation of this type of systems requires a deep evaluation and validation of them. In order to validate the HLT, similar evaluation methods must exists for similar applications, in order to compare them straightforwardly.

Besides, most tasks of HLT, as summarization and automatic translation, does not have a unique valid solution, but more than one can be accepted. Therefore, the evaluation methods required must be clear and adjusted to the system goals.

Following the line of other workshops focused in the evaluation of HLT systems, this IBEREVAL I workshop is presented as a discussion forum about the evaluation of systems working with modern iberian languages, with the aim of discovering the interests and necessities of the scientific community, dealing with the problems that evaluation implies, and promoting the creation of evaluation resources and training corpus for HLT systems working on these languages.
TOPICS OF INTEREST

This IBEREVAL I workshop will bring together researchers, academic institutions and companies working on the development of HLT systems and their evaluation, participating through submissions regarding issues such as:
Development of evaluation resources over different HLT modules and applications:

* creation of gold-standard corpus for iberian languages (Catalan, Basque, Galician, Portuguese and Spanish); Part of Speech tagging; syntactic parsing; semantic interpretation; anaphora resolution; information retrieval and extraction; summarization; machine translation, etc.
* Evaluation metrics for the different HLT modules and applications.
* General modules of evaluation: direct and indirect evaluation.
* Development of testing, supervision and evaluation frameworks for HLT systems.
* Manual, supervised and semi-supervised evaluation.
* Creation and development of evaluation standards.

IMPORTANT DATES
Paper submission deadline: June 15, 2010
Acceptance Notification: July 15, 2010
Camera Ready Copy: July 31, 2010
Workshop: September 6-7, 2010


PROGRAM COMMITTEE

Chair: Patricio Martínez-Barco (University of Alicante)
Program Committee Members:

* Eneko Aguirre (EHU)
* Anabela Barreiro (U. Porto)
* Víctor Díaz (U. Sevilla)
* Xavier Gómez-Guinovart (U. Vigo)
* Fernando Llopis (U. Alicante)
* M. Antonia Martí (U. Barcelona)
* Paloma Martínez (U. Carlos III)
* Manuel Montes (INAOE, Mexico)
* Lidia Moreno (UPV)
* German Rigau (EHU)
* Horacio Rodríguez (UPC)
* Paolo Rosso (UPV)
* Alfonso Ureña (U. Jaén)
* Felisa Verdejo (UNED)