posted by user: peak || 1032 views || tracked by 1 users: [display]

CRAC-corefud 2022 : CRAC 2022 Shared Task on Multilingual Coreference Resolution

FacebookTwitterLinkedInGoogle

Link: https://ufal.mff.cuni.cz/corefud/crac22
 
When Oct 16, 2022 - Oct 17, 2022
Where Gyeongju, Republic of Korea
Submission Deadline Jul 8, 2022
Notification Due Aug 22, 2022
Categories    NLP   coreference resolution
 

Call For Papers

CALL FOR PARTICIPATION

We are excited to announce the CRAC 2022 Shared Task on Multilingual Coreference Resolution! The task will be held at COLING 2022 on October 16–17.

TASK DESCRIPTION

The focus of the task is learning models for prediction of coreference across a range of typologically different languages: Catalan, Czech, English, French, German, Hungarian, Lithuanian, Polish, Russian, and Spanish. Both identification of mentions and clustering of mentions that refer to the same entity are included. Only identity coreference is considered in this shared task, i.e., more complex coreference-related phenomena such as bridging anaphora are not considered. Submissions by participants will be ranked according to a scoring criterion based on standard coreference evaluation metrics.

BACKGROUND

Recently, inspired by the Universal Dependencies initiative (UD), the coreference community has started discussions on establishing a universal annotation scheme and using it to harmonize existing corpora. The discussions at the CRAC 2020 workshop led to proposing the Universal Anaphora initiative. One of the lines of effort related to Universal Anaphora resulted in CorefUD, which is a multilingual collection of coreference data resources harmonized under a common scheme. The public edition of CorefUD 1.0 contains 13 datasets for 10 languages, all of which are included in the CRAC 2022 shared task.

EXPECTED TIMELINE

Development Phase:

* March 3, 2022 – train+dev data release, start of the development phase
* March 17, 2022 – baseline system release, evaluation script release

Evaluation Phase:

* June 1, 2022 – start of evaluation phase, test evaluation via CodaLab
* June 8, 2022 (AoE) – end of evaluation phase

Presentation Phase:

* July 11, 2022 – submission of system description papers to CRAC 2022
* August 22, 2022 – notification of acceptance
* October 16-17, 2022 – the CRAC 2022 workshop at COLING 2022

Please visit the website for more details: https://ufal.mff.cuni.cz/corefud/crac22

Related Resources

VarDial EC 2023   Call for Participation - VarDial Evaluation Campaign 2023
IEEE Xplore-Ei/Scopus-CCCAI 2023   2023 International Conference on Communications, Computing and Artificial Intelligence (CCCAI 2023) -EI Compendex
WAMTA 2023   Workshop on Asynchronous Many-Task Systems and Applications
FLAIRS 2023   FLAIRS-36 2023 : The 36th International FLAIRS Conference
AMTE 2023   Asynchronous Many-Task systems for Exascale 2023
CSIP 2023   10th International Conference on Signal Processing
SIGTYP 2023   5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP
IOTBC 2023   International Conference IOT, Blockchain and Cryptography
HEIN 2023   International conference on Health Informatics
CSSE 2023   International Conference on Computer Science and Software Engineering