posted by user: cmkumar87 || 5749 views || tracked by 6 users: [display]

CL-SciSumm @SIGIR 2019 : [CfP] CL-SciSumm @SIGIR 2019: 5th Computational Linguistics Scientific Document Summarization Shared Task


When Jun 25, 2019 - Jun 25, 2019
Where Paris, France
Abstract Registration Due Mar 31, 2019
Submission Deadline May 24, 2019
Notification Due May 31, 2019
Final Version Due Jul 7, 2019
Categories    natural language processing   information retrieval   summarization   citation

Call For Papers

You are invited to participate in the 5th Computational Linguistics (CL) Scientific Summarization Shared Task, sponsored by SRI International and Chan-Zuckerberg Initiative (CZI), to be held as part of 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019) in Paris, France on 25th July 2019. This task follows up on the successful CL-SciSumm 2018 @ SIGIR 2018 and three previous editions. In this task, a training corpus CL research papers are released. Participants are invited to enter their systems in a task-based evaluation on a blind test set.

The CLSciSumm19 corpus is expected to be of interest to a broad community including those working in computational linguistics and natural language processing, text summarization, discourse structure in scholarly discourse, paraphrase, textual entailment and text simplification. The task constitutes automatic scientific paper summarization in the Computational Linguistics (CL) domain. The output summaries will be of two types: faceted summaries of the traditional self-summary (the abstract) and the community summary (the collection of citation sentences ‘citances’). We also propose to group the citances by the facets of the text that they refer to.

This is the 5th edition of the Shared Task, 3rd at SIGIR, following the 2nd edition at JCDL‘16 and a successful Pilot task at TAC ‘14 at NIST, USA.

=== Important Dates ===
Training Set Release: Already Online
Deadline for Registration and Short System Descriptions - March 30, 2019
Test Set Release: Already Online
System Runs Due: May 24, 2019
Preliminary System Reports Due: June 9, 2019
Camera Ready Contributions: July 7, 2019
Participants present at BIRNDL 2019 workshop: July 25, 2019 in Paris, France

=== The CL-SciSumm Corpus ===
The CL-SciSumm corpus is created by randomly sampling documents from the ACL Anthology corpus and selecting their citing papers. Citing paper may include papers from outside the Anthology.

The manually annotated training set of 40 reference papers and citing papers is already available for download and can be used by participants to pilot their systems. Further, this year we have introduced 1000 documents sets that were automatically annotated to be used as training data. This training data was generated following Nomoto,2018.Further, for Task 2 one thousand summaries that were released as part of the SciSummNet (Yasunaga et al., 2019) have been included as human summaries to train on.

The training set of articles is available for download at GitHub ( and can be used by participants to pilot their systems.

The test set (input documents with blind ground truth) of 20 articles is available in

The system outputs from the test set should be submitted to the task organizers, for the collation of the final results to be presented at the workshop.

=== Registration ===
Teams that wish to participate in the CL Shared Task track at BIRNDL 2019 are invited to register on EasyChair with a title and a tentative abstract describing their approach at

Participants are advised to register as soon as possible in order to receive timely access to evaluation resources, including development and testing data. Registration for the task does not commit you to participation - but is helpful to know for planning. All participants who submit system runs are welcome to present their system at the BIRNDL Workshop in the poster session, while the best performing system will be invited to present their paper in the main session. Dissemination of CL-SciSumm work and results other than in the workshop proceedings is welcomed, but the conditions of participation specifically preclude any advertising claims based on these results. Any questions about conference participation may be sent to the organizers mentioned below.

=== Organising Committee ===
- Muthu Kumar Chandrasekaran, SRI International,, (
- Michihiro Yasunaga, Yale, (
- Dayne Freitag, SRI International, (
- Dragomir Radev, Yale, (
- Kokil Jaidka, Nanyang Technological University, (
- Min-Yen Kan, National University of Singapore, (

Related Resources

ACL 2020   Annual Conference of the Association for Computational Linguistics
CL-MISRNLP 2020   Special Issue of Computational Linguistics: Multilingual and Interlingual Semantic Representations for Natural Language Processing
SPTM 2020   8th International Conference of Security, Privacy and Trust Management
CDKP 2020   9th International Conference on Data Mining & Knowledge Management Process
CL-Aff @ AAAI 2019   CL-Aff Happiness Shared Task @ AAAI AffCon : Modeling Affect-in-Action
SIPRO 2020   6th International Conference on Signal and Image Processing
ACM-MLNLP-Ei/Scopus 2019   2019 2nd International Conference on Machine Learning and Natural Language Processing
CLNLP 2020   2020 International Conference on Computational Linguistics and Natural Language Processing (CLNLP 2020)
SAI 2020   9th International Conference on Soft Computing, Artificial Intelligence and Applications