posted by organizer: siddhantagarwal || 511 views || tracked by 3 users: [display]

PerAnsSumm Shared Task @ CL4Health NAACL 2025 : Shared Task on Perspective-aware Healthcare Answer Summarization at CL4Health Workshop [NAACL 2025]

FacebookTwitterLinkedInGoogle

Link: https://peranssumm.github.io
 
When May 3, 2025 - May 4, 2025
Where Albuquerque, New Mexico
Submission Deadline Feb 1, 2025
Final Version Due Feb 25, 2025
Categories    shared task   natural language processing   clinical nlp
 

Call For Papers

We invite you to participate in the Perspective-Aware Healthcare Answer Summarization (PerAnsSumm) Shared Task, focusing on creating perspective-aware summaries from healthcare community question-answering (CQA) forums.

The results will be presented at the CL4Health Workshop, co-located with the NAACL 2025 conference in Albuquerque, New Mexico. The publication venue for system descriptions will be the proceedings of the CL4Health workshop, also co-published in the ACL anthology.

== TASK DESCRIPTION ==
Healthcare CQA forums provide diverse user perspectives, from personal experiences to factual advice and suggestions. However, traditional summarization approaches often overlook this richness by focusing on a single best-voted answer. The PerAnsSumm shared task seeks to address this gap with two main challenges:

* Task A: Identifying and classifying perspective-specific spans in CQA answers.
* Task B: Generating structured, perspective-specific summaries for the entire question-answer thread.

This task aims to build tools that provide users with concise summaries catering to varied informational needs.

== DATA ==
Participants will be provided with:
* Training and validation datasets, accessible via CodaBench.
* A separate test set for evaluation. (Unseen)
A starter code is also available to make it easier for participants to get started.

== EVALUATION ==
System submissions will be evaluated based on automatic metrics, with a focus on the accuracy and relevance of the summaries. Further details can be found on the task website: https://peranssumm.github.io/
CodaBench Competition Page: https://www.codabench.org/competitions/4312/

== PRIZES ==
* 1st Place: $100
* 2nd Place: $50

== TIMELINE ==
* Second call for participation: 5th December, 2024
* Release of task data (training, validation): 12th November, 2024
* Release of test data: 25th January, 2025
* Results submission deadline: 1st February, 2025
* Release of final results: 5th February, 2025
* System papers due: 25th February, 2025
* Notification of acceptance: 7th March, 2025
* Camera-ready papers due: TBC
* CL4Health Workshop: 3rd or 4th May, 2025

== PUBLICATION ==
We encourage participants to submit a system description paper to the CL4Health Workshop at NAACL 2025. Accepted papers will be included in the workshop proceedings and co-published in the ACL Anthology. All papers will be reviewed by the organizing committee. Upon paper publication, we encourage you to share models, code, fact sheets, extra data, etc., with the community through GitHub or other repositories.

== ORGANIZERS ==
Shweta Yadav, University of Illinois Chicago, USA
Md Shad Akhtar, Indraprastha Institute of Information Technology Delhi, India
Siddhant Agarwal, University of Illinois Chicago, USA

== CONTACT ==
Please join the Google group at https://groups.google.com/g/peranssumm-shared-task-2025 or email us at peranssumm@gmail.com with any questions or clarifications.

Related Resources

IEEE-Ei/Scopus-ITCC 2025   2025 5th International Conference on Information Technology and Cloud Computing (ITCC 2025)-EI Compendex
Abu Dhabi, UAE 2025   The First Workshop and Shared Task on Multilingual Counterspeech Generation
SPIE-Ei/Scopus-DMNLP 2025   2025 2nd International Conference on Data Mining and Natural Language Processing (DMNLP 2025)-EI Compendex&Scopus
COLING 2025   [2nd CFP] The 1st Workshop and Shared Task on Multilingual Counterspeech Generation
IEEE CACML 2025   2025 4th Asia Conference on Algorithms, Computing and Machine Learning (CACML 2025)
Topical collection Springer 2025   CFP: Sense-Making and Collective Virtues among AI Innovators. Aligning Shared Concepts and Common Goals
SNLP 2025   6th International Conference on Semantic & Natural Language Processing
GEM shared task 2024   GEM 2024 multilingual data-to-text and summarization shared task
MLSP 2024   Multilingual Lexical Simplification Pipeline (MLSP) Shared Task @ 19th Workshop on Innovative Use of NLP for Building Educational Applications
IJNLC 2024   International Journal on Natural Language Computing - H index - 24