posted by organizer: TristanMiller || 9147 views || tracked by 7 users: [display]

Task 7 of SemEval 2017 : Detection and Interpretation of English Puns

FacebookTwitterLinkedInGoogle

Link: http://alt.qcri.org/semeval2017/task7/
 
When Aug 3, 2017 - Aug 4, 2017
Where Vancouver, Canada
Abstract Registration Due Jan 9, 2017
Submission Deadline Feb 27, 2017
Notification Due Apr 3, 2017
Final Version Due Apr 17, 2017
Categories    NLP   semantics   humour   computational linguistics
 

Call For Papers

==== Final Call for Participation ====

SemEval-2017 Task 7:
Detection and Interpretation of English Puns

http://alt.qcri.org/semeval2017/task7/

Researchers and industry professionals are invited to participate in a
shared task on the computational detection and interpretation of English
puns. The task will occur as part of the SemEval-2017 workshop, to be
collocated with the 55th Annual Meeting of the Association for
Computational Linguistics in Vancouver, Canada on August 3-4, 2017.
SemEval is an ongoing series of evaluations of computational
semantic analysis systems, organized under the aegis of SIGLEX, the
Special Interest Group on the Lexicon of the Association for
Computational Linguistics.


---- Task description ----

A pun is a form of wordplay in which one signifier (e.g., a word or
phrase) suggests two or more meanings by exploiting polysemy, or
phonological similarity to another signifier, for an intended humorous
or rhetorical effect. Puns where the two meanings share the same
spelling are known as homographic, whereas those where the two meanings
are spelled (and also usually pronounced) differently are known as
heterographic.

Conscious or tacit linguistic knowledge -- particularly of lexical
semantics and phonology -- is an essential prerequisite for the
production and interpretation of puns. This has long made them an
attractive subject of study in theoretical linguistics, and has led to a
small but growing body of research into puns in computational
linguistics. This SemEval shared task will be the first organized
evaluation of automatic pun processing systems.

Participants will be provided with two data sets. The first data set
will contain several hundred short contexts (jokes, slogans, aphorisms,
etc.). In some of these contexts, a single word will be used as a
homographic pun; in the rest, there will be no pun. The second data set
will be similar to the first, except that the puns will be heterographic
rather than homographic. For one or both data sets, participating
systems will compete in any or all of three subtasks:

Subtask 1: Pun detection. For this subtask, participants are given an
entire raw data set. For each context, the system must decide whether or
not it contains a pun.

Subtask 2: Pun location. For this subtask, the contexts not containing
puns are removed from the data set. For each context, the system must
identify which word is the pun.

Subtask 3: Pun interpretation. For this subtask, the pun word in each
context is marked, and contexts where the pun's two meanings are not
found in WordNet are removed from the data set. For each context, the
system must annotate the two meanings of the given pun by reference to
WordNet sense keys.

System performance will be measured with the usual metrics from
information retrieval and WSD. Please see the task website for further
details.


---- Practical information ----

* January 9, 2017: Evaluation start
* January 30, 2017: Evaluation end
* February 27, 2017: Paper submission due
* April 3, 2017: Author notifications
* April 17, 2017: Camera-ready submission due
* August 3-4, 2017: SemEval-2017 workshop at ACL 2017 in Vancouver

The evaluation will be conducted using the CodaLab Competitions
platform. Teams can register for any or all of the subtasks on their
CodaLab pages:

Subtask 1: https://competitions.codalab.org/competitions/15705
Subtask 2: https://competitions.codalab.org/competitions/15706
Subtask 3: https://competitions.codalab.org/competitions/15707

It is also strongly recommended to subscribe to the task mailing list:
https://groups.google.com/d/forum/semeval-puns


---- Organizing committee ----

* Tristan Miller, UKP Lab, Technische Universität Darmstadt
* Christian F. Hempelmann, Ontological Semantic Technology Lab, Texas
A&M University-Commerce
* Iryna Gurevych, UKP Lab, Technische Universität Darmstadt

To contact the organizing committee, please e-mail Tristan Miller or
post to the task mailing list.

Related Resources

GermEval2024 GerMS-Detect 2024   GermEval2024 Shared Task GerMS-Detect -- Sexism Detection and Annotator Disagreement Prediction in German Online News Fora @Konvens 2024
IEEE-Ei/Scopus-ITCC 2025   2025 5th International Conference on Information Technology and Cloud Computing (ITCC 2025)-EI Compendex
DS 2024   Discovery Science 2024
BIOEN 2025   8th International Conference on Biomedical Engineering and Science
SDSM 2024   Suicide Detection on Social Media @ IEEE BigData 2024
CMHSM 2025   The 1st Workshop on Cognitive and Mental Health Disorder Detection on Social Media at ICDE’25
AISCA 2025   International Conference on Artificial Intelligence, Soft Computing And Applications
Abu Dhabi, UAE 2025   The First Workshop and Shared Task on Multilingual Counterspeech Generation
Sandeep Kumar Mishra 2025   Edited Volume Call for Papers on Sandeep Kumar Mishra’s Books/stories/writings