posted by user: grupocole || 166 views || tracked by 1 users: [display]

LLM fails 2025 : Failed experiments with Generative AI and what we can learn from them

FacebookTwitterLinkedInGoogle

Link: https://www.ids-mannheim.de/home/lexiktagungen/llm-fails
 
When Apr 8, 2025 - Apr 9, 2025
Where Mannheim, Germany
Submission Deadline Dec 11, 2024
Notification Due Dec 16, 2024
Final Version Due Feb 15, 2024
Categories    NLP   computational linguistics   linguistics   artificial intelligence
 

Call For Papers


more information on our Workshop-Website: https://www.ids-mannheim.de/home/lexiktagungen/llm-fails

Dear list members,

we would like to invite you to submit abstracts to our workshop "LLM fails – Failed experiments with Generative AI and what we can learn from them" taking place from April 8-9, 2025 at the Leibniz Institute for the German Language, Mannheim, Germany.

If the extended short papers are positively reviewed, there is an opportunity to publish them in a special issue of the Journal for Language Technology and Computational Linguistics.

Further information (automatic English translation):

Failed experiments typically have no place in scientific discourse; they are discarded and not published. We believe this leads to a loss of potential knowledge. After all, a systematic reflection on the reasons for failure allows for the questioning and/or improvement of methods used. Furthermore, when previously failed experiments are repeated and succeed, explicit progress can be determined. Thus, the discussion and documentation of failures creates added value for the scientific community from the perspective of methodological reflection. This is even more relevant in a field like research into and with Generative Artificial Intelligence (AI), which cannot look back on decades of tradition and where best practices are still being negotiated.
This workshop focuses on linguistic and NLP experiments with Generative AI that did not yield the desired results, such as but not limited to:
• Using Generative AI as a Named-Entity Recognizer
• Using Generative AI for automatic transcription of spoken language data
• Using Generative AI for the creation of dictionary entries
• Using Generative AI for the detection of language change phenomena

The contribution should clarify how this failure can contribute to knowledge gain regarding the work with Generative AI.
Unpublished proposals can be submitted anonymously as an abstract (500-750 words) in either German or English to the following email address by December 11, 2024:

llmfails(at)ids-mannheim.de

The organization team will decide on the acceptance of contributions by December 16, 2025. If a contribution is accepted, a short paper (4-6 pages without references) in English will be requested by February 15, 2025. The short papers will undergo double-blind peer review and will be published in a special issue of the Journal for Language Technology and Computational Linguistics and archived at ACL Anthology.

Best,
Annelen Brunner, Christian Lang, Ngoc Duyen Tanja Tu
(Organising committee)

Related Resources

IEEE-Ei/Scopus-ITCC 2025   2025 5th International Conference on Information Technology and Cloud Computing (ITCC 2025)-EI Compendex
GPTMB 2025   The Second International Conference on Generative Pre-trained Transformer Models and Beyond
DEPLING 2023   International Conference on Dependency Linguistics
GenAI and LVMs for Biometrics 2025   IEEE Transactions on Biometrics, Behavior, and Identity Science (T-BIOM) Special Issue on Generative AI and Large Vision-Language Models for Biometrics
DMML 2025   6th International Conference on Data Mining & Machine Learning
ACDL 2025   8th Advanced Course on Data Science & Machine Learning
SPIE-Ei/Scopus-DMNLP 2025   2025 2nd International Conference on Data Mining and Natural Language Processing (DMNLP 2025)-EI Compendex&Scopus
AIMEDIA 2025   The First International Conference on AI-based Media Innovation
ACL 2025   The 63rd Annual Meeting of the Association for Computational Linguistics
SusAI 2024   The International Workshop on Sustainable AI for Natural Language Processing