posted by organizer: skallumadi || 10553 views || tracked by 2 users: [display]

SIGIR eCom DC 2020 : The 2020 SIGIR Ecom Data Challenge : Multi-modal Product Data Classification and Retrieval challenge


When Jul 30, 2020 - Jul 30, 2020
Where Xi'an
Abstract Registration Due Jul 15, 2020
Submission Deadline Jul 22, 2020
Notification Due Jul 23, 2020
Final Version Due Jul 27, 2020
Categories    ecommerce   NLP   information retrieval   classification

Call For Papers

Call for Participation

The 2020 SIGIR workshop on eCommerce is hosting the Rakuten Multi-modal Product Data Classification and Retrieval challenge. This challenge focuses on two topics, namely large-scale multi-modal (text and image) classification and cross-modal retrieval. The goal of the multi-modal classification task is to predict each product’s 'type code' as defined in the catalog of Rakuten France. In the cross-modal retrieval task, presented with the text of the products, the goal is to retrieve the images corresponding to the products.

Challenge website:

Important Dates:
Data Challenge opens: April 20, 2020
Final Leaderboard - July 22, 2020
SIGIR eCom Full day Workshop - July 30, 2020

Task Description:

The cataloging of product listings through some type of text or image categorization method is a fundamental problem for any e-commerce marketplace, with applications ranging from personalized search and recommendations to query understanding. Manual and rule-based approaches to categorization are not scalable since commercial products are organized in many and sometimes thousands of classes. When actual users categorize product data, it has often been observed that not only the text of the title and description of the product is useful but also its associated images.


The main tasks for this challenge are as follows:
1. Multi-modal classification. Given a training set of products and their product type codes, predict the corresponding product type codes for an unseen held out test set of products. The systems are free to use the available textual titles and/or descriptions whenever available and additionally the images to allow for true multi-modal learning.
2. Cross-modal retrieval. Given an held-out test set of product items with their titles and (possibly empty) descriptions, predict the best image from among a set of test images that correspond to the products in the test set.

Participation and Data:

The data challenge is open to everyone.

For this challenge, Rakuten France has released approximately 99K product listings in tsv format, including a training (84,916) and test set (13,812). The dataset consists of product titles, product descriptions, product images and their corresponding product type codes. The test set will be released towards the end of the data challenge. Furthermore, one can assume the test set has been generated from the same data distribution as the training set.

Details about evaluation metrics and other aspects of the task can be found at the website:

Important Dates:
Data Challenge opens: April 20, 2020
Final Leaderboard - July 22, 2020
SIGIR eCom Full day Workshop - July 30, 2020

Related Resources

SIGIR 2021   The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval
ACL-IJCNLP 2021   59t Annual Meeting of the Association for Computational Linguistcs and the 10th International Joint Conference on Natural Language Processing
CHIIR 2021   6th ACM SIGIR Conference on Human Information Interaction and Retrieval
ICDCS 2021   International Conference on Distributed Computing Systems
CSEIT 2021   8th International Conference on Computer Science, Engineering and Information Technology
ICDM 2021   21st IEEE International Conference on Data Mining
TSD 2021   The twenty-fourth International Conference on Text, Speech and Dialogue (TSD 2021).
ML_BDA 2021   Special Issue on Machine Learning Technologies for Big Data Analytics
MDPI-SI-BDHA 2021   Call for Papers: Special Issue “Big Data for eHealth Applications” (MDPI Applied Sciences, IF 2.474 – Indexed on Scopus, Web of Science)
AS-RLPMTM 2021   Applied Sciences special issue Rich Linguistic Processing for Multilingual Text Mining