posted by user: gulvarol || 5170 views || tracked by 1 users: [display]

Preregistration 2020 : NeurIPS'20 Workshop: The pre-registration experiment: an alternative publication model for machine learning research

FacebookTwitterLinkedInGoogle

Link: http://preregister.science/
 
When Dec 11, 2020 - Dec 11, 2020
Where Virtual
Submission Deadline Oct 7, 2020
Notification Due Oct 30, 2020
Final Version Due Nov 12, 2020
Categories    machine learning
 

Call For Papers

What is pre-registration and how does it improve peer review? Benchmarks on popular datasets have played a key role in the considerable measurable progress that machine learning has made in the last few years. But reviewers can be tempted to prioritize incremental improvements in benchmarks to the detriment of other scientific criteria, destroying many good ideas in their infancy. Authors can also feel obligated to make orthogonal improvements in order to “beat the state-of-the-art”, making the main contribution hard to assess.

Pre-registration changes the incentives by reviewing and accepting a paper before experiments are conducted. The emphasis of peer-review will be on whether the experiment plan can adequately prove or disprove one (or more) hypotheses. Some results will be negative, and this is welcomed. This way, good ideas that do not work will get published, instead of filed away and wastefully replicated many times by different groups. Finally, the clear separation between hypothesizing and confirmation (absent in the current review model) will raise the statistical significance of the results.

We are inviting submissions on the broad range of topics covered at NeurIPS! The paper template is structured like a mini-tutorial on the pre-registration process to get you started quickly. Pre-registered papers will be published at the workshop. The final results will be published in the Proceedings of Machine Learning Research (PMLR), a sister publication to the Journal of Machine Learning Research (JMLR).

Related Resources

GLECC 2025   GLECC 2025 - International Conference on Globalisation in Languages, Education, Culture, and Communication (Final CfP)
Ei/Scopus-CCNML 2025   2025 5th International Conference on Communications, Networking and Machine Learning (CCNML 2025)
BIOMED DATA 2025   Biomedical Data Science Summer School and Conference Registration Extended!!!
Ei/Scopus-SGGEA 2025   2025 2nd Asia Conference on Smart Grid, Green Energy and Applications (SGGEA 2025)
GPTMB 2025   The Second International Conference on Generative Pre-trained Transformer Models and Beyond
IEEE-ACAI 2025   2025 IEEE 8th International Conference on Algorithms, Computing and Artificial Intelligence (ACAI 2025)
Ei/Scopus-IPCML 2025   2025 International Conference on Image Processing, Communications and Machine Learning (IPCML 2025)
IEEE- CCRIS 2025   2025 IEEE 6th International Conference on Control, Robotics and Intelligent System (CCRIS 2025)
Ei/Scopus-AI2A 2025   2025 5th International Conference on Artificial Intelligence, Automation and Algorithms (AI2A 2025)
AIAT 2025   2025 5th International Conference on Artificial Intelligence and Application Technologies (AIAT 2025)