===============================================================

CALL FOR PAPERS

REPRODUCE: Workshop on Reproducible Research Methodologies
February 15, 2014, Orlando, Florida, USA
(co-located with HPCA 2014)

http://www.occamportal.org/reproduce

===============================================================

Computer science and engineering research increasingly rely on
numerous methods to explore research breakthroughs, including
empirical and statistical analysis, modeling, and simulation of
complex computer systems. These ad hoc methods are utilized due
to a variety of factors including cost of designing prototypes,
minimal access to state-of-the-art fabrication plants, problem
complexity and size, and return on investment. However, lack of
a common experimental methodology, and lack of simple and
unified mechanisms, tools and repositories to preserve and
exchange the whole experimental setup (including all past
research artifacts) makes it excessively challenging or even
impossible to accurately reproduce experimental results for
evaluation and future advancement.

This workshop is an interdisciplinary forum for academic,
governmental, and industrial researchers, promoters,
practitioners and developers to discuss ideas, experience,
trustable and reproducible research methodologies, practical
techniques, tools and repositories. Detailed topics of interest
include but are not limited to:

* Techniques for experimental reproducibility
* Fidelity validation of experiments and tools
* Reproducible benchmarking methodologies
* Scientific method for computing experiments
* Techniques to effectively leverage emulation
* Scalable HPC computing in experimentation
* Metrics quantifying performance vs. fidelity
* Reproducible and extensible methodologies
* Data-mining, crowdsourcing analysis methods
* Methods of dissemination of results
* Nomenclature and metadata onthology
* Tool, benchmark, experiment repositories
* Visualization and analysis techniques
* Reproducible simulation environments
* Experimental documentation methods
* Techniques to preserve/share experiments
* Methods to effectively analyze experiments
* Extracting metadata from experiments
* Methods for protecting intellectual property
* Education strategies for reproducible science

Submissions are 2-page extended abstracts for ongoing research,
wild and crazy ideas, position statements, demonstration of
tools for reproducible experiments, etc. Submissions should be
made via EasyChair at
https://www.easychair.org/conferences/?conf=reproduce14

Submission Deadline: January 8, 2014
Notification of Acceptance: January 23, 2014
Final Manuscripts Due: January 30, 2014
Workshop Date: February 15, 2014

Authors may be invited to submit to an IEEE Transactions on
Emerging Topics in Computing (TETC) Special Issue on
Reproducible Research Methodologies.

==== Organizers: ==============================================

Alex Jones, akjones@pitt.edu
University of Pittsburgh, Pittsburgh, PA, USA

Grigori Fursin, grigori.fursin@inria.fr
INRIA, Saclay, France

Daniel Mosse, mosse@cs.pitt.edu
University of Pittsburgh, Pittsburgh, PA, USA

Bruce Childers, childers@cs.pitt.edu
University of Pittsburgh, Pittsburgh, PA, USA
===============================================================