| |||||||||||
Metrics 2023 : Research Computing Metrics | |||||||||||
Link: https://sites.google.com/view/metrics2023 | |||||||||||
| |||||||||||
Call For Papers | |||||||||||
Metrics2023: Metrics2023
Website https://sites.google.com/view/metrics2023 Submission link https://easychair.org/conferences/?conf=metrics2023 Poster download Abstract registration deadline September 15, 2023 Submission deadline October 1, 2023 Topics: metrics software hardware training and education Metrics for objectively assessing the progress and impact of CyberInfrastructure (CI) projects are important for not only obtaining the required resources for the long-term sustainability of the projects and community engagement but also for identifying issues and prioritizing the areas of improvement. As projects evolve over time, the metrics for measuring their progress and impact should also evolve. Even though each CI project is unique, there are certain elements (such as the community engagement and training) that cross-cut across a vast majority of the projects. Hence, there is a possibility of defining a set of metrics that can be relevant to a broad range of the CI projects for measuring their progress and impact. The main goal of the Metrics 2023 conference is to bring together colleagues from a diverse range of disciplines and organizations to network, collaborate, and work towards defining a taxonomy of CI projects and the appropriate metrics for their short-term and long-term evaluation. Towards this end, abstracts for presentations, and papers for publication in the special issue of Springer Nature journal are invited. Metrics for evaluating the projects related to the following areas are in the scope of this conference: Software and data infrastructure projects including AI and Quantum Computing projects Hardware infrastructure development, deployment, operations and maintenance projects (for High Performance Computing, Data-Intensive Computing, Cloud Computing, Quantum Computing, and Data Storage and Archival) Community building and customer service projects Training, education, and outreach projects Diversity, Equity, Inclusion, and Accessibility (DEIA) projects Following are suggestions for some topics for abstracts and papers that are related to the aforementioned project areas: Case-studies on measuring success of projects Description of the projects and its goals Description of the metrics of interest for evaluating the projects The design of the evaluation method and analysis of the data The evolution of the metrics as the project progresses through different project years and release cycles Lessons learnt such as, Are there any metrics that were thought to be useful initially but are not useful any longer? Are there any metrics that were added in the evaluation plan later after the project started? Currently known best practices for tracking metrics Tools for tracking the product use metrics and experiences related to their adoption Challenges and opportunities in developing self-reporting software or data product/infrastructure Problems and solutions related to gathering certain types of metrics Benchmarking and performance evaluation techniques for hardware and software products Methods and experiences related to measuring productivity of people Methods and experiences related to measuring accuracy, precision, explainability, and fairness of results Manual and automated methods for gathering quantitative and qualitative metrics Methods for measuring the societal impact of projects Literature review and survey of the methods for evaluating success of projects from the areas that are in the scope of the conference New methods for analyzing success including the role and use of social-media Taxonomy of CyberInfrastructure (CI) projects and associated metrics Submission Guidelines Guidelines for Journal Papers: The Metrics2023 proceedings will be published by Springer Nature Computer Science in a special journal issue. We invite authors to submit their original and unpublished work, that is not under review for another publication. Full papers (10 -25 pages in length including references) should be formatted as per the Springer-specified guidelines (details below) for review. Authors of selected papers will be provided 20 minutes time-slots for their presentations at the conference. Submission system opens by August 31, 2023 Deadline for submission: October 1, 2023 Deadline for notification: November 1, 2023 Presentations of selected papers: November 11 - November 12, 2023 Deadline for submission of the final version of the paper: November 30, 2023 Timeline for publication: December 1, 2023 Link to the submission system: https://www.editorialmanager.com/sncs/default2.aspx Instructions for authors for preparing the papers are available at the following link: https://www.springer.com/journal/42979/submission-guidelines Guidelines for Abstracts for Presentations: We invite extended abstracts for short talks (maximum 7 minutes each). The abstracts should be prepared following the Springer guidelines, and could be 3-5 pages in length including references. While the abstracts will NOT be published in the proceedings, they will be made publicly accessible through a GitHub repository set up for the conference. The PDF copies of the rough draft of the slides (up to 16 slides maximum) are also required. The PDFs of the abstract and the slides can be merged into a single PDF file, and can be uploaded to Easychair for peer-review.The PDF version of the extended abstracts and slides can be submitted for review through EasyChair. Submission deadline: September 15, 2023 Notification deadline: October 1, 2023 Submission of the final slides and abstract to the GitHub repository: November 8, 2023 Presentations of selected papers: November 11 - November 12, 2023 Committees Program Committee TBD Organizing committee Ritu Arora, Wayne State University Izzat Alsmadi, Texas A & M University Prasad Calyam, University of Missouri Matthew Curry, Sandia National Laboratory George K. Thiruvathukal, Loyala University Publication Metrics2023 proceedings will be published in Springer Nature Computer Science, special issue. Venue The conference will be held in Denver, Colorado. Contact All questions about submissions should be emailed to ritu@wayne.edu. |
|