QEST: Quantitative Evaluation of Systems



Past:   Proceedings on DBLP

Future:  Post a CFP for 2021 or later   |   Invite the Organizers Email


All CFPs on WikiCFP

Event When Where Deadline
QEST 2020 International Conference on Quantitative Evaluation of SysTems
Aug 31, 2020 - Sep 3, 2020 Vienna, Austria Apr 3, 2020 (Mar 27, 2020)
QEST 2019 16th International Conference on Quantitative Evaluation of SysTems
Sep 9, 2019 - Sep 12, 2019 Glasgow Apr 18, 2019 (Apr 15, 2019)
QEST 2018 QEST 2018 : 15th International Conference on Quantitative Evaluation of SysTems
Sep 4, 2018 - Sep 7, 2018 Beijing, China Apr 4, 2018 (Mar 28, 2018)
QEST 2017 14th International Conference on Quantitative Evaluation of SysTems
Sep 5, 2017 - Sep 7, 2017 Berlin Apr 9, 2017
QEST 2016 International Conference on Quantitative Evaluation of Systems
Aug 23, 2016 - Aug 25, 2016 Quebec City, Canada Mar 14, 2016 (Mar 7, 2016)
QEST 2014 Quantitative Evaluation of Systems
Sep 8, 2014 - Sep 11, 2014 Florence, Italy Mar 14, 2014 (Mar 7, 2014)
QEST 2013 10th International Conference on Quantitative Evaluation of SysTems
Aug 27, 2013 - Aug 30, 2013 Buenos Aires, Argentinia Mar 18, 2013 (Mar 11, 2013)
QEST 2012 9th International Conference on Quantitative Evaluation of SysTems
Sep 17, 2012 - Sep 20, 2012 London, UK, Imperial College Mar 5, 2012 (Feb 27, 2012)
QEST 2011 8th International Conference on Quantitative Evaluation of SysTems
Sep 5, 2011 - Sep 8, 2011 Aachen, Germany Mar 25, 2011 (Mar 18, 2011)
QEST 2010 7th International Conference on Quantitative Evaluation of SysTems
Sep 15, 2010 - Sep 19, 2010 Williamsburg, VA, USA Mar 29, 2010 (Mar 22, 2010)
QEST 2009 6th International Conference on Quantitative Evaluation of SysTems
Sep 13, 2009 - Sep 16, 2009 Budapest, Hungary Mar 23, 2009 (Mar 16, 2009)

Present CFP : 2020

Scope and Topics:

The International Conference on Quantitative Evaluation of SysTems (QEST) is the leading forum on quantitative evaluation and verification of computer systems and networks. Areas of interest include quantitative specification methods, stochastic and non-deterministic models and metrics for performance, reliability, safety, correctness, and security. QEST is interested in both theoretical and experimental research. QEST welcomes a diversity of modelling formalisms, programming languages and methodologies that incorporate quantitative aspects such as probabilities, temporal properties and other forms of non-determinism. This includes work on the combination of quantitative evaluation and verification with machine learning techniques. Papers may advance empirical, simulation and analytic methods. Of particular interest are case studies that highlight the role of quantitative specification, modelling and evaluation in the design of systems. Systems of interest include computer hardware and software architectures, communication systems, cyber-physical systems, infrastructural systems, security systems and biological systems. Papers that describe novel tools to support the practical application of research results in all of the above areas are also welcome.

QEST 2020 will organize a special session under the topic “Predictive performance by machine learning.” Submissions that address the combination of machine learning and performance prediction are particularly welcomed. – Ph.D. students whose work is not yet finished are encouraged to register for the Ongoing Work session. This session offers opportunity to discuss, not to publish formally.


QEST 2020 considers six types of papers:

Theoretical: advance our understanding, apply to non-trivial problems and be mathematically rigorous.
Methodological and technical: describe situations that require the development and proposal of new analysis processes and techniques.
Application: describes a novel application, and compares with previous results.
Tools: should motivate the development of the new tools and the formalisms they support, with a focus on the software architecture and practical capabilities.
Tool demonstration: describe a relevant tool, as well as its features, evaluation, or any other information that may demonstrate the merits of the tool.
Posters: provide a short abstract of work that you want to present in an elevator pitch.

All accepted papers (including tool demonstrations) must be presented at the conference by one of the authors. The QEST 2020 proceedings will be published in the Springer LNCS series and indexed by ISI Web of Science, Scopus, ACM Digital Library, dblp, Google Scholar. All submitted papers will be evaluated by at least three reviewers on the basis of their originality, technical quality, scientific or practical contribution to the state of the art, methodology, clarity, and adequacy of references.

Authors should consult Springer’s authors’ guidelines and use Springer’s LaTeX templates for the preparation of their papers. Submitted full papers must not exceed 16 pages excluding references. Short papers (i.e. tool demonstrations and extended poster abstracts) must not exceed 4 pages, also excluding references. Papers must be unpublished and not be submitted for publication elsewhere.

Tools and results reproducibility

Authors of tool papers (both regular and demonstration) must make their tools and input data available to reviewers; reproducibility of results will be taken into account during the evaluation process, and the conference will include a demo session. Authors should present use cases, distinctive features, and computational/memory requirements through motivating examples. Theoretical background need not be presented in tool demonstration papers. If accepted after peer-review, the authors may choose to have the extended poster abstract (4 pages long) included in the proceedings. Tools full papers (16 pages long) must describe substantial improvements if they present new versons of existing tools.

We expect authors of tool papers (regular and short) to provide instructions detailing the steps which need to be taken to reproduce the results presented in the tool papers to ensure reproducibility. In particular, the following information should be provided:

Information on system requirements for running the tool, such as OS, compilers, environments, etc.
A link to the (publicly downloadable) tool with detailed installation instructions.
A detailed description of the steps taken to reproduce the results presented in the paper, referencing tables and figures. This description should be available online and a link needs to be included in the paper.
If possible, include also a link to a public online repository, such as bitbucket.org, github.com, or sourceforge.net.

Submission and special issue

✉Papers should be submitted electronically using EasyChair.

Full papers will participate in the competence for the best paper award, elected by the programme committee. A best poster award will be elected by the QEST 2020 participants among the posters presented in the venue. Accepted tool demonstrations are invited to join the poster competition. We thank Springer for support with these awards. A selection of the best full papers will be invited to submit an extended version of their paper to a special issue in the Performance Evaluation journal.

Related Resources

IJCCSA 2020   International Journal on Cloud Computing: Services and Architecture
MaSPECS 2020   Modeling and Simulation for Performance Evaluation of Computer-based Systems track of the 34th International ECMS Conference on Modelling and Simulation
GridCom 2020   12th International Conference on Grid Computing
LREC 2020   12th Conference on Language Resources and Evaluation
CSW 2021   2021 International Workshop on Cyber Security (CSW 2021)
ICDCS 2021   International Conference on Distributed Computing Systems
ITE 2021   2nd International Conference on Integrating Technology in Education
ICSRS--Scopus & EI Compendex 2021   2021 5th International Conference on System Reliability and Safety (ICSRS 2021)--Scopus & EI Compendex
ICRE--EI, Scopus 2021   2021 5th International Conference on Reliability Engineering (ICRE 2021)--EI Compendex, Scopus
MLIOB 2020   International Conference on Machine Learning, IOT and Blockchain