posted by user: cesi_chairs || 414 views || tracked by 3 users: [display]

WSESE@ICSE2018 2018 : 1st International Workshop on Methodological Issues with Empirical Studies involving Human Subjects - An ICSE2018 Workshop


When May 27, 2018 - Jun 3, 2018
Where Gothenburg
Submission Deadline Feb 5, 2018
Notification Due Mar 5, 2018
Final Version Due Mar 19, 2018
Categories    empirical software engineering   methods   human subjects   experiments

Call For Papers

With the steep increase of empirical studies and the advent of secondary studies (aggregation or meta-study), one main concern raised by recent studies, is the quality of the primary studies (e.g., a single experiment). Concerns about different quality issues have been raised for many years, however, due to the complexity of empirical studies, not all of them seem to be solved. In particular, problems with regard to the appropriate design of experiments and the correct usage of statistical tests are crucial for the trustworthiness of the results. Consequently, we need to better understand the issues and how to mitigate, if not remove them. The workshop focuses on the empirical process, which can be seen as one measure to ensure repeatable quality. It of six consecutive steps: Definition, Design, Implementation, Execution, Analysis, and Reporting. We also address research with regard to methodological issues arising during the execution of the stages of the process. The workshop’s aim is to increase awareness on the importance of the quality and appropriateness of the methods applied during the different stages of empirical studies to get a reliable answer from an empirical study and to disseminate this knowledge to the broader SE community.
Topics of interest include, but are not restricted to:
• Issues with regard to the motivation and definition of appropriate research questions.
• Issues with regard to the operationalization, e.g., missing standard metrics.
• Issues in the selection of appropriate experimental design and its consequences
• Issues in the systematic identification of threats to validity; and how to address them.
• Dealing with perceptions and biases.
• Drawing the appropriate conclusions from the findings and their generalization.
• Issues with replication, families of studies and their aggregation.
• Issues with quantitative, qualitative approaches and combined approaches.

Paper categories
Experience reports (8 pages max) describe the experience with conducting studies over a period of time and lessons learned that would be useful to be added to the methodological body of knowledge.
Technical papers (8 pages max) describe either studies conducted highlighting concrete results and the way they were designed and conducted to overcome challenges. Also expected in these papers are comparisons of the advances made against the state-of-the-art.
Vision / Position papers (4 pages max) are expected to describe new directions to follow in conducting empirical studies. Convincing arguments supported by clear rationale need to be included.
Papers must describe original work not submitted or presented at other forums. Accepted papers will be published in ICSE workshop proceedings. The official publication date of the workshop proceedings is the date the ICSE proceedings are made available in the ACM Digital Library. This date may be up to two weeks prior to the first day of ICSE 2018. The official publication date affects the deadline for any patent filings related to published work.
Keynote speaker and invited talks
Keynote by Per Runeson (U Lund) on “Studying the Human Side of Software Engineering”
Invited talks by Natalia Juristo (UP Madrid) and Dieter Rombach (Uni Kaiserslautern).
Submission information
Submissions via Easychair ( Papers must be formatted according to ICSE 2018 guidelines (cf.

Workshop Organization
Andreas Jedlitschka – Fraunhofer IESE, Germany
Laurie Williams – North Carolina State University, NC, US

Workshops Advisory Board
Natalia Juristo, Univ. Politec. Madrid, Spain
Dieter Rombach, Univ. of Kaiserslautern, Germany
Guilherme H. Travassos, COPPE/UFRJ, Brazil
Claes Wohlin, BTH, Sweden

Program Committee
Abrahão Silvia, Uni. Politec. de Valencia, Spain
Avgeriou Paris, Univ. of Gronningen, The Netherlands
Baldassarre Maria Teresa, Univ. of Bari, Italy
Carver Jeffery, Univ. of Alabahma, US
Daneva Maya, Univ. of Twente, The Netherlands
Franch Xavier, Technical Univ. of Catalunya, Spain
Genero Marcela, Univ. of Castilla-La Mancha, Spain
Heldal Rogardt, Chalmers Univ. of Tech., Sweden
Izuireta Clem, Montana State Univ., US
Jørgensen Magne, Simula Research Labs, Norway
Kalinowski Marcos, PUC-Rio, Brazil
Lassenius Caspar, Aalto Univ., Finland
Männistö Tomi, Univ. of Helsinki, Finland
Mendez Fernandez Daniel, Tech. Univ. Munich, Germany
Pfahl Dietmar, Univ. of Tartu, Estonia
Russo Barbara, Free Univ. of Bolzano-Bozen, Italy
Seaman Carolyn, Univ. of Maryland-Baltimore County, US
Sjøberg Dag, Univ. of Oslo, Norway
Sira Vegas, UP Madrid, Spain
Wagner Stefan, Univ. of Stuttgart, Germany

Paper length
Experience reports 8 pages
Technical papers 8 pages
Vision / Position papers 4 pages

Important Dates
Submission of papers: February 05, 2018
Notification: March 05, 2018
Camera-ready: March 19, 2018
Workshop: May 29, 2018

Related Resources

ACM CoNEXT 2018   The 14th International Conference on Emerging Networking EXperiments and Technologies
EMNLP 2018   2018 Conference on Empirical Methods in Natural Language Processing
ALGOSENSORS 2018   14th International Symposium on Algorithms and Experiments for Wireless Networks
ESEM 2018   Empirical Software Engineering and Measurement
CONISOFT 2018   6th IEEE International Conference on Software Engineering Research and Innovation
SWQD 2019   Software Quality Days 2019
CHI 2019   The ACM CHI Conference on Human Factors in Computing Systems
EJA - 2 2018   The European Journal of Arts
ECSA 2018   CFP: 12th European Conference on Software Architecture
In Commemoration of the 200th Birthday o 2018   In Commemoration of the 200th Birthday of Karl Marx