Is business domain language support beneficial for creating test case specifications: A controlled experiment

详细信息    查看全文

• 作者：Florian H&auml ; ser ; ^{florian.haeser@uibk.ac.at" class="auth_mail" title="E-mail the corresponding author} ; Michael Felderer ^{michael.felderer@uibk.ac.at" class="auth_mail" title="E-mail the corresponding author} ; Ruth Breu ^{ruth.breu@uibk.ac.at" class="auth_mail" title="E-mail the corresponding author}
• 关键词：Domain Specific Languages (DSL) ; Behavior driven development ; Controlled experiment ; Software testing ; Student experiment
• 刊名：Information and Software Technology
• 出版年：2016
• 出版时间：November 2016
• 年：2016
• 卷：79
• 期：Complete
• 页码：52-62
• 全文大小：1021 K

文摘

Context: Behavior Driven Development (BDD), widely used in modern software development, enables easy creation of acceptance test case specifications and serves as a communication basis between business- and technical-oriented stakeholders. BDD is largely facilitated through simple domain specific languages (DSL) and usually restricted to technical test domain concepts. Integrating business domain concepts to implement a ubiquitous language for all members of the development team is an appealing test language improvement issue. But the integration of business domain concepts into BDD toolkits has so far not been investigated.

spara0002">Objective: The objective of the study presented in this paper is to examine whether supporting the ubiquitous language features inside a DSL, by extending a DSL with business domain concepts, is beneficial over using a DSL without those concepts. In the context of the study, benefit is measured in terms of perceived quality, creation time and length of the created test case specifications. In addition, we analyze if participants feel supported when using predefined business domain concepts.

spara0003">Method: We investigate the creation of test case specifications, similar to BDD, in a controlled student experiment performed with graduate students based on a novel platform for DSL experimentation. The experiment was carried out by two groups, each solving a similar comparable test case, one with the simple DSL, the other one with the DSL that includes business domain concepts. A crossover design was chosen for evaluating the perceived quality of the resulting specifications.

spara0004">Results: Our experiment indicates that a business domain aware language allows significant faster creation of documents without lowering the perceived quality. Subjects felt better supported by the DSL with business concepts.

spara0005">Conclusion: Based on our findings we propose that existing BDD toolkits could be further improved by integrating business domain concepts.