论文标题
通过复制提高有效性:一个说明性的TDD情况
Increasing Validity Through Replication: An Illustrative TDD Case
论文作者
论文摘要
上下文:软件工程(SE)实验受到对有效性的威胁,可能会影响其结果。复制允许研究人员以先前实验的弱点为基础,并提高发现结果的可靠性。目的:说明复制的好处,以提高调查结果的可靠性和发现主持人变量。方法:我们复制了关于测试驱动开发(TDD)的实验,并解决了其对有效性和先前复制的威胁。我们比较了复制的结果,并假设影响结果的合理主持人。结果:TDD复制的结果之间的差异可能是由于响应变量的操作,受试者对治疗的分配,在实验室外工作的津贴,提供存根或任务。结论:复制允许研究发现的鲁棒性,假设对结果的合理主持人进行假设以及加强获得的证据。
Context: Software Engineering (SE) experiments suffer from threats to validity that may impact their results. Replication allows researchers building on top of previous experiments' weaknesses and increasing the reliability of the findings. Objective: Illustrating the benefits of replication to increase the reliability of the findings and uncover moderator variables. Method: We replicate an experiment on Test-Driven-Development (TDD) and address some of its threats to validity and those of a previous replication. We compare the replications' results and hypothesize on plausible moderators impacting results. Results: Differences across TDD replications' results might be due to the operationalization of the response variables, the allocation of subjects to treatments, the allowance to work outside the laboratory, the provision of stubs, or the task. Conclusion: Replications allow examining the robustness of the findings, hypothesizing on plausible moderators influencing results, and strengthening the evidence obtained.