论文标题

在软件测试教育中基于询问的概念反馈与传统的详细反馈机制的比较:经验研究

A Comparison of Inquiry-Based Conceptual Feedback vs. Traditional Detailed Feedback Mechanisms in Software Testing Education: An Empirical Investigation

论文作者

Cordova, Lucas, Carver, Jeffrey, Walia, Gursimran, Gershmel, Noah

论文摘要

当前的测试教育工具提供的反馈有关学生的测试套件中的缺陷模仿行业代码覆盖工具,或列出了学生测试套件中缺少的特定讲师测试案例。尽管从某种意义上说,这些类型的反馈类似于揭示问题的解决方案,这可以无意中鼓励学生采取试验和错误的测试方法,而不是使用鼓励学习的更系统的方法。除了不教学生为什么他们的测试套件不足之外,这种反馈还可能激发学生依赖反馈,而不是自己思考。为了解决这种缺陷,有机会研究替代反馈机制,其中包括测试概念的积极加强。我们认为,使用基于询问的学习方法比简单地提供答案更好。为了促进这种类型的学习,我们提出了Testing Tutor,这是一个基于Web的作业提交平台,该平台通过可自定义的反馈引擎支持不同级别的测试教学法。我们通过两项大二课程的实证研究评估了不同类型的反馈类型的影响。我们使用测试教师为学生提供不同类型的反馈,即传统的详细代码覆盖反馈或基于查询的学习概念反馈,并比较效果。结果表明,接受概念反馈的学生比获得传统代码覆盖反馈的学生具有更高的代码覆盖范围(通过不同的措施),冗余测试用例较少和更高的编程成绩。

The feedback provided by current testing education tools about the deficiencies in a student's test suite either mimics industry code coverage tools or lists specific instructor test cases that are missing from the student's test suite. While useful in some sense, these types of feedback are akin to revealing the solution to the problem, which can inadvertently encourage students to pursue a trial-and-error approach to testing, rather than using a more systematic approach that encourages learning. In addition to not teaching students why their test suite is inadequate, this type of feedback may motivate students to become dependent on the feedback rather than thinking for themselves. To address this deficiency, there is an opportunity to investigate alternative feedback mechanisms that include a positive reinforcement of testing concepts. We argue that using an inquiry-based learning approach is better than simply providing the answers. To facilitate this type of learning, we present Testing Tutor, a web-based assignment submission platform that supports different levels of testing pedagogy via a customizable feedback engine. We evaluated the impact of the different types of feedback through an empirical study in two sophomore-level courses. We use Testing Tutor to provide students with different types of feedback, either traditional detailed code coverage feedback or inquiry-based learning conceptual feedback, and compare the effects. The results show that students that receive conceptual feedback had higher code coverage (by different measures), fewer redundant test cases, and higher programming grades than the students who receive traditional code coverage feedback.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源