论文标题
迈向与人类进行软件维护工具评估的基准存储库
Toward a Benchmark Repository for Software Maintenance Tool Evaluations with Humans
论文作者
论文摘要
为了评估与人类参与者对照实验的软件维护技术和工具，研究人员目前使用临时选择的项目和任务。这可能不切实际地倾向于他们的工具，这使得结果的比较变得困难。我们建议逐步创建一个基准存储库，其中具有与人类研究相关的项目，任务和元数据。在本文中，我们讨论了这种存储库的要求和挑战，以及可能导致其构建的步骤。
To evaluate software maintenance techniques and tools in controlled experiments with human participants, researchers currently use projects and tasks selected on an ad-hoc basis. This can unrealistically favor their tool, and it makes the comparison of results difficult. We suggest a gradual creation of a benchmark repository with projects, tasks, and metadata relevant for human-based studies. In this paper, we discuss the requirements and challenges of such a repository, along with the steps which could lead to its construction.
