论文标题
虚拟对照组：测量隐藏的性能指标
Virtual Control Group: Measuring Hidden Performance Metrics
论文作者
论文摘要
金融完整性系统中的绩效指标对于维持高效且具有成本效益的操作至关重要。重要的性能度量是假阳性率。无法直接监视此指标，因为我们不确定一旦阻止用户是否不好。我们提出了一种基于调查理论和因果推理方法的统计方法，以估计系统的假阳性率或单个阻止策略。我们还建议一种新的结果匹配方法，在某些情况下，包括经验数据的表现优于其他常用方法。本文中描述的方法可以应用于其他完整性域，例如网络安全。
Performance metrics measuring in Financial Integrity systems are crucial for maintaining an efficient and cost effective operation. An important performance metric is False Positive Rate. This metric cannot be directly monitored since we don't know for sure if a user is bad once blocked. We present a statistical method based on survey theory and causal inference methods to estimate the false positive rate of the system or a single blocking policy. We also suggest a new approach of outcome matching that in some cases including empirical data outperformed other commonly used methods. The approaches described in this paper can be applied in other Integrity domains such as Cyber Security.
