论文标题
使用功能工程升级预测:解决IBM生态系统中的支持票证升级
Escalation Prediction using Feature Engineering: Addressing Support Ticket Escalations within IBM's Ecosystem
论文作者
论文摘要
大型软件组织每天都以错误报告,功能请求以及客户提交的一般误解的形式处理许多客户支持问题。收集,分析和谈判要求的策略是通过部署产品后管理客户投入的努力来补充的。对于后者,支持门票是允许客户提交问题,错误报告和功能请求的关键。每当给予支持问题的关注不足时,客户就有可能会升级他们的问题,并且管理层的升级既耗时又昂贵,尤其是对于管理数百名客户和数千张支持票的大型组织而言。本论文为简化支持分析师和经理的工作提供了一步,尤其是在预测支持票升级的风险方面。在我们大型工业合作伙伴IBM的一项现场研究中,采用了设计科学方法来表征IBM分析师在管理升级方面可用的支持过程和数据。通过设计和评估的迭代循环,支持分析师对客户的专家知识被转化为支持票务模型的功能,以预测机器学习模型,以预测支持票证升级。对机器学习模型进行了培训和评估,并评估了超过250万张支持票和10,000次升级,召回了79.9%的召回和减少80.8%的工作量,以供支持分析师,以识别以升级风险的支持门票。支持机票模型中开发的功能旨在成为有兴趣实施该模型以预测支持票证升级的组织的起点,并供将来的研究人员建立发展,以推动对升级预测的研究。
Large software organizations handle many customer support issues every day in the form of bug reports, feature requests, and general misunderstandings as submitted by customers. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. Whenever insufficient attention is given to support issues, there is a chance customers will escalate their issues, and escalation to management is time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. This thesis provides a step towards simplifying the job for support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, a design science methodology was employed to characterize the support process and data available to IBM analysts in managing escalations. Through iterative cycles of design and evaluation, support analysts' expert knowledge about their customers was translated into features of a support ticket model to be implemented into a Machine Learning model to predict support ticket escalations. The Machine Learning model was trained and evaluated on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 79.9% and an 80.8% reduction in the workload for support analysts looking to identify support tickets at risk of escalation. The features developed in the Support Ticket Model are designed to serve as a starting place for organizations interested in implementing the model to predict support ticket escalations, and for future researchers to build on to advance research in Escalation Prediction.