论文标题

在智能家庭环境中,基于以用户为中心的功率优化的多目标增强学习方法

Multi-objective Reinforcement Learning based approach for User-Centric Power Optimization in Smart Home Environments

论文作者

Gupta, Saurabh, Bhambri, Siddhant, Dhingra, Karan, Buduru, Arun Balaji, Kumaraguru, Ponnurangam

论文摘要

智能房屋要求内部的每个设备始终相互连接,这每天都会导致大量功率浪费。随着智能家居内部的设备的增加,用户很难最佳地控制或操作每个设备。因此,用户通常依靠电源管理系统进行这种优化,但通常对结果不满意。在本文中,我们提出了一个新颖的多目标增强学习框架,其目标是最大程度地减少功耗和最大化用户满意度的目标。该框架探讨了两个目标之间的权衡,并在寻找最佳策略时考虑两个目标时将其融合到更好的电源管理政策。我们在现实世界中的智能家居数据进行实验,并证明多目标方法:i)在两个目标之间建立权衡取舍,ii)比单目标方法获得更好的组合用户满意度和功耗。我们还表明,定期使用并在设备模式中定期使用几个波动的设备应定期进行优化,并且对其他智能家居的数据进行的实验获得了相似的结果,从而确保了所提出的框架的传递性。

Smart homes require every device inside them to be connected with each other at all times, which leads to a lot of power wastage on a daily basis. As the devices inside a smart home increase, it becomes difficult for the user to control or operate every individual device optimally. Therefore, users generally rely on power management systems for such optimization but often are not satisfied with the results. In this paper, we present a novel multi-objective reinforcement learning framework with two-fold objectives of minimizing power consumption and maximizing user satisfaction. The framework explores the trade-off between the two objectives and converges to a better power management policy when both objectives are considered while finding an optimal policy. We experiment on real-world smart home data, and show that the multi-objective approaches: i) establish trade-off between the two objectives, ii) achieve better combined user satisfaction and power consumption than single-objective approaches. We also show that the devices that are used regularly and have several fluctuations in device modes at regular intervals should be targeted for optimization, and the experiments on data from other smart homes fetch similar results, hence ensuring transfer-ability of the proposed framework.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源