论文标题

通过安全的加固学习协调频率控制

Coordinated Frequency Control through Safe Reinforcement Learning

论文作者

Zhou, Yi, Zhou, Liangcai, Shi, Di, Zhao, Xiaoying

论文摘要

随着可再生能源的广泛部署,电力电网正在经历越来越多的动力和不确定性,其安全的操作受到威胁。现有的频率控制方案基于日前的脱机分析和分钟级的在线灵敏度计算很难适应迅速变化的系统状态。特别是,他们无法促进对系统频率和功率流的协调控制。迫切需要一种精致的方法和工具,以协助系统操作员及时做出决定。本文提出了一个基于安全强化学习的新型无模型协调频率控制框架,并考虑了多个控制目标。负载频率控制问题被建模为受约束的马尔可夫决策过程,可以通过与网格连续相互作用以实现子秒决策做出的AI代理来解决。在东中国电力电网进行的广泛的数值实验证明了该方法的有效性和希望。

With widespread deployment of renewables, the electric power grids are experiencing increasing dynamics and uncertainties, with its secure operation being threatened. Existing frequency control schemes based on day-ahead offline analysis and minute-level online sensitivity calculations are difficult to adapt to rapidly changing system states. In particular, they are unable to facilitate coordinated control of system frequency and power flows. A refined approach and tools are urgently needed to assist system operators to make timely decisions. This paper proposes a novel model-free coordinated frequency control framework based on safe reinforcement learning, with multiple control objectives considered. The load frequency control problem is modeled as a constrained Markov decision process, which can be solved by an AI agent continuously interacting with the grid to achieve sub-second decision making. Extensive numerical experiments conducted at East China Power Grid demonstrate the effectiveness and promise of the proposed method.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源