基于深度强化学习的微电网低碳优化运行方法

A Low-carbon Optimal Operation Method for Microgrids Based on Deep Reinforcement Learning

  • 摘要: 在建设新型电力系统的远景目标下,为实现配电侧绿色低碳运行,提出了一种基于深度强化学习的计及电转气和碳捕集的微电网低碳优化运行方法。首先,考虑新能源发电设备、储能设备、电转气系统及碳捕集设备,在发电侧碳捕集–电转气–燃气轮机同新能源共同形成了多类型供能的微电网系统。其次,为实现所提微电网系统在源荷不确定性环境下的优化运行,基于深度强化学习理论,将多时段优化问题转化为马尔科夫决策问题,并提出了一种融合知识的深度强化学习求解框架。在此基础上采用分布式近端策略优化算法实现了微电网系统多类电源的低碳优化运行。仿真结果证明了所提深度强化学习框架及算法的有效性和其制定的运行方案的经济性。

     

    Abstract: In this paper we present a low-carbon optimization strategy for microgrids with the long-term goal of developing a new type of power system. This method, rooted in deep reinforcement learning, integrates the concepts of electricity-to-gas conversion and carbon capture to attain environmentally conscious operations. Primarily, by conducting an assessment of renewable energy generation and storage apparatus, as well as incorporating electricity-to-gas conversion and carbon capture systems, the integration of a carbon-capturing electricity-to-gas turbine within the power generation framework establishes a diverse and multi-source energy microgrid system. Subsequently, to achieve optimal operation of the proposed microgrid system in an environment of source-load uncertainty, the multi-period optimization problem is transformed into a Markov decision problem based on deep reinforcement learning theory. Additionally, a knowledge fusion deep reinforcement learning framework is proposed. The utilization of the distributed proximal policy optimization algorithm facilitates the realization of optimal performance across diverse power sources within the microgrid system. The empirical findings from the simulations provide substantial evidence for both the efficacy of the envisaged deep reinforcement learning framework and algorithm, as well as the economic feasibility of the proposed operational strategy.

     

/

返回文章
返回