基于深度强化学习的含氢综合能源系统低碳调度策略

Low-carbon Scheduling Strategy for Hydrogen-integrated Energy Systems Based on Deep Reinforcement Learning

  • 摘要: 为了提高含氢综合能源系统(hydrogen-integrated energy system,H-IES)的新能源利用率、降低碳排放水平,提出一种基于深度强化学习的H-IES调度策略。首先,构建包含氢能相关设备的H-IES模型,并引入奖惩阶梯式碳交易机制,利用阶梯碳价激励减排行为。然后,采用马尔可夫决策过程将调度问题转化为序列决策任务,综合考虑总成本、风光消纳率等多个目标,设计自适应奖励函数,动态调整各目标的权重。最后,在实测数据基础上,利用双延迟深度确定性策略梯度算法训练智能体。案例分析结果表明,所提方法能够挖掘H-IES的碳减排潜力,促进新能源消纳,实现经济性与环保性的双重优化。

     

    Abstract: To enhance renewable energy utilization and reduce carbon emissions in hydrogen-integrated energy systems (H-IES), this study proposes a deep reinforcement learning-based scheduling strategy. Firstly, an H-IES model incorporating hydrogen energy-related equipment is established, and a reward-penalty ladder-type carbon trading mechanism is introduced to incentivize emission reduction behaviors via stepwise carbon prices. Subsequently, the uncertainty optimization scheduling problem is transformed into a sequential decision-making task using the Markov decision process (MDP). Considering multiple objectives—such as total cost and renewable energy consumption—an adaptive reward function is designed to dynamically adjust their respective weights. Finally, based on the measured data, the agent is trained using the twin delayed deep deterministic policy gradient (TD3) algorithm. Case study results indicate that the proposed method can effectively exploit the carbon emission reduction potential of H-IES, enhance renewable energy utilization, and achieve dual optimization of economic performance and environmental sustainability.

     

/

返回文章
返回