1.Anhui Province Key Laboratory of Renewable Energy Utilization and Energy Saving (Hefei University of Technology), Hefei 230009, China;2.Electric Power Research Institute of State Grid Anhui Electric Power Co., Ltd., Hefei 230601, China;3.Lu’an Power Supply Company of State Grid Anhui Electric Power Co., Ltd., Lu’an 237000, China

In order to achieve carbon reduction targets, the combination of hydrogen energy and integrated energy systems has become one of the most potential development directions. Aiming at the problems such as the insufficient flexibility of scheduling strategy of hydrogen integrated energy system and difficulty in solving multi-objective optimization of complex systems, an optimal scheduling method for hydrogen integrated energy systems based on deep reinforcement learning is proposed. First, the variable operation condition model of coupled equipment is used to construct a wind-solar-hydrogen-cooling-heat-electricity integrated energy system, and expand the joint energy supply space of equipment. Secondly, considering the system operation cost, carbon emissions, system self-supply balance and renewable energy utilization rate, a multi-objective optimization model is built based on the optimal solution distance to stimulate the exploration of the agent. Then, the deep reinforcement learning algorithm is optimized by time segment characterization to enhance the estimation accuracy of the system state change. Finally, a simulation case is designed based on the measured data of the source and load. The results show that the proposed method can effectively improve the scheduling flexibility of the hydrogen integrated energy system, fully tap the carbon emission reduction potential of hydrogen energy, and realize the dual optimization of scheduling economy and environmental protection.

This work is supported by Regional Innovation and Development Joint Fund of National Natural Science Foundation of China (No. U19A20106), Anhui Provincial Natural Science Foundation of China (No. 2108085UD05) and Anhui Provincial Science and Technology Major Special Program of China (No. 202203f07020003).