Spatio-temporal interpretable neural network for solar irradiation prediction using transformer

Yuan Gao, Shohei Miyata, Yuki Matsunami, Yasunori Akashi
Energy and Buildings, Volume 297, 2023, 113461
https://doi.org/10.1016/j.enbuild.2023.113461

Abstract
Deep learning models have been increasingly applied in the field of solar radiation prediction. However, the characteristics of a deep learning black box model restrict its application in practical scenarios such as model predictive control. Because energy system controllers may be unable to make final decisions based solely on the predictions of a black-box model. This study considers both the temporal and spatial dependencies of solar radiation predictions through unfolding sequences and applying a transformer model As the results indicate, the transformer model used can improve the mean absolute percent error by approximately 20.9% and the mean squared error by 14.3% compared to the baseline recurrent neural network model. At the same time, detailed case studies show that the transformer model heavily considers humidity and temperature when predicting the more significant outcomes Finally, the detailed results of a one-step analysis prove that the change in weight of the transformer model is related to the change in outdoor weather conditions.