A New Hybrid Model using WTBPNN-EHO and LSTM with EMD-WOA Signal Decomposition for mid and Long-Term Electricity Load Forecasting

Mesbaholdin Salami, Masoumeh Rostam Niakan, Masoud Hasani Marzooni, Kioumars Heydari

Abstract


The manager of the electricity supply chain needs to correctly forecast one of the most important variables affecting the management of the electricity chain. This article has proposed a hybrid model for electricity demand forecasting using deep learning. Firstly, the historical electricity demand data is decomposed using empirical mode decomposition (EMD) algorithm. Then, whale optimization algorithm (WOA) is used to determine signal decomposition levels rounds by EMD and the allocation of signals to neural networks. Parameters that promote accuracy of the forecast are selected using principal component analysis (PCA). A group of signals are fed into a back propagation neural network, whose components are decomposed by wavelet transform. The weights of this neural network are determined by using elephant herding optimization (EHO) algorithm (WTBPNN-EHO). The rest of the signals with higher levels of complexity are fed into the long short-term memory (LSTM) neural network. Finally, the load is calculated by aggregating the results of these two neural networks. Finally, the performance of this model has been compared with other existing models

Keywords


Deep learning; Electricity demand forecasting; LSTM; Signal decomposition; WOA

Full Text:

PDF

References


Salami M, Movahedi Sobhani. F., and Ghazizadeh. M.S., 2020. Evaluating power consumption model and load deficit at different temperatures using clustering techniques and presenting a strategy for changing production management. IEEE Third International Conference on Data Stream Mining & Processing (DSMP), pp. 341-345, doi: 10.1109/DSMP47368.2020.9204247.

Salami M., Movahedi Sobhani F., and Ghazizadeh M.S., 2018. Multi-objective model for fair pricing of electricity using the parameters from the iran electricity market big data analysis. International Journal of Industrial Mathematics 10(4): 359-374.

Debnath K.B. and M. Mourshed. 2018. Forecasting methods in energy planning models. Renewable and Sustainable Energy Reviews 88: 297-325, https://doi.org/10.1016/j.rser.2018.02.002.

Chen G., Tang B., Zeng X., Zhou P., Kang P., and Long H., 2022. Short-term wind speed forecasting based on long short-term memory and improved BP neural network. International Journal of Electrical Power & Energy Systems 134: 107365. https://doi.org/10.1016/j.ijepes.2021.107365.

Zhang Z., Wu X., Liao S., and Cheng C., 2022. An ultra-short-term scheduling model for cascade hydropower regulated by multilevel dispatch centers suppressing wind power volatility. International Journal of Electrical Power & Energy Systems 134: 107467. https://doi.org/10.1016/j.ijepes.2021.107467.

Dudek G., 2016. Pattern-based local linear regression models for short-term load forecasting. Electric Power Systems Research 130: 139-14.

Pao H.T., 2006. Comparing linear and nonlinear forecasts for Taiwan's electricity consumption. Energy 31(12): 2129-2141. https://doi.org/10.1016/j.energy.2005.08.010.

Lee C.M. and C.N. Ko. 2011. Short-term load forecasting using lifting scheme and ARIMA models. Expert Systems with Applications 38(5): 5902-5911.

Cadenas E., Jaramillo O.A., and Rivera W., 2010. Analysis and forecasting of wind velocity in chetumal, quintana roo, using the single exponential smoothing method. Renewable Energy 35(5): 925-930.

Saab S., Badr E., and Nasr G., 2001. Univariate modeling and forecasting of energy consumption: the case of electricity in Lebanon. Energy 26(1): 1-14. https://doi.org/10.1016/S0360-5442(00)00049-9.

Zhu S., Wang J., Zhao W., and Wang J., 2011. A seasonal hybrid procedure for electricity demand forecasting in China. Applied Energy (88)11: 3807-3815.https://doi.org/10.1016/j.apenergy.2011.05.005.

Wang Y., Wang J., Zhao G., and Dong Y., 2012. Application of residual modification approach in seasonal ARIMA for electricity demand forecasting: A case study of China. Energy Policy 48: 284-294.

Hickey E., Loomis D.G., and Mohammadi H., 2011. Forecasting hourly electricity prices using ARMAX–GARCH models: An application to MISO hubs. Energy Economics 34(1): 307-315. https://doi.org/10.1016/j.eneco.2011.11.011.

Niu D., Wang Y., and Dash Wu D., 2010. Power load forecasting using support vector machine and ant colony optimization. Expert Systems with Applications (37)3: 2531-2539. https://doi.org/10.1016/j.eswa.2009.08.019.

Behrang M.A., Assareh E., Assari M.R., and Ghanbarzadeh A., 2011. Using bees algorithm and artificial neural network to forecast world carbon dioxide emission. Energy Sources, Part A: Recovery, Utilization, and Environmental Effects 33(19): 1747-1759.

Hong W.C., 2011. Electric load forecasting by seasonal recurrent SVR (support vector regression) with chaotic artificial bee colony algorithm. Energy 36(9): 5568-5578. https://doi.org/10.1016/j.energy.2011.07.015.

Salami M.; Movahedi Sobhani F.; and Ghazizadeh, M.S., 2018. Short-term forecasting of electricity supply and demand by using the wavelet-PSO-NNs-SO technique for searching in big data of Iran’s electricity market. Data 3, 43. https://doi.org/10.3390/data3040043

Ju F.Y. and W.C. Hong. 2013. Application of seasonal SVR with chaotic gravitational search algorithm in electricity forecasting. Applied Mathematical Modelling 37(23): 9643-9651. https://doi.org/10.1016/j.apm.2013.05.016.

Salami M., Movahedi Sobhani F., Ghazizadeh M.S., and Sadegh M., 2019. Shared subscribe hyper simulation optimization (SUBHSO) algorithm for clustering big data – using big databases of Iran electricity market. Applied Computer Systems 24(1): 49-60. https://doi.org/10.2478/acss-2019-0007.

Guo X., Gao Y., Li Y., Zheng D., and Shan D., 2021. Short-term household load forecasting based on Long- and Short-term time-series network, Energy Reports 7(1): 58-64. https://doi.org/10.1016/j.egyr.2021.02.023.

Liang Y., Niu D., and Hong W.C., 2019. Short term load forecasting based on feature extraction and improved general regression neural network model. Energy 166: 653-663. https://doi.org/10.1016/j.energy.2018.10.119.

Salami M., Movahedi Sobhani F., and Ghazizadeh M.S., 2020. A hybrid short-term load forecasting model developed by factor and feature selection algorithms using improved grasshopper optimization algorithm and principal component analysis. Electrical Engineering 102: 437–460. https://doi.org/10.1007/s00202-019-00886-7.

Díaz-Robles L.A., Ortega J.C., Fu J.S., Reed G.D., Chow J.C., Watson J.G., and Moncada-Herrera J.A., 2008. A hybrid ARIMA and artificial neural networks model to forecast particulate matter in urban areas: The case of Temuco, Chile. Atmospheric Environment 42(35): 8331-8340, https://doi.org/10.1016/j.atmosenv.2008.07.020.

Zhang J., Wei Y.M., Li D., Tan Z., and Zhou J., 2018. Short term electricity load forecasting using a hybrid model. Energy 158: 774-781. https://doi.org/10.1016/j.energy.2018.06.012.

Wang Y., Gan D., Sun M., Zhang N., Lu Z., and Kang C., 2019. Probabilistic individual load forecasting using pinball loss guided LSTM. Applied Energy 235: 10-20. https://doi.org/10.1016/j.apenergy.2018.10.078.

Qin J., Zhang Y., Fan S., Hu X., Huang Y., Lu Z., and Liu Y., 2022. Multi-task short-term reactive and active load forecasting method based on attention-LSTM model. International Journal of Electrical Power & Energy Systems 135: 107517, https://doi.org/10.1016/j.ijepes.2021.107517.

Memarzadeh G. and F. Keynia. 2021. Short-term electricity load and price forecasting by a new optimal LSTM-NN based prediction algorithm. Electric Power Systems Research 192: 106995, https://doi.org/10.1016/j.epsr.2020.106995.

Mughees N., Mohsin S.Y., Mughees A., and Mughees A., 2021. Deep sequence to sequence Bi-LSTM neural networks for day-ahead peak load forecasting. Expert Systems with Applications 175: 114844.

Kumar Dubey A., Kumar A., García-Díaz V., Sharma A. K., and Kanhaiya K., 2021. Study and analysis of SARIMA and LSTM in forecasting time series data. Sustainable Energy Technologies and Assessments 47: 101474. https://doi.org/10.1016/j.seta.2021.101474.

Guo X., Zhao Q., Zheng D., Ning Y., Gao Y., 2020. A short-term load forecasting model of multi-scale CNN-LSTM hybrid neural network considering the real-time electricity price. Energy Reports 6(9): 1046-1053. https://doi.org/10.1016/j.egyr.2020.11.078.

Zang H., Xu R., Cheng L., Ding T., Liu L., Wei Z., Sun G., 2021. Residential load forecasting based on LSTM fusing self-attention mechanism with pooling. Energy 229: 120682. https://doi.org/10.1016/j.energy.2021.120682.

Salami M., Niakan M.R. and Hasani M., 2021. Electricity load forecasting: a new hybrid model combining wavelet transform, genetic algorithm and LSTM models. In 2021 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME), pp. 1-6, doi: 10.1109/ICECCME52200.2021.9591091.

Kychkin A.V. and G.C. Chasparis. 2021. Feature and model selection for day-ahead electricity-load forecasting in residential buildings. Energy and Buildings 249: 111200.

Ghadimi N., Akbarimajd A., Shayeghi H., Abedinia O., 2018. Two stage forecast engine with feature selection technique and improved meta-heuristic algorithm for electricity load forecasting. Energy 161: 130-142.

Dai Y. and P. Zhao. 2020. A hybrid load forecasting model based on support vector machine with intelligent methods for feature selection and parameter optimization. Applied Energy 279: 115332.

Xie W., Wang L., Yu K., Shi T., and Li W., 2023. Improved multi-layer binary firefly algorithm for optimizing feature selection and classification of microarray data. Biomedical Signal Processing and Control 79(Part 1): 104080.

Hu Z., Bao Y., Chiong R., and Xiong T., 2015. Mid-term interval load forecasting using multi-output support vector regression with a memetic algorithm for feature selection. Energy 84: 419-431. https://doi.org/10.1016/j.energy.2015.03.054.

Hu Z., Bao Y., Chiong R., and Xiong T., 2015. Mid-term interval load forecasting using multi-output support vector regression with a memetic algorithm for feature selection. Energy 84: 419-431. https://doi.org/10.1016/j.energy.2015.03.054.

Sungkono, Bahri A.S., Warnana D.D., Monteiro Santos F.A., Santosa B.J., 2014. Fast, simultaneous and robust VLF-EM data denoising and reconstruction via multivariate empirical mode decomposition. Computers & Geosciences 67: 125-138. https://doi.org/10.1016/j.cageo.2014.03.007.

Tawhid M.A. and A.M. Ibrahim. 2021. Solving nonlinear systems and unconstrained optimization problems by hybridizing whale optimization algorithm and flower pollination algorithm, Mathematics and Computers in Simulation 190: 1342-1369.

Lee L.C. and A.A. Jemain. 2021. On overview of PCA application strategy in processing high dimensionality forensic data. Microchemical Journal 169: 106608.

Chen J., Rong Y., Zhu Q., Chandra B., and Zhong H., 2021. A generalized minimal residual based iterative back propagation algorithm for polynomial nonlinear models. Systems & Control Letters 153: 104966.

Mallat S., 1989. A theory for multiresolution signal decomposition: the wavelet representation. IEEE Transaction on Pattern Analysis and Machine Intelligence 11(7): 674-693.

Conejo A., Plazas M., Espinola R., Molina A., 2005. Day-ahead electricity price forecasting using wavelet transform and ARIMA models. IEEE Transaction on Power Systems 20(2): 1035-1042.

Reis A. and A. da Silva. 2005. Feature extraction via multiresolution analysis for short term load forecasting. IEEE Transaction on Power Systems 20(1): 189-198.

Bowden N. and J.E. Payne. 2008. Short term forecasting of electricity prices for MISO hubs: Evidence from ARIMA-EGARCH models. Energy Economics 30(6) 3186-3197.

Tawhid M.A. and A.M. Ibrahim. 2021. Solving nonlinear systems and unconstrained optimization problems by hybridizing whale optimization algorithm and flower pollination algorithm. Mathematics and Computers in Simulation 190: 1342-1369.

Nourani V. and N. Behfar. 2021. Multi-station runoff-sediment modeling using seasonal LSTM models. Journal of Hydrology 601: 126672.

Willmott C.J., 1982. Some comments on the evaluation of model performance. Bull. Am. Meteorol. Soc. 63: 1309–1313.

Bagkavos D. and P.N. Patil. 2021. Improving the Wilcoxon signed rank test by a kernel smooth probability integral transformation. Statistics & Probability Letters 171: 109026. https://doi.org/10.1016/j.spl.2020.109026.