Artificial intelligence

Abstract: The problem of forecasting electricity generation is key to enabling decision-making support at the level of individual prosumers in the power grid and efficient prosumer integration into the grid. This study investigates the application of machine learning (ML) approaches to photovoltaic generation forecasting, aiming to provide general practical recommendations for the development of applied forecasting solutions. To this end, a specific use case was considered in the context of a private household with a photovoltaic installation, where data was gathered for several years. Based on the experimental results, a set of recommendations for applying ML models to photovoltaic generation forecasting tasks was formulated in the context of prosumer decision support. These recommendations address key aspects such as training and test data sizes used in the model creation process, and prediction horizon size used in the prediction process. In addition, guidelines on model file size were developed from the perspective of practical model utilization in specific use cases. This research demonstrates that establishing universal guidelines for ML model utilization in the Power System (PS) domain is both beneficial and achievable. It also highlights opportunities for further research on developing solutions for automated recommendations for required training data sizes and prediction horizons.

Keywords: machine learning, photovoltaic generation, generation forecasting, decision support, prosumer.

References:

1. Alotaibi, I., Abido, M. A., Khalid, M., & Savkin, A. V. (2020). A Comprehensive Review of Recent Advances in Smart Grids: A Sustainable Future with Renewable Energy Resources. Energies, 13(23), 6269. https://doi.org/10.3390/en13236269
2. Benti, N. E., Chaka, M. D., & Semie, A. G. (2023). Forecasting Renewable Energy Generation with Machine Learning and Deep Learning: Current Advances and Future Prospects. Sustainability, 15(9), 7087. https://doi.org/10.3390/su15097087
3. Bergstra, J., & Bengio, Y. (2012). Random search for hyper-parameter optimization. Journal of Machine Learning Research, 13.
4. Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., Deng, D., & Lindauer, M. (2023). Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. WIREs Data Mining and Knowledge Discovery, 13(2). https://doi.org/10.1002/widm.1484
5. Chomać-Pierzecka, E., Rogozińska-Mitrut, J., Różycka, M., Soboń, D., & Stasiak, J. (2023). Energy Innovation for Individual Consumers in Poland – Analysis of Potential and Evaluation of Practical Applications in Selected Areas. Energies, 16(15), 5766. https://doi.org/10.3390/en16155766
6. Costa, R. L. de C. (2022). Convolutional-LSTM networks and generalization in forecasting of household photovoltaic generation. Engineering Applications of Artificial Intelligence, 116, 105458. https://doi.org/10.1016/j.engappai.2022.105458
7. Dimeas, A., Drenkard, S., Hatziargyriou, N., Karnouskos, S., Kok, K., Ringelstein, J., & Weidlich,A. (2014). Smart Houses in the Smart Grid: Developing an interactive network. IEEE Electrification Magazine, 2(1), 81–93. https://doi.org/10.1109/MELE.2013.2297032
8. Dorado-Rojas, S. A., Bogodorova, T., & Vanfretti, L. (2021). Time Series-Based Small-Signal Stability Assessment using Deep Learning. 2021 North American Power Symposium (NAPS), 1–6. https://doi.org/10.1109/NAPS52732.2021.9654643
9. Gan, L., Jiang, P., Lev, B., & Zhou, X. (2020). Balancing of supply and demand of renewable energy power system: A review and bibliometric analysis. Sustainable Futures, 2, 100013. https://doi.org/10.1016/j.sftr.2020.100013
10. Grimaldo, A. I., & Novak, J. (2020). Combining Machine Learning with Visual Analytics for Explainable Forecasting of Energy Demand in Prosumer Scenarios. Procedia Computer Science, 175, 525–532. https://doi.org/10.1016/j.procs.2020.07.07
11. Gržanić, M., Capuder, T., Zhang, N., & Huang, W. (2022). Prosumers as active market participants: A systematic review of evolution of opportunities, models and challenges. Renewable and Sustainable Energy Reviews, 154, 111859. https://doi.org/10.1016/j.rser.2021.111859
12. Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., Kern, R., Picus, M., Hoyer, S., van Kerkwijk, M. H., Brett, M., Haldane, A., del Río, J. F., Wiebe, M., Peterson, P., … Oliphant, T. E. (2020). Array programming with NumPy. Nature, 585(7825), 357–362. https://doi.org/10.1038/s41586-020-2649-2
13. Hu, J.-L., & Chuang, M.-Y. (2023). The Importance of Energy Prosumers for Affordable and Clean Energy Development: A Review of the Literature from the Viewpoints of Management and Policy. Energies, 16(17), 6270. https://doi.org/10.3390/en16176270
14. Hunter, J. D. (2007). Matplotlib: A 2D Graphics Environment. Computing in Science & Engineering, 9(3), 90–95. https://doi.org/10.1109/MCSE.2007.55
15. Jing, X., Song, M., Gao, C., Wang, C., Li, L., & Liu, W. (2022). Analysis of the decision-making process of prosumers in the transactive energy market : From the perspective of traditional economics and behavioral economics. 2022 IEEE 5th International Electrical and Energy Conference (CIEEC), 4679–4684. https://doi.org/10.1109/CIEEC54735.2022.9846116
16. Jozi, A., Pinto, T., Praça, I., & Vale, Z. (2019). Decision Support Application for Energy Consumption Forecasting. Applied Sciences, 9(4), 699. https://doi.org/10.3390/app9040699
17. Karande, P., Gallagher, B., & Han, T. Y.-J. (2022). A Strategic Approach to Machine Learning for Material Science: How to Tackle Real-World Challenges and Avoid Pitfalls. Chemistry of Materials, 34(17), 7650–7665. https://doi.org/10.1021/acs.chemmater.2c01333
18. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., & Liu, T. Y. (2017). LightGBM: A highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems, 2017-December.
19. Koltsaklis, N., Panapakidis, I. P., Pozo, D., & Christoforidis, G. C. (2021). A Prosumer Model Based on Smart Home Energy Management and Forecasting Techniques. Energies, 14(6), 1724. https://doi.org/10.3390/en14061724
20. Lopes, J. A. P., Madureira, A. G., Matos, M., Bessa, R. J., Monteiro, V., Afonso, J. L., Santos, S. F., Catalão, J. P. S., Antunes, C. H., & Magalhães, P. (2020). The future of power systems: Challenges, trends, and upcoming paradigms. WIREs Energy and Environment, 9(3). https://doi.org/10.1002/wene.368
21. Lukianykhin, O., & Bogodorova, T. (2021). Voltage Control-Based Ancillary Service Using Deep Reinforcement Learning. Energies, 14(8), 2274. https://doi.org/10.3390/en14082274
22. Lukianykhin, O., Shendryk, V., Shendryk, S., & Malekian, R. (2024). Promising AI Applications in Power Systems: Explainable AI (XAI), Transformers, LLMs. In International Conference “New Technologies, Development and Applications” (pp. 66–76). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-66271-3_8
23. McKinney, W. (2010). Data Structures for Statistical Computing in Python. Proceedings of the 9th Python in Science Conference, 56–61. https://doi.org/10.25080/Majora-92bf1922-00a
24. Mellit, A., Massi Pavan, A., Ogliari, E., Leva, S., & Lughi, V. (2020). Advanced Methods for Photovoltaic Output Power Forecasting: A Review. Applied Sciences, 10(2), 487. https://doi.org/10.3390/app10020487
25. Melo, F. C., Carrilho da Graça, G., & Oliveira Panão, M. J. N. (2023). A review of annual, monthly, and hourly electricity use in buildings. Energy and Buildings, 293, 113201. https://doi.org/10.1016/j.enbuild.2023.113201
26. Mohammadi, E., Alizadeh, M., Asgarimoghaddam, M., Wang, X., & Simoes, M. G. (2022). A Review on Application of Artificial Intelligence Techniques in Microgrids. IEEE Journal of Emerging and Selected Topics in Industrial Electronics, 3(4), 878–890. https://doi.org/10.1109/JESTIE.2022.3198504
27. Muttaqi, K. M., Islam, Md. R., & Sutanto, D. (2019). Future Power Distribution Grids: Integration of Renewable Energy, Energy Storage, Electric Vehicles, Superconductor, and Magnetic Bus. IEEE Transactions on Applied Superconductivity, 29(2), 1–5. https://doi.org/10.1109/TASC.2019.2895528
28. Natarajan, V. A., & Karatampati, P. (2019). Survey on renewable energy forecasting using different techniques. 2019 2nd International Conference on Power and Embedded Drive Control (ICPEDC), 349–354. https://doi.org/10.1109/ICPEDC47771.2019.9036569
29. Olson, R. S., Cava, W. La, Mustahsan, Z., Varik, A., & Moore, J. H. (2018). Data-driven advice for applying machine learning to bioinformatics problems. Biocomputing 2018, 0(212669), 192–203. https://doi.org/10.1142/9789813235533_0018
30. Panapakidis, I. P., Koltsaklis, N. E., & Christoforidis, G. C. (2021). Forecasting Methods to Support the Decision Framework of Prosumers in Deregulated Markets. 2021 9th International Conference on Modern Power Systems (MPS), 1–5. https://doi.org/10.1109/MPS52805.2021.9492725
31. Parag, Y., & Sovacool, B. K. (2016). Electricity market design for the prosumer era. Nature Energy, 1(4), 16032. https://doi.org/10.1038/nenergy.2016.32
32. Parra-Domínguez, J., Sánchez, E., & Ordóñez, Á. (2023). The Prosumer: A Systematic Review of the New Paradigm in Energy and Sustainable Development. Sustainability, 15(13), 10552. https://doi.org/10.3390/su151310552
33. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Cournapeau, D., Brucher, M., & Perrot, M. (2011). Scikit-learn: Machine Learning in Python Pedregosa, Varoquaux, Gramfort et al. Journal of Machine Learning Research, 12. https://doi.org/10.5555/1953048.2078195
34. Peng, F. Z., Liu, C.-C., Li, Y., Jain, A. K., & Vinnikov, D. (2024). Envisioning the Future Renewable and Resilient Energy Grids – A Power Grid Revolution Enabled by Renewables, Energy Storage, and Energy Electronics. IEEE Journal of Emerging and Selected Topics in Industrial Electronics, 5(1), 8–26. https://doi.org/10.1109/JESTIE.2023.3343291
35. Petrican, T., Vesa, A. V., Antal, M., Pop, C., Cioara, T., Anghel, I., & Salomie, I. (2018). Evaluating Forecasting Techniques for Integrating Household Energy Prosumers into Smart Grids. 2018 IEEE 14th International Conference on Intelligent Computer Communication and Processing (ICCP), 79–85. https://doi.org/10.1109/ICCP.2018.8516617
36. Piekut, M. (2021). The Consumption of Renewable Energy Sources (RES) by the European Union Households between 2004 and 2019. Energies, 14(17), 5560. https://doi.org/10.3390/en14175560
37. Pirbazari, A. M. (2021). Predictive Analytics for Maintaining Power System Stability in Smart Energy Communities. In Predictive Analytics for Maintaining Power System Stability in Smart Energy Communities. University of Stavanger. https://doi.org/10.31265/usps.83
38. Priestley, M., O’donnell, F., & Simperl, E. (2023). A Survey of Data Quality Requirements That Matter in ML Development Pipelines. Journal of Data and Information Quality, 15(2), 1–39. https://doi.org/10.1145/3592616
39. Rahman, M. S., Khomh, F., Hamidi, A., Cheng, J., Antoniol, G., & Washizaki, H. (2023). Machine learning application development: practitioners’ insights. Software Quality Journal, 31(4), 1065–1119. https://doi.org/10.1007/s11219-023-09621-9
40. Rai, A., Shrivastava, A., & Jana, K. C. (2023). An Empirical Analysis of Machine Learning Algorithms for Solar Power Forecasting in a High Dimensional Uncertain Environment. IETE Technical Review, 40(4), 558–573. https://doi.org/10.1080/02564602.2022.2136270
41. Scarabaggio, P., Grammatico, S., Carli, R., & Dotoli, M. (2022). Distributed Demand Side Management With Stochastic Wind Power Forecasting. IEEE Transactions on Control Systems Technology, 30(1), 97–112. https://doi.org/10.1109/TCST.2021.3056751
42. Schultz, B. G., Joukhadar, Z., Nattala, U., Quiroga, M. del M., Bolk, F., & Vogel, A. P. (2021). Best practices for supervised machine learning when examining biomarkers in clinical populations. In Big Data in Psychiatry #x0026; Neurology (pp. 1–34). Elsevier. https://doi.org/10.1016/B978-0-12-822884-5.00013-1
43. Smith, T. G. (2017). pmdarima: ARIMA estimators for Python. https://www.alkaline-ml.com/pmdarima/
44. Sobri, S., Koohi-Kamali, S., & Rahim, N. Abd. (2018). Solar photovoltaic generation forecasting methods: A review. Energy Conversion and Management, 156, 459–497. https://doi.org/10.1016/j.enconman.2017.11.019
45. Solea, C., Hera, C., Florea, A., Morariu, D., Stanescu, D., & Vintan, M. (2024). A Comparative Study on Prosumers Load Demand and Production Forecasting Using Machine Learning and Time Series Techniques. 2024 International Conference on Applied and Theoretical Electricity (ICATE), 1–7. https://doi.org/10.1109/ICATE62934.2024.10749434
46. Soman, S. S., Zareipour, H., Malik, O., & Mandal, P. (2010). A review of wind power and wind speed forecasting methods with different time horizons. North American Power Symposium 2010, 1–8. https://doi.org/10.1109/NAPS.2010.5619586
47. Taik, A., Nour, B., & Cherkaoui, S. (2021). Empowering Prosumer Communities in Smart Grid with Wireless Communications and Federated Edge Learning. IEEE Wireless Communications, 28(6), 26–33. https://doi.org/10.1109/MWC.017.2100187
48. Teixeira, R., Cerveira, A., Pires, E. J. S., & Baptista, J. (2024). Advancing Renewable Energy Forecasting: A Comprehensive Review of Renewable Energy Forecasting Methods. Energies, 17(14), 3480. https://doi.org/10.3390/en17143480
49. Triantafyllou, A., Jimenez, J. A. P., Torres, A. D. R., Lagkas, T., Rantos, K., & Sarigiannidis, P. (2020). The Challenges of Privacy and Access Control as Key Perspectives for the Future Electric Smart Grid. IEEE Open Journal of the Communications Society, 1, 1934–1960. https://doi.org/10.1109/OJCOMS.2020.3037517
50. Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt, S. J., Brett, M., Wilson, J., Millman, K. J., Mayorov, N., Nelson, A. R. J., Jones, E., Kern, R., Larson, E., … Vázquez-Baeza, Y. (2020). SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature Methods, 17(3), 261–272. https://doi.org/10.1038/s41592-019-0686-2
51. Xie, Y., Li, C., Li, M., Liu, F., & Taukenova, M. (2023). An overview of deterministic and probabilistic forecasting methods of wind energy. IScience, 26(1), 105804. https://doi.org/10.1016/j.isci.2022.105804