Штучний інтелект

Анотація: In this paper we discuss the on-going joint work contributing to the IIASA (International Institute for Applied Systems Analysis, Laxenburg, Austria) and National Academy of Science of Ukraine projects on “Modeling and management of dynamic stochastic interdependent systems for food-water-energy-health security nexus” (see [1-2] and references therein). The project develops methodological and modeling tools aiming to create Intelligent multimodel Decision Support System (IDSS) and Platform (IDSP), which can integrate national Food, Water, Energy, Social models with the models operating at the global scale (e.g., IIASA GLOBIOM and MESSAGE), in some cases ‘downscaling’ the results of the latter to a national level. Data harmonization procedures rely on new type non-smooth stochastic optimization and stochastic quasigradient (SQG) [3-4] methods for robust of-line and on-line decisions involving large-scale machine learning and Artificial Intelligence (AI) problems in particular, Deep Learning (DL) including deep neural learning or deep artificial neural network (ANN). Among the methodological aims of the project is the development of “Models’ Linkage” algorithms which are in the core of the IDSS as they enable distributed models’ linkage and data integration into one system on a platform [5-8]. The linkage algorithms solve the problem of linking distributed models, e.g., sectorial and/or regional, into an inter-sectorial inter-regional integrated models. The linkage problem can be viewed as a general endogenous reinforced learning problem of how software agents (models) take decisions in order to maximize the “cumulative reward". Based on novel ideas of systems’ linkage under asymmetric information and other uncertainties, nested strategic-operational and local-global models are being developed and used in combination with, in general, non-Bayesian probabilistic downscaling procedures. In this paper we illustrate the importance of the iterative “learning” solution algorithms based on stochastic quasigradient (SQG) procedures for robust of-line and on-line decisions involving large-scale Machine Learning, Big Data analysis, Distributed Models Linkage, and robust decision-making problems. Advanced robust statistical analysis and machine learning models of, in general, nonstationary stochastic optimization allow to account for potential distributional shifts, heavy tails, and nonstationarities in data streams that can mislead traditional statistical and machine learning models, in particular, deep neural learning or deep artificial neural network (ANN). Proposed models and methods rely on probabilistic and non-probabilistic (explicitly given or simulated) distributions combining measures of chances, experts’ beliefs and similarity measures (for example, compressed form of the kernel estimators). For highly nonconvex models such as the deep ANN network, the SQGs allow to avoid local solutions. In cases of nonstationary data, the SQGs allow for sequential revisions and adaptation of parameters to the changing environment, possibly, based on of-line adaptive simulations. The non-smooth STO approaches and SQG-based iterative solution procedures are illustrated with examples of robust estimation, models’ linkage, machine learning, adaptive Monte Carlo optimization for cat risks (floods, earthquakes, etc.) modeling and management.

Ключові слова: Intelligent multimodel Decision Support System (IDSS), Platform (IDSP), neural network (ANN)

Посилання:

1. Zagorodny A.G., Ermoliev Y.M., & Bogdanov V.L. (Eds.) Integrated Management, Security and Robustness. NASU, ISBN 978-966-02-7376-4, 2014.
2. Zagorodny, A.G., Ermoliev, Yu.N., Bogdanov, V.L., Ermolieva, T. Integrated modeling and management of Food-Energy-Water NEXUS for sustainable development. Kiev, Ukraine: Committee for Systems Analysis at Presidium of National Academy of Sciences of Ukraine — National Member Organization of Ukraine in International Institute for Applied Systems Analysis (IIASA). ISBN 978-966-02-9344-1, 2020.
3. Ermoliev Y. Two-stage stochastic programming: Stochastic quasigradient methods. In: Encyclopedia of Optimization; Floudas, C.A., Pardalos, P.M., Eds.; Springer-Verlag, New York, USA, 2009, pp. 3955-3959.
4. Ermoliev, Y., Wets, RJ-B. Numerical techniques for stochastic optimization. - Springer Verlag, Heidelberg, Germany, 1988.
5. Ermoliev Y.M., Zagorodny A.G., Bogdanov V.L., Ermolieva T., Havlik P., Obersteiner M., et al. Linking distributed sectorial and regional optimization models under asymmetric information: towards robust food-water-energy-environmental nexus. In: Integrated modeling and management of Food-Energy-Water NEXUS for sustainable development. Eds. Zagorodny, A.G., Ermoliev, Yu.N., Bogdanov, V.L., Ermolieva, T., Kiev, Ukraine. ISBN 978-966-02-9344-1, 2020.
6. Ermoliev, Y., Zagorodny, A.G., Bogdanov, V.L., Ermolieva, T., Havlik, P., Rovenskaya, E., Komendantova, N., & Obersteiner, M. (2022). Linking Distributed Optimization Models for Food, Water, and Energy Security Nexus Management. Sustainability 14 (3) e1255. 10.3390/su14031255.
7. Ermolieva, T., Havlik, P., Frank, S., Kahil, T., Balkovič, J., Skalský, R., Ermoliev, Y., Knopov, P.S., et al. (2022). A Risk-Informed Decision-Making Framework for Climate Change Adaptation through Robust Land Use and Irrigation Planning. Sustainability 14 (3) p. 1430. 10.3390/su14031430.
8. Ermoliev, Y., Zagorodny, A.G., Bogdanov, V. L., Ermolieva, T., Havlik, P., Rovenskaya, E., Komendantova, N., & Obersteiner, M. (2022). Robust Food–Energy–Water–Environmental Security Management: Stochastic Quasigradient Procedure for Linkage of Distributed Optimization Models under Asymmetric Information and Uncertainty. Cybernetics and Systems Analysis 58 (1) 45-57. 10.1007/s10559-022-00434-5.
9. Ermoliev, Y., Norkin, V. On nonsmooth and discontinuous problems of stochastic systems optimization. Eur. J. Oper. Res. 1997, 101(2), 230–244.