Artificial intelligence

Scientific journal

ISSN 2710-1673

ONLINE: ISSN 2710-1681

Select your language


Using AI for Real-Time Big Data Processing and Analysis with Integration of Multi-Agent Systems

Pisarenko U.1, Karmazin K.1
1 V.M. Hlushkov Institute of Cybernetics of NAS of Ukraine
pisarenkojv@gmail.com; kirillkarmazin2301@gmail.com

Full text (PDF)

UDC: 004.8
Publication Language: Ukrainian
Stuc. intelekt. 2025; 30(4):134-145

Abstract: This paper presents an integrated approach to real-time processing and analysis of large-scale data streams using artificial intelligence methods, multi-agent systems, and multi-layered control architectures. Particular attention is devoted to combining technologies that are traditionally applied separately: unmanned aerial vehicle (UAV) control systems, situational centers, streaming video services, and distributed sensor networks. The proposed model accounts for the stochastic nature of the environment, the dynamic behaviour of data flows, and resource constraints, which are critical factors for real-time systems. The study develops a multi-level multi-agent architecture that includes central, regional, and edge nodes, as well as local agents such as drones, sensors, and client-side video devices. A mathematical formalization of agent interaction and reward functions is proposed to ensure a balance between service quality, latency, packet loss, and energy consumption. The use of multi-agent reinforcement learning (MARL) algorithms is introduced to support adaptive decision-making in real time, along with the development of a digital twin of the environment for predicting future system states using deep and generative models. The results demonstrate that the integration of edge computing, hierarchical decision-making, and local agent autonomy significantly enhances system resilience, provides stable performance under external disturbances, and enables effective infrastructure scaling. The findings form a scientific foundation for designing adaptive, robust, and self-learning next-generation digital ecosystems capable of intelligent processing of large data streams in real time.

Keywords: artificial intelligence, multi-agent systems, real-time data processing, unmanned aerial vehicles, edge computing, reinforcement learning, video streaming, quality of experience (QoE), system resilience.

References:

  1. Pisarenko, J., & Melkumyan, E. (2019). The structure of the information storage “CONTROL_TEA” for UAV applications. IEEE 5th International Conference on Actual Problems of Unmanned Aerial Vehicles Developments (APUAVD), 274–277. https://doi.org/10.1109/APUAVD47061.2019.8943938
  2. Melkumian, K., Pisarenko, J., & Koval, A. (2021). Organization of regional situational centers of the intelligent system “CONTROL_TEA” using UAVs. IEEE 6th International Conference on Actual Problems of Unmanned Aerial Vehicles Developments (APUAVD). https://doi.org/10.1109/APUAVD53804.2021.961541
  3. Pisarenko, J., Melkumyan, K., Varava, I., Koval, O., & Chumakova, N. (2022). About the organization of regional situational centers of the intellectual system “CONTROL_TEA” with the use of UAVs. Artificial Intelligence, (1), 275–287. https://doi.org/10.15407/jai2022.01.275
  4. Artioli, E. (2024). Generative AI for HTTP adaptive streaming. In Proceedings of the 15th ACM Multimedia Systems Conference (MMSys ’24) (pp. 516–519). Association for Computing Machinery. https://doi.org/10.1145/3625468.3652912
  5. Wang, Y., Aggarwal, V., & Lan, T. (2022). Learning-based online QoE optimization in multi-agent video streaming. Algorithms, 15(7). https://doi.org/10.3390/a15070227
  6. Li, Y., Zheng, Q., Zhang, Z., et al. (2023). Improving ABR performance for short video streaming using multi-agent reinforcement learning with expert guidance. Proceedings of the 2023 ACM Conference on Multimedia Systems. https://doi.org/10.48550/arXiv.2304.04637
  7. Souane, N., Bourenane, M., & Douga, Y. (2023). Deep-reinforcement-learning-based approach for video streaming: Dynamic adaptive video streaming over HTTP. Applied Sciences, 13(21). https://doi.org/10.3390/app132111697
  8. Ajeyprasaath, K. B., & Vetrivelan, P. (2024). A hybrid machine learning approach for improvised QoE in video services over 5G wireless networks. Computers, Materials & Continua, 78, 3195–3213. https://doi.org/10.32604/cmc.2023.046911
  9. Peroni, L., & Gorinsky, S. (2025). An end-to-end pipeline perspective on video streaming in best-effort networks: A survey and tutorial. ACM Computing Surveys, 57. https://doi.org/10.1145/3742472
  10. Tang, X., Chen, F., & He, Y. (2023). Intelligent video streaming at network edge: An attention-based multiagent reinforcement learning solution. Future Internet, 15. https://doi.org/10.3390/fi15070234
  11. Duo, W., Panlong, W., Miao, Z., & Fangxin, W. (2025). MANSY: Generalizing neural adaptive immersive video streaming with ensemble and representation learning. IEEE Transactions on Mobile Computing, 24, 1654–1668. https://doi.org/10.1109/TMC.2024.3487175
  12. Haopeng, W., Zijian, L., Haiwei, D., & Abdulmotaleb, S. (2024). MADRL-based rate adaptation for 360° video streaming with multi-viewpoint prediction. IEEE Internet of Things Journal, 11, 26503–26517. https://doi.org/10.1109/JIOT.2024.3398548
  13. Alireza, M., Chakareski, J., & Mastronarde, N. (2025). ASL360: AI-enabled adaptive streaming of layered 360° video over UAV-assisted wireless networks. IEEE Global Communications Conference. https://doi.org/10.48550/arXiv.2509.10544
  14. Hwang, S., Lee, H., Kim, M., & Lee, I. (2023). Multi-agent deep reinforcement learning for decentralized multi-UAV mobile edge computing networks. IEEE Internet of Things Journal. https://doi.org/10.1109/JIOT.2025.3527016
  15. Jing, Y., Guo, B., Nuo, L., Ruonan, X., & Zhiwen, Y. (2025). Federated multi-agent reinforcement learning: A comprehensive survey of methods, applications and challenges. Expert Systems with Applications, 293. https://doi.org/10.1016/j.eswa.2025.128729

View full text (PDF)