Artificial intelligence techniques for real-time visualisation of big data graph models
Andrii Banyk, Pavlo MulesaThe purpose of the study was to develop approaches to the use of artificial intelligence to improve the processes of interactive visualisation of graph structures of big data in real time, considering the optimisation of computing resources. During the study, graphs were constructed for analysing relationships in big data, and computational intelligence methods were used to optimise the processing and visualisation of graphs in an interactive format. The results of the study included the development of programmes for building graph structures in Python in the Visual Studio Code environment and their further visualisation in Unity using C# in Visual Studio. First, a visualisation of a random Erdos-Renyi-type graph was shown, which was then recreated in Unity 3D space. Using Python libraries, graph generation and interactive web visualisation were implemented. Machine learning methods were used to optimise the location of nodes in graphs, in particular, autoencoders and principal components to reduce dimension. A demonstration of the Barbashi-Albert model allowed seeing the clustering of nodes and their relationships in real time. In addition, interactive visualisation was demonstrated, where nodes were located in 2D space according to the results of the principal components analysis. The use of the Louvain algorithm helped to perform clustering and visualise the structure of communities. The results showed that the use of neural networks significantly improves the accuracy and efficiency of node placement in graphs, and reduces computational complexity. The results obtained can be useful for scientific research involving the analysis of large graph structures and requiring interactive data visualisation
References
[1] Bellmann, L., Wiederhold, A.J., Trübe, L., Twerenbold, R., Ückert, F., & Gottfried, K. (2024). Introducing attribute association graphs to facilitate medical data exploration: Development and evaluation using epidemiological study data. JMIR Medical Informatics, 12, article number e49865. doi: 10.2196/49865.
[2] Çınar, D. (2024). The role of artificial intelligence and big data analytics in business management: A review of decision – making and strategic planning. Journal of Tourism Economics and Business Research, 6(2), 219-229.
[3] Devi, M., & Kasireddy, S.R. (2019). Graph analysis and visualization of social network big data. In Social network forensics, cyber security, and machine learning. springerbriefs in applied sciences and technology (pp. 93-104). Singapore: Springer. doi: 10.1007/978-981-13-1456-8_8.
[4] Devineni, S.K. (2024). AI-enhanced data visualization: Transforming complex data into actionable insights. Journal of Technology and Systems, 6(3), 52-77. doi: 10.47941/jts.1911.
[5] Di, L., & Yu, E. (2023). Big data analytic platforms. In Remote sensing big data (pp. 171-194). Cham: Springer. doi: 10.1007/978-3-031-33932-5_10.
[6] Duan, S., & Zhao, Y. (2024). Knowledge graph analysis for chronic diseases nursing based on visualization technology and literature big data. Scalable Computing Practice and Experience, 25(3), 1728-1747. doi: 10.12694/scpe.v25i3.2664.
[7] Gandomi, A.H., Chen, F., & Abualigah, L. (2023). Big data analytics using artificial intelligence. Electronics, 12(4), article number 957. doi: 10.3390/electronics12040957.
[8] Gebretsadik, F., & Patgiri, R. (2023). The major challenges of big graph and their solutions: A review. Advances in Computers, 128, 399-421. doi: 10.1016/bs.adcom.2021.10.010.
[9] Gheorghe, G., & Lorenz, P. (Eds.). (2023). Proceedings of the 3rd international conference on artificial intelligence, big data and algorithms. Advances in Artificial intelligence, big data and algorithms. Amsterdam: IOS Press BV.
[10] Haiyang, X., Ruomei, Y., Yan, W., Lixin, G., & Li, M. (2024). Knowledge graph for solubility big data: Construction and applications. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 15(1), article number e1570. doi: 10.1002/widm.1570.
[11] Janicijevic, S., & Nikolic, V. (2021). Graph structures for data visualizations. Serbian Journal of Engineering Management, 6(2), 24-31.
[12] Kliestik, T., Kral, P., Bugaj, M., & Ďurana, P. (2024). Generative artificial intelligence of things systems, multisensory immersive extended reality technologies, and algorithmic big data simulation and modelling tools in digital twin industrial metaverse. Equilibrium. Quarterly Journal of Economics and Economic Policy, 19(2), 429-461. doi: 10.24136/ eq.3108.
[13] Liu, J., Xie, R., & Song, A. (2019). Analysis on research frontiers and hotspots of “Artificial intelligence plus education” in China – visualization research based on citespace V. IOP Conference Series Materials Science and Engineering, 569, article number 052073. doi: 10.1088/1757-899X/569/5/052073.
[14] Miroshnyk, M., Shkil, O., Rakhlis, D., Pshenychnyi, K., & Miroshnyk, A. (2023). Event processing model for simulation of real-time logic control devices. Bulletin of Cherkasy State Technological University, 28(2), 50-57. https:// doi org/10.24025/2306-4412.2.2023.274840.
[15] Mykolaichuk, R., & Mykolaichuk, A. (2024). Using artificial intelligence technologies for document processing automation. Modern Information Technologies in the Sphere of Security and Defence, 50(2), 111-117. doi: 10.33099/23117249/2024-50-2-111-117.
[16] Noshi, A., & Gasmi, S. (2024). Building efficient knowledge maps through NLP and optimization in big data environments. doi: 10.13140/RG.2.2.11353.53609.
[17] Pankiv, V.I., & Storozhuk, O.L. (2024). The use of neural measurements and advanced techniques for the analysis of large quantities of data in real time. In Forestry education and science: Current challenges and development prospects, international science-practical conference. Lviv: National Polytechnic University of Ukraine. doi: 10.36930/conf150.5.19.
[18] Panyaram, S. (2024). Integrating artificial intelligence with big data for real-time insights and decision-making in complex systems. FMDB Transactions on Sustainable Intelligent Networks, 1(2), 85-95. doi: 10.69888/FTSIN.2024.000211.
[19] Riva, D., & Rossetti, C. (2024). Visualization of knowledge graphs with embeddings: An essay on recent trends and methods. ArXiv. doi: 10.48550/arXiv.2412.05289.
[20] Ruiz Estrada, M.A. (2023). New artificial intelligence (AI) models for policy modelling. Kuala Lumpur: Econographication Laboratory. doi: 10.13140/RG.2.2.30920.90887.
[21] Soroka, I.M., Mochalov, IO., & Kizim, A.V. (2024). The modern directions of implementation of the large models of artificial intelligence in health care. Intermedical Journal, 2, 174-180. doi: 10.32782/2786-7684/2024-2-30.
[22] Yang, J. (2024). Application of artificial intelligence and big data in financial management. SHS Web of Conferences, 208, article number 01006. doi: 10.1051/shsconf/202420801006.
[23] Yang, M. (2024). Design of a cybersecurity defense system based on big data and artificial intelligence. Applied and Computational Engineering, 87, 98-103. doi: 10.54254/2755-2721/87/20241443.
[24] Yin, S., Li, H., Sun, Y., Ibrar, M., & Teng, L. (2024). Data visualization analysis based on explainable artificial intelligence: A survey. IJLAI Transactions on Science and Engineering, 2(2), 13-20.
[25] Zhao, J., Pierre, J., & Konstantinidis, K.T. (2024). Approximate nearest neighbor graph provides fast and efficient embedding with applications for large-scale biological data. NAR Genomics and Bioinformatics, 6(4), article number lqae172. doi: 10.1093/nargab/lqae172.
[26] Zion, D., & Tripathy, B. (2020). Comparative analysis of tools for big data visualization and challenges. In S.M. Anouncia, H.A. Gohel & S. Vairamuthu (Eds.), Data visualization (pp. 33-52). Singapore: Springer. doi: 10.1007/978-981-15-2282-6_3.