Keywords
augmented reality
artificial intelligence
interactive media
cultural heritage research
virtual interactive characters
How to Cite
Abstract
This article presents a comprehensive framework for developing interactive media components in augmented reality (AR) cultural heritage projects using artificial intelligence (AI) tools. The system aims to improve the accessibility, engagement, and educational effectiveness of cultural heritage learning by streamlining the creation of high-quality multimedia content. The proposed solution consists of three interconnected subsystems: (S1) task definition and project coordination, (S2) AI-driven content generation (using GANs, OCR, 3D modeling, and NLP), and (S3) historical and cultural validation. These subsystems are integrated through a distributed knowledge base (DKB) that facilitates remote collaboration and ensures transparency, cultural sensitivity, and adherence to historical accuracy.
The research demonstrates how AI can significantly reduce development costs and time for AR projects while preserving educational and cultural value. Methods for developing interactive elements include virtual characters, restored 3D models, localized environments, and adaptive content for diverse audiences. Evaluation of generated content involves a rigorous multi-method validation process, including SWOT and ABC-XYZ analyses, iterative expert feedback, and machine learning-based classification and clustering. These evaluations address key challenges such as AI-induced historical inaccuracies, culturally insensitive representations, and the ethical dilemmas inherent in machine-driven storytelling.
The study of the practical implementation of the proposed system is focused on a project aimed at popularizing mythology within the context of Ukraine’s cultural heritage. This confirms the system’s effectiveness in improving content quality, user engagement, and interdisciplinary collaboration. A functional prototype of the DKB, implemented in the Notion Space environment, further demonstrates the practicality of the approach. Results from expert and user testing indicate a statistically significant improvement in both the authenticity and educational impact of the generated materials.
References
[1] L. Rau, J. L. Bitter, Y. Liu, U. Spierling, and R. Dörner, “Supporting the creation of non-linear everyday AR experiences in exhibitions and museums: An authoring process based on self-contained building blocks,” Front. Virtual Real., vol. 3, p. 955437, Aug. 2022, doi: 10.3389/frvir.2022.955437. (in English)
[2] I. Remolar, C. Rebollo, and J. A. Fernández-Moyano, “Learning History Using Virtual and Augmented Reality,” Computers, vol. 10, no. 11, p. 146, Nov. 2021, doi: 10.3390/computers10110146. (in English)
[3] A. Leopardi et al., “X-reality technologies for museums: a comparative evaluation based on presence and visitors experience through user studies,” Journal of Cultural Heritage, vol. 47, pp. 188–198, Jan. 2021, doi: 10.1016/j.culher.2020.10.005. (in English)
[4] J. Li, W. Wider, Y. Ochiai, and M. A. Fauzi, “A bibliometric analysis of immersive technology in museum exhibitions: exploring user experience,” Front. Virtual Real., vol. 4, p. 1240562, Sep. 2023, doi: 10.3389/frvir.2023.1240562. (in English)
[5] D. Reiners, M. R. Davahli, W. Karwowski, and C. Cruz-Neira, “The Combination of Artificial Intelligence and Extended Reality: A Systematic Review,” Front. Virtual Real., vol. 2, p. 721933, Sep. 2021, doi: 10.3389/frvir.2021.721933. (in English)
[6] C. Wienrich and M. E. Latoschik, “eXtended Artificial Intelligence: New Prospects of Human-AI Interaction Research,” Front. Virtual Real., vol. 2, p. 686783, Sep. 2021, doi: 10.3389/frvir.2021.686783. (in English)
[7] S. Pansoni et al., “ARTIFICIAL INTELLIGENCE AND CULTURAL HERITAGE: DESIGN AND ASSESSMENT OF AN ETHICAL FRAMEWORK,” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., vol. XLVIII-M-2–2023, pp. 1149–1155, Jun. 2023, doi: 10.5194/isprs-archives-XLVIII-M-2-2023-1149-2023. (in English)
[8] A. K. Munk, A. G. Olesen, and M. Jacomy, “The Thick Machine: Anthropological AI between explanation and explication,” Big Data & Society, vol. 9, no. 1, p. 20539517211069891, Jan. 2022, doi: 10.1177/20539517211069891. (in English)
[9] A. Foka and G. Griffin, “AI, Cultural Heritage, and Bias: Some Key Queries That Arise from the Use of GenAI,” Heritage, vol. 7, no. 11, pp. 6125–6136, Oct. 2024, doi: 10.3390/heritage7110287. (in English)
[10] M. Hincapié, C. Díaz, M.-I. Zapata-Cárdenas, H. D. J. T. Rios, D. Valencia, and D. Güemes-Castorena, “Augmented reality mobile apps for cultural heritage reactivation,” Computers & Electrical Engineering, vol. 93, p. 107281, Jul. 2021, doi: 10.1016/j.compeleceng.2021.107281. (in English)
[11] R. G. Boboc, E. Băutu, F. Gîrbacia, N. Popovici, and D.-M. Popovici, “Augmented Reality in Cultural Heritage: An Overview of the Last Decade of Applications,” Applied Sciences, vol. 12, no. 19, p. 9859, Sep. 2022, doi: 10.3390/app12199859. (in English)
[12] F. Moral-Andrés, E. Merino-Gómez, P. Reviriego, and F. Lombardi, “Can Artificial Intelligence Reconstruct Ancient Mosaics?,” 2022, doi: 10.48550/ARXIV.2210.06145. (in English)
[13] V. Geroimenko, Ed., Augmented Reality and Artificial Intelligence: The Fusion of Advanced Technologies. in Springer Series on Cultural Computing. Cham: Springer Nature Switzerland, 2023. doi: 10.1007/978-3-031-27166-3. (in English)
[14] Y. Uzun and H.N. Kilinc, “Current Studies in Artificial Intelligence, Virtual Reality and Augmented Reality”, 2022 ISRES Publishing. ISBN: 978-605-67951-5-2 (in English)
[15] Y. Netragaonkar Y, “Role of artificial intelligence (AI) and augmented reality technology (ART) in higher education”. Scholarly Research Journal for Interdisciplinary, UGC CARE Listed ( Group -I) Journal Volume 11, Iss 10, Dec 2022 ISSN: 2319-4766 (in English)
[16] S. Wu, Z. Chen, and Q. Su, “Knowledge-Aware Artifact Image Synthesis with LLM-Enhanced Prompting and Multi-Source Supervision,” 2023, arXiv. doi: 10.48550/ARXIV.2312.08056.(in English)
[17] M. Mishra and P. B. Lourenço, “Artificial intelligence-assisted visual inspection for cultural heritage: State-of-the-art review,” Journal of Cultural Heritage, vol. 66, pp. 536–550, Mar. 2024, doi: 10.1016/j.culher.2024.01.005.(in English)
[18] R. Wu et al., (2024). “Applying generative AI to visualize and imagine cultural heritage sites”. Proceedings of the International Symposium on Electronic Art (ISEA) 2024. [Online]. Available: https://isea-archives.siggraph.org/wp-content/uploads/2025/01/2024_Wu_THE_PRESENT_IN_THE_FUTURE_IS_THE.pdf (in English)
[19] Europeana Pro, “Exploring the importance of digital media authenticity in cultural heritage”. Europeana Pro. [Online]. Available: https://pro.europeana.eu/post/exploring-the-importance-of-digital-media-authenticity-in-cultural-heritage (in English)
[20] S. Masneri, A. Domínguez, G. Pacho, M. Zorrilla, M. Larrañaga, and A. Arruarte, “A collaborative AR application for education: from architecture design to user evaluation,” Virtual Reality, vol. 28, no. 1, p. 42, Mar. 2024, doi: 10.1007/s10055-024-00952-x. (in English)
[21] A. Wang, “The combination and application of virtual reality and artificial intelligence,” ACE, vol. 6, no. 1, pp. 149–153, Jun. 2023, doi: 10.54254/2755-2721/6/20230773. (in English)
[22] O. Kononenko “Ukrainian mythology”, 2017, Kharkiv: Folio. pp. 128-130 (in Ukrainian)
[23] Mythchuk, “Legends and myths of the ancient world! The Forester (Lisun, Polisun, Hayovik, Borovik, Righteous Grandfather, Forest Pan)”, 2023. [Online]. Available: https://myths.com.ua/slovyanska-mifologiya/bestiariy-monstru-ta-istotu/lisovuk.php (in Ukrainian)
[24] O. S. Yevsyeyev, V. Yu. Velychko, “Methodology of artbook development of a computer game,” "Scientific Notes - Ukrainian Academy of Printing", Printing and Publishing, vol. 2, no. 86, pp. 125–134, 2023, doi: 10.32403/0554-4866-2023-2-86-125-134. (in English)
[25] L. Potrashkova, V. Zaruba, D. Raiko, and O. Yevsyeyev, “Identifying the system of value factors of green consumer choice,” Innovative Marketing, vol. 20, no. 1, pp. 199–211, Mar. 2024, doi: 10.21511/im.20(1).2024.17. (in English)
[26] O. S. Yevsyeyev, “Creation of interactive media” [Electronic resource]: study guide – Electronic text network edition (137 p. / 6681 Kb). – Kharkiv, S. Kuznets Kharkiv National University of Economics, 2020. [Online]. Available: https://shorl.com/telamebraproke - ISBN 978-966-676-799-1(in English)
[27] A. Srilakshmi, “Integrating Augmented Reality and Artificial Intelligence to Enhance the Spatial Ability Skills in the Field of Geography”, Int J Intell Syst Appl Eng, vol. 12, no. 4, pp. 201, Jun. 2024. (in English)
[28] M. Vallance and P. A. Towndrow, “Perspective: Narrative Storyliving in Virtual Reality Design,” Front. Virtual Real., vol. 3, p. 779148, Mar. 2022, doi: 10.3389/frvir.2022.779148. (in English)
[29] V. Nisi, S. James, P. Bala, A. Del Bue, and N. J. Nunes, “Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to Re-centre Stories from the Margins,” in Interactive Storytelling, vol. 14383, L. Holloway-Attaway and J. T. Murray, Eds., in Lecture Notes in Computer Science, vol. 14383. , Cham: Springer Nature Switzerland, 2023, pp. 117–137. doi: 10.1007/978-3-031-47655-6_8. (in English)
[30] I. Capecchi, I. Bernetti, T. Borghini, A. Caporali, and C. Saragosa, “Augmented reality and serious game to engage the alpha generation in urban cultural heritage,” Journal of Cultural Heritage, vol. 66, pp. 523–535, Mar. 2024, doi: 10.1016/j.culher.2024.01.004. (in English)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright (c) 2026 Oleksiy Yevsyeyev, Oleksandr Pushkar, Liudmyla Potrashkova