INTEGRATION OF MACHINE LEARNING AND AUGMENTED REALITY FOR MALAY CULTURAL HERITAGE
Keywords:
Machine Learning, Augmented Reality, Cultural Heritage, Malay Culture, Cultural Heritage DigitizatioAbstract
Cultural heritage digitization has become an essential strategy for preserving local heritage through the adoption of emerging digital technologies. This study aims to investigate the integration of Machine Learning and Augmented Reality (AR) for preserving and promoting Malay cultural heritage. A descriptive research approach was employed through literature review, field observations, image acquisition, and cultural object documentation. The research data consisted of digital images and descriptive information of Malay cultural heritage objects collected from five cultural sites: Maimun Palace, North Sumatra State Museum, Deli Serdang Museum, Tebing Tinggi Museum, and Batubara Museum. The collected cultural objects were curated and classified according to their visual characteristics and historical significance to establish a structured dataset suitable for Machine Learning-based object recognition and AR integration. The results demonstrate that the proposed data collection and classification process successfully produced a well-organized cultural heritage dataset capable of supporting automatic object recognition and interactive visualization in an AR environment. The integration of Machine Learning and Augmented Reality provides an effective foundation for developing intelligent digital cultural applications that enhance public engagement while supporting the preservation, promotion, and accessibility of Malay cultural heritage.
Keywords : Machine Learning; Augmented Reality; Cultural Heritage; Malay Culture; Cultural Heritage Digitizatio
References
Revianur, A. (2020). Digitalisasi Cagar Budaya di Indonesia: Sudut Pandang Baru Pelestarian Cagar Budaya Masa Hindu-Buddha di Kabupaten Semarang. Bakti Budaya, 3(1), 90. https://doi.org/10.22146/bb.55505
Boboc, R. G., Băutu, E., Gîrbacia, F., Popovici, N., & Popovici, D. (2022). Augmented reality in cultural heritage: An overview of the last decade of applications. Applied Sciences, 12(19), 9859. https://doi.org/10.3390/app12199859
Nugroho, L. A., & Wuryani, E. (2024). DIGITALISASI PENINGGALAN CAGAR BUDAYA DI DESA NGRAWAN SEBAGAI UPAYA PELESTARIAN WARISAN BUDAYA. Magistrorum Et Scholarium Jurnal Pengabdian Masyarakat, 4(3), 255–267. https://doi.org/10.24246/jms.v4i32024p255-267
Kartini, S. A., Bunda, Y. P., & Afni, N. (2024). Transformasi augmented reality berbasis Android sebagai media pembelajaran pengenalan budaya Sumatera Utara. JURNAL FASILKOM, 14(3), 573–580. https://doi.org/10.37859/jf.v14i3.7904
Dawis, A. M., Setiyanto, S., Sadida, I., & Bariq, F. F. D. (2024). Revitalizing Nusantara Traditions through Interactive Cultural Experiences with Augmented Reality Technology. Jurnal Sisfokom (Sistem Informasi Dan Komputer), 13(3), 375–380. https://doi.org/10.32736/sisfokom.v13i3.2277
Rizki, Y., Hayami, R., & Rahmadani, E. (2022). Identifikasi objek cagar budaya Candi Mahligai berbasis citra digital menggunakan mask R-CNN. Jurnal CoSciTech (Computer Science and Information Technology), 3(3), 309–314. https://doi.org/10.37859/coscitech.v3i3.3939
Harisanty, D., Obille, K. L. B., Anna, N. E. V., Purwanti, E., & Retrialisca, F. (2024). Cultural heritage preservation in the digital age, harnessing artificial intelligence for the future: a bibliometric analysis. Digital Library Perspectives, 40(4), 609–630. https://doi.org/10.1108/dlp-01-2024-0018
Bakti, I. R., Supriyanto, A., & Mustafa, S. R. (2023). Penerapan Augmented Reality Berbasis Android Sebagai Media Pembelajaran Pendidikan Budaya Melayu Riau Rokan Hulu. Zonasi Jurnal Sistem Informasi, 5(3), 495–504. https://doi.org/10.31849/zn.v5i3.16154
Karim, M. S. A., Hakim, A. A., Rafika, C. S., & Puspaningrum, E. Y. (2025). Klasifikasi Motif Batik Yogyakarta dan Pekalongan Menggunakan Metode GLCM dan CNN Berbasis Arsitektur EfficientNet. Prosiding Seminar Nasional Informatika Bela Negara, 5(1), 350–356. https://doi.org/10.33005/santika.v5i1.747
Laudra, D. C., Pauziah, F., Siburian, N. U., Sibarani, G., Manalu, S. B., & Ivanna, J. (2021). Mengenal dan Melestarikan Budaya Melayu Deli di Kota Medan Sumatera Utara. Jotika Journal in Education, 1(1), 6–9. https://doi.org/10.56445/jje.v1i1.13
Nasution, H. D., Nurhayati, & Munandar, A. (2019). KAJIAN LANSKAP BUDAYA MELAYU UNTUK MENINGKATKAN IDENTITAS KOTA MEDAN. Jurnal Lanskap Indonesia, 10(2), 71–80. https://doi.org/10.29244/jli.2018.10.2.71-80
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L. (2018b, January 13). MobileNetV2: Inverted residuals and linear bottlenecks. arXiv.org. https://arxiv.org/abs/1801.04381
Tharwat, A., & Schenck, W. (2023). A survey on active learning: State-of-the-Art, practical challenges and research directions. Mathematics, 11(4), 820. https://doi.org/10.3390/math11040820
Rinaldi, A. M., Russo, C., & Tommasino, C. (2022). An augmented reality CBIR system based on multimedia knowledge graph and deep learning techniques in cultural heritage. Computers, 11(12), 172. https://doi.org/10.3390/computers11120172
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Rizki Ramadhansyah, Septian Simatupang, Rio Fernandez Tamba

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.




