INTEGRATION OF MACHINE LEARNING AND AUGMENTED REALITY FOR MALAY CULTURAL HERITAGE

Authors

  • Rizki Ramadhansyah Politeknik Wilmar Bisnis Indonesia
  • Septian Simatupang Politeknik Wilmar Bisnis Indonesia
  • Rio Fernandez Tamba Politeknik Wilmar Bisnis Indonesia

Keywords:

Machine Learning, Augmented Reality, Cultural Heritage, Malay Culture, Cultural Heritage Digitizatio

Abstract

Cultural heritage digitization has become an essential strategy for preserving local heritage through the adoption of emerging digital technologies. This study aims to investigate the integration of Machine Learning and Augmented Reality (AR) for preserving and promoting Malay cultural heritage. A descriptive research approach was employed through literature review, field observations, image acquisition, and cultural object documentation. The research data consisted of digital images and descriptive information of Malay cultural heritage objects collected from five cultural sites: Maimun Palace, North Sumatra State Museum, Deli Serdang Museum, Tebing Tinggi Museum, and Batubara Museum. The collected cultural objects were curated and classified according to their visual characteristics and historical significance to establish a structured dataset suitable for Machine Learning-based object recognition and AR integration. The results demonstrate that the proposed data collection and classification process successfully produced a well-organized cultural heritage dataset capable of supporting automatic object recognition and interactive visualization in an AR environment. The integration of Machine Learning and Augmented Reality provides an effective foundation for developing intelligent digital cultural applications that enhance public engagement while supporting the preservation, promotion, and accessibility of Malay cultural heritage.

Keywords : Machine Learning; Augmented Reality; Cultural Heritage; Malay Culture; Cultural Heritage Digitizatio

References

Revianur, A. (2020). Digitalisasi Cagar Budaya di Indonesia: Sudut Pandang Baru Pelestarian Cagar Budaya Masa Hindu-Buddha di Kabupaten Semarang. Bakti Budaya, 3(1), 90. https://doi.org/10.22146/bb.55505

Boboc, R. G., Băutu, E., Gîrbacia, F., Popovici, N., & Popovici, D. (2022). Augmented reality in cultural heritage: An overview of the last decade of applications. Applied Sciences, 12(19), 9859. https://doi.org/10.3390/app12199859

Nugroho, L. A., & Wuryani, E. (2024). DIGITALISASI PENINGGALAN CAGAR BUDAYA DI DESA NGRAWAN SEBAGAI UPAYA PELESTARIAN WARISAN BUDAYA. Magistrorum Et Scholarium Jurnal Pengabdian Masyarakat, 4(3), 255–267. https://doi.org/10.24246/jms.v4i32024p255-267

Kartini, S. A., Bunda, Y. P., & Afni, N. (2024). Transformasi augmented reality berbasis Android sebagai media pembelajaran pengenalan budaya Sumatera Utara. JURNAL FASILKOM, 14(3), 573–580. https://doi.org/10.37859/jf.v14i3.7904

Dawis, A. M., Setiyanto, S., Sadida, I., & Bariq, F. F. D. (2024). Revitalizing Nusantara Traditions through Interactive Cultural Experiences with Augmented Reality Technology. Jurnal Sisfokom (Sistem Informasi Dan Komputer), 13(3), 375–380. https://doi.org/10.32736/sisfokom.v13i3.2277

Rizki, Y., Hayami, R., & Rahmadani, E. (2022). Identifikasi objek cagar budaya Candi Mahligai berbasis citra digital menggunakan mask R-CNN. Jurnal CoSciTech (Computer Science and Information Technology), 3(3), 309–314. https://doi.org/10.37859/coscitech.v3i3.3939

Harisanty, D., Obille, K. L. B., Anna, N. E. V., Purwanti, E., & Retrialisca, F. (2024). Cultural heritage preservation in the digital age, harnessing artificial intelligence for the future: a bibliometric analysis. Digital Library Perspectives, 40(4), 609–630. https://doi.org/10.1108/dlp-01-2024-0018

Bakti, I. R., Supriyanto, A., & Mustafa, S. R. (2023). Penerapan Augmented Reality Berbasis Android Sebagai Media Pembelajaran Pendidikan Budaya Melayu Riau Rokan Hulu. Zonasi Jurnal Sistem Informasi, 5(3), 495–504. https://doi.org/10.31849/zn.v5i3.16154

Karim, M. S. A., Hakim, A. A., Rafika, C. S., & Puspaningrum, E. Y. (2025). Klasifikasi Motif Batik Yogyakarta dan Pekalongan Menggunakan Metode GLCM dan CNN Berbasis Arsitektur EfficientNet. Prosiding Seminar Nasional Informatika Bela Negara, 5(1), 350–356. https://doi.org/10.33005/santika.v5i1.747

Laudra, D. C., Pauziah, F., Siburian, N. U., Sibarani, G., Manalu, S. B., & Ivanna, J. (2021). Mengenal dan Melestarikan Budaya Melayu Deli di Kota Medan Sumatera Utara. Jotika Journal in Education, 1(1), 6–9. https://doi.org/10.56445/jje.v1i1.13

Nasution, H. D., Nurhayati, & Munandar, A. (2019). KAJIAN LANSKAP BUDAYA MELAYU UNTUK MENINGKATKAN IDENTITAS KOTA MEDAN. Jurnal Lanskap Indonesia, 10(2), 71–80. https://doi.org/10.29244/jli.2018.10.2.71-80

Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L. (2018b, January 13). MobileNetV2: Inverted residuals and linear bottlenecks. arXiv.org. https://arxiv.org/abs/1801.04381

Tharwat, A., & Schenck, W. (2023). A survey on active learning: State-of-the-Art, practical challenges and research directions. Mathematics, 11(4), 820. https://doi.org/10.3390/math11040820

Rinaldi, A. M., Russo, C., & Tommasino, C. (2022). An augmented reality CBIR system based on multimedia knowledge graph and deep learning techniques in cultural heritage. Computers, 11(12), 172. https://doi.org/10.3390/computers11120172

Downloads

Published

2026-06-30