Analysis and Design of AI and AR-Based Applications with a UIUX Approach to support Inclusive Learning for students with Disabilities

Authors

  • Galandaru Swalaganata
  • Mardiana Andarwati
  • Firnanda Al-Islama Achyunda Putra
  • Prihat Assih
  • Ririn Sudarwati
  • Yara Bramasta

DOI:

https://doi.org/10.25139/inform.v10i2.9996

Keywords:

SignSyncAI, Wireframe, Mock-up, Mobile Application, Flutter Framework, Virtual Reality

Abstract

The integration of Artificial Intelligence (AI) and Augmented Reality (AR) in education holds transformative potential, particularly in fostering inclusive learning environments for students with disabilities. This study investigates the integration of Artificial Intelligence and Augmented Reality to advance inclusive education. This research examines the analysis and design of AI and AR-based applications, employing a User Interface and User Experience (UI/UX) approach to cater to the diverse needs of students with physical, sensory, or cognitive impairments. By emphasizing inclusive design principles, the study aims to develop adaptive and accessible educational tools that promote engagement, deepen understanding, and improve learning outcomes. The research adopts a multidisciplinary methodology, combining insights from accessibility standards, UI/UX design frameworks, and educational technologies. Key objectives include identifying accessibility barriers, designing user-centric interfaces, and evaluating the effectiveness of AI-driven personalization and AR-enhanced interactivity in real-world learning scenarios. Preliminary findings highlight the importance of responsive and adaptive interfaces in facilitating equitable access and promoting active participation among students with disabilities. The study underscores the role of innovative technologies in bridging gaps in traditional education systems, ultimately promoting an inclusive and empowering learning experience. This research contributes to the broader discourse on leveraging technology to ensure educational equity and inclusion in the digital age.

References

B. I. Rodhiyah and S. Wulandari, “Aplikasi Berbasis Mobile Sebagai Sarana Pembelajaran Dasar Bahasa Isyarat,” INTECOMS J. Inf. Technol. Comput. Sci., vol. 7, no. 1, pp. 58–63, 2024.

M. Syani and A. Hartanto, “Aplikasi Multimedia Pembelajaran Bahasa Indonesia Berbasis Mobile (Studi Kasus Slbn-a Citeureup Cimahi),” J. Teknol. Dan Sist. Inf. Bisnis, vol. 3, no. 1, pp. 190–200, 2021.

D. A. Mega Puspita, S. Subandowo, and H. Karyono, “Pengembangan Media Pembelajaran Pada Mata Pelajaran Program Khusus Pengembangan Diri Untuk Anak Disabilitas Intelektual Berbasis Mobile Learning,” JIPI (Jurnal Ilm. Penelit. dan Pembelajaran Inform., vol. 9, no. 1, pp. 320–326, 2024.

M. A. Alkhawaldeh and M. A. S. Khasawneh, "Designing gamified assistive apps: A novel approach to motivating and supporting students with learning disabilities," Int. J. Data Netw. Sci., vol. 8, no. 1, pp. 53–60, 2024.

R. Informatika, "JURNAL REIN," vol. 1, no. 1, pp. 36–45, 2024.

I. Pendahuluan, “SignSync AI : Perancangan Aplikasi Mobile untuk Membantu Mahasiswa Disabilitas dalam Melakukan Pembelajaran dengan Menerapkan AI dan AR,” vol. 8, pp. 1052–1060, 2024.

F. I. Pradhana, “Perancangan Desain Ui/Ux Aplikasi Mobile Startup Sajiloka Dengan Lean Ux,” pp. 1–1, 2022.

T. Tiara, K. R. Lieubun, J. P. Sirken, and ..., “Penerapan Metode E-GovQual Untuk Mengevaluasi Tingkat Kualitas Layanan Website E-LAPOR!,” Semin. Nas. …, no. September, pp. 4421–4432, 2023.

Firnanda Al-Islama Achyunda Putra, Andriyan Rizki Jatmiko, R. M. A. Arief, and M. I. A. Ardiansa, “A Rancang Bangun Sistem Informasi Kepegawaian dan Inventaris Di Universitas Merdeka Malang Berbasis Web Menggunakan Framework Codeigniter,” J. RESTIKOM Ris. Tek. Inform. dan Komput., vol. 5, no. 2, pp. 124–136, 2023.

J. Petra Sirken and F. Al-Islama Achyunda Putra, “Analisis Kualitas Layanan Pada Aplikasi Satusehat Dengan Pendekatan E-Govqual,” Jl. Terusan Raya Dieng, no. September, p. 65146, 2023.

Y. J. Wu, W. J. Liu, and C. H. Yuan, "A mobile-based barrier-free service transportation platform for people with disabilities," Comput. Human Behav., vol. 107, no. October, pp. 0–1, 2020.

M. Mateos-Sanchez, A. C. Melo, L. S. Blanco, and A. M. F. García, "Chatbot, as Educational and Inclusive Tool for People with Intellectual Disabilities," Sustain., vol. 14, no. 3, 2022.

M. Andarwati and G. Swalaganata, “Perancangan Aplikasi WeSai sebagai Media Penunjang Pembelajaran Mahasiswa Tuli dengan Metode RAD,” Briliant J. Ris. dan Konseptual, vol. 8, no. 2, p. 465, 2023.

Rian Nanda, “Perancangan Aplikasi Tuna Wicara Dan Tuna Rungu Dengan Metode Waterfall Berbasis Android,” JEKIN - J. Tek. Inform., vol. 3, no. 1, pp. 20–30, 2023.

A. B. Afriani, G. Wilmanda, and A. Jiyaris Gamaradika, “Difabel di Pusat: Artificial Intelligence dan Bazar Platform sebagai Medium Inklusif Sistem Edukasiauau,” Proc. Unimbone , pp. 1–9, 2023.

A. N. Aniedu, S. C. Nwokoye, C. S. Okafor, K. Anyanwu, A. N. Isizoh, and P. Bank, "Enhanced AI-Based Navigation System for The Visually Impaired," vol. 10, no. 1, pp. 16–20, 2025.

K. Marlin et al., “Manfaat dan Tantangan Penggunaan Artificial Intelligences (AI) Chat GPTTerhadap Proses Pendidikan Etika dan KompetensiMahasiswa Di Perguruan Tinggi,” Innov. J. Soc. Sci. Res., vol. 3, no. 6, pp. 5192–5201, 2023.

G. F. Mumtaz, J. Zeniarja, A. Luthfiarta, A. Najiib, and I. Muttaqin, "Optimising Face Recognition and Emotion Detection in Student Identification Using FaceNet and YOLOv8 Models," vol. 10, no. 1, pp. 34–44, 2025.

X. D. Crystallography, Optimalisasi pemanfaatan Teknologi Pembelajaran. 2016.

F. Amrullah et al., “Jurnal Teknologi dan Manajemen Informatika Pengembangan Aplikasi Android MVTE dengan Metode RAD Info Artikel ABSTRAK,” vol. 7, no. 2, pp. 122–130, 2021.

Downloads

Published

2025-07-06

How to Cite

Swalaganata, G. ., Andarwati, M. ., Al-Islama Achyunda Putra, F. ., Assih, P. ., Sudarwati, R. ., & Bramasta, Y. . (2025). Analysis and Design of AI and AR-Based Applications with a UIUX Approach to support Inclusive Learning for students with Disabilities. Inform : Jurnal Ilmiah Bidang Teknologi Informasi Dan Komunikasi, 10(2), 129–135. https://doi.org/10.25139/inform.v10i2.9996

Issue

Vol. 10 No. 2 (2025)

Section

Articles

License

Authors who publish with Inform: Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal. 

  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.

  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.