X-Means Clustering for UX Evaluation of the Candy CBT Application Using the SUS Instrument

Authors

DOI:

https://doi.org/10.25139/inform.v11i1.11277

Keywords:

X-Means Clustering, User Experience, UX, System Usability Scale, SUS, CBT Application, Responsiveness, Data Mining

Abstract

The Candy CBT application at SMKS Pancabudi Medan has been operating for three years without adequate usability reviews, posing a high risk of serious problems in user experience (UX), especially in terms of system responsiveness. Therefore, this study aims to analyze the level of system usability and group users based on three aspects (GUI, Navigation, and Responsiveness) using X-Means Clustering to develop recommendations for improvement. The method used is a data mining-based evaluative study involving 400 respondents of a modified System Usability Scale (SUS) questionnaire, with data processed through reverse scoring and Z-Score Normalization before clustering. The results show that the GUI (4.53) and Navigation (4.51) aspects are rated very good. Still, responsiveness is very low (1.48), becoming a major weakness consistent across all clusters. The X-Means Clustering model automatically determined two optimal clusters, with the most dominant cluster specifically showing extreme dissatisfaction with responsiveness (score 1.08). This study contributes a more granular usability evaluation approach by integrating aspect-based SUS features with X-Means Clustering, enabling more precise identification of critical UX weaknesses and supporting data-driven prioritization of usability improvements in CBT systems. Therefore, the application's usability needs to be significantly improved, and recommendations should focus on enhancing non-functional requirements, particularly system performance and stability, to ensure better multi-device responsiveness, with the cluster showing the highest dissatisfaction as the top priority.

References

N. Romadhona, W. Fachrudin Yusuf, A. Yusuf, and A. Marzuki, “Penerapan Aplikasi Computer Based Test (Cbt) Sebagai Alternatif Penilaian Hasil Pembelajaran Pai Di Smk Syamsul Arifin Kraton Pasuruan,” no. 08, pp. 190–201, 2024.

G. Daniel and A. Ikpe, "Computer-Based Testing (CBT): A Paradigm Shift in Examination Administration in Nigerian Post- Primary Schools," International Journal of Modern Science and Research Technology, vol. 3, no. 9, pp. 289–302, 2025, doi: 10.5281/zenodo.17207075.

M. L. Hutahaean, E. Hadinata, and Y. Faradillah, “Aplikasi Computer Based Test (CBT) Berbasis Website Menggunakan Metode RAD Pada SMA Negeri 21 Medan,” Jatilima : Jurnal Multimedia Dan Teknologi Informasi, vol. 07, no. 01, pp. 1–10, 2025, doi: https://doi.org/10.54209/jatilima.v7i01.1085.

F. D. Pratama, I. Zufria, and T. Triase, “Implementasi Data Mining Menggunakan Algoritma Naïve Bayes Untuk Klasifikasi Penerima Program Indonesia Pintar,” Rabit : Jurnal Teknologi dan Sistem Informasi Univrab, vol. 7, no. 1, pp. 77–84, Jan. 2022, doi: 10.36341/rabit.v7i1.2217.

M. Y. Kurniawan and T. Dirgahayu, “Evaluasi dan Rekomendasi Peningkatan User Interface dan User Experience pada Aplikasi Prime Video Mobile,” Jurnal Kridatama Sains Dan Teknologi, vol. 6, no. 02, pp. 453–468, 2024, doi: 10.53863/kst.v6i02.1221.

M. R. Silalahi, L. M. Michelli, H. Umayasyah, D. A. Mu’adin, and B. Parga Zen, “Evaluasi Heuristik Dan System Usability Scale UI/UX pada Aplikasi ‘Makan Kuy,’” Jurnal Ilmiah Media Sisfo, vol. 18, no. 1, pp. 57–67, Apr. 2024, doi: 10.33998/mediasisfo.2024.18.1.1475.

S. D. Rahmawati and B. Prasetiyo, "Application of Lean UX and System Usability Scale (SUS) Methods in Redesigning User Interface and User Experience on Adella Hospital Online Registration Website," Journal of Advances in Information Systems and Technology, vol. 6, no. 2, pp. 200–218, 2025, doi: 10.15294/jaist.v6i2.2430.

R. R. Khaerullah, N. Suarna, and O. Nurdiawan, “Analisa Pengelompokan Dataset Komputer Menggunakan Algoritma X-Means,” Jurnal Informatika dan Teknologi Informasi, vol. 1, no. 2, 2023, doi: 10.56854/jt.v1i2.135.

Z. Manzis, R. Kurniawan, and Y. A. Wijaya, “Penerapan X-Means Clustering Terhadap Hasil Kuesioner Website Virtual Tour Stmik Ikmi Cirebon System Usability Scale (SUS),” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 8, no. 3, pp. 2863–2869, 2024.

M. N. Romadhoni and T. Dirgahayu, “Evaluasi dan Redesain UI/UX pada Aplikasi Web Young on Top,” Jurnal Indonesia : Manajemen Informatika dan Komunikasi, vol. 5, no. 3, pp. 2390–2401, 2024, doi: 10.35870/jimik.v5i3.909.

V. A. Subarjah and Ari Purno Wahyu, "Analysis and Design of User Interface and User Experience of Regional Tax Enterprise Resources Planning System with Design Thinking Method," Inform : Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi, vol. 7, no. 2, pp. 96–106, 2022, doi: 10.25139/inform.v7i2.4729.

T. Rahmawati, “Analisis perbandingan silhouette coefficient dan metode elbow pada pengelompokkan provinsi di indonesia berdasarkan indikator ipm dengan k-medoids 1,2,3,” vol. 13, pp. 13–24, 2024, doi: 10.14710/j.gauss.13.1.13-24.

H. A. Ulvi and M. Ikhsan, "Comparison of K-Means and K-Medoids Clustering Algorithms for Export and Import Grouping of Goods in Indonesia," sinkron, vol. 8, no. 3, pp. 1671–1685, Jul. 2024, doi: 10.33395/sinkron.v8i3.13815.

A. Khamaj and A. M. Ali, "Adapting user experience with reinforcement learning: Personalizing interfaces based on user behavior analysis in real-time," Alexandria Engineering Journal, vol. 95, pp. 164–173, May 2024, doi: 10.1016/j.aej.2024.03.045.

J. R. Leite Filho, T. A. Coleti, and M. Morandini, "Evaluating chatbot user experience (UX) through electroencephalography measures: A systematic literature review," Mar. 2024, Elsevier B.V. doi: 10.1016/j.chbr.2024.100381.

N. Septiana and M. Rohmadi, “Persepsi Mahasiswa Terhadap Aplikasi CBT Android Berbasis Exambrower Sebagai Alat Evaluasi Paper Less,” JRIP: Jurnal Riset dan Inovasi Pembelajaran, vol. 4, no. 1, pp. 448–464, 2024.

R. Rahim, “Pelatihan Sistem Informasi Penerimaan Siswa Baru Di Smk Pancabudi Medan,” Jurnal PKM Bangsa (Jurmas Bangsa), vol. 1, no. 2, pp. 95–100, 2023, doi: 10.62357/jpb.v1i2.175.

D. S. Atanggae, A. Angelaus Ete, and M. Dhema, "Keefektifan Ujian Berbasis Komputer Menggunakan Aplikasi CANDY CBT Di SMA Muhammadiyah Maumere," Jurnal PTI (Jurnal Pendidikan Teknologi Informasi), vol. 11, no. 2, pp. 50–55, 2024, doi: 10.35134/jpti.v11i2.219.

D. Ayu and B. Utami, “Perancangan Sistem Login Pada Aplikasi Berbasis GUI Menggunakan QTDesigner Python,” vol. 4, no. 2, pp. 92–100, 2021, doi: https://doi.org/10.30873/simada.v4i2.2961.

A. A. Suhendra, G. Agung, A. Putri, G. Made, and A. Sasmita, “Evaluasi Usability User Interface Website Menggunakan Metode Usability Testing Berbasis ISO 9241-11 (Studi Kasus PT.X),” JITTER- Jurnal Ilmiah Teknologi dan Komputer, vol. 2, no. 3, pp. 1–9, 2021.

E. Timothy Napitupulu and F. Aldi Jous Nainggolan, "Perbandingan Algoritma K-Means Dan X-Means Untuk Mengelompokkan Minat Kejuruan Siswa Baru Pada Smk Multikarya Medan Menggunakan Metode Clustering," Jurnal TEKINKOM, vol. 6, no. 2, p. 2023, doi: 10.37600/tekinkom.v6i2.933.

E. Fitriana, Windarsyah, and Kamarudin, “Clustering Kos Dengan Algoritma K-Means Untuk Rekomendasi Tempat Berdasarkan Harga dan Fasilitas,” Jurnal Media Informatika [JUMIN], vol. 6, no. 3, pp. 1990–1995, 2025.

Y. Sopyan, A. D. Lesmana, and C. Juliane, “Analisis Algoritma K-Means dan Davies Bouldin Index dalam Mencari Cluster Terbaik Kasus Perceraian di Kabupaten Kuningan,” Building of Informatics, Technology and Science (BITS), vol. 4, no. 3, Dec. 2022, doi: 10.47065/bits.v4i3.2697.

B. Yusuf, R. Mahara, H. Ahmadian, S. Wahyuni, P. Studi Teknologi Informasi, and P. Sudi Pendidikan Teknologi Informasi, “Analisis Clustering Penduduk Miskin Di Provinsi Aceh Menggunakan Algoritma K-Means Dan X-Means,” Jurnal Nasional Komputasi dan Teknologi Informasi, vol. 5, no. 1, 2022.

R. Hariyanto and M. Z. Sarwani, “Optimizing K-Measn Algorithm Using Particle Swarm Optimization To Group Student Learning Processes,” Inform : Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi, vol. 6, no. 1, pp. 65–68, 2021, doi: 10.25139/inform.v6i1.3459.

Downloads

Published

2026-01-29

How to Cite

X-Means Clustering for UX Evaluation of the Candy CBT Application Using the SUS Instrument. (2026). Inform : Jurnal Ilmiah Bidang Teknologi Informasi Dan Komunikasi, 11(1), 71–79. https://doi.org/10.25139/inform.v11i1.11277

Issue

Vol. 11 No. 1 (2026)

Section

Articles

License

Authors who publish with Inform: Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal. 

  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.

  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.