Performance Analysis of Support Vector Machine with Hyperparameter Tuning for Engagement Rate Classification of TikTok Digital Marketing Content

  • Muhammad Dzar Algifahri Computer Science Department, Universitas Islam Negeri Sumatera Utara Medan
  • Sriani Sriani Computer Science Department, Universitas Islam Negeri Sumatera Utara Medan

Abstract

The effectiveness of TikTok digital marketing content often varies, creating challenges for marketers in achieving consistent audience engagement. Differences in posting time, upload frequency, video length, and music selection make it difficult to distinguish engagement rate (ER) levels accurately. This paper investigates key factors affecting engagement and proposes a classification framework to separate high- and low-engagement TikTok content. A machine learning approach using the Support Vector Machine (SVM) algorithm is applied to a dataset of TikTok videos collected between 2023 and 2025. From an initial dataset of 2,992 videos, 1,638 representative samples were retained after data cleaning and creator-level filtering. The research process involves feature engineering, engagement-based labelling with a 5% ER threshold, data normalisation, and dataset partitioning with an 80:20 training–testing split. The baseline SVM model achieved an accuracy of 70.43%, indicating limited ability to distinguish low-engagement content. After systematic hyperparameter tuning, the optimised linear SVM model demonstrated improved performance, achieving an accuracy of 88.41% with an optimal regularisation parameter (C = 100) and more balanced classification results. Model interpretation indicates that video duration, temporal attributes, and audio characteristics play important roles in separating engagement levels. The proposed framework is intended for post-hoc engagement classification rather than engagement prediction, providing interpretable insights to support TikTok digital marketing strategy optimization.

References

A. A. Irwanda et al., "Analisis Engagement Rate Pada Instagram Universitas Lancang Kuning," Zo. J. Sist. Inf., vol. 6, no. 2, pp. 391–399, 2024, doi: https://doi.org/10.31849/zn.v6i2.17904.

D. Wiryany, S. Natasha, and R. Kurniawan, “Komunikasi Terhadap Perubahan Sistem,” J. Nomosleca, vol. 8, no. November, pp. 242–252, 2022, doi: https://doi.org/10.26905/nomosleca.v8i2.8821.

N. Sapina, A. Nanda, and M. A. Arifin, "Analysis of Factors that Influence Video Engagement on the TikTok Platform Using the Multiple Linear Regression Algorithm Analisis Faktor-Faktor yang Mempengaruhi Engagement Video di Platform TikTok Menggunakan Multiple Linear Regression," MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 5, no. July, pp. 875–885, 2025, doi: https://doi.org/10.57152/malcom.v5i3.1987.

Rahmi Rosita and Evalina Darlin, "Pengaruh Kualitas Konten Tik Tok Terhadap Customer Engagement Pada Customer Queensha," J. Lentera Bisnis, vol. 13, pp. 1061–1071, 2024, doi: 10.34127/jrlab.v13i2.1129.

C. A. Krisdanu and K. A. Sumantri, “TikTok sebagai Media Pemasaran Digital di Indonesia Cheryl Arshiefa Krisdanu 1 , Kiranastari Asoka Sumantri 2 12,” J. Lensa Mutiara Komun., vol. 7, no. 2, pp. 24–36, 2023, doi: https://doi.org/10.51544/jlmk.v7i2.4173.

T. Tatasari, S. Purnomo, and A. K. Dewa, “Social Sciences Journal ( SSJ ) Pemanfaatan Konten Digital Berbasis Video Pendek untuk Meningkatkan Engagement pada UMKM Makanan di Media Sosial,” Soc. Sci. J., vol. 3, no. 2, pp. 20–32, 2025.

V. V. Madnure and D. P. A. Kadam, "Predictive Modeling of User Engagement Patterns On Social Media Using Data Mining Approaches," Int. J. Sci. Technol., vol. 16, no. 4, pp. 1–11, 2025, doi: 10.71097/IJSAT.v16.i4.8876.

S. Zannettou, O. Nemes-nemeth, A. Goetzen, K. P. Gummadi, and E. M. Redmiles, "Analyzing User Engagement with TikTok' s Short Format Video Recommendations using Data Donations", doi: 10.1145/3613904.3642433.

N. Lau, K. Srinakarin, H. Aalfs, X. Zhao, and T. M. Palermo, "TikTok and teen mental health : an analysis of user-generated content and engagement," J. Pediatr. Psychol., vol. 50, no. July 2024, pp. 63–75, 2025, doi: https://doi.org/10.1093/jpepsy/jsae039.

M. B. Younes, "Assisting Drivers at Stop Signs in a Connected Vehicle Environment," Futur. Internet, vol. 15, no. 7, p. 238, 2023, doi: https://doi.org/ 10.3390/fi1507023.

S. Rahmatullah and Sriani, "Identification of Social Media Addiction Levels on " TikTok " Among Students Using Mamdani Fuzzy Logic," Inf. J. Ilm. Bid. Teknol. Inf. dan Komun., vol. 10, no. 1, pp. 8–15, 2025, doi: https://doi.org/10.25139/inform.v10i1.8447.

F. H. Nasution, R. A. Setyanti, and Y. Siregar, “Analisis Faktor Faktor Yang Mempengaruhi Viralnya Konten Tiktok Dengan Pendekatan Statistik,” J. Artif. Intell. Digit. Bus., vol. 4, no. 2, pp. 2441–2445, 2025, doi: https://doi.org/ 10.31004/riggs.v4i2.875.

M. H. Arfian et al., “Analisis Sentimen Pada Media Sosial Menggunakan Metode Support Vector Machine,” J. Ilmu Tek. dan Komput., vol. 09, no. 01, pp. 1–6, 2025, doi: http://dx.doi.org/10.22441/jitkom.v9i1.001.

I. R. Ainunnisa and S. Sulastri, “Analisis Sentimen Aplikasi Tiktok dengan Metode Support Vector Machine ( SVM ), Logistic Regression dan Naïve Bayes,” J. Teknol. Sist. Inf. dan Apl., vol. 6, no. 3, pp. 423–430, 2023, doi: 10.32493/jtsi.v6i3.31076.

T. Alifah, D. Wahdiyati, and N. Rahman, “Analisis Engagement Rate Pada Konten Video di Akun Tiktok Grup Idol Virtual Plave @ plave official,” J. Komun. Nusant., vol. 7, no. 1, pp. 1–15, 2025, doi: https://doi.org/10.33366/jkn.v7i1.226.

M. Furqan, R. Ichsan, and H. Hasibuan, "Recognition Of Calligraphy Writing Patterns Using The Zernike Moment Method And Support Vector Machine," J. Sci. Soc. Res., vol. 4307, no. 4, pp. 2139–2146, 2024, doi: https://doi.org/10.54314/jssr.v7i4.2362.

A. S. Chan, M. Husna, P. P. Putra, A. Info, S. Analysis, and T. Classification, "A Performance Enhancement Strategy for Sentiment Classification Models On Political Social Media Using Hyperparameter Tuning And Boosting," Int. J. Adv. Data Inf. Syst., vol. 6, no. 3, pp. 763–772, 2025, doi: 10.59395/ijadis.v6i3.1455.

C. Maulida, T. Yunanda, M. Hanafi, W. Mega, and P. Dhuhita, "Sentiment Analysis on TikTok Shop Reviews Using Long Short-Term Memory Method to Find Business Opportunity," Inf. J. Ilm. Bid. Teknol. Inf. dan Komunikas, vol. 9, no. 1, pp. 1–7, 2024, doi: https://doi.org/10.25139/inform.v9i1.6524.

A. Agung, A. Daniswara, and I. K. D. Nuryana, “Data Preprocessing Pola Pada Penilaian Mahasiswa Program Profesi Guru,” JINACS (Journal Informatics Comput. Sci., vol. 05, no. 01, pp. 97–100, 2023, doi: https://doi.org/10.26740/jinacs.v5n01.p97-100.

N. Putri et al., “Penerapan Feature Engineering Dan Hyperparameter Tuning Untuk Meningkatkan Akurasi Model Random Forest Pada Application Of Feature Engineering And Hyperparameter Tuning To Improve The Accuracy Of Random Forest Models On Credit Risk,” J. JTIK (Jurnal Teknol. Inf. dan Komunikasi), vol. 12, no. 2, pp. 251–262, 2025, doi: 10.25126/jtiik.2025128472.

V. Padiya, D. Shah, T. Dave, and R. Karani, Classification of Instagram Users and Prediction of Engagement Rates Using Machine Learning. Springer Nature Singapore, 2025. doi: 10.1007/978-981-96-4139-0.

I. Permana and F. Nur Salisah, "The Effect of Data Normalization on the Performance of the Classification Results of the Backpropagation Algorithm Pengaruh Normalisasi Data Terhadap Performa Hasil Klasifikasi Algoritma Backpropagation," IJIRSE Indones. J. Inform. Res. Softw. Eng. J., vol. 2, no. 1, pp. 67–72, 2022, doi: https://doi.org/10.57152/ijirse.v2i1.311.

J. Anggraini and D. Alita, “Implementasi Metode SVM Pada Sentimen Analisis Terhadap Pemilihan Presiden ( Pilpres ) 2024 Di Twitter,” J. Inform. J. Pengemb. IT, vol. 9, no. 2, pp. 102–111, 2024, doi: 10.30591/jpit.v9i2.6560.

Sriani, Sulindawaty, and Y. Rizky, “Tembakau Menggunakan Glcm (Gray Level Co-Occurrence Matrix) Dan Svm (Support Vector Machine),” JITET (Jurnal Inform. dan Tek. Elektro Ter., vol. 12, no. 3, pp. 3342–3349, 2024, doi: http://dx.doi.org/10.23960/jitet.v12i3.4599.

W. Nugraha and A. Sasongko, “Hyperparameter Tuning pada Algoritma Klasifikasi dengan Grid Search Hyperparameter Tuning on Classification Algorithm with Grid Search,” Sist. J. Sist. Inf., vol. 11, no. 2, pp. 391–401, 2022, doi: https://doi.org/10.32520/stmsi.v11i2.1750.

F. Farasalsabila, V. B. Lestari, D. D. N. Cahyo, T. Lestari, F. Rusdi, and A. Islami, "Sentiment Analysis for IMDb Movie Review Using Support Vector Machine ( SVM ) Method," Inf. J. Ilm. Bid. Teknol. Inf. dan Komunikas, vol. 8, no. 2, 2023, doi: https://doi.org/10.25139/inform.v8i2.5700.

Published
2026-02-02
How to Cite
Algifahri, M. D., & Sriani, S. (2026). Performance Analysis of Support Vector Machine with Hyperparameter Tuning for Engagement Rate Classification of TikTok Digital Marketing Content. Inform : Jurnal Ilmiah Bidang Teknologi Informasi Dan Komunikasi, 11(1), 111-120. https://doi.org/10.25139/inform.v11i1.11362
Section
Articles

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.