A Comparative Analysis of Naïve Bayes and Random Forest Algorithms for Sentiment Classification of Akulaku User Reviews
DOI:
https://doi.org/10.66341/fusion.v3i1.342Keywords:
Sentiment Analysis, Naïve Bayes, Random ForestAbstract
Abstract User reviews of the Akulaku application on Google Play Store contain important information regarding user satisfaction and complaints. This study compares the performance of Naïve Bayes and Random Forest algorithms in classifying sentiment into three classes: positive, negative, and neutral. A total of 2,000 Indonesian-language reviews were collected using web scraping techniques. Data were processed through case folding, cleaning, normalization, stopword removal, tokenizing, and stemming. Labeling was based on user ratings. After preprocessing, 1,953 data points remained with an imbalanced distribution; SMOTE was applied to balance each class to 1,114 samples. TF-IDF was used for feature weighting with an 80:20 train-test split. Results showed Random Forest achieved 83% accuracy, while Naïve Bayes reached 80%. However, Naïve Bayes outperformed in precision, recall, and F1-score with macro averages of 0.59, 0.70, and 0.60, compared to Random Forest at 0.52, 0.55, and 0.54. Based on these results, the choice of the best algorithm depends on the specific needs. If the priority is overall accuracy, Random Forest is more recommended however, if the priority is balanced performance across sentiment classes, Naïve Bayes performs better.
References
[1] L. O. M. H. Abdillah Sam Mongkito, N. Ransi, L. Surimi, A. Tenriawaru, G. Gunawan, and B. Wijaya Rauf, “Analisis Sentimen Aplikasi Peminjaman Online Berdasarkan Ulasan Pada Play Store Menggunakan Metode Naïve Bayes Dan Support Vector Machine (Studi Kasus : Adakami Dan Easycash),” AnoaTIK J. Teknol. Inf. Dan Komput., vol. 2, no. 2, pp. 121–128, Dec. 2024, doi: 10.33772/anoatik.v2i2.71.
[2] Putri Cahyani and Lufty Abdillah, “Perbandingan Performa Algoritma Naïve Bayes, SVM dan Random Forest Studi Kasus Analisis Sentimen Pengguna Sosial Media X,” KALBISCIENTIA J. Sains Dan Teknol., vol. 11, no. 02, pp. 12–21, Oct. 2024, doi: 10.53008/kalbiscientia.v11i02.3624.
[3] L. A. Qomariah, A. Eviyanti, H. Setiawan, and N. Ariyanti, “Klasifikasi Sentimen Ulasan Minecraft Pada Google Play Store: Studi Komparatif Naïve Bayes Dan Random Forest,” vol. 10, no. 1, 2026.
[4] Kaeren and Andrianingsih, “Analisis Sentimen Aplikasi Linkaja Di Google Play Store Menggunakan Algoritma Naïve Bayes Dan Random Forest,” J. Ris. Dan Apl. Mhs. Inform. JRAMI, vol. 06, no. 02, pp. 438–447, 2025, doi: 10.30998/jrami.v6i02.13821.
[5] A. K. Nugroho, L. N. Hayati, and S. R. Jabir, “Analisis Perbandingan Metode Naive Bayes dan Random Forest pada Klasifikasi Sentimen Publik terhadap Aplikasi Identitas Kependudukan Digital (IKD),” J. Algoritma, vol. 22, no. 2, Nov. 2025, doi: 10.33364/algoritma/v.22-2.2729.
[6] A. Sole and A. Zubair, “Analisis Perbandingan Naïve Bayes dan Random Forest untuk Evaluasi PKKMB Berbasis Sentimen Mahasiswa,” J. Janitra Inform. Dan Sist. Inf., vol. 6, no. 1, pp. 20–32, Apr. 2026, doi: 10.59395/nf4xmg03.
[7] S. Agustin, A. E. Pajri, and A. D. Ardianti, “Analisis Sentimen Aplikasi BRImo Pada Google Play Store Menggunakan Algoritma Naïve Bayes Dan Random Forest,” J. Algoritma, vol. 23, no. 1, May 2026, doi: 10.33364/algoritma/v.23-1.3266.
[8] F. Marzuqi, Y. Purba, T. Syaputra, W. Bismi, I. Kurniawati, and R. Fahlapi, “Perbandingan Algoritma Machine Learning Untuk Sentimen Ulasan Aplikasi Jobstreet,” INFOTECH J., vol. 11, no. 2, pp. 416–423, Dec. 2025, doi: 10.31949/infotech.v11i2.16609.
[9] D. N. I. Huda, C. Prianto, and R. M. Awangga, “Analisis Sentimen Perbandingan Layanan Jasa Pengiriman Kurir Pada Ulasan Play Store Menggunakan Metode Random Forest dan Descision Tree,” vol. 11, no. 02, 2023.
[10] A. Nurian, “Analisis Sentimen Ulasan Pengguna Aplikasi Google Play Menggunakan Naïve Bayes,” J. Inform. Dan Tek. Elektro Terap., vol. 11, no. 3s1, Sep. 2023, doi: 10.23960/jitet.v11i3s1.3348.
[11] F. Riza, D. F. Hendrakusuma, B. Wibowo, and D. Y. A. Afghani, “Comparison Of Machine Learning Classification Algorithm Performance In Wondr By Bni Mobile Banking Review Sentiment Analysis,” J. Inf. Technol. Comput. Sci., 2025.
[12] Fenilinas Adi Artanto, “Implementasi Algoritma Random Forest dan Model Bag of Words Dalam Analisis Sentimen Mengenai E-Materai,” SATESI J. Sains Teknol. Dan Sist. Inf., vol. 4, no. 2, pp. 139–145, Oct. 2024, doi: 10.54259/satesi.v4i2.3240.
[13] Sari, Pratama, and Wijaya, “Sistem Informasi Pendaftaran Mahasiswa Baru Berbasis Web,” J. Sist. Inf., 2021.
[14] F. A. T. Putra, A. B. P. Negara, and H. Sastypratiwi, “Perbandingan Kinerja Naive Bayes Dan Random Forest Dengan Penanganan Imbalance Data,” vol. 12, 2026.
[15] M. F. Y. Herjanto and C. Carudin, “Analisis Sentimen Ulasan Pengguna Aplikasi Sirekap Pada Play Store Menggunakan Algoritma Random Forest Classifer,” J. Inform. Dan Tek. Elektro Terap., vol. 12, no. 2, Apr. 2024, doi: 10.23960/jitet.v12i2.4192.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Nur Ferdiansyah, Ariel Mutia Salsabila, Putri Wiji Lestari (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
