Detection of Rupiah Nominal Values Based on Computer Vision and OCR for Low Vision Accessibility

Authors

  • Doucoure Mohammed Hakeem Universitas Bina Sarana Informatika Author
  • Trisna Almuti Universitas Bina Sarana Informatika Author
  • Syahbil Afriza Baharaji Universitas Bina Sarana Informatika Author
  • Muhammad Iqbal Universitas Bina Sarana Informatika Author
  • Albert Riyandi Universitas Bina Sarana Informatika Author

DOI:

https://doi.org/10.66341/fusion.v3i1.338

Keywords:

Computer Vision, Low Vision, OCR, Image Processing, Rupiah Currency

Abstract

The ability to recognize banknotes' nominal value is a fundamental skill in daily economic transactions. However, for low-vision individuals, this simple task poses a major challenge, risking transaction errors and fraud. This study aims to build a web-based application capable of detecting Rupiah currency nominals in real-time by integrating computer vision and Optical Character Recognition (OCR) as an independent accessibility feature. The method combines a custom object detection model based on the YOLO architecture via the Roboflow platform and Tesseract OCR for nominal text verification, which is then integrated with the Web Speech API for voice-based output (Text-to-Speech). The system test results indicate that the combined "Roboflow + OCR" approach significantly improves detection reliability compared to using the object model alone. The system achieved a classification accuracy rate of 94.5% under optimal lighting conditions, with an average Text-to-Speech response latency of 1.8 seconds. This implementation proves that the synergy of image processing and OCR can provide an effective and inclusive assistive technology solution for visually impaired groups in Indonesia.

Author Biographies

  • Doucoure Mohammed Hakeem, Universitas Bina Sarana Informatika

    Classmate

  • Trisna Almuti, Universitas Bina Sarana Informatika

    Classmate

  • Muhammad Iqbal, Universitas Bina Sarana Informatika

    Classmate

  • Albert Riyandi, Universitas Bina Sarana Informatika

    Dosen

References

[1] D. Rafikil, M. Basri, U. Suwardoyo, A. Wafiah, And M. Yunus, “Pendeteksi Nominal Mata Uang Kertas Menggunakan Kamera Berbasis Android,” Jurnal Manajemen Informatika, Sistem Informasi Dan Teknologi Komputer (Jumistik), Vol. 4, No. 2, Pp. 495–504, 2025, Doi: 10.70247/Jumistik.V4i2.170.

[2] Misbahul Arifin, Abdul Rahman, And Ravik Karsidi, “Dampak Pengembangan Teknologi Asistif Terhadap Layanan Pendidikan Berbasis Iptek Bagi Individu Tunanetra,” Jst (Jurnal Sains Dan Teknologi), Vol. 13, No. 1, Pp. 33–40, 2024, Doi: 10.23887/Jstundiksha.V13i1.73684.

[3] D. Indra, H. Herman, And F. S. Budi, “Implementasi Sistem Penghitung Kendaraan Otomatis Berbasis Computer Vision,” Komputika : Jurnal Sistem Komputer, Vol. 12, No. 1, Pp. 53–62, 2023, Doi: 10.34010/Komputika.V12i1.9082.

[4] Mohammad Soeharto, Mohammad Jeky Hasan, Ahmad Rega Susanto, And Dimas Ahmad Fahrezi, “Mengklasifikasi Mata Uang Lima Ribu Rupiah Dan Dua Ribu Rupiah Dengan Menggunakan Algoritma Cnn,” Saber : Jurnal Teknik Informatika, Sains Dan Ilmu Komunikasi, Vol. 2, No. 3, Pp. 163–170, 2024, Doi: 10.59841/Saber.V2i3.1407.

[5] M. N. Baay, A. N. Irfansyah, And M. Attamimi, “Sistem Otomatis Pendeteksi Wajah Bermasker Menggunakan Deep Learning,” Jurnal Teknik Its, Vol. 10, No. 1, 2021, Doi: 10.12962/J23373539.V10i1.59790.

[6] F. Dristyan, A. B. Trisnawan, and M. S. Simanjuntak, COMPUTER VISION : Implementasi dan Penerapan.

[7] F. Ananda, Lutfiyah Et Al., “Deteksi Nominal Uang Kertas Rupiah Menggunakan Yolov8 Dan Text-To-Speech Untuk Disabilitas Netra,” Vol. 06, No. 01, Pp. 61–65, 2026.

[8] M. Malik Ibrahim, R. Rahmadewi, And L. Nurpulaela, “Pendeteksian Nominal Uang Pada Gambar Menggunakan Convolutional Neural Network: Integrasi Metode Pra-Pemrosesan Citra Dan Klasifikasi Berbasis Cnn,” Jati (Jurnal Mahasiswa Teknik Informatika), Vol. 7, No. 2, Pp. 1394–1400, 2023, Doi: 10.36040/Jati.V7i2.6863.

[9] Aprilino A. And Imam Husni A., “Implementasi Algoritma Yolo Dan Tesseract Ocr Pada Sistem Deteksi Plat Nomor Otomatis,” Jurnal Teknoinfo, Vol. 16, No. 1, Pp. 54–59, 2022.

[10] M. N. Darpito, Kartika Firdausy, And Abdul Fadlil, “Perbandingan Unjuk Kerja Library Optical Character Recognition (Ocr) Dalam Pengenalan Teks Pada Dokumen Digital,” Jurnal Informatika Polinema, Vol. 11, No. 3, Pp. 273–282, 2025, Doi: 10.33795/Jip.V11i3.7025.

[11] G. Swapurba And I. Pratama, “Implementasi Voice To Text Pada Invoice Checking Berbasis Web,” Intechno Journal (Information Technology Journal), Vol. 5, No. 2, Pp. 65–74, 2023, Doi: 10.24076/Intechnojournal.2023v5i2.1391.

[12] F. S. Utomo Et Al., “Pengembangan Sistem E-Learning Inklusif Cerdas Untuk Tuna Netra Dengan Integrasi Teknologi Voice Command Dan Text-To- Developing An Intelligent Inclusive E-Learning System For Visually Impaired Users Through Voice Command And Text-To-,” Vol. 13, No. 2, Pp. 261–272, 2026.

[13] Clara Alyuson, Husnul Hotimah, and Febri Dristyan, “Penerapan Computer Vision Dalam Pengenalan Bendera Negara: Integrasi HSV Dan Kontur Menggunakan OpenCV,” J. Comput. Sci. Technol., vol. 3, no. 3, pp. 166–173, 2025, doi: 10.59435/jocstec.v3i3.548.

Downloads

Published

2026-07-15

How to Cite

Detection of Rupiah Nominal Values Based on Computer Vision and OCR for Low Vision Accessibility. (2026). Fusion : Journal of Research in Engineering, Technology and Applied Sciences, 3(1), 17-23. https://doi.org/10.66341/fusion.v3i1.338