Email this article 
Evaluation of Computer-Based Testing Website Quality Using the DeLone and McLean Information System Success Model
Abstract
The rapid development of information technology has significantly impacted the education sector, particularly in the implementation of computer-based examination systems. This study aims to analyze and evaluate the quality of a Computer-Based Testing (CBT) website at SMK Bangun Bangsa using the DeLone and McLean Information System Success Model. A quantitative approach was employed by collecting primary data through questionnaires distributed to 260 students from grades X and XI of SMK Bangun Bangsa who had experience using the CBT system. The respondents represented various demographic backgrounds in terms of gender, age, and academic majors. The variables analyzed include system quality, information quality, service quality, user satisfaction, and net benefits. Data analysis was conducted using descriptive statistical methods, supported by validity and reliability testing to ensure the accuracy and consistency of the research instrument. The results indicate that the CBT system has generally performed well. System quality obtained a score of 75.4% (good category), indicating that the system is easy to use despite minor technical issues. Information quality achieved 77.7% (very good), reflecting that the system provides accurate, relevant, and understandable information. Service quality recorded the lowest score of 72.2% (good), suggesting the need for improvement in security and technical support. Meanwhile, user satisfaction reached 81.6% and net benefits 80%, both categorized as very good, indicating that the system enhances efficiency and provides a positive user experience. This study contributes to evaluating the effectiveness of CBT systems in vocational education environments and highlights the importance of improving service quality and system reliability to achieve optimal system performance. Future research is recommended to expand the study scope and integrate additional models for deeper analysis.
Keywords
Full Text:
PDFReferences
D. Hawkridge, New information technology in education. Routledge, 2022.
S. Timotheou et al., "Impacts of digital technologies on education and factors influencing schools' digital capacity and transformation: A literature review," Education and information technologies, vol. 28, no. 6, pp. 6695-6726, 2023, doi: 10.1007/s10639-022-11431-8.
I. A. Ariwanta, I. E. Saputra, N. P. E. Apriyanthi, I. Gunawan, and G. Indrawan, "Analisis kepuasan pengguna menggunakan metode eucs pada sistem computer based test di institusi pendidikan," Journal of Computer System and Informatics (JoSYC), vol. 4, no. 4, pp. 942-951, 2023, doi: 10.47065/josyc.v4i4.3752.
P. Diawati, S. S. Gadzali, M. K. N. Abd Aziz, A. M. A. Ausat, and S. Suherlan, "The role of information technology in improving the efficiency and productivity of human resources in the workplace," Jurnal Teknologi Dan Sistem Informasi Bisnis, vol. 5, no. 3, pp. 296-302, 2023, doi: 10.47233/jteksis.v5i3.872.
K. Talman, J. Vierula, T. Karihtala, E. Laakkonen, J. Engblom, and E. Haavisto, "Development and Validity Evaluation of a National Digital Entrance Examination Test for Higher Education Student Selection," Higher Education Quarterly, vol. 79, no. 1, p. e70006, 2025, doi: 10.1111/hequ.70006.
A. D. Augustia, C. N. Agustia, D. Azzahra, L. Hakim, and V. Pratiwi, "Analisis validitas dan reliabilitas soal pilihan ganda dengan menggunakan software Anates pada mata pelajaran perpajakan," AKADEMIK: Jurnal Mahasiswa Ekonomi & Bisnis, vol. 5, no. 1, pp. 250-265, 2025, doi: 10.37481/jmeb.v5i1.1165.
O. Tananda, M. Nasir, M. Milana, and M. Muslim, "Perbandingan antara sistem computer based test dan paper based test pada hasil pembelajaran mata pelajaran pmkr di smkn 1 sumatera barat," JTPVI: Jurnal Teknologi Dan Pendidikan Vokasi Indonesia, vol. 1, no. 1, pp. 67-74, 2023, doi: 10.24036/jtpvi.v1i1.10.
R. Setiawan, "Optimasi Pengalaman Pengguna: Penilaian Otomatis dan Pencegahan Kecurangan Ujian Online," bit-Tech, vol. 7, no. 2, pp. 299-306, 2024, doi: 10.32877/bt.v7i2.1758.
M. Sakban and Y. M. Silaban, "Aplikasi Ujian Computer Based Test (CBT) Berbasis Web," Jurnal Bisantara Informatika, vol. 8, no. 2, pp. 65-77, 2024.
Z. Wahiah, S. M. Prabowo, and H. A. S. Hana, "Eksplorasi Efektivitas Tes Pilihan Ganda Berbasis Komputer Sebagai Evaluasi Pembelajaran: Jurnal Pendidikan," EDUCATIVO: Jurnal Pendidikan, vol. 2, no. 2, pp. 342-347, 2023.
A. M. Kartini, S. Fadli, and H. Fahmi, "The DeLone and McLean model for measuring success hospital management information system case study: Praya Regional Hospital," JISA (Jurnal Informatika dan Sains), vol. 8, no. 1, pp. 66-73, 2025, doi: 10.31326/jisa.v8i1.2203.
R. Saputri, M. E. Baining, and K. Khairiyani, "Pengaruh kualitas sistem dan kualitas pelayanan terhadap manfaat bersih aplikasi mobile banking dengan variabel intervening kepuasan pengguna," E-Bisnis: Jurnal Ilmiah Ekonomi Dan Bisnis, vol. 17, no. 1, pp. 126-138, 2024, doi: 10.51903/e-bisnis.v17i1.1801.
F. Rozi, S. Fadli, and M. T. A. Zaen, "Application of the DeLone and McLean Success Model to the SEMAIK Website: A Case Study in Central Lombok," JISA (Jurnal Informatika dan Sains), vol. 8, no. 2, pp. 220-227, 2025, doi: 10.31326/jisa.v8i2.2554.
D. Y. Nofita and J. Veri, "Mengukur keberhasilan penerapan aplikasi Sistem Keuangan Desa (Siskeudes) dengan model kesuksesan Delon and McLean," Jurnal Ekobistek, vol. 13, no. 2, pp. 27-35, 2024, doi: 10.35134/ekobistek.v13i2.776.
R. Pambudi, B. Berlilana, and G. Karyono, "Analisis Kesuksesan Pengguna Website E-Learning Menggunakan Model DeLone & McLean," Decode: Jurnal Pendidikan Teknologi Informasi, vol. 4, no. 3, pp. 948-967, 2024, doi: 10.51454/decode.v4i3.683.
N. N. Pusparini and A. Sani, "Mengukur keberhasilan penerapan sistem informasi akademik dengan model kesuksesan Delon and Mclean," METHOMIKA: Jurnal Manajemen Informatika & Komputerisasi Akuntansi, vol. 4, no. 2, pp. 149-155, 2020, doi: 10.46880/jmika.Vol4No2.pp149-155.
S. R. Agustini, "Analisis Kesuksesan Aplikasi Noice Terhadap Pengguna DiKota Jambi Menggunakan Metode DeLone and Mclean," Jurnal Informatika Dan Rekayasa Komputer (JAKAKOM), vol. 4, no. 1, pp. 883-891, 2024, doi: 10.33998/jakakom.2024.4.1.1660.
E. Wicaksono, E. M. Safitri, M. A. S. Anam, and R. A. Bimantara, "Analisis kepuasan pengguna pada aplikasi gojek mengguanakn pendekatan metode delone-mclean," in Prosiding Seminar Nasional Teknologi dan Sistem Informasi, 2023, vol. 3, no. 1, pp. 394-402, doi: 10.33005/sitasi.v3i1.613.
M. Esmaeili Givi, H. Keshavarz, and Z. Kargar Azad, "Quality assessment of E-learning website using asymmetric impact–performance analysis and Kano’s customer satisfaction model: a case study based on WebQual 4.0," Information Discovery and Delivery, vol. 51, no. 1, pp. 35-46, 2023, doi: 10.1108/IDD-08-2021-0083.
A. I. Pauji, R. Rida, and R. H. Emynorane, "The Effect Of Web-Based Academic Information System Use On Student Satisfaction: A Quantitative Study In Islamic Higher Education," JoIEM (Journal of Islamic Education Management), vol. 6, no. 2, pp. 99-105, 2025, doi: 10.30762/joiem.v6i2.6799.
X. J. Mamakou, P. Zaharias, and M. Milesi, "Measuring customer satisfaction in electronic commerce: the impact of e-service quality and user experience," International Journal of Quality & Reliability Management, vol. 41, no. 3, pp. 915-943, 2024, doi: 10.1108/IJQRM-07-2021-0215.
W. H. DeLone and E. R. McLean, "The DeLone and McLean model of information systems success: a ten-year update," Journal of management information systems, vol. 19, no. 4, pp. 9-30, 2003.
M. M. Rahman, "Sample size determination for survey research and non-probability sampling techniques: A review and set of recommendations," Journal of Entrepreneurship, Business and Economics, vol. 11, no. 1, pp. 42-62, 2023.
S. J. Stratton, "Population sampling: Probability and non-probability techniques," Prehospital and Disaster Medicine, vol. 38, no. 2, pp. 147-148, 2023, doi: 10.1017/S1049023X23000304.
M. A. Adeoye, "Review of sampling techniques for education," ASEAN Journal for Science Education, vol. 2, no. 2, pp. 87-94, 2023.
N. Nurkholis, Wilarso, P. Sukamto, M. A. Sobarnas, S. Jamaludin, and U. Tsani A, "Digital survey for customer satisfaction of regional drinking water companies (PDAM) using the mWater application and the Slovin formula method," in BIO Web of Conferences, 2024, vol. 144: EDP Sciences, p. 03006, doi: 10.1051/bioconf/202414403006.
M. K. H. Hasan and L. K. Kumar, "Determining adequate sample size for social survey research: sample size for social survey research," Journal of the Bangladesh Agricultural University, vol. 22, no. 2, pp. 146-157, 2024, doi: 10.3329/jbau.v22i2.74547.
T. Tugiman, H. Herman, and A. Yudhana, "Uji validitas dan reliabilitas kuesioner model Utaut untuk evaluasi sistem pendaftaran online rumah sakit," JATISI, vol. 9, no. 2, pp. 1621-1630, 2022.
E. F. Tarigan, S. Nilmarito, K. Islamiyah, A. Darmana, and R. D. Suyanti, "Analisis instrumen tes menggunakan Rasch model dan software SPSS 22.0," Jurnal Inovasi Pendidikan Kimia, vol. 16, no. 2, pp. 92-96, 2022, doi: 10.15294/jipk.v16i2.30530.
R. Mahkotawati, T. Rijanto, and P. W. Rusimamto, "Uji validitas dan reliabilitas instrumen penelitian: Angket pengalaman praktik kerja lapangan (PKL) pada siswa SMK," JIIP-Jurnal Ilmiah Ilmu Pendidikan, vol. 8, no. 2, pp. 1830-1835, 2025, doi: 10.54371/jiip.v8i2.6990.
F. D. P. Anggraini, A. Aprianti, V. A. V. Setyawati, and A. A. Hartanto, "Pembelajaran statistika menggunakan software SPSS untuk uji validitas dan reliabilitas," Jurnal basicedu, vol. 6, no. 4, pp. 6491-6504, 2022.
C. D. A. Istri and R. Fadila, "Uji validitas dan reliabilitas kuesioner pengetahuan masyarakat tentang program JKN," Jurnal Kesehatan Qamarul Huda, vol. 11, no. 1, pp. 307-315, 2023.
E. A. Cahyono and D. Darsini, "Sikap masyarakat terhadap program vaksinasi booster covid-19 (validitas dan reliabilitas kuesioner penelitian)," Pengembangan Ilmu dan Praktik Kesehatan, vol. 1, no. 1, pp. 1-21, 2022, doi: 10.56586/pipk.v1i1.185.
C. J. Viana, E. Selviyanti, A. Deharja, and A. P. Wicaksono, "Analisis Kesuksesan Sistem Informasi Manajemen Puskesmas (SIMPUS) Menggunakan Metode Delone and Mclean di UPT Puskesmas Sananwetan Kota Blitar," J-REMI: Jurnal Rekam Medik dan Informasi Kesehatan, vol. 5, no. 2, pp. 120-131, 2024, doi: 10.25047/j-remi.v5i2.4124.
DOI: https://doi.org/10.31326/jisa.v9i1.2748
Refbacks
- There are currently no refbacks.
Copyright (c) 2026 Muhamad Sakinul Wadi, Sofiansyah Fadli, Mohammad Taufan Asri Zaen
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
JOURNAL IDENTITY
Journal Name: JISA (Jurnal Informatika dan Sains)
e-ISSN: 2614-8404, p-ISSN: 2776-3234
Publisher: Program Studi Teknik Informatika Universitas Trilogi
Publication Schedule: June and December
Language: English
APC: The Journal Charges Fees for Publishing
Indexing: EBSCO , DOAJ, Google Scholar, Arsip Relawan Jurnal Indonesia, Directory of Research Journals Indexing, Index Copernicus International, PKP Index, Science and Technology Index (SINTA, S4) , Garuda Index
OAI address: http://trilogi.ac.id/journal/ks/index.php/JISA/oai
Contact: jisa@trilogi.ac.id
Sponsored by: DOI – Digital Object Identifier Crossref, Universitas Trilogi
In Collaboration With: Indonesian Artificial Intelligent Ecosystem(IAIE), Relawan Jurnal Indonesia, Jurnal Teknologi dan Sistem Komputer (JTSiskom)
JISA (Jurnal Informatika dan Sains) is Published by Program Studi Teknik Informatika, Universitas Trilogi under Creative Commons Attribution-ShareAlike 4.0 International License.