Usability Evaluation of the Yellow Cart Feature in the TikTok Shop Application Using the System Usability Scale (SUS)

Hikmah Sani Nadia, Evy Nurmiati, Nuryasin nuryasin

Abstract


TikTok Shop is a rapidly growing e-commerce platform in Indonesia, particularly through its Yellow Basket feature, which allows content creators to embed product links directly in videos. This feature has become essential within Indonesia's social commerce ecosystem. However, limited research specifically evaluates the usability of this feature from a general user perspective. This study aims to measure and evaluate the usability of TikTok Shop's Yellow Basket feature using the System Usability Scale (SUS) method. This method was selected because it is a widely validated and reliable instrument for assessing the perceived usability of interactive systems, providing a standardized measure that facilitates comparison across studies. Testing involved 50 active TikTok Shop users from various age groups, within four predefined age categories (17–21, 22–35, 36–45, and above 45 years). Data were collected through an online questionnaire consisting of 10 statements with a Likert scale and then analyzed using the standard SUS scoring formula. The evaluation yielded a mean SUS score of 71.30, categorized as “Good” according to the adjective rating scale. Dimension-level analysis identified efficiency and errors as the weakest dimensions, attributed to cognitive load induced by a concurrently active background video during catalog navigation. Thematic analysis of open-ended responses revealed three dominant concerns: pricing transparency issues, a rigid and inflexible user interface, and a perceived lack of practicality. Additionally, some of respondents reported usability difficulties suggesting an age-related usability gap not captured by the aggregate SUS score. Design recommendations are proposed to address the identified usability gaps and improve the overall user experience.

Keywords


Usability Testing; System Usability Scale; TikTok Shop; Yellow Basket; User Experience; Human Computer Interaction

Full Text:

PDF

References


N. Putri, Y. Prasetya, P. W. Handayani, and H. Fitriani, “TikTok Shop: How trust and privacy influence generation Z’s purchasing behaviors,” Cogent Soc. Sci., vol. 10, no. 1, 2023, doi: 10.1080/23311886.2023.2292759.

I. Purwandani, N. O. Syamsiah, and S. Nurwahyuni, “Perceived Usability Evaluation of TikTok Shop Platform Using the System Usability Scale,” Sinkron, vol. 8, no. 3, pp. 1389–1399, 2023, doi: 10.33395/sinkron.v8i3.12473.

S. Dahniar, W. Anugra, A. Sakinah, W. Febrianti, and M. Hasan, “Utilization of TikTok Shop Interactive Features and Their Impact on Consumer Purchasing Decisions,” Int. J. Asian Bus. Manag., vol. 2, no. 6, pp. 947–960, 2023, doi: 10.55927/ijabm.v2i6.6891.

D. M. Tan, K. R. Alexia, and U. Bunda, “the Influence of Tiktok Affiliate Content Quality and Credibility on Purchase Decisions Via the Yellow Basket Feature,” JUMDER J. Bisnis Digit. dan Ekon. Kreat., vol. 1, no. 2, pp. 58–79, 2025.

S. Shasya and W. J. A, “Yellow Cart Feature on Tiktok as a Medium to Attract Purchase Interest,” J. Indones. Sos. Sains, vol. 5, no. 07, pp. 1846–1853, 2024, doi: 10.59141/jiss.v5i07.1195.

A. Baj-Rogowska and M. Sikorski, “Exploring the usability and user experience of social media apps through a text mining approach,” Eng. Manag. Prod. Serv., vol. 15, no. 1, pp. 86–105, 2023, doi: 10.2478/emj-2023-0007.

I. Standard and T. S. Preview, “Iso 9241-11,” vol. 1998, 1998.

M. Kurosu, “Usability, quality in use and the model of quality characteristics,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 9169, pp. 227–237, 2015, doi: 10.1007/978-3-319-20901-2_21.

J. Nielsen, Usability engineering. Morgan Kaufmann, 1994.

J. Brooke, “SUS: A ‘Quick and Dirty’ Usability Scale,” Usability Eval. Ind., pp. 207–212, 2020, doi: 10.1201/9781498710411-35.

A. M. Deshmukh and R. Chalmeta, “Validation of system usability scale as a usability metric to evaluate voice user interfaces,” PeerJ Comput. Sci., vol. 10, 2024, doi: 10.7717/peerj-cs.1918.

R. D. Pahlevi and H. B. Santoso, “A Usability Evaluation of an E-Commerce Checkout System Using SUS and Usability Testing,” vol. 7, no. 1, pp. 160–173, 2026, doi: 10.59395/ijadis.v7i1.1498.

A. Bangor, P. Kortum, and J. Miller, “Determining what individual SUS scores mean; adding an adjective rating,” J. usability Stud., vol. 4, no. 3, pp. 114–23, 2009.

H. R. Saeidnia, M. Karajizadeh, Z. Mohammadzadeh, S. Abdoli, and M. Hassanzadeh, “Usability Evaluation of the Mask Mobile Application: The Official Application of the Iranian Government,” Iran. J. Med. Microbiol., vol. 16, no. 1, pp. 49–55, 2022, doi: 10.30699/ijmm.16.1.49.

T. S. Tullis and J. N. Stetson, “A Comparison of Questionnaires for Assessing Website Usability ABSTRACT : Introduction,” Usability Prof. Assoc. Conf., pp. 1–12, 2004, [Online]. Available: http://home.comcast.net/~tomtullis/publications/UPA2004TullisStetson.pdf

J. R. Lewis and J. Sauro, “The Factor Structure of the System Usability Scale. In: Kurosu, M. (eds) Human Centered Design. Lecture Notes in Computer Science.,” Lncs, vol. 5619, pp. 94–103, 2009.




DOI: https://doi.org/10.31326/jisa.v9i1.2762

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Hikmah Sani Nadia, Evy Nurmiati, Nuryasin nuryasin

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

JOURNAL IDENTITY

Journal Name: JISA (Jurnal Informatika dan Sains)
e-ISSN: 2614-8404, p-ISSN: 2776-3234
Publisher: Program Studi Teknik Informatika Universitas Trilogi
Publication Schedule: June and December 
Language: English
APC: The Journal Charges Fees for Publishing 
Indexing:  EBSCO , DOAJ, Google Scholar, Arsip Relawan Jurnal Indonesia, Directory of Research Journals Indexing, Index Copernicus International, PKP Index, Science and Technology Index (SINTA, S4) , Garuda Index
OAI address: http://trilogi.ac.id/journal/ks/index.php/JISA/oai
Contact: jisa@trilogi.ac.id
Sponsored by: DOI – Digital Object Identifier Crossref, Universitas Trilogi

In Collaboration With: Indonesian Artificial Intelligent Ecosystem(IAIE), Relawan Jurnal Indonesia, Jurnal Teknologi dan Sistem Komputer (JTSiskom)

 

 

JISA (Jurnal Informatika dan Sains) is Published by Program Studi Teknik Informatika, Universitas Trilogi under Creative Commons Attribution-ShareAlike 4.0 International License.