User Experience Evaluation of M-Passpor Using User Experience Questionnaire
Abstract
This study evaluates UX of the M-Passpor application, an m-government application to facilitate the online passport administrative process and reduce queues at the immigration office. Although this application offers convenience in making passports, since its release M-Paspor has received many complaints from users regarding the services provided. A UX evaluation was conducted using the UEQ method, which measures six of these aspects aspects: Attractiveness, Perspicuity, Efficiency, Dependability, Stimulation, and Novelty. The outputs presented that Perspective and Attractiveness aspects had the highest scores, indicating that the app is quite easy to understand and visually appealing. However, the Novelty aspect had a low score, indicating a lack of innovation and new experiences for users. Based on these findings, the researcher recommends improving efficiency, simplifying processes, notifications and feature innovation to improve UX. The outcome of this study is expected to become the basis for improving the UX quality of the M-Passpor application so as to create better and satisfying services for users in the future
Downloads
References
C. Wang, T. S. H. Teo, and L. Liu, “Perceived value and continuance intention in mobile government service in China,” Telemat. Informatics, vol. 48, no. January, p. 101348, 2020, doi: 10.1016/j.tele.2020.101348.
P. Assiroj, A. Mahendra Putra, N. P. Ayu Yuniartika Dewi, B. Mega Rahmaningtis, and I. Afifah, “Socialization Of The M- Passport Application To Minimize Difficulties In Using The M-Passport At The Class Ii Immigration Office In Wonosobo,” JaIM J. Abdimas Imigrasi, vol. 03, pp. 20–24, 2022, doi: https://doi.org/10.52617/jaim.v3i1.431.
J. D. Primasari Pamadi, D. S. Kusuma Dewi, and E. W. Dj, “Evaluasi Implementasi E-Government Di Kantor Imigrasi Kelas Ii Non Tempat Pemeriksaan Imigrasi Ponorogo,” Moderat J. Ilm. Ilmu Pemerintah., vol. 8, no. 4, pp. 756–768, 2022, doi: 10.25157/moderat.v8i4.2855.
I. Nurkumalawati and M. S. Rofii, “Public Review of M-Paspor Application in Indonesia: Mobile Government, Digital Resilience, Cyber Security,” Proc. Fifth Annu. Int. Conf. Bus. Public Adm. (AICoBPA 2022), pp. 404–412, 2023, doi: 10.2991/978-2-38476-090-9_32.
R. Parente Da Costa, E. Di. Canedo, R. T. De Sousa, R. De Oliveira Albuquerque, and L. J. Garcia Villalba, “Set of Usability Heuristics for Quality Assessment of Mobile Applications on Smartphones,” IEEE Access, vol. 7, no. c, pp. 116145–116161, 2019, doi: 10.1109/ACCESS.2019.2910778.
M. D. Revansa, A. Angraini, T. K. Ahsyar, and S. Syaifullah, “EVALUATION OF USER EXPERIENCE (UX) HNI MOBILE USING THE THINK ALOUD METHOD,” J. Tek. Inform., vol. 5, no. 4, pp. 141–148, Jul. 2024, doi: 10.52436/1.jutif.2024.5.4.2120.
A. Hinderks, M. Schrepp, F. J. Domínguez Mayo, M. J. Escalona, and J. Thomaschewski, “Developing a UX KPI based on the user experience questionnaire,” Comput. Stand. Interfaces, vol. 65, no. July, pp. 38–44, 2019, doi: 10.1016/j.csi.2019.01.007.
F. Aini, F. Muttakin, T. K. Ahsyar, and E. Saputra, “Analisis Kepuasan Pengguna Aplikasi DANA Menggunakan Metode TAM dan EUCS,” J. Sist. Cerdas, vol. 6, no. 1, pp. 65–76, 2023, doi: 10.37396/jsc.v6i1.288.
H. Petrie and N. Bevan, “The evaluation of accessibility, usability, and user experience,” Univers. Access Handb., pp. 20-1-20–16, 2009, doi: 10.1201/9781420064995-c20.
International Organization Standardization, “ISO 9241-11_2018(en), Ergonomics of human-system interaction — Part 11_ Usability_ Definitions and concepts,” Online Browsing Platform, 2018. https://www.iso.org/obp/ui/en/#iso:std:iso:9241:-11:ed-2:v1:en (accessed Jan. 20, 2024).
Z. Mack and S. Sharples, “The importance of usability in product choice: A mobile phone case study,” Ergonomics, vol. 52, no. 12, pp. 1514–1528, 2009, doi: 10.1080/00140130903197446.
F. S. Hamdi, Syaifullah, E. Saputra, and M. Jazman, “User Experience Analysis of Adobe Lightroom Application for Photographers Using the Heart Framework Method,” J. Teknol. Sist. Inf. dan Apl., vol. 7, no. 3, pp. 1151–1159, 2024, doi: 10.32493/jtsi.v7i3.41295.
M. Schrepp, A. Hinderks, and J. Thomaschewski, “Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S),” Int. J. Interact. Multimed. Artif. Intell., vol. 4, no. 6, p. 103, 2017, doi: 10.9781/ijimai.2017.09.001.
A. Butkovic, G. McArdle, and M. Bertolotto, “A Framework to Measure User Experience of Geoportals,” Conf. Int. East. Conf. Human-Computer Interact. (IECHCI2023, vol. 31, no. 2, pp. 158–164, 2015.
H. B. Santoso, M. Schrepp, R. Yugo Kartono Isal, A. Y. Utomo, and B. Priyogi, “Measuring user experience of the student-centered E-learning environment,” J. Educ. Online, vol. 13, no. 1, pp. 1–79, 2016.
A. D. Nariswari, A. Faroqi, and T. L. M. Suryanto, “Evaluasi User Experience Aplikasi Digital Banking Jenius Menggunakan Metode User Experience Questionnaire (UEQ),” Jutisi J. Ilm. Tek. Inform. dan Sist. Inf., vol. 13, no. 1, p. 574, 2024, doi: 10.35889/jutisi.v13i1.1756.
M. R. A. Soelistyo, D. F. Naufal, Muhammad Rifqi Murad, and S. A. Murad, “Improving User Experience Using User Experience Questionnaire Method on Online Attendance Super HANA Application,” in 2023 IEEE 9th International Conference on Computing, Engineering and Design (ICCED), 2023, pp. 1–6.
T. Alisya, E. Hamzah, Muhammad Luthfi Saputra, T. K. Ahsyar, and Syaifullah, “Evaluation of User Experience on ShopeePay Digital Wallet Using System Usability Scale (SUS) and User Experience Questionnaire (UEQ) Methods,” in 2023 3rd International Conference on Emerging Smart Technologies and Applications (eSmarTA), 2023, pp. 1–6. [Online]. Available: https://ieeexplore.ieee.org/document/10293705
A. A. Lee, A. M. Rachmat, Felice, and M. Ramadhani, “Evaluation of Indorelawan.org Website in User Experience Perspective using User Experience Questionnaire (UEQ),” Proc. 2023 Int. Conf. Inf. Manag. Technol. ICIMTech 2023, no. February, pp. 544–549, 2023, doi: 10.1109/ICIMTech59029.2023.10277756.
D. Wulan, Syaifullah, E. Saputra, M. Rahmawita, and A. Marsal, “Analysis of User Experience of the CapCut Application in Generation Z for Social Media Content Using the User Experience Questionnaire Method,” Sci. J. Informatics, vol. 11, no. 3, pp. 721–732, 2024, doi: 10.15294/sji.v11i3.7543.
M. Schrepp, A. Hinderks, and J. Thomaschewski, “Construction of a Benchmark for the User Experience Questionnaire ( UEQ ),” Int. J. Interact. Multimed. Artif. Intell., no. June, 2017, doi: 10.9781/ijimai.2017.445.
B. Laugwitz, T. Held, and M. Schrepp, “Construction and evaluation of a user experience questionnaire,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 5298 LNCS, pp. 63–76, 2008, doi: 10.1007/978-3-540-89350-9_6.
S. M. Gucci and F. Adnan, “Evaluation Of User Experience And Recommendation Of Improvements To The Jember DISPENDUKCAPIL Service Information System With UEQ Method,” INFORMAL Informatics J., vol. 7, no. 2, p. 109, 2022, doi: 10.19184/isj.v7i2.32111.
A. K. Darmawan, M. A. Hamzah, B. Bakir, M. Walid, A. Anwari, and I. Santosa, “Exploring Usability Dimension of Smart Regency Service with Indonesian Adaptation of the System Usability Scale (SUS) and User Experience Questionnaire (UEQ),” 2021 Int. Conf. Comput. Sci. Inf. Technol. Electr. Eng. ICOMITEE 2021, no. October, pp. 74–79, 2021, doi: 10.1109/ICOMITEE53461.2021.9650086.
M. Ariansidi, I. M. Candiasa, and I. M. G. Sunarya, “Analisis Usability Pada Sistem Informasi LAPORBUP Menggunakan Performance Measurement , Retrospective Think Aloud dan User Experience Questionnaire,” Kaji. Ilm. Inform. dan Komput., vol. 3, no. 6, pp. 754–764, 2023, doi: 10.30865/klik.v3i6.807.
M. Mujinga, “Online Banking User Experience: A User Experience Questionnaire (UEQ) Assessment in South Africa,” Indones. J. Inf. Syst., vol. 6, no. 2, pp. 117–129, 2024, doi: 10.24002/ijis.v6i2.8606.
S. A. Wulandari, M. L. Hamzah, E. Saputra, T. K. Ahsyar, and Syaifullah, “Evaluation Usability and User Experience (UX) of Bstation Mobile Applications,” in 2023 3rd International Conference on Emerging Smart Technologies and Applications (eSmarTA), 2023, pp. 1–7.
Sugiyono, Metode Penelitian Kuantitatif, Kualitatif dan R&D, no. April. ALFABETA, 2013.
Martin Schrepp and J. Thomaschewski, “Handbook for the modular extension of the User Experience Questionnaire,” 2023.
