An Experimental Study on Usability and User Experience Evaluation Techniques in Mobile Applications

Eduardo Jesus, Guilherme Guerino, Pedro Valle, Walter Nakamura, Ana Oran, Renato Balancieri, Thiago Coleti, Marcelo Morandini, Bruna Ferreira, Williamson Silva

2022

Abstract

Usability and User Experience (UX) are two quality attributes of Human-Computer Interaction (HCI) relevant to the software development process. Thus, to verify the quality of a system, researchers and developers investigate this area, resulting in different Usability and UX evaluation techniques to improve the quality of applications. However, most of them verify only one of these criteria, being necessary, in many cases, to use more than one technique to evaluate an application in both aspects. Therefore, this research aims to present an experimental study to compare the efficiency, effectiveness, and acceptance of two inspection techniques, Userbility and UX-Tips, which jointly evaluate the Usability and UX of mobile applications. In this way, 99 volunteer participants used the techniques to identify defects in two mobile applications. After the evaluation, the participants answered an acceptance questionnaire about the techniques used. The quantitative comparison results show that the techniques have no significant difference regarding efficiency and effectiveness. However, in terms of participant acceptance, Userbility achieved higher rates of usefulness and future usage intentions, while UX-Tips achieved better rates related to ease of use.

Paper Citation

in Harvard Style

Jesus E., Guerino G., Valle P., Nakamura W., Oran A., Balancieri R., Coleti T., Morandini M., Ferreira B. and Silva W. (2022). An Experimental Study on Usability and User Experience Evaluation Techniques in Mobile Applications. In Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-569-2, pages 340-347. DOI: 10.5220/0011083000003179

in Bibtex Style

@conference{iceis22,
author={Eduardo Jesus and Guilherme Guerino and Pedro Valle and Walter Nakamura and Ana Oran and Renato Balancieri and Thiago Coleti and Marcelo Morandini and Bruna Ferreira and Williamson Silva},
title={An Experimental Study on Usability and User Experience Evaluation Techniques in Mobile Applications},
booktitle={Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2022},
pages={340-347},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011083000003179},
isbn={978-989-758-569-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - An Experimental Study on Usability and User Experience Evaluation Techniques in Mobile Applications
SN - 978-989-758-569-2
AU - Jesus E.
AU - Guerino G.
AU - Valle P.
AU - Nakamura W.
AU - Oran A.
AU - Balancieri R.
AU - Coleti T.
AU - Morandini M.
AU - Ferreira B.
AU - Silva W.
PY - 2022
SP - 340
EP - 347
DO - 10.5220/0011083000003179