Article published In: Information Design Journal
Vol. 28:3 (2023) ► pp.200–214
Combining common heuristic sets for a new exhaustive usability evaluation of e-learning interface design
Published online: 1 December 2023
https://doi.org/10.1075/idj.23005.men
https://doi.org/10.1075/idj.23005.men
Abstract
With global school shut-downs due to the pandemic, in 2020 many educational institutions and universities were
making use of e-learning like never before, but designing lesson plans for a digital space came with its own set of challenges. In
most modern universities, education is still based on traditional learning methods and the teacher-centred physical classrooms.
However, with nationwide school closures, teachers had no choice but to turn to e-learning for solutions. Usability evaluation of
this kind of platform, therefore, has become essential, and a priority in the application development process. A set of usability
evaluation methods have been developed to allow specialists to systematically determine whether graphical interfaces are usable.
The usability assessment questionnaire is one of the most used methods and is intended to be answered by end-users of the
application. This method is preferred due to its simplicity and low demand for resources.
In this paper, a usability evaluation which combines existing work is presented. Based on existing heuristics, we
propose a new questionnaire for evaluating e-learning interface design. In addition, we illustrate two different methodologies for
evaluating e-learning interface design, and provide a quantitative rate, Usability Percentage (UP), which
complements the usual qualitative data provided by this kind of evaluation.
Article outline
- 1.Introduction
- 2.Related work
- 3.Our contribution
- 4.Experimentation
- 4.1First evaluation method inspired by Freddy Formula (2019)
- 4.2Second evaluation method inspired by Tony Granollers (2018)
- 5.Results and discussion
- 6.Conclusion and future work
- Acknowledgements
References
References (33)
Baker, K., Greenberg, S., & Gutwin, C. (2018). Empirical
development of a heuristic evaluation methodology for shared workspace groupware. Paper
published in Proceedings of Conference on Computer Supported Cooperative
Work, 96–105.
Bango, A., Kortum, P. T., & Miller, J. T. (2008). An
empirical evaluation of the system usability scale. International Journal of Human–Computer
Interaction, 24 (6), 574–594.
Bonastre, L., & Granollers, T. (2014). A
Set of Heuristics for User Experience Evaluation in E-commerce websites. Paper published
in Proceedings of the 7th International Conference on Advances in Computer-Human Interactions
(ACHI), 27–34, Barcelona, Spain.
Brooke, J. (1996). SUS:
A quick and dirty usability scale. Usability Evaluation in Industry, Jordan, 189–193.
Desurvire, H., Caplan, M., & Toth, J. A. (2004). Using
heuristics to evaluate the playability of games. Paper published
in Proceedings of the CHI 2004, Extended Abstracts on Human Factors in Computing Systems,
1509–1512, Association for Computing Machinery, Vienna, Austria.
Diaz, E., Flores, S., & Paz, F. (2019). Proposal
of usability metrics to evaluate e-commerce websites. Paper published
in Proceedings of the International Conference on Human-Computer Interaction, HCII 2019: Design,
User Experience, and Usability, Practice and Case Studies, LNCS, Vol. 11586, 85–95, Springer,
Cham.
Ellio, S., Shari, L., Jackson, J. K., Chris, Q., Reed, J., Spitulnik, J., & Stratford, S. J. (2020). Learning
Theory in Practice: Case Studies of Learner-Centered Design. Paper published
in Proceedings of the SIGCHI Conference on Human Factors in Computing
Systems.
Engel, J. F., Blackwell, R. D., & Kollat, D. T. (1978). Consumer
behavior, 3rd
edition. Hinsdale: Dryden Press.
Falconi, F., Zapata, C., Moquillaza, A., & Paz, F. (2020). Security
guidelines for the design of ATM interfaces. International Conference on Applied Human
Factors and Ergonomics, Vol. 121, 265–271, Springer, Cham.
Fernandez, A., Insfran, E., Abrahão, S. (2011). Usability
evaluation methods for the web: A systematic mapping study. Information and Software
Technology, 53 (8), 789–817.
Granollers, T. (2016). Validación
experimental de un conjunto heurístico para evaluaciones de UX de sitios web de
comercio-e. Paper published in Proceedings of the IEEE 11th
Colombian Computing Conference (CCC), 1–8.
(2018). Usability
Evaluation with Heuristics, Beyond Nielsen’s List. Paper published
in Proceedings of the 11th International Conference on Advances in Computer-Human Interactions,
ACHI 2018, ISBN: 978-1-61208-616-3.
Kaur, J., Kaur, P. (2018). Usability
Evaluation of E-Commerce Websites. The International Journal of Scientific Engineering and
Research.
Kirakowski, J., & Corbet, M. (1993). SUMI:
The software usability measurement inventory. British Journal of Educational
Technology, 24(3), 210–212.
Lewis, J. R. (1995). IBM
computer usability satisfaction questionnaires: Psychometric evaluation and instructions for
use. International Journal of Human Computer
Interactions, 7(1), 57–78.
Martínez, A. B., Juan, A. A., Álvarez, D., & Suárez, M. C. (2009). WAB:
A quantitative metric based on WAB. Paper published in Proceedings
of the 9th International Conference on Web Engineering (ICWE), LNCS, Vol. 5648,
485–488, Springer, Verlag, Berlin Heidelberg.
Masip, L., Oliva, M., & Granollers, T. (2011). Open
heuristic resource for designing and evaluating user experience. Paper published
in Proceedings of the 13th International conference on Human-computer interaction (INTER-
ACT’11), Springer- Verlag, Berlin,
Heidelberg, 418–421.
Medium. (2020). Check if you are not
missing these principles of interaction design, [Online link]. [URL]
Nielsen, J. (1995). Accessed (2019). 10 Usability Heuristics for User Interface
Design, [Online link]. [URL]
(2021). Usability101:
Introduction to Usability. [Onlinelink]. [URL]
Paz, F., Paz, F. A., & Pow-Sang, J. A. (2015). Experimental
case study of new usability heuristics. Paper published
in Proceeding of 4th International Conference: the Design, User Experience, and Usability: Design
Discourse, Held as Part of HCI International, Los Angeles, CA,
USA, LNCS, Vol. 91861, 212–223, Springer,
Cham.
Paz, F., Paz, F. A., Villanueva, D., & Pow-Sang, J. A. (2015). Heuristic
evaluation as a complement to usability testing: A case- study in web
domain, in Proceedings of the 12th International Conference on
Information Technology – New Generations, 546–551.
Paz, F. & Pow-Sang, J. A. (2016). A
systematic mapping review of usability evaluation methods for software development
process. International Journal of Software Engineering and Its
Applications, Vol. 101, 165–178.
Paz, F. & Granollers, T. (2019). Redesign
of a Questionnaire to Assess the Usability of Websites. Paper published
in Proceedings of the 2nd International Conference on Human Systems Engineering and Design: Future
Trends and Applications, Munich,
Germany, 423–428.
Paz, F. (2019). Application
of a new questionnaire to measure the usability: A case study in the e-commerce
domain. International Journal of Advanced Trends in Computer Science and
Engineering, 8 (1.4), 395–297.
Paz, F., Paz, F. A., Villanueva, D., Moquillaza, A., & Arenas, J. (2020). Accessibility
evaluation of peruviane-commerce website. International Journal of Advanced Trends in Computer
Science and
Engineering, Vol. 9,1, 558–561.
Plateformes MOOC. (2021). Les 10
meilleures plateformes MOOC et de cours en ligne, [Online link]. [URL]
Quiñones, D., & Rusu, C. (2017). How
to develop usability heuristics: A systematic literature
review. In Computer Standards and
Interfaces, Vol. 531, 89–122, ISSN 0920-5489.
Salinas, E., Cueva, R., & Paz, F. (2020). A
systematic review of user-centered design techniques. Paper published
in Proceedings of the 9th International Conference, Design, User Experience, and Usability.
Interaction Design, Copenhagen, Denmark, LNCS, Vol. 12200, 253–267, Springer,
Cham.
Social Psychology. (2023). False
Consensus Effect: Definition and Example. [Online link]. [URL]
Suarez, M. C. (2011). SIRIUS:
Sistema de Evaluación de la Usabilidad Web Orientado al Usuario y basado en la Determinación de Tareas
Críticas“. Doctoral Thesis, Oviedo, Spain.
Tognazzini, B. (2014). Interaction
design solution for the real world. Paper published in Proceedings
of First Principles, Human Computer. Interaction (HCI), Principles of HCI Design, Usability-
Testing. [Online link]. [URL]
First
Principles of Interaction Design. [Online link]. [URL]
