The USUS evaluation framework for user-centered HRI

Weiss, Astrid; Bernhaupt, Regina; Tscheligi, Manfred

doi:10.1075/ais.2.07wei

In:New Frontiers in Human–Robot Interaction
Edited by Kerstin Dautenhahn and Joe Saunders
[Advances in Interaction Studies 2] 2011
► pp. 89–110

Get fulltext from our e-platform

Download Book PDF

The USUS evaluation framework for user-centered HRI

Astrid Weiss | Christian Doppler Laboratory for “Contextual Interfaces” University of Salzburg, Austria

Regina Bernhaupt | IRIT, Group ICS University of Toulouse, France

Manfred Tscheligi | Christian Doppler Laboratory for “Contextual Interfaces” University of Salzburg, Austria

Published online: 21 December 2011

https://doi.org/10.1075/ais.2.07wei

This chapter presents the USUS evaluation framework for the user-centered assessment of interaction scenarios with humanoid robots based on the factors Usability, Social Acceptance, User Experience, and Societal Impact. It consists of (1) a theoretical factor-indicator framework and (2) a methodological framework. Each of the four theoretical evaluation factors is split up into several indicators, which are extracted and justified by literature review. The methodological framework is based on a method mix derived from various disciplines. It proposes the most feasible method for each indicator to be addressed in a human-robot interaction study. This chapter concludes with a validation and application process of the framework and a discussion and outlook on future work with the proposed USUS evaluation framework.

Cited by (39)

Cited by 39 other publications

Order by:

Blomkvist, Johan, Wanjun Chu & Emma Mainza Chilufya

2025. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff.

Cheng, Ya-Wen & Nian-Shing Chen

2025. The Development and Evaluation of Robot Enhanced Picture Book Reading Learning System. In New Technology in Education and Training [Lecture Notes in Educational Technology, ], ► pp. 333 ff.

Ghazali, Ezlika M., Dilip S. Mutum & Jia Jia Cheah

2025. Dining with robots: An integrated perspective on functional, emotional and relational dimensions of customer experience. Electronic Markets 35:1

Kim, Taenyun, Yeosol Song, Doha Kim & Hayeon Song

2025. Too Much Is as Bad as Too Little: The Impact of Implementing Multiple Social Interaction Features on Trust and Acceptance of Automated Vehicle Agents. International Journal of Human–Computer Interaction 41:21 ► pp. 13875 ff.

Zaman, Mustafeed

2025. Transforming Travellers’ Experience with AI: A New Era of Innovation. In Leveraging Digital Marketing for Tourism [Tourism on the Verge, ], ► pp. 169 ff.

Seifi, Hasti, Arpit Bhatia & Kasper Hornbæk

2024. Charting User Experience in Physical Human–Robot Interaction. ACM Transactions on Human-Robot Interaction 13:2 ► pp. 1 ff.

Yitmen, Ibrahim & Amjad Almusaed

2024. Synopsis of Industry 5.0 Paradigm for Human-Robot Collaboration. In Industry 4.0 Transformation Towards Industry 5.0 Paradigm - Challenges, Opportunities and Practices [Artificial Intelligence, 27],

Alklind Taylor, Anna-Sofia, Kajsa Nalin, Jesper Holgersson, Andreas Gising, Bruce Ferwerda & Lei Chen

2023. Guardian Angel – Using Lighting Drones to Improve Traffic Safety, Sense of Security, and Comfort for Cyclists. In HCI International 2023 – Late Breaking Papers [Lecture Notes in Computer Science, 14057], ► pp. 209 ff.

Repiso, Ely, Anaís Garrell & Alberto Sanfeliu

2023. 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), ► pp. 660 ff.

Ribino, Patrizia

2023. The role of politeness in human–machine interactions: a systematic literature review and future perspectives. Artificial Intelligence Review 56:S1 ► pp. 445 ff.

Sidlauskiene, Justina, Yannick Joye & Vilte Auruskeviciene

2023. AI-based chatbots in conversational commerce and their effects on product and price perceptions. Electronic Markets 33:1

Dobrosovestnova, Anna, Glenda Hannibal & Tim Reinboth

2022. Service robots for affective labor: a sociology of labor perspective. AI & SOCIETY 37:2 ► pp. 487 ff.

Lin, Tsung-Chi, Achyuthan Unni Krishnan & Zhi Li

2022. Intuitive, Efficient and Ergonomic Tele-Nursing Robot Interfaces: Design Evaluation and Evolution. ACM Transactions on Human-Robot Interaction 11:3 ► pp. 1 ff.

Cansev, Mehmet Ege, Honghu Xue, Nils Rottmann, Adna Bliek, Luke E. Miller, Elmar Rueckert & Philipp Beckerle

2021. Interactive Human–Robot Skill Transfer: A Review of Learning Methods and User Experience. Advanced Intelligent Systems 3:7

Cheng, Ya-Wen, Yuping Wang, Yu-Fen Yang, Zih-Kwan Yang & Nian-Shing Chen

2021. Designing an authoring system of robots and IoT-based toys for EFL teaching and learning. Computer Assisted Language Learning 34:1-2 ► pp. 6 ff.

Drolshagen, Sandra, Max Pfingsthorn, Pascal Gliesche & Andreas Hein

2021. Acceptance of Industrial Collaborative Robots by People With Disabilities in Sheltered Workshops. Frontiers in Robotics and AI 7

Lan Hing Ting, Karine, Dimitri Voilmy, Quitterie De Roll, Ana Iglesias & Rebeca Marfil

2021. Fieldwork and Field Trials in Hospitals: Co-Designing A Robotic Solution to Support Data Collection in Geriatric Assessment. Applied Sciences 11:7 ► pp. 3046 ff.

Lupetti, Maria Luce, Cristina Zaga & Nazli Cila

2021. Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, ► pp. 389 ff.

Rose, David Christian, Jessica Lyon, Auvikki de Boon, Marc Hanheide & Simon Pearson

2021. Responsible development of autonomous robotics in agriculture. Nature Food 2:5 ► pp. 306 ff.

Lindblom, Jessica, Beatrice Alenljung & Erik Billing

2020. Evaluating the User Experience of Human–Robot Interaction. In Human-Robot Interaction [Springer Series on Bio- and Neurosystems, 12], ► pp. 231 ff.

Rossi, Silvia, Alessandra Rossi & Kerstin Dautenhahn

2020. The Secret Life of Robots: Perspectives and Challenges for Robot’s Behaviours During Non-interactive Tasks. International Journal of Social Robotics 12:6 ► pp. 1265 ff.

Seibt, Johanna, Malene Flensborg Damholdt & Christina Vestergaard

2020. Integrative social robotics, value-driven design, and transdisciplinarity. Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 21:1 ► pp. 111 ff.

Wallström, Josefine & Jessica Lindblom

2020. Design and Development of the USUS Goals Evaluation Framework. In Human-Robot Interaction [Springer Series on Bio- and Neurosystems, 12], ► pp. 177 ff.

Asselborn, Thibault, Kshitij Sharma, Wafa Johal & Pierre Dillenbourg

2019. Bridging Multilevel Time Scales in HRI. ACM Transactions on Human-Robot Interaction 8:3 ► pp. 1 ff.

Greunen, Darelle van

2019. 2019 Amity International Conference on Artificial Intelligence (AICAI), ► pp. 32 ff.

Horstmann, Aike C. & Nicole C. Krämer

2019. Great Expectations? Relation of Previous Experiences With Social Robots in Real Life or in the Media and Expectancies Based on Qualitative and Quantitative Assessment. Frontiers in Psychology 10

Scheidig, Andrea, Bianca Jaeschke, Benjamin Schuetz, Thanh Q. Trinh, Alexander Vorndran, Anke Mayfarth & Horst-Michael Gross

2019. 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), ► pp. 701 ff.

Backhaus, Nils, Patricia H. Rosen, Andrea Scheidig, Horst-Michael Gross & Sascha Wischniewski

2018. 2018 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO), ► pp. 54 ff.

Nordqvist, Malin & Jessica Lindblom

2018. Proceedings of the 6th International Conference on Human-Agent Interaction, ► pp. 341 ff.

Tonkin, Meg, Jonathan Vitale, Sarita Herse, Mary-Anne Williams, William Judge & Xun Wang

2018. Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, ► pp. 407 ff.

Alenljung, Beatrice, Jessica Lindblom, Rebecca Andreasson & Tom Ziemke

2017. User Experience in Social Human-Robot Interaction. International Journal of Ambient Computing and Intelligence 8:2 ► pp. 12 ff.

Alenljung, Beatrice, Jessica Lindblom, Rebecca Andreasson & Tom Ziemke

2019. User Experience in Social Human-Robot Interaction. In Rapid Automation, ► pp. 1468 ff.

Gross, Horst-Michael, Andrea Scheidig, Klaus Debes, Erik Einhorn, Markus Eisenbach, Steffen Mueller, Thomas Schmiedel, Thanh Q. Trinh, Christoph Weinrich, Tim Wengefeld, Andreas Bley & Christian Martin

2017. ROREAS: robot coach for walking and orientation training in clinical post-stroke rehabilitation—prototype implementation and evaluation in field trials. Autonomous Robots 41:3 ► pp. 679 ff.

Hebesberger, Denise, Tobias Koertner, Christoph Gisinger & Jürgen Pripfl

2017. A Long-Term Autonomous Robot at a Care Hospital: A Mixed Methods Study on Social Acceptance and Experiences of Staff and Older Adults. International Journal of Social Robotics 9:3 ► pp. 417 ff.

Veling, Louise

2017. Becoming Real: An Anthropological Approach to Evaluating Robots in the Real World. In Social Robotics [Lecture Notes in Computer Science, 10652], ► pp. 638 ff.

Hebesberger, Denise, Tobias Koertner, Christoph Gisinger, Juergen Pripfl & Christian Dondrup

2016. 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), ► pp. 27 ff.

Lindblom, Jessica & Rebecca Andreasson

2016. Current Challenges for UX Evaluation of Human-Robot Interaction. In Advances in Ergonomics of Manufacturing: Managing the Enterprise of the Future [Advances in Intelligent Systems and Computing, 490], ► pp. 267 ff.

Gross, Horst-Michael, Steffen Mueller, Christof Schroeter, Michael Volkhardt, Andrea Scheidig, Klaus Debes, Katja Richter & Nicola Doering

2015. 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), ► pp. 5992 ff.

Lohse, Manja, Frederic Siepmann & Sven Wachsmuth

2014. A Modeling Framework for User-Driven Iterative Design of Autonomous Systems. International Journal of Social Robotics 6:1 ► pp. 121 ff.

This list is based on CrossRef data as of 2 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.