Robot programming by demonstration (RPD) covers methods by which a robot learns new skills through human guidance. We present an interactive, multimodal RPD framework using active teaching methods that places the human teacher in the robot’s learning loop. Two experiments are presented in which observational learning is first used to demonstrate a manipulation skill to a HOAP–3 humanoid robot by using motion sensors attached to the teacher’s body. Then, putting the robot through the motion, the teacher incrementally refines the robot’s skill by moving its arms manually, providing the appropriate scaffolds to reproduce the action. An incremental teaching scenario is proposed based on insights from various fields addressing developmental, psychological, and social issues related to teaching mechanisms in humans. Based on this analysis, different benchmarks are suggested to evaluate the setup further.
Cited by (73)
Cited by 73 other publications
Bacaro, Martina
2026. Rethinking Learning from Demonstration Through Enactive Cognitive Sciences: From Replication to Dialogue in HRI. In Social Robotics + AI [Lecture Notes in Computer Science, 16133], ► pp. 415 ff.
Sakr, Maram, Juyan Zhang, H. F. Machiel Van der Loos, Dana Kulić & Elizabeth Croft
2026. Consistency Matters: Defining Demonstration Data Quality Metrics in Robot Learning from Demonstration. ACM Transactions on Human-Robot Interaction 15:2 ► pp. 1 ff.
Cai, Chang, Gaoxia Zhu & Min Ma
2025. A systemic review of AI for interdisciplinary learning: Application contexts, roles, and influences. Education and Information Technologies 30:7 ► pp. 9641 ff.
Kassem, Khaled, Patrick Gietl, Florian Michahelles & Andrii Matviienko
2025. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff.
Sakr, Maram, Zhikai Zhang, Benjamin Li, Haomiao Zhang, H. F. Machiel Van der Loos, Dana Kulić & Elizabeth Croft
2025. How Can Everyday Users Efficiently Teach Robots by Demonstration?. ACM Transactions on Human-Robot Interaction 14:4 ► pp. 1 ff.
Tavassoli, Mehrdad, Sunny Katyara, Maria Pozzi, Nikhil Deshpande, Darwin G. Caldwell & Domenico Prattichizzo
2024. Learning Skills From Demonstrations: A Trend From Motion Primitives to Experience Abstraction. IEEE Transactions on Cognitive and Developmental Systems 16:1 ► pp. 57 ff.
Kulak, Thibaut & Sylvain Calinon
2023. Combining Social and Intrinsically Motivated Learning for Multitask Robot Skill Acquisition. IEEE Transactions on Cognitive and Developmental Systems 15:2 ► pp. 385 ff.
Papadopoulos, Christos & Christos Katsanos
2023. Proceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter, ► pp. 1 ff.
2023. 2023 IEEE International Conference on Robotics and Automation (ICRA), ► pp. 5829 ff.
Chi, Mingshan, Yaxin Liu, Yufeng Yao, Yan Liu, Shouqiang Li, Chao Zeng & Ming Zhong
2022. Development and evaluation of demonstration information recording approach for wheelchair mounted robotic arm. Complex & Intelligent Systems 8:4 ► pp. 2843 ff.
Iodice, Francesco, Yuqiang Wu, Wansoo Kim, Fei Zhao, Elena De Momi & Arash Ajoudani
2022. Learning cooperative dynamic manipulation skills from human demonstration videos. Mechatronics 85 ► pp. 102807 ff.
Sakr, Maram, Zexi Jesse Li, H. F. Machiel Van der Loos, Dana Kulic & Elizabeth A. Croft
2022. Quantifying Demonstration Quality for Robot Learning and Generalization. IEEE Robotics and Automation Letters 7:4 ► pp. 9659 ff.
Balakuntala, Mythra V., Upinder Kaur, Xin Ma, Juan Wachs & Richard M. Voyles
2021. 2021 IEEE International Conference on Robotics and Automation (ICRA), ► pp. 4679 ff.
Goldfarb, Nathaniel, Charles Bales & Gregory S. Fischer
2021. Toward Generalization of Bipedal Gait Cycle During Stair Climbing Using Learning From Demonstration. IEEE Transactions on Medical Robotics and Bionics 3:2 ► pp. 446 ff.
Ab Azar, Nematollah, Aref Shahmansoorian & Mohsen Davoudi
2020. From inverse optimal control to inverse reinforcement learning: A historical review. Annual Reviews in Control 50 ► pp. 119 ff.
Du, Guanglong, Zhiyao Wang & Zhelin Li
2020. A New Cloud Robots Training Method Using Cooperative Learning. IEEE Access 8 ► pp. 20838 ff.
Huang, Chien-Ming
2020. Contextual Programming of Collaborative Robots. In Artificial Intelligence in HCI [Lecture Notes in Computer Science, 12217], ► pp. 321 ff.
Sena, Aran & Matthew Howard
2020. Quantifying teaching behavior in robot learning from demonstration. The International Journal of Robotics Research 39:1 ► pp. 54 ff.
Stoelen, Martin F., Davide Marocco, Fabio Bonsignorio & Angelo Cangelosi
2020. Measuring Progress on an Approach for Interactive Learning of Context-Driven Actions. In Metrics of Sensory Motor Coordination and Integration in Robots and Animals [Cognitive Systems Monographs, 36], ► pp. 127 ff.
Xie, ZongWu, Qi Zhang, ZaiNan Jiang & Hong Liu
2020. Robot learning from demonstration for path planning: A review. Science China Technological Sciences 63:8 ► pp. 1325 ff.
Balakuntala, Mythra V., Vishnunandan L. N. Venkatesh, Jyothsna Padmakumar Bindu, Richard M. Voyles & Juan Wachs
2019. 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), ► pp. 1 ff.
Jackson, Astrid, Brandon D. Northcutt & Gita Sukthankar
2019. 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), ► pp. 326 ff.
Chen, Yuxin, Jean-Baptiste Bordes & David Filliat
2018. Comparison Studies on Active Cross-Situational Object-Word Learning Using Non-Negative Matrix Factorization and Latent Dirichlet Allocation. IEEE Transactions on Cognitive and Developmental Systems 10:4 ► pp. 1023 ff.
2018. Constraints extraction from asymmetrical bimanual tasks and their use in coordinated behavior. Robotics and Autonomous Systems 103 ► pp. 222 ff.
Vázquez, Juan Pablo García, María Angélica Astorga Vargas, Milagros Guiza Ezkauriatza, Victoria Irene Marín Juarros, Luis Enrique Vizcarra Corral, José Martín Olguín Espinoza & Martina A. Doolan
2018. Instructional strategies and information technologies used for supporting the undergraduate mathematics teaching process: Scoping review protocol. International Journal of Educational Research 90 ► pp. 27 ff.
Ferraz, Marta
2017. Robot Programming Through Whole-Body Interaction. In Progress in Artificial Intelligence [Lecture Notes in Computer Science, 10423], ► pp. 150 ff.
Li, Xiao, Hongtai Cheng, Guangfei Ji & Jiaming Chen
2017. 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), ► pp. 2646 ff.
Liu, Hung-Shen & Kai-Tai Song
2017. 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE), ► pp. 1417 ff.
Petric, Tadej, Misel Cevzar & Jan Babic
2017. 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), ► pp. 107 ff.
Petrič, Tadej, Mišel Cevzar & Jan Babič
2018. Shared Control for Human-Robot Cooperative Manipulation Tasks. In Advances in Service and Industrial Robotics [Mechanisms and Machine Science, 49], ► pp. 787 ff.
Rekabdar, Banafsheh, Monica Nicolescu, Mircea Nicolescu & Sushil Louis
2017. Using patterns of firing neurons in spiking neural networks for learning and early recognition of spatio-temporal patterns. Neural Computing and Applications 28:5 ► pp. 881 ff.
Song, Kai-Tai, Shao-Huan Song & Hung-Shen Liu
2017. 2017 International Automatic Control Conference (CACS), ► pp. 1 ff.
2016. Learning from Humans. In Springer Handbook of Robotics [Springer Handbooks, ], ► pp. 1995 ff.
Hussein, Ahmed, Mohamed Medhat Gaber & Eyad Elyan
2016. Deep Active Learning for Autonomous Navigation. In Engineering Applications of Neural Networks [Communications in Computer and Information Science, 629], ► pp. 3 ff.
Petrič, Tadej, Rok Goljat & Jan Babič
2016. 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), ► pp. 345 ff.
Tzafestas, Spyros G.
2016. Sociorobot Learning. In Sociorobot World [Intelligent Systems, Control and Automation: Science and Engineering, 80], ► pp. 41 ff.
Cha, Elizabeth, Klas Kronander & Aude Billard
2015. 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), ► pp. 83 ff.
Chandrasekaran, Balasubramaniyan & James M. Conrad
2015. SoutheastCon 2015, ► pp. 1 ff.
Ge, Fenglu, Wayne Moore & Michael Antolovich
2015. Learning from Demonstration Using GMM, CHMM and DHMM: A Comparison. In AI 2015: Advances in Artificial Intelligence [Lecture Notes in Computer Science, 9457], ► pp. 204 ff.
Hamabe, Takuma, Hiraki Goto & Jun Miura
2015. 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), ► pp. 1195 ff.
2015. 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA), ► pp. 1 ff.
Huang, Di-Wei, Garrett E. Katz, Joshua D. Langsfeld, Hyuk Oh, Rodolphe J. Gentili & James A. Reggia
2015. An Object-Centric Paradigm for Robot Programming by Demonstration. In Foundations of Augmented Cognition [Lecture Notes in Computer Science, 9183], ► pp. 745 ff.
Rekabdar, Banafsheh, Monica Nicolescu, Mircea Nicolescu & Richard Kelley
2015. 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), ► pp. 291 ff.
Stein, Gary & Avelino J. Gonzalez
2015. Building and Improving Tactical Agents in Real Time through a Haptic-Based Interface. Journal of Intelligent Systems 24:4 ► pp. 383 ff.
Doisy, Guillaume, Joachim Meyer & Yael Edan
2014. The Impact of Human–Robot Interface Design on the Use of a Learning Robot System. IEEE Transactions on Human-Machine Systems 44:6 ► pp. 788 ff.
Stoelen, Martin F., Davide Marocco, Angelo Cangelosi, Fabio Bonsignorio & Carlos Balaguer
2014. 2014 International Joint Conference on Neural Networks (IJCNN), ► pp. 700 ff.
Pais, Ana Lucia, Brenna D. Argall & Aude G. Billard
2013. Assessing Interaction Dynamics in the Context of Robot Programming by Demonstration. International Journal of Social Robotics 5:4 ► pp. 477 ff.
Rozo, Leonel, Pablo Jiménez & Carme Torras
2013. A robot learning from demonstration framework to perform force-based manipulation tasks. Intelligent Service Robotics 6:1 ► pp. 33 ff.
Taylor, John G., Vassilis Cutsuridis, Matthew Hartley, Kaspar Althoefer & Thrishantha Nanayakkara
2013. Observational Learning: Basis, Experimental Results and Models, and Implications for Robotics. Cognitive Computation 5:3 ► pp. 340 ff.
Akgun, Baris, Maya Cakmak, Karl Jiang & Andrea L. Thomaz
2012. Keyframe-based Learning from Demonstration. International Journal of Social Robotics 4:4 ► pp. 343 ff.
2012. Physical Human-Robot Interaction: Mutual Learning and Adaptation. IEEE Robotics & Automation Magazine 19:4 ► pp. 24 ff.
Lin, Hsien-I & Chun-Chia Lai
2012. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, ► pp. 2383 ff.
Stoelen, Martin F., Fabio Bonsignorio, Carlos Balaguer, Davide Marocco & Angelo Cangelosi
2012. 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL), ► pp. 1 ff.
Ge, Fenglu, Wayne Moore, Michael Antolovich & Junbin Gao
2011. 2011 First International Conference on Robot, Vision and Signal Processing, ► pp. 32 ff.
Gribovskaya, E., S.M. Khansari-Zadeh & A. Billard
2011. Learning Non-linear Multivariate Dynamics of Motion in Robotic Manipulators. The International Journal of Robotics Research 30:1 ► pp. 80 ff.
Kormushev, Petar, Dragomir N. Nenchev, Sylvain Calinon & Darwin G. Caldwell
2011. 2011 IEEE International Conference on Robotics and Automation, ► pp. 3970 ff.
Cakmak, Maya, Nick DePalma, Rosa I. Arriaga & Andrea L. Thomaz
2010. Exploiting social partners in robot learning. Autonomous Robots 29:3-4 ► pp. 309 ff.
Giovannangeli, Christophe & Philippe Gaussier
2010. Interactive Teaching for Vision-Based Mobile Robots: A Sensory-Motor Approach. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 40:1 ► pp. 13 ff.
Ikemoto, Shuhei, Heni Ben Amor, Takashi Minato, Bernhard Jung & Hiroshi Ishiguro
2010. Motor Learning for Flexible Joint Humanoid Robots using Physical Human-Robot Interaction. Journal of the Robotics Society of Japan 28:8 ► pp. 1025 ff.
Ajallooeian, M., A. Borji, B. N. Araabi, M. Nili Ahmadabadi & H. Moradi
2009. RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication, ► pp. 841 ff.
Argall, Brenna D., Sonia Chernova, Manuela Veloso & Brett Browning
2009. A survey of robot learning from demonstration. Robotics and Autonomous Systems 57:5 ► pp. 469 ff.
Calinon, Sylvain & Aude Billard
2009. Statistical Learning by Imitation of Competing Constraints in Joint Space and Task Space. Advanced Robotics 23:15 ► pp. 2059 ff.
Nagai, Y. & K.J. Rohlfing
2009. Computational Analysis of Motionese Toward Scaffolding Robot Action Learning. IEEE Transactions on Autonomous Mental Development 1:1 ► pp. 44 ff.
Thomaz, Andrea L. & Maya Cakmak
2009. Proceedings of the 4th ACM/IEEE international conference on Human robot interaction, ► pp. 15 ff.
Akanyeti, O., U. Nehmzow & S.A. Billings
2008. Robot training using system identification. Robotics and Autonomous Systems 56:12 ► pp. 1027 ff.
Billard, Aude, Sylvain Calinon, Rüdiger Dillmann & Stefan Schaal
2008. Robot Programming by Demonstration. In Springer Handbook of Robotics, ► pp. 1371 ff.
Calinon, S. & A. Billard
2008. 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, ► pp. 367 ff.
Nehmzow, U., O. Akanyeti, Christoph Weinrich, Theocharis Kyriacou & S.A. Billings
2007. 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, ► pp. 801 ff.
[no author supplied]
2017. Introduction. In Robot Learning by Visual Observation, ► pp. 1 ff.
This list is based on CrossRef data as of 30 march 2026. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.
