Cover not available

Article published In: Interaction Studies
Vol. 22:1 (2021) ► pp.86–109

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required
Groups in human-agent interaction

Effect of synchronous robot motion on human synchrony and enjoyment perception

 | Osaka University / JST ERATO
 | Osaka University / JST ERATO
 | Osaka University / JST ERATO
Published online: 17 September 2021
DOI logo with link
https://doi.org/10.1075/is.18027.men
Abstract
Enhancing synchronization among people when synchronization is lacking is believed to improve their social skills, learning processes, and proficiency in musical rhythmic development. Greater synchronization among people can be induced to improve the rhythmic interaction of a system with multiple dancing robots that dance to a drum beat. A series of experiments were conducted to examine the human–human synchrony between persons that participated in musical sessions with robots. In this study, we evaluated: (a) the effect of the number of robots on a subject’s ability to synchronize with an experimenter; (b) the effect of the type of robot synchrony, namely, whether the robots did or did not represent the subject’s rhythm; (c) the effect of an in-sync and out-of-sync robot on a subject’s behavior. We found that: (a) three robots increased the level of synchronization between the subject and experimenter and their enjoyment level; (b) robots may induce greater synchronization between the subject and experimenter by reproducing the rhythms of not only the experimenter but also of the subject compared to when only the experimenter’s rhythms had been reproduced; (c) the robots in-sync had greater influence on the natural rhythm of the subject.
Article outline
  • Introduction
  • Experiment 1
    • Method
    • Subjects
    • Experimental setup
      • Humanoid robots
      • Rhythm detection system
    • Environment
    • Procedure
    • Evaluation
    • Results
  • Experiment 2
    • Method
    • Subjects
    • Experimental setup
    • Procedure
    • Evaluation
  • Results
  • Experiment 3
    • Method
    • Subjects
    • Experimental setup
    • Environment
    • Procedure
    • Evaluation
  • Results
  • Discussion
  • Limitations
  • Conclusion
  • References
References (54)
References
Alimardani, M., Nishio, S., & Ishiguro, H. (2013). Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators. Scientific reports, 31, 2396. Google Scholar logo with link to Google Scholar
(2014). Effect of biased feedback on motor imagery learning in BCI-teleoperation system. Frontiers in systems neuroscience, 81, 52. Google Scholar logo with link to Google Scholar
Arimoto, T., Yoshikawa, Y., & Ishiguro, H. (2018). Multiple-Robot Conversational Patterns for Concealing Incoherent Responses. International Journal of Social Robotics, 1–11. Google Scholar logo with link to Google Scholar
Avrunin, E., Hart, J., Douglas, A., & Scassellati, B. (2011, March). Effects related to synchrony and repertoire in perceptions of robot dance. In Proceedings of the 6th international conference on Human-robot interaction (pp. 93–100). ACM. Google Scholar logo with link to Google Scholar
Barsade, S. G. (2002). The ripple effect: Emotional contagion and its influence on group behavior. Administrative Science Quarterly, 47(4), 644–675. Google Scholar logo with link to Google Scholar
Bhide, A., Power, A., & Goswami, U. (2013). A rhythmic musical intervention for poor readers: A comparison of efficacy with a letter-based intervention. Mind, Brain, and Education, 7(2), 113–123. Google Scholar logo with link to Google Scholar
Blakemore et al. (1999). Spatio-Temporal Prediction Modulates the Perception of Self-Produced Stimuli, Journal of Cognitive Neuroscience, 11:5, pp.551–559. Google Scholar logo with link to Google Scholar
Botvinick, M., & Cohen, J. (1998). Rubber hands ‘feel’ touch that eyes see. Nature, 391(6669), 756. Google Scholar logo with link to Google Scholar
Briggs, G., & Scheutz, M. (2014). How robots can affect human behavior: Investigating the effects of robotic displays of protest and distress. International Journal of Social Robotics, 6(3), 343–355. Google Scholar logo with link to Google Scholar
Brown, S. (2000). Evolutionary models of music: From sexual selection to group selection. In Perspectives in ethology (pp. 231–281). Springer, Boston, MA. Google Scholar logo with link to Google Scholar
Cohen, G. L. (2003). Party over policy: The dominating impact of group influence on political beliefs. Journal of personality and social psychology, 85(5), 808. Google Scholar logo with link to Google Scholar
Crick, C., Munz, M., & Scassellati, B. (2006, September). Synchronization in social tasks: Robotic drumming. In Robot and Human Interactive Communication, 2006. ROMAN 2006. (pp. 97–102). The 15th IEEE International Symposium. Google Scholar logo with link to Google Scholar
David, D., Wade-Woolley, L., Kirby, J., Smithrim, K. (2007). Rhythm and reading development in school-age children: A longitudinal study. Journal of Research in Reading. Volume 30, Issue 2, 169–183. Google Scholar logo with link to Google Scholar
Eerola, T., Luck, G., & Toiviainen, P. (2006, August). An investigation of pre-schoolers’ corporeal synchronization with music. In Proceedings of the 9th international conference on music perception and cognition (pp. 472–476). The Society for Music Perception and Cognition and European Society for the Cognitive Sciences of Music Bologna.Google Scholar logo with link to Google Scholar
Gan, L., Huang, Y., Zhou, L., Qian, C., & Wu, X. (2015). Synchronization to a bouncing ball with a realistic motion trajectory. Scientific reports, 51, 11974. Google Scholar logo with link to Google Scholar
Hoffman, G., & Vanunu, K. (2013). Effects of Robotic Companionship on Music Enjoyment and Agent Perception. In Proceedings of the 3rd ACM/IEEE International Conference on Human-Robot Interaction (pp. 317–324). IEEE/RSJ International Conference on Intelligent Robots and Systems Int’l Workshop on Human-Agent Interaction. Google Scholar logo with link to Google Scholar
Hove, M. J., Iversen, J. R., Zhang, A., & Repp, B. H. (2013). Synchronization with competing visual and auditory rhythms: bouncing ball meets metronome. Psychological Research, 77(4), 388–398. Google Scholar logo with link to Google Scholar
Iio, T., Yoshikawa, Y., & Ishiguro, H. (2016, October). Pre-scheduled turn-taking between robots to make conversation coherent. In Proceedings of the Fourth International Conference on Human Agent Interaction (pp. 19–25). ACM. Google Scholar logo with link to Google Scholar
Iqbal, T., Moosaei, M., & Riek, L. D. (2016). Tempo adaptation and anticipation methods for human-robot teams. RSS, Planning for HRI: Shared Autonomy and Collab. Robotics Work.Google Scholar logo with link to Google Scholar
Jaffe, J., Beebe, B., Feldstein, S., Crown, C. L., Jasnow, M. D., Rochat, P., & Stern, D. N. (2001). Rhythms of dialogue in infancy: Coordinated timing in development. Monographs of the society for research in child development, i–149.Google Scholar logo with link to Google Scholar
Kawasaki, M., Yamada, Y., Ushiku, Y., Miyauchi, E., & Yamaguchi, Y. (2013). Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction. Scientific reports, 31, 1692. Google Scholar logo with link to Google Scholar
Kelso, J. S. (1997). Dynamic patterns: The self-organization of brain and behavior. MIT press.Google Scholar logo with link to Google Scholar
Kose-Bagci, H., Dautenhahn, K., & Nehaniv, C. L. (2008, August). Emergent dynamics of turn-taking interaction in drumming games with a humanoid robot. In RO-MAN 2008-The 17th IEEE International Symposium on Robot and Human Interactive Communication (pp. 346–353). IEEE. Google Scholar logo with link to Google Scholar
LaGasse, A. B., & Hardy, M. W. (2013). Rhythm, movement, and autism: using rhythmic rehabilitation research as a model for autism. Frontiers in integrative neuroscience, 71, 19.Google Scholar logo with link to Google Scholar
Lenggenhager, B., Tadi, T., Metzinger, T., & Blanke, O. (2007). Video ergo sum: manipulating bodily self-consciousness. Science, 317(5841), 1096–1099. Google Scholar logo with link to Google Scholar
Ma, K., & Hommel, B. (2015). The role of agency for perceived ownership in the virtual hand illusion. Consciousness and cognition, 361, 277–288. Google Scholar logo with link to Google Scholar
Mates, J. (1994). A model of synchronization of motor acts to a stimulus sequence. Biological cybernetics, 70(5), 463–473. Google Scholar logo with link to Google Scholar
McNeill, W. H. (2009). Keeping Together in Time: Dance and Drill in Human History. Harvard Univ. Press. Google Scholar logo with link to Google Scholar
Merker, B. (1999). Synchronous chorusing and the origins of music. Musicae Scientiae, 3(1_suppl), 59–73. Google Scholar logo with link to Google Scholar
Michalowski, M. P., Sabanovic, S., & Kozima, H. (2007, March). A dancing robot for rhythmic social interaction. In 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2007 (pp. 89–96). IEEE. Google Scholar logo with link to Google Scholar
Michalowski, M. P., Simmons, R., & Kozima, H. (2009, September). Rhythmic attention in child-robot dance play. In Robot and Human Interactive Communication, 2009. RO-MAN 2009. The 18th IEEE International Symposium on (pp. 816–821). IEEE. Google Scholar logo with link to Google Scholar
Miles, L. K., Nind, L. K., & Macrae, C. N. (2009). The rhythm of rapport: Interpersonal synchrony and social perception. Journal of experimental social psychology, 45(3), 585–589. Google Scholar logo with link to Google Scholar
Milgram, S., Bickman, L., & Berkowitz, L. (1969). Note on the drawing power of crowds of different size. Journal of personality and social psychology, 13(2), 79. Google Scholar logo with link to Google Scholar
Milgram, S. & Gudehus, C. (1978). Obedience to authority.Google Scholar logo with link to Google Scholar
Mörtl, A., Lorenz, T., & Hirche, S. (2014). Rhythm patterns interaction-synchronization behavior for human-robot joint action. PloS one, 9(4), e95195. Google Scholar logo with link to Google Scholar
Néda, Z., Ravasz, E., Brechet, Y., Vicsek, T., & Barabási, A. L. (2000). Tumultuous applause can transform itself into waves of synchronized clapping. Nature, 403(6772), 849–850. Google Scholar logo with link to Google Scholar
Nishio, S., Watanabe, T., Ogawa, K., & Ishiguro, H. (2012, October). Body ownership transfer to teleoperated android robot. In International Conference on Social Robotics (pp. 398–407). Springer, Berlin, Heidelberg. Google Scholar logo with link to Google Scholar
Overy, K. (2012). Making music in a group: synchronization and shared experience. Annals of the New York Academy of Sciences, 1252(1), 65–68. Google Scholar logo with link to Google Scholar
Pikovsky, A., Rosenblum, M., & Kurths, J. (2003). Synchronization: a universal concept in nonlinear sciences (Vol. 121). Cambridge university press. Google Scholar logo with link to Google Scholar
Rau, P. L. P., Li, Y., & Liu, J. (2013). Effects of a social robot’s autonomy and group orientation on human decision-making. Advances in Human-Computer Interaction, 2013, 111. Google Scholar logo with link to Google Scholar
Richardson, M. J., Marsh, K. L., Isenhower, R. W., Goodman, J. R., & Schmidt, R. C. (2007). Rocking together: Dynamics of intentional and unintentional interpersonal coordination. Human movement science, 26(6), 867–891. Google Scholar logo with link to Google Scholar
Richardson, M. J., Marsh, K. L., & Schmidt, R. C. (2005). Effects of visual and verbal interaction on unintentional interpersonal coordination. Journal of Experimental Psychology: Human Perception and Performance, 31(1), 62. Google Scholar logo with link to Google Scholar
Roederer, J. G. (1984). The search for a survival value of music. Music Perception: An Interdisciplinary Journal, 1(3), 350–356. Google Scholar logo with link to Google Scholar
Schloss, W. A. (1985). On the automatic transcription of percussive music – From acoustic signals to high-level analysis (Doctoral dissertation, Stanford University).
Schmidt, R. C., Carello, C., & Turvey, M. T. (1990). Phase transitions and critical fluctuations in the visual coordination of rhythmic movements between people. Journal of experimental psychology: human perception and performance, 16(2), 227.Google Scholar logo with link to Google Scholar
Scothern, P. M. T. (1992). The music-archaeology of the Palaeolithic within its cultural setting (Doctoral dissertation, University of Cambridge).
Shimada et al. (2009). Rubber Hand Illusion under Delayed Visual Feedback, PLoS ONE, 4(7): e6185. Google Scholar logo with link to Google Scholar
Slater, M., Pérez–Marcos, D., Ehrsson, H., & Sanchez–Vives, M. V. (2008). Towards a digital body: the virtual arm illusion. Frontiers in human neuroscience, 21, 6. Google Scholar logo with link to Google Scholar
Tsakiris, M., & Haggard, P. (2005). The rubber hand illusion revisited: visuotactile integration and self-attribution. Journal of Experimental Psychology: Human Perception and Performance, 31(1), 80.Google Scholar logo with link to Google Scholar
Valdesolo, P., Ouyang, J., & DeSteno, D. (2010). The rhythm of joint action: Synchrony promotes cooperative ability. Journal of Experimental Social Psychology, 46(4), 693–695. Google Scholar logo with link to Google Scholar
van Ulzen, N. R., Lamoth, C. J., Daffertshofer, A., Semin, G. R., & Beek, P. J. (2008). Characteristics of instructed and uninstructed interpersonal coordination while walking side-by-side. Neuroscience letters, 432(2), 88–93. Google Scholar logo with link to Google Scholar
Van Vugt, F. T., Ritter, J., Rollnik, J. D., & Altenmüller, E. (2014). Music-supported motor training after stroke reveals no superiority of synchronization in group therapy. Frontiers in human neuroscience, 81, 315. Google Scholar logo with link to Google Scholar
Wallach, M. A., Kogan, N., & Bem, D. J. (1962). Group influence on individual risk taking. ETS Research Report Series, 1962(1).Google Scholar logo with link to Google Scholar
Wilder, D. A. (1977). Perception of groups, size of opposition, and social influence. Journal of Experimental Social Psychology, 13(3), 253–268. Google Scholar logo with link to Google Scholar
Cited by (4)

Cited by four other publications

Zhong, Shu
2024. Reflections on Rhythm Control in the Stage Performance Process of Dancers. Applied Mathematics and Nonlinear Sciences 9:1 DOI logo
Meneses, Alexis, Hamed Mahzoon, Yuichiro Yoshikawa & Hiroshi Ishiguro
2022. Multiple Groups of Agents for Increased Movement Interference and Synchronization. Sensors 22:14 ► pp. 5465 ff. DOI logo
Rogel, Amit, Richard Savery, Ning Yang & Gil Weinberg
2022. Proceedings of the 8th International Conference on Movement and Computing, ► pp. 1 ff. DOI logo
Šabanović, Selma, Malte Jung, Ana Paiva & Friederike Eyssel
2021. Special section editorial. Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 22:1 ► pp. 81 ff. DOI logo

This list is based on CrossRef data as of 17 march 2026. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue