---
_id: '17225'
abstract:
- lang: eng
text: How is communicative gesture behavior in robots perceived by humans? Although
gesture is crucial in social interaction, this research question is still largely
unexplored in the field of social robotics. Thus, the main objective of the present
work is to investigate how gestural machine behaviors can be used to design more
natural communication in social robots. The chosen approach is twofold. Firstly,
the technical challenges encountered when implementing a speech-gesture generation
model on a robotic platform are tackled. We present a framework that enables the
humanoid robot to flexibly produce synthetic speech and co-verbal hand and arm
gestures at run-time, while not being limited to a predefined repertoire of motor
actions. Secondly, the achieved flexibility in robot gesture is exploited in controlled
experiments. To gain a deeper understanding of how communicative robot gesture
might impact and shape human perception and evaluation of human-robot interaction,
we conducted a between-subjects experimental study using the humanoid robot in
a joint task scenario. We manipulated the non-verbal behaviors of the robot in
three experimental conditions, so that it would refer to objects by utilizing
either (1) unimodal (i.e., speech only) utterances, (2) congruent multimodal (i.e.,
semantically matching speech and gesture) or (3) incongruent multimodal (i.e.,
semantically non-matching speech and gesture) utterances. Our findings reveal
that the robot is evaluated more positively when non-verbal behaviors such as
hand and arm gestures are displayed along with speech, even if they do not semantically
match the spoken utterance.
author:
- first_name: Maha
full_name: Salem, Maha
last_name: Salem
- first_name: Stefan
full_name: Kopp, Stefan
last_name: Kopp
- first_name: Ipke
full_name: Wachsmuth, Ipke
last_name: Wachsmuth
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Frank
full_name: Joublin, Frank
last_name: Joublin
citation:
ama: Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F. Generation and evaluation
of communicative robot gesture. International Journal of Social Robotics, Special
Issue on Expectations, Intentions, and Actions. 2012;4(2):201-217. doi:10.1007/s12369-011-0124-9
apa: Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., & Joublin, F. (2012).
Generation and evaluation of communicative robot gesture. International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions,
4(2), 201–217. https://doi.org/10.1007/s12369-011-0124-9
bibtex: '@article{Salem_Kopp_Wachsmuth_Rohlfing_Joublin_2012, title={Generation
and evaluation of communicative robot gesture}, volume={4}, DOI={10.1007/s12369-011-0124-9},
number={2}, journal={International Journal of Social Robotics, Special Issue on
Expectations, Intentions, and Actions}, publisher={Springer Science + Business
Media}, author={Salem, Maha and Kopp, Stefan and Wachsmuth, Ipke and Rohlfing,
Katharina and Joublin, Frank}, year={2012}, pages={201–217} }'
chicago: 'Salem, Maha, Stefan Kopp, Ipke Wachsmuth, Katharina Rohlfing, and Frank
Joublin. “Generation and Evaluation of Communicative Robot Gesture.” International
Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions
4, no. 2 (2012): 201–17. https://doi.org/10.1007/s12369-011-0124-9.'
ieee: 'M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, and F. Joublin, “Generation
and evaluation of communicative robot gesture,” International Journal of Social
Robotics, Special Issue on Expectations, Intentions, and Actions, vol. 4,
no. 2, pp. 201–217, 2012, doi: 10.1007/s12369-011-0124-9.'
mla: Salem, Maha, et al. “Generation and Evaluation of Communicative Robot Gesture.”
International Journal of Social Robotics, Special Issue on Expectations, Intentions,
and Actions, vol. 4, no. 2, Springer Science + Business Media, 2012, pp. 201–17,
doi:10.1007/s12369-011-0124-9.
short: M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, F. Joublin, International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions 4 (2012)
201–217.
date_created: 2020-06-24T13:01:48Z
date_updated: 2023-02-01T16:21:50Z
department:
- _id: '749'
doi: 10.1007/s12369-011-0124-9
intvolume: ' 4'
issue: '2'
keyword:
- Social Human-Robot Interaction
- Multimodal Interaction and Conversational Skills
- Robot Companions and Social Robots
- Non-verbal Cues and Expressiveness
language:
- iso: eng
page: 201-217
publication: International Journal of Social Robotics, Special Issue on Expectations,
Intentions, and Actions
publication_identifier:
issn:
- 1875-4805
publisher: Springer Science + Business Media
status: public
title: Generation and evaluation of communicative robot gesture
type: journal_article
user_id: '14931'
volume: 4
year: '2012'
...
---
_id: '17428'
abstract:
- lang: eng
text: How is communicative gesture behavior in robots perceived by humans? Although
gesture is crucial in social interaction, this research question is still largely
unexplored in the field of social robotics. Thus, the main objective of the present
work is to investigate how gestural machine behaviors can be used to design more
natural communication in social robots. The chosen approach is twofold. Firstly,
the technical challenges encountered when implementing a speech-gesture generation
model on a robotic platform are tackled. We present a framework that enables the
humanoid robot to flexibly produce synthetic speech and co-verbal hand and arm
gestures at run-time, while not being limited to a predefined repertoire of motor
actions. Secondly, the achieved flexibility in robot gesture is exploited in controlled
experiments. To gain a deeper understanding of how communicative robot gesture
might impact and shape human perception and evaluation of human-robot interaction,
we conducted a between-subjects experimental study using the humanoid robot in
a joint task scenario. We manipulated the non-verbal behaviors of the robot in
three experimental conditions, so that it would refer to objects by utilizing
either (1) unimodal (i.e., speech only) utterances, (2) congruent multimodal (i.e.,
semantically matching speech and gesture) or (3) incongruent multimodal (i.e.,
semantically non-matching speech and gesture) utterances. Our findings reveal
that the robot is evaluated more positively when non-verbal behaviors such as
hand and arm gestures are displayed along with speech, even if they do not semantically
match the spoken utterance.
author:
- first_name: Maha
full_name: Salem, Maha
last_name: Salem
- first_name: Stefan
full_name: Kopp, Stefan
last_name: Kopp
- first_name: Ipke
full_name: Wachsmuth, Ipke
last_name: Wachsmuth
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Frank
full_name: Joublin, Frank
last_name: Joublin
citation:
ama: Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F. Generation and evaluation
of communicative robot gesture. International Journal of Social Robotics, Special
Issue on Expectations, Intentions, and Actions. 2012;4(2):201-217. doi:10.1007/s12369-011-0124-9
apa: Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., & Joublin, F. (2012).
Generation and evaluation of communicative robot gesture. International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions,
4(2), 201–217. https://doi.org/10.1007/s12369-011-0124-9
bibtex: '@article{Salem_Kopp_Wachsmuth_Rohlfing_Joublin_2012, title={Generation
and evaluation of communicative robot gesture}, volume={4}, DOI={10.1007/s12369-011-0124-9},
number={2}, journal={International Journal of Social Robotics, Special Issue on
Expectations, Intentions, and Actions}, publisher={Springer Science + Business
Media}, author={Salem, Maha and Kopp, Stefan and Wachsmuth, Ipke and Rohlfing,
Katharina and Joublin, Frank}, year={2012}, pages={201–217} }'
chicago: 'Salem, Maha, Stefan Kopp, Ipke Wachsmuth, Katharina Rohlfing, and Frank
Joublin. “Generation and Evaluation of Communicative Robot Gesture.” International
Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions
4, no. 2 (2012): 201–17. https://doi.org/10.1007/s12369-011-0124-9.'
ieee: 'M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, and F. Joublin, “Generation
and evaluation of communicative robot gesture,” International Journal of Social
Robotics, Special Issue on Expectations, Intentions, and Actions, vol. 4,
no. 2, pp. 201–217, 2012, doi: 10.1007/s12369-011-0124-9.'
mla: Salem, Maha, et al. “Generation and Evaluation of Communicative Robot Gesture.”
International Journal of Social Robotics, Special Issue on Expectations, Intentions,
and Actions, vol. 4, no. 2, Springer Science + Business Media, 2012, pp. 201–17,
doi:10.1007/s12369-011-0124-9.
short: M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, F. Joublin, International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions 4 (2012)
201–217.
date_created: 2020-07-28T11:44:02Z
date_updated: 2023-02-01T12:52:23Z
department:
- _id: '749'
doi: 10.1007/s12369-011-0124-9
intvolume: ' 4'
issue: '2'
keyword:
- Social Human-Robot Interaction
- Multimodal Interaction and Conversational Skills
- Robot Companions and Social Robots
- Non-verbal Cues and Expressiveness
language:
- iso: eng
page: 201-217
publication: International Journal of Social Robotics, Special Issue on Expectations,
Intentions, and Actions
publication_identifier:
issn:
- 1875-4805
publisher: Springer Science + Business Media
status: public
title: Generation and evaluation of communicative robot gesture
type: journal_article
user_id: '14931'
volume: 4
year: '2012'
...