{"_id":"55154","type":"preprint","external_id":{"arxiv":["2406.12544"]},"abstract":[{"text":"In human interaction, gestures serve various functions such as marking speech\r\nrhythm, highlighting key elements, and supplementing information. These\r\ngestures are also observed in explanatory contexts. However, the impact of\r\ngestures on explanations provided by virtual agents remains underexplored. A\r\nuser study was carried out to investigate how different types of gestures\r\ninfluence perceived interaction quality and listener understanding. This study\r\naddresses the effect of gestures in explanation by developing an embodied\r\nvirtual explainer integrating both beat gestures and iconic gestures to enhance\r\nits automatically generated verbal explanations. Our model combines beat\r\ngestures generated by a learned speech-driven synthesis module with manually\r\ncaptured iconic gestures, supporting the agent's verbal expressions about the\r\nboard game Quarto! as an explanation scenario. Findings indicate that neither\r\nthe use of iconic gestures alone nor their combination with beat gestures\r\noutperforms the baseline or beat-only conditions in terms of understanding.\r\nNonetheless, compared to prior research, the embodied agent significantly\r\nenhances understanding.","lang":"eng"}],"year":"2024","status":"public","date_updated":"2024-07-16T09:38:34Z","language":[{"iso":"eng"}],"author":[{"last_name":"Robrecht","id":"91982","first_name":"Amelie","orcid":"0000-0001-5622-8248","full_name":"Robrecht, Amelie"},{"last_name":"Voss","first_name":"Hendric","full_name":"Voss, Hendric"},{"last_name":"Gottschalk","first_name":"Lisa","full_name":"Gottschalk, Lisa"},{"full_name":"Kopp, Stefan","first_name":"Stefan","last_name":"Kopp"}],"title":"Integrating Representational Gestures into Automatically Generated  Embodied Explanations and its Effects on Understanding and Interaction  Quality","citation":{"apa":"Robrecht, A., Voss, H., Gottschalk, L., &#38; Kopp, S. (2024). Integrating Representational Gestures into Automatically Generated  Embodied Explanations and its Effects on Understanding and Interaction  Quality. In <i>arXiv:2406.12544</i>.","ieee":"A. Robrecht, H. Voss, L. Gottschalk, and S. Kopp, “Integrating Representational Gestures into Automatically Generated  Embodied Explanations and its Effects on Understanding and Interaction  Quality,” <i>arXiv:2406.12544</i>. 2024.","short":"A. Robrecht, H. Voss, L. Gottschalk, S. Kopp, ArXiv:2406.12544 (2024).","ama":"Robrecht A, Voss H, Gottschalk L, Kopp S. Integrating Representational Gestures into Automatically Generated  Embodied Explanations and its Effects on Understanding and Interaction  Quality. <i>arXiv:240612544</i>. Published online 2024.","chicago":"Robrecht, Amelie, Hendric Voss, Lisa Gottschalk, and Stefan Kopp. “Integrating Representational Gestures into Automatically Generated  Embodied Explanations and Its Effects on Understanding and Interaction  Quality.” <i>ArXiv:2406.12544</i>, 2024.","mla":"Robrecht, Amelie, et al. “Integrating Representational Gestures into Automatically Generated  Embodied Explanations and Its Effects on Understanding and Interaction  Quality.” <i>ArXiv:2406.12544</i>, 2024.","bibtex":"@article{Robrecht_Voss_Gottschalk_Kopp_2024, title={Integrating Representational Gestures into Automatically Generated  Embodied Explanations and its Effects on Understanding and Interaction  Quality}, journal={arXiv:2406.12544}, author={Robrecht, Amelie and Voss, Hendric and Gottschalk, Lisa and Kopp, Stefan}, year={2024} }"},"user_id":"91982","project":[{"_id":"111","grant_number":"438445824","name":"TRR 318 - A01: TRR 318 - Adaptives Erklären (Teilprojekt A01)"}],"department":[{"_id":"660"}],"publication":"arXiv:2406.12544","date_created":"2024-07-10T11:03:59Z"}