{"doi":"10.1145/3678957.3685741","date_created":"2024-08-30T07:42:55Z","project":[{"_id":"112","grant_number":"438445824","name":"TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und auswerten (Teilprojekt A02)"}],"publication":"Proceedings of the 26th ACM International Conference on Multimodal Interaction","department":[{"_id":"660"}],"citation":{"mla":"Türk, Olcay, et al. “Predictability of Understanding in Explanatory Interactions Based on Multimodal Cues.” <i>Proceedings of the 26th ACM International Conference on Multimodal Interaction</i>, 2024, pp. 449–58, doi:<a href=\"https://doi.org/10.1145/3678957.3685741\">10.1145/3678957.3685741</a>.","bibtex":"@inproceedings{Türk_Lazarov_Wang_Buschmeier_Grimminger_Wagner_2024, place={San José, Costa Rica}, title={Predictability of understanding in explanatory interactions based on multimodal cues}, DOI={<a href=\"https://doi.org/10.1145/3678957.3685741\">10.1145/3678957.3685741</a>}, booktitle={Proceedings of the 26th ACM International Conference on Multimodal Interaction}, author={Türk, Olcay and Lazarov, Stefan and Wang, Yu and Buschmeier, Hendrik and Grimminger, Angela and Wagner, Petra}, year={2024}, pages={449–458} }","chicago":"Türk, Olcay, Stefan Lazarov, Yu Wang, Hendrik Buschmeier, Angela Grimminger, and Petra Wagner. “Predictability of Understanding in Explanatory Interactions Based on Multimodal Cues.” In <i>Proceedings of the 26th ACM International Conference on Multimodal Interaction</i>, 449–58. San José, Costa Rica, 2024. <a href=\"https://doi.org/10.1145/3678957.3685741\">https://doi.org/10.1145/3678957.3685741</a>.","ama":"Türk O, Lazarov S, Wang Y, Buschmeier H, Grimminger A, Wagner P. Predictability of understanding in explanatory interactions based on multimodal cues. In: <i>Proceedings of the 26th ACM International Conference on Multimodal Interaction</i>. ; 2024:449-458. doi:<a href=\"https://doi.org/10.1145/3678957.3685741\">10.1145/3678957.3685741</a>","ieee":"O. Türk, S. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, and P. Wagner, “Predictability of understanding in explanatory interactions based on multimodal cues,” in <i>Proceedings of the 26th ACM International Conference on Multimodal Interaction</i>, San José, Costa Rica, 2024, pp. 449–458, doi: <a href=\"https://doi.org/10.1145/3678957.3685741\">10.1145/3678957.3685741</a>.","apa":"Türk, O., Lazarov, S., Wang, Y., Buschmeier, H., Grimminger, A., &#38; Wagner, P. (2024). Predictability of understanding in explanatory interactions based on multimodal cues. <i>Proceedings of the 26th ACM International Conference on Multimodal Interaction</i>, 449–458. <a href=\"https://doi.org/10.1145/3678957.3685741\">https://doi.org/10.1145/3678957.3685741</a>","short":"O. Türk, S. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, P. Wagner, in: Proceedings of the 26th ACM International Conference on Multimodal Interaction, San José, Costa Rica, 2024, pp. 449–458."},"quality_controlled":"1","author":[{"last_name":"Türk","first_name":"Olcay","full_name":"Türk, Olcay"},{"full_name":"Lazarov, Stefan","last_name":"Lazarov","first_name":"Stefan"},{"full_name":"Wang, Yu","first_name":"Yu","last_name":"Wang"},{"full_name":"Buschmeier, Hendrik","orcid":"0000-0002-9613-5713","id":"76456","first_name":"Hendrik","last_name":"Buschmeier"},{"last_name":"Grimminger","id":"57578","first_name":"Angela","full_name":"Grimminger, Angela"},{"full_name":"Wagner, Petra","last_name":"Wagner","id":"74505","first_name":"Petra"}],"language":[{"iso":"eng"}],"date_updated":"2024-11-11T15:54:48Z","place":"San José, Costa Rica","year":"2024","type":"conference","conference":{"name":"The 26th ACM International Conference on Multimodal Interaction","start_date":"2024-11-04","location":"San José, Costa Rica","end_date":"2024-11-08"},"title":"Predictability of understanding in explanatory interactions based on multimodal cues","user_id":"76456","publication_status":"published","abstract":[{"text":"In explanatory interactions, explainees are expected to continuously provide feedback to explainers by signaling whether they understand an ongoing explanation. The study presented in this paper is based on the hypothesis that explainees use a set of multimodal cues, including vocalizations, facial expressions, and movements of the torso, head, and hands, to do so. We test this hypothesis by building a random forest classifier based on a multimodal corpus of dyadic explanations (21 explainers and explainees), in which windows of understanding or non-understanding were identified by participants in a retrospective video recall task. Results show that sequences of understanding can indeed be differentiated from those of non-understanding, and that a diverse set of predictors covering a wide range of modalities contributes to this classification. Due to data sparsity and a high degree of individual variation, the generalizability of our results is currently limited, but they support our hypothesis of the relevance of multimodal display in explanatory interactions.","lang":"eng"}],"status":"public","page":"449-458","_id":"55912"}