{"date_updated":"2026-03-13T18:01:19Z","publisher":"ELRA","date_created":"2026-03-13T17:59:22Z","author":[{"full_name":"Wang, Yu","last_name":"Wang","first_name":"Yu"},{"full_name":"Türk, Olcay","last_name":"Türk","first_name":"Olcay"},{"last_name":"Grimminger","id":"57578","full_name":"Grimminger, Angela","first_name":"Angela"},{"first_name":"Hendrik","id":"76456","full_name":"Buschmeier, Hendrik","last_name":"Buschmeier","orcid":"0000-0002-9613-5713"}],"title":"Predicting states of understanding in explanatory interactions using cognitive load-related linguistic cues","conference":{"end_date":"2026-05-16","location":"Palma, Mallorca, Spain","name":"15th Biennial Language Resources and Evaluation Conference","start_date":"2026-05-11"},"quality_controlled":"1","publication_status":"inpress","place":"Palma, Mallorca, Spain","year":"2026","citation":{"bibtex":"@inproceedings{Wang_Türk_Grimminger_Buschmeier, place={Palma, Mallorca, Spain}, title={Predicting states of understanding in explanatory interactions using cognitive load-related linguistic cues}, booktitle={Proceedings of the 15th Biennial Language Resources and Evaluation Conference}, publisher={ELRA}, author={Wang, Yu and Türk, Olcay and Grimminger, Angela and Buschmeier, Hendrik} }","short":"Y. Wang, O. Türk, A. Grimminger, H. Buschmeier, in: Proceedings of the 15th Biennial Language Resources and Evaluation Conference, ELRA, Palma, Mallorca, Spain, n.d.","mla":"Wang, Yu, et al. “Predicting States of Understanding in Explanatory Interactions Using Cognitive Load-Related Linguistic Cues.” <i>Proceedings of the 15th Biennial Language Resources and Evaluation Conference</i>, ELRA.","apa":"Wang, Y., Türk, O., Grimminger, A., &#38; Buschmeier, H. (n.d.). Predicting states of understanding in explanatory interactions using cognitive load-related linguistic cues. <i>Proceedings of the 15th Biennial Language Resources and Evaluation Conference</i>. 15th Biennial Language Resources and Evaluation Conference, Palma, Mallorca, Spain.","ieee":"Y. Wang, O. Türk, A. Grimminger, and H. Buschmeier, “Predicting states of understanding in explanatory interactions using cognitive load-related linguistic cues,” presented at the 15th Biennial Language Resources and Evaluation Conference, Palma, Mallorca, Spain.","chicago":"Wang, Yu, Olcay Türk, Angela Grimminger, and Hendrik Buschmeier. “Predicting States of Understanding in Explanatory Interactions Using Cognitive Load-Related Linguistic Cues.” In <i>Proceedings of the 15th Biennial Language Resources and Evaluation Conference</i>. Palma, Mallorca, Spain: ELRA, n.d.","ama":"Wang Y, Türk O, Grimminger A, Buschmeier H. Predicting states of understanding in explanatory interactions using cognitive load-related linguistic cues. In: <i>Proceedings of the 15th Biennial Language Resources and Evaluation Conference</i>. ELRA."},"_id":"64914","project":[{"_id":"112","name":"TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten"}],"department":[{"_id":"660"}],"user_id":"76456","language":[{"iso":"eng"}],"publication":"Proceedings of the 15th Biennial Language Resources and Evaluation Conference","type":"conference","abstract":[{"lang":"eng","text":"We investigate how verbal and nonverbal linguistic features, exhibited by speakers and listeners in dialogue, can contribute to predicting the listener's state of understanding in explanatory interactions on a moment-by-moment basis. Specifically, we examine three linguistic cues related to cognitive load and hypothesised to correlate with listener understanding: the information value (operationalised with surprisal) and syntactic complexity of the speaker's utterances, and the variation in the listener's interactive gaze behaviour. Based on statistical analyses of the MUNDEX corpus of face-to-face dialogic board game explanations, we find that individual cues vary with the listener's level of understanding. Listener states (‘Understanding’, ‘Partial Understanding’, ‘Non-Understanding’ and ‘Misunderstanding’) were self-annotated by the listeners using a retrospective video-recall method. The results of a subsequent classification experiment, involving two off-the-shelf classifiers and a fine-tuned German BERT-based multimodal classifier, demonstrate that prediction of these four states of understanding is generally possible and improves when the three linguistic cues are considered alongside textual features."}],"status":"public"}