---
_id: '64914'
abstract:
- lang: eng
  text: 'We investigate how verbal and nonverbal linguistic features, exhibited by
    speakers and listeners in dialogue, can contribute to predicting the listener''s
    state of understanding in explanatory interactions on a moment-by-moment basis.
    Specifically, we examine three linguistic cues related to cognitive load and hypothesised
    to correlate with listener understanding: the information value (operationalised
    with surprisal) and syntactic complexity of the speaker''s utterances, and the
    variation in the listener''s interactive gaze behaviour. Based on statistical
    analyses of the MUNDEX corpus of face-to-face dialogic board game explanations,
    we find that individual cues vary with the listener''s level of understanding.
    Listener states (‘Understanding’, ‘Partial Understanding’, ‘Non-Understanding’
    and ‘Misunderstanding’) were self-annotated by the listeners using a retrospective
    video-recall method. The results of a subsequent classification experiment, involving
    two off-the-shelf classifiers and a fine-tuned German BERT-based multimodal classifier,
    demonstrate that prediction of these four states of understanding is generally
    possible and improves when the three linguistic cues are considered alongside
    textual features.'
author:
- first_name: Yu
  full_name: Wang, Yu
  last_name: Wang
- first_name: Olcay
  full_name: Türk, Olcay
  last_name: Türk
- first_name: Angela
  full_name: Grimminger, Angela
  id: '57578'
  last_name: Grimminger
- first_name: Hendrik
  full_name: Buschmeier, Hendrik
  id: '76456'
  last_name: Buschmeier
  orcid: 0000-0002-9613-5713
citation:
  ama: 'Wang Y, Türk O, Grimminger A, Buschmeier H. Predicting states of understanding
    in explanatory interactions using cognitive load-related linguistic cues. In:
    <i>Proceedings of the 15th Language Resources and Evaluation Conference</i>. ELRA;
    2026:11368-11378. doi:<a href="https://doi.org/10.63317/4tsmsshhd3ad">10.63317/4tsmsshhd3ad</a>'
  apa: Wang, Y., Türk, O., Grimminger, A., &#38; Buschmeier, H. (2026). Predicting
    states of understanding in explanatory interactions using cognitive load-related
    linguistic cues. <i>Proceedings of the 15th Language Resources and Evaluation
    Conference</i>, 11368–11378. <a href="https://doi.org/10.63317/4tsmsshhd3ad">https://doi.org/10.63317/4tsmsshhd3ad</a>
  bibtex: '@inproceedings{Wang_Türk_Grimminger_Buschmeier_2026, place={Palma, Mallorca,
    Spain}, title={Predicting states of understanding in explanatory interactions
    using cognitive load-related linguistic cues}, DOI={<a href="https://doi.org/10.63317/4tsmsshhd3ad">10.63317/4tsmsshhd3ad</a>},
    booktitle={Proceedings of the 15th Language Resources and Evaluation Conference},
    publisher={ELRA}, author={Wang, Yu and Türk, Olcay and Grimminger, Angela and
    Buschmeier, Hendrik}, year={2026}, pages={11368–11378} }'
  chicago: 'Wang, Yu, Olcay Türk, Angela Grimminger, and Hendrik Buschmeier. “Predicting
    States of Understanding in Explanatory Interactions Using Cognitive Load-Related
    Linguistic Cues.” In <i>Proceedings of the 15th Language Resources and Evaluation
    Conference</i>, 11368–78. Palma, Mallorca, Spain: ELRA, 2026. <a href="https://doi.org/10.63317/4tsmsshhd3ad">https://doi.org/10.63317/4tsmsshhd3ad</a>.'
  ieee: 'Y. Wang, O. Türk, A. Grimminger, and H. Buschmeier, “Predicting states of
    understanding in explanatory interactions using cognitive load-related linguistic
    cues,” in <i>Proceedings of the 15th Language Resources and Evaluation Conference</i>,
    Palma, Mallorca, Spain, 2026, pp. 11368–11378, doi: <a href="https://doi.org/10.63317/4tsmsshhd3ad">10.63317/4tsmsshhd3ad</a>.'
  mla: Wang, Yu, et al. “Predicting States of Understanding in Explanatory Interactions
    Using Cognitive Load-Related Linguistic Cues.” <i>Proceedings of the 15th Language
    Resources and Evaluation Conference</i>, ELRA, 2026, pp. 11368–78, doi:<a href="https://doi.org/10.63317/4tsmsshhd3ad">10.63317/4tsmsshhd3ad</a>.
  short: 'Y. Wang, O. Türk, A. Grimminger, H. Buschmeier, in: Proceedings of the 15th
    Language Resources and Evaluation Conference, ELRA, Palma, Mallorca, Spain, 2026,
    pp. 11368–11378.'
conference:
  end_date: 2026-05-16
  location: Palma, Mallorca, Spain
  name: 15th Biennial Language Resources and Evaluation Conference
  start_date: 2026-05-11
date_created: 2026-03-13T17:59:22Z
date_updated: 2026-05-07T08:08:53Z
department:
- _id: '660'
doi: 10.63317/4tsmsshhd3ad
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: https://doi.org/10.63317/4tsmsshhd3ad
oa: '1'
page: 11368-11378
place: Palma, Mallorca, Spain
project:
- _id: '112'
  name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: Proceedings of the 15th Language Resources and Evaluation Conference
publication_status: published
publisher: ELRA
quality_controlled: '1'
status: public
title: Predicting states of understanding in explanatory interactions using cognitive
  load-related linguistic cues
type: conference
user_id: '76456'
year: '2026'
...