---
_id: '61322'
author:
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Igor
full_name: Tchappi, Igor
last_name: Tchappi
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
citation:
ama: 'Lazarov ST, Tchappi I, Grimminger A. Characteristics of nonverbal behavior.
In: Rohlfing KJ, Främling K, Alpsancar S, Thommes K, Lim BY, eds. Social Explainable
AI. Springer; 2026:367-390. doi:10.1007/978-981-96-5290-7_19'
apa: Lazarov, S. T., Tchappi, I., & Grimminger, A. (2026). Characteristics of
nonverbal behavior. In K. J. Rohlfing, K. Främling, S. Alpsancar, K. Thommes,
& B. Y. Lim (Eds.), Social Explainable AI (pp. 367–390). Springer.
https://doi.org/10.1007/978-981-96-5290-7_19
bibtex: '@inbook{Lazarov_Tchappi_Grimminger_2026, title={Characteristics of nonverbal
behavior}, DOI={10.1007/978-981-96-5290-7_19},
booktitle={Social Explainable AI}, publisher={Springer}, author={Lazarov, Stefan
Teodorov and Tchappi, Igor and Grimminger, Angela}, editor={Rohlfing, Katharina
J. and Främling, Kary and Alpsancar, Suzana and Thommes, Kirsten and Lim, Brian
Y.}, year={2026}, pages={367–390} }'
chicago: Lazarov, Stefan Teodorov, Igor Tchappi, and Angela Grimminger. “Characteristics
of Nonverbal Behavior.” In Social Explainable AI, edited by Katharina J.
Rohlfing, Kary Främling, Suzana Alpsancar, Kirsten Thommes, and Brian Y. Lim,
367–90. Springer, 2026. https://doi.org/10.1007/978-981-96-5290-7_19.
ieee: S. T. Lazarov, I. Tchappi, and A. Grimminger, “Characteristics of nonverbal
behavior,” in Social Explainable AI, K. J. Rohlfing, K. Främling, S. Alpsancar,
K. Thommes, and B. Y. Lim, Eds. Springer, 2026, pp. 367–390.
mla: Lazarov, Stefan Teodorov, et al. “Characteristics of Nonverbal Behavior.” Social
Explainable AI, edited by Katharina J. Rohlfing et al., Springer, 2026, pp.
367–90, doi:10.1007/978-981-96-5290-7_19.
short: 'S.T. Lazarov, I. Tchappi, A. Grimminger, in: K.J. Rohlfing, K. Främling,
S. Alpsancar, K. Thommes, B.Y. Lim (Eds.), Social Explainable AI, Springer, 2026,
pp. 367–390.'
date_created: 2025-09-17T10:15:42Z
date_updated: 2026-03-19T13:58:43Z
department:
- _id: '660'
- _id: '36'
doi: 10.1007/978-981-96-5290-7_19
editor:
- first_name: Katharina J.
full_name: Rohlfing, Katharina J.
last_name: Rohlfing
- first_name: Kary
full_name: Främling, Kary
last_name: Främling
- first_name: Suzana
full_name: Alpsancar, Suzana
last_name: Alpsancar
- first_name: Kirsten
full_name: Thommes, Kirsten
last_name: Thommes
- first_name: Brian Y.
full_name: Lim, Brian Y.
last_name: Lim
language:
- iso: eng
main_file_link:
- open_access: '1'
oa: '1'
page: 367-390
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: Social Explainable AI
publication_identifier:
eisbn:
- 978-981-96-5290-7
publication_status: published
publisher: Springer
quality_controlled: '1'
related_material:
link:
- relation: original
url: https://link.springer.com/chapter/10.1007/978-981-96-5290-7_19
status: public
title: Characteristics of nonverbal behavior
type: book_chapter
user_id: '57578'
year: '2026'
...
---
_id: '61151'
abstract:
- lang: eng
text: In this paper, we discuss the application of retrospective video recall for
the assessment of cognitive processes in explanatory interactions, such as understanding
and mental models. Our purpose is to reflect on the benefits and limitations of
video recall compared to another self-report method, ‘thinking-aloud’. To do so,
we reveal empirical results from the application of video recall in three interdisciplinary
research projects that applied the method for the qualitative and quantitative
assessment of cognitive and behavioral phenomena in everyday explanations. In
all three projects, video recall was applied as a post-hoc procedure following
the recording of dyadic face-to-face explanations of board games. The design of
the video recall procedure differed between individual projects because they pursued
different research objectives – that is the investigation of (1) an interlocutor's
multimodal signals of understanding, (2) the change in assumptions about an interlocutor's
dispositional and situational knowledge, and (3) the differentiated assessment
of an interlocutor's developing understanding of domain knowledge aspects by distinguishing
between mechanistic and functional explanatory stances. By discussing the benefits
and the limitations of each procedure, this article provides critical reflections
on video recall as a versatile research method applied for the analysis of human
multimodal behavior in interaction and cognitive processing.
author:
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Michael
full_name: Schaffer, Michael
id: '92807'
last_name: Schaffer
- first_name: Viviane
full_name: Gladow, Viviane
last_name: Gladow
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Heike M.
full_name: Buhl, Heike M.
id: '27152'
last_name: Buhl
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
citation:
ama: Lazarov ST, Schaffer M, Gladow V, Buschmeier H, Buhl HM, Grimminger A. Retrospective
video recall for analyzing cognitive processes in naturalistic explanations.
apa: Lazarov, S. T., Schaffer, M., Gladow, V., Buschmeier, H., Buhl, H. M., &
Grimminger, A. (n.d.). Retrospective video recall for analyzing cognitive processes
in naturalistic explanations.
bibtex: '@article{Lazarov_Schaffer_Gladow_Buschmeier_Buhl_Grimminger, title={Retrospective
video recall for analyzing cognitive processes in naturalistic explanations},
author={Lazarov, Stefan Teodorov and Schaffer, Michael and Gladow, Viviane and
Buschmeier, Hendrik and Buhl, Heike M. and Grimminger, Angela} }'
chicago: Lazarov, Stefan Teodorov, Michael Schaffer, Viviane Gladow, Hendrik Buschmeier,
Heike M. Buhl, and Angela Grimminger. “Retrospective Video Recall for Analyzing
Cognitive Processes in Naturalistic Explanations,” n.d.
ieee: S. T. Lazarov, M. Schaffer, V. Gladow, H. Buschmeier, H. M. Buhl, and A. Grimminger,
“Retrospective video recall for analyzing cognitive processes in naturalistic
explanations.” .
mla: Lazarov, Stefan Teodorov, et al. Retrospective Video Recall for Analyzing
Cognitive Processes in Naturalistic Explanations.
short: S.T. Lazarov, M. Schaffer, V. Gladow, H. Buschmeier, H.M. Buhl, A. Grimminger,
(n.d.).
date_created: 2025-09-08T14:11:37Z
date_updated: 2026-03-27T16:18:03Z
department:
- _id: '660'
language:
- iso: eng
main_file_link:
- url: https://doi.org/10.31219/osf.io/u24kz_v2
page: '29'
project:
- _id: '111'
name: 'TRR 318; TP A01: Adaptives Erklären'
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
- _id: '114'
name: 'TRR 318; TP A04: Integration des technischen Modells in das Partnermodell
bei der Erklärung von digitalen Artefakten'
publication_status: submitted
status: public
title: Retrospective video recall for analyzing cognitive processes in naturalistic
explanations
type: preprint
user_id: '76456'
year: '2026'
...
---
_id: '61154'
author:
- first_name: Olcay
full_name: Türk, Olcay
last_name: Türk
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Petra
full_name: Wagner, Petra
id: '74505'
last_name: Wagner
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
citation:
ama: 'Türk O, Lazarov ST, Buschmeier H, Wagner P, Grimminger A. Acoustic detection
of false positive backchannels of understanding in explanations. In: LingCologne
2025 – Book of Abstracts. ; 2025:36.'
apa: Türk, O., Lazarov, S. T., Buschmeier, H., Wagner, P., & Grimminger, A.
(2025). Acoustic detection of false positive backchannels of understanding in
explanations. LingCologne 2025 – Book of Abstracts, 36.
bibtex: '@inproceedings{Türk_Lazarov_Buschmeier_Wagner_Grimminger_2025, title={Acoustic
detection of false positive backchannels of understanding in explanations}, booktitle={LingCologne
2025 – Book of Abstracts}, author={Türk, Olcay and Lazarov, Stefan Teodorov and
Buschmeier, Hendrik and Wagner, Petra and Grimminger, Angela}, year={2025}, pages={36}
}'
chicago: Türk, Olcay, Stefan Teodorov Lazarov, Hendrik Buschmeier, Petra Wagner,
and Angela Grimminger. “Acoustic Detection of False Positive Backchannels of Understanding
in Explanations.” In LingCologne 2025 – Book of Abstracts, 36, 2025.
ieee: O. Türk, S. T. Lazarov, H. Buschmeier, P. Wagner, and A. Grimminger, “Acoustic
detection of false positive backchannels of understanding in explanations,” in
LingCologne 2025 – Book of Abstracts, Cologne, Germany, 2025, p. 36.
mla: Türk, Olcay, et al. “Acoustic Detection of False Positive Backchannels of Understanding
in Explanations.” LingCologne 2025 – Book of Abstracts, 2025, p. 36.
short: 'O. Türk, S.T. Lazarov, H. Buschmeier, P. Wagner, A. Grimminger, in: LingCologne
2025 – Book of Abstracts, 2025, p. 36.'
conference:
end_date: 2025-05-23
location: Cologne, Germany
name: LingCologne 2025 International Conference on Feedback in Interaction
start_date: 2025-05-21
date_created: 2025-09-08T14:21:30Z
date_updated: 2025-09-11T06:58:18Z
department:
- _id: '660'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://pub.uni-bielefeld.de/download/3003514/3003515/Turk-etal-2025-lingcologne.pdf
oa: '1'
page: '36'
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: LingCologne 2025 – Book of Abstracts
publication_status: published
quality_controlled: '1'
status: public
title: Acoustic detection of false positive backchannels of understanding in explanations
type: conference_abstract
user_id: '76456'
year: '2025'
...
---
_id: '61429'
author:
- first_name: Hendrik
full_name: Buschmeier, Hendrik
last_name: Buschmeier
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
- first_name: Petra
full_name: Wagner, Petra
last_name: Wagner
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Olcay
full_name: Türk, Olcay
last_name: Türk
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
citation:
ama: Buschmeier H, Grimminger A, Wagner P, Lazarov ST, Türk O, Wang Y. MUNDEX
Annotations. LibreCat University; 2025. doi:10.5281/ZENODO.17129817
apa: Buschmeier, H., Grimminger, A., Wagner, P., Lazarov, S. T., Türk, O., &
Wang, Y. (2025). MUNDEX Annotations. LibreCat University. https://doi.org/10.5281/ZENODO.17129817
bibtex: '@book{Buschmeier_Grimminger_Wagner_Lazarov_Türk_Wang_2025, title={MUNDEX
Annotations}, DOI={10.5281/ZENODO.17129817},
publisher={LibreCat University}, author={Buschmeier, Hendrik and Grimminger, Angela
and Wagner, Petra and Lazarov, Stefan Teodorov and Türk, Olcay and Wang, Yu},
year={2025} }'
chicago: Buschmeier, Hendrik, Angela Grimminger, Petra Wagner, Stefan Teodorov Lazarov,
Olcay Türk, and Yu Wang. MUNDEX Annotations. LibreCat University, 2025.
https://doi.org/10.5281/ZENODO.17129817.
ieee: H. Buschmeier, A. Grimminger, P. Wagner, S. T. Lazarov, O. Türk, and Y. Wang,
MUNDEX Annotations. LibreCat University, 2025.
mla: Buschmeier, Hendrik, et al. MUNDEX Annotations. LibreCat University,
2025, doi:10.5281/ZENODO.17129817.
short: H. Buschmeier, A. Grimminger, P. Wagner, S.T. Lazarov, O. Türk, Y. Wang,
MUNDEX Annotations, LibreCat University, 2025.
date_created: 2025-09-24T09:41:50Z
date_updated: 2025-09-24T09:46:28Z
department:
- _id: '660'
doi: 10.5281/ZENODO.17129817
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publisher: LibreCat University
status: public
title: MUNDEX Annotations
type: research_data
user_id: '57578'
year: '2025'
...
---
_id: '62748'
abstract:
- lang: eng
text: 'Erklärungen spielen eine zentrale Rolle in alltäglichen persönlichen Gesprächen,
indem sie den Wissensaustausch fördern, Ideen klären und das Verständnis unterstützen.
In solchen Gesprächen versuchen die Erklärenden (d. h. die sachkundigere Person),
das Verständnis der Explainees (d. h. die Person, die eine Erklärung erhält) durch
Interaktionsprozesse wie Monitoring, Scaffolding und gemeinsame Konstruktion zu
verbessern (Buschmeier et al., 2023; Rohlfing et al., 2021). Während gemeinsame
Konstruktionen aus dem bidirektionalen (non-)verbalen Austausch zwischen den Gesprächspartnern
entstehen, bezeichnet Scaffolding den Prozess, durch den die Erklärenden eine
Erklärung anpassen, indem sie unterschiedliche Verhaltensweisen als Reaktion auf
das Verhalten der Explainees einsetzen, welches deren kognitive Verarbeitung signalisiert
(Wood et al., 1976). Monitoring bezeichnet einen kontinuierlichen Prozess, in
dem die Gesprächspartner auf Wahrnehmungssignale wie (non-)verbale Verhaltensweisen
achten, um Hinweise auf (Miss-)Verständnisse zu erkennen und zu interpretieren
(Clark & Krych, 2004).In der vorliegenden Arbeit berichte ich über fünf Studien
zu dyadischen Erklärungen zwischen Menschen und diskutiere anhand empirischer
Befunde die Interaktionsdynamiken, die bestimmten Formen verbalen und nonverbalen
Erklärungsverhaltens zugrunde liegen. Zu diesem Zweck analysierte ich in den vorgestellten
Studien Daten aus zwei Videokorpora zu verschiedenen Bereichen alltäglicher Erklärungen,
beispielsweise medizinischen Erklärungen und Brettspielerklärungen. Das Korpus
zu medizinischen Erklärungen umfasst elf naturalistische Interaktionen zwischen
Ärzten und Bezugspersonen über eine bevorstehende chirurgische Operation von Kindern.
Das Korpus zu Brettspielerklärungen besteht aus 87 dyadischen Brettspielerklärungen,
von denen eine Teilstichprobe von 24 Interaktionen in den vorgestellten Studien
spezifisch untersucht wurde.Um das verbale Erklärungsverhalten zu untersuchen,
analysierte ich in zwei Studien, die sich mit medizinischen Erklärungen und Brettspielerklärungen
befassten, den Zusammenhang zwischen Themenwechseln in Erklärungen und dem multimodalen
Verhalten der Explainees, das von den Erklärenden beobachtet wurde. Die Analyse
medizinischer Erklärungen legt nahe, dass der Wechsel von Elaborationen zu neuen
Themen mit dem multimodalen Verhalten der Explainees einhergeht, welches Blickabwendung,
Kopfnicken und verbale Rückkopplung umfasst. Der Wechsel zu Elaborationen hingegen
ist mit einer anhaltenden Blickrichtung verbunden, unabhängig davon, ob zusätzliche
Signale vorhanden sind oder nicht (Lazarov et al., 2024). Eine nachfolgende Studie
zu Brettspielerklärungen (Lazarov & Grimminger, in Begutachtung) erweiterte
diese Analyse durch die Einbeziehung des Blickverhaltens der Erklärenden. Die
Studie untersuchte den Zusammenhang zwischen gegenseitigem Blickkontakt und Blickabwendung
mit der Einleitung neuer Themen. Die Ergebnisse bestätigten die Ergebnisse aus
dem medizinischen Kontext: Blickabwendungen der Explainees gehen Themenwechseln
häufiger voraus als gegenseitiger Blickkontakt, was mit früheren Forschungsergebnissen
von Rossano (2012, 2013) übereinstimmt. Die Analyse untersuchte zudem den Zusammenhang
zwischen dem / der Gesprächspartner:in, der / die Blickabwendungen initiierte,
und dem / der Gesprächspartner:in, der / die Themenwechsel initiierte.Um das nonverbale
Erklärungsverhalten zu untersuchen, analysierte ich die Verwendung von sprachbegleitenden
Gesten von verschiedenen Erklärenden in drei Studien zu Brettspielerklärungen,
in denen das zu erklärende Objekt im gemeinsamen Referenzraum physisch nicht vorhanden
war. Obwohl diese Abwesenheit ein fortwährendes Bedürfnis nach der Etablierung
gemeinsamer imaginärer Räume impliziert (Kang et al., 2015; Kinalzik & Heller,
2021), beispielsweise durch kontinuierliches Zeigen auf unsichtbare Orte, zeigte
die Studie von Lazarov & Grimminger (2025), dass Gestenikonizität und zeitliche
Hervorhebung auch in Themen zu Objekteigenschaften, Handlungsprozessen und bedingten
Regeln variabel auftreten.Motiviert durch die kontinuierliche Verwendung von der
gestischen Deixis während der physischen Abwesenheit des Explanandums erforschten
die letzten zwei Studien den kognitiven Mechanismus der Anpassung des Gebrauchs
deiktischer Gesten in Bezug auf die Beobachtung des Verständnisses der Explainees.
Unabhängig davon, ob die Erklärenden das Verständnis der Explainees in einer retrospektiven
Video Recall Aufgabe interpretierten (Lazarov & Grimminger, 2024a) oder die
verbalen Verständnissignale der Explainees wahrnahmen (Lazarov & Grimminger,
2024b), zeigten die Analysen, dass die Häufigkeit der gestischen Deixis während
der Erklärungsphase, in der das Explanandum nicht im gemeinsamen Raum vorhanden
war, stabil blieb. Zu den Ergebnissen der in dieser Dissertation präsentierten
Studien diskutiere ich, wie die kontinuierliche Beobachtung des Feedbackverhaltens
der Explainees Anpassungen sowohl im verbalen als auch im nonverbalen Erklärungsverhalten
erläutern kann. Darüber hinaus verdeutlichen die von mir präsentierten Studien
das Ausmaß der individuellen Variation innerhalb und zwischen den Erklärenden,
von denen jeder / jede mit drei verschiedenen Explainees interagierte.'
- lang: eng
text: 'Explanations play a central role in everyday face-to-face interactions by
helping people share knowledge, clarify ideas, and support understanding. In face-to-face
explanations, explainers (i.e., the more knowledgeable part) seek to enhance explainees’
understanding of an explanandum through interactional processes such as monitoring,
scaffolding, and co-constructions (Buschmeier et al., 2023; Rohlfing et al., 2021).
While co-constructions emerge from the bidirectional (non-)verbal exchange between
the interlocutors, scaffolding refers to the process by which the explainers tailor
an explanation by employing different forms of behavior in response to the explainees''
behavior signaling their cognitive processing (Wood et al., 1976). Monitoring
denotes a continuous process in which the interlocutors attend to perceptual evidence,
such as (non-)verbal behaviors, to identify and interpret cues of (mis)understanding
(Clark & Krych, 2004).In the present thesis, I report five studies on dyadic
human–human explanations, and based on empirical findings, I discuss the interactional
dynamics underpinning some forms of the verbal and nonverbal explaining behavior.
To this end, in the reported studies, I analyzed data from two video corpora on
different domains of everyday explanations, such as medical and board game explanations.
The corpus on medical explanations comprises eleven naturalistic interactions
between physicians and caregivers about an upcoming pediatric surgery. The corpus
on board game explanations consists of 87 dyadic board game explanations, from
which a subsample of 24 interactions was specifically addressed in the reported
studies.To explore the verbal explaining behavior, I examined the relation between
topical shifts in explanations and the explainees’ multimodal behavior as monitored
by the explainers in two studies addressing the domains of medical and board game
explanations. The analysis of medical explanations suggests that shifts from elaborations
to new topics are associated with the explainees'' multimodal behavior that comprises
gaze aversions, co-occurring with head nodding, and vocal backchanneling, whereas
shifts into elaborations are associated with a sustained gaze direction, whether
accompanied by additional cues or not (Lazarov et al., 2024). A subsequent study
on board game explanations (Lazarov & Grimminger, under review) extended this
analysis by incorporating the explainers’ gaze behavior. The study investigated
the relation of mutual gaze and gaze withdrawals to the initiation of new topics.
The findings corroborated those from the medical context: the explainees'' gaze
withdrawals precede topical changes more frequently than mutual gaze, which corresponds
to prior research by (Rossano, 2012, 2013). The analysis further investigated
the relation between the initiator of gaze withdrawals and the initiator of topical
changes.To examine the nonverbal explaining behavior, I analyzed the use of co-speech
gestures by different explainers in three studies on board game explanations,
during which the explanandum was physically absent from the shared space. Although
this absence implies a persistent need for establishing joint imagined spaces
(Kang et al., 2015; Kinalzik & Heller, 2021), for example, by continuously
pointing at invisible locations, the study by Lazarov & Grimminger (2025)
revealed that gesture iconicity and temporal highlighting also occur variably
across explanation topics about object features, action processes, and conditional
rules.Motivated by the continuous use of gesture deixis during the physical absence
of the explanandum, the last two studies explored the cognitive mechanism of adapting
the use of deictic gestures in relation to the monitoring of the explainees''
understanding. Whether the explainers interpreted the explainees'' understanding
in a retrospective video recall task (Lazarov & Grimminger, 2024a), or perceived
the explainees'' verbal signals of understanding (Lazarov & Grimminger, 2024b),
the analyses demonstrated that the frequency of gesture deixis remains stable
over the course of the explanation phase in which the explanandum was absent from
the shared space.Building on the results from the studies presented in this thesis,
I discuss how the continuous monitoring of the explainees'' feedback behavior
accounts for adaptations in both the verbal and the nonverbal modes of explaining
behavior. Furthermore, the analyses I present illuminate the extent of individual
variation within and across explainers, each of whom interacted with three different
explainees.'
author:
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
citation:
ama: Lazarov ST. The Reflection of Interactional Monitoring in the Dynamics of
Verbal and Nonverbal Forms of Explaining. Universitätsbibliothek Paderborn;
2025. doi:10.17619/UNIPB/1-2446
apa: Lazarov, S. T. (2025). The reflection of interactional monitoring in the
dynamics of verbal and nonverbal forms of explaining. Universitätsbibliothek
Paderborn. https://doi.org/10.17619/UNIPB/1-2446
bibtex: '@book{Lazarov_2025, place={Paderborn}, title={The reflection of interactional
monitoring in the dynamics of verbal and nonverbal forms of explaining}, DOI={10.17619/UNIPB/1-2446}, publisher={Universitätsbibliothek
Paderborn}, author={Lazarov, Stefan Teodorov}, year={2025} }'
chicago: 'Lazarov, Stefan Teodorov. The Reflection of Interactional Monitoring
in the Dynamics of Verbal and Nonverbal Forms of Explaining. Paderborn: Universitätsbibliothek
Paderborn, 2025. https://doi.org/10.17619/UNIPB/1-2446.'
ieee: 'S. T. Lazarov, The reflection of interactional monitoring in the dynamics
of verbal and nonverbal forms of explaining. Paderborn: Universitätsbibliothek
Paderborn, 2025.'
mla: Lazarov, Stefan Teodorov. The Reflection of Interactional Monitoring in
the Dynamics of Verbal and Nonverbal Forms of Explaining. Universitätsbibliothek
Paderborn, 2025, doi:10.17619/UNIPB/1-2446.
short: S.T. Lazarov, The Reflection of Interactional Monitoring in the Dynamics
of Verbal and Nonverbal Forms of Explaining, Universitätsbibliothek Paderborn,
Paderborn, 2025.
date_created: 2025-12-02T14:15:00Z
date_updated: 2025-12-02T14:21:41Z
department:
- _id: '36'
doi: 10.17619/UNIPB/1-2446
language:
- iso: eng
page: '167'
place: Paderborn
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication_status: published
publisher: Universitätsbibliothek Paderborn
status: public
supervisor:
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
- first_name: Geert
full_name: Brône, Geert
last_name: Brône
title: The reflection of interactional monitoring in the dynamics of verbal and nonverbal
forms of explaining
type: dissertation
user_id: '90345'
year: '2025'
...
---
_id: '61156'
abstract:
- lang: eng
text: Explainability has become an important topic in computer science and artificial
intelligence, leading to a subfield called Explainable Artificial Intelligence
(XAI). The goal of providing or seeking explanations is to achieve (better) ‘understanding’
on the part of the explainee. However, what it means to ‘understand’ is still
not clearly defined, and the concept itself is rarely the subject of scientific
investigation. This conceptual article aims to present a model of forms of understanding
for XAI-explanations and beyond. From an interdisciplinary perspective bringing
together computer science, linguistics, sociology, philosophy and psychology,
a definition of understanding and its forms, assessment, and dynamics during the
process of giving everyday explanations are explored. Two types of understanding
are considered as possible outcomes of explanations, namely enabledness, ‘knowing
how’ to do or decide something, and comprehension, ‘knowing that’ – both in different
degrees (from shallow to deep). Explanations regularly start with shallow understanding
in a specific domain and can lead to deep comprehension and enabledness of the
explanandum, which we see as a prerequisite for human users to gain agency. In
this process, the increase of comprehension and enabledness are highly interdependent.
Against the background of this systematization, special challenges of understanding
in XAI are discussed.
article_number: '101419'
article_type: original
author:
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Heike M.
full_name: Buhl, Heike M.
id: '27152'
last_name: Buhl
- first_name: Friederike
full_name: Kern, Friederike
last_name: Kern
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
- first_name: Helen
full_name: Beierling, Helen
id: '50995'
last_name: Beierling
- first_name: Josephine Beryl
full_name: Fisher, Josephine Beryl
id: '56345'
last_name: Fisher
orcid: 0000-0002-9997-9241
- first_name: André
full_name: Groß, André
id: '93405'
last_name: Groß
orcid: 0000-0002-9593-7220
- first_name: Ilona
full_name: Horwath, Ilona
id: '68836'
last_name: Horwath
- first_name: Nils
full_name: Klowait, Nils
id: '98454'
last_name: Klowait
orcid: 0000-0002-7347-099X
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Michael
full_name: Lenke, Michael
last_name: Lenke
- first_name: Vivien
full_name: Lohmer, Vivien
last_name: Lohmer
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
orcid: 0000-0002-5676-8233
- first_name: Ingrid
full_name: Scharlau, Ingrid
id: '451'
last_name: Scharlau
orcid: 0000-0003-2364-9489
- first_name: Amit
full_name: Singh, Amit
id: '91018'
last_name: Singh
orcid: 0000-0002-7789-1521
- first_name: Lutz
full_name: Terfloth, Lutz
id: '37320'
last_name: Terfloth
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
id: '86589'
last_name: Vollmer
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Annedore
full_name: Wilmes, Annedore
last_name: Wilmes
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
citation:
ama: Buschmeier H, Buhl HM, Kern F, et al. Forms of Understanding for XAI-Explanations.
Cognitive Systems Research. 2025;94. doi:10.1016/j.cogsys.2025.101419
apa: Buschmeier, H., Buhl, H. M., Kern, F., Grimminger, A., Beierling, H., Fisher,
J. B., Groß, A., Horwath, I., Klowait, N., Lazarov, S. T., Lenke, M., Lohmer,
V., Rohlfing, K., Scharlau, I., Singh, A., Terfloth, L., Vollmer, A.-L., Wang,
Y., Wilmes, A., & Wrede, B. (2025). Forms of Understanding for XAI-Explanations.
Cognitive Systems Research, 94, Article 101419. https://doi.org/10.1016/j.cogsys.2025.101419
bibtex: '@article{Buschmeier_Buhl_Kern_Grimminger_Beierling_Fisher_Groß_Horwath_Klowait_Lazarov_et
al._2025, title={Forms of Understanding for XAI-Explanations}, volume={94}, DOI={10.1016/j.cogsys.2025.101419},
number={101419}, journal={Cognitive Systems Research}, author={Buschmeier, Hendrik
and Buhl, Heike M. and Kern, Friederike and Grimminger, Angela and Beierling,
Helen and Fisher, Josephine Beryl and Groß, André and Horwath, Ilona and Klowait,
Nils and Lazarov, Stefan Teodorov and et al.}, year={2025} }'
chicago: Buschmeier, Hendrik, Heike M. Buhl, Friederike Kern, Angela Grimminger,
Helen Beierling, Josephine Beryl Fisher, André Groß, et al. “Forms of Understanding
for XAI-Explanations.” Cognitive Systems Research 94 (2025). https://doi.org/10.1016/j.cogsys.2025.101419.
ieee: 'H. Buschmeier et al., “Forms of Understanding for XAI-Explanations,”
Cognitive Systems Research, vol. 94, Art. no. 101419, 2025, doi: 10.1016/j.cogsys.2025.101419.'
mla: Buschmeier, Hendrik, et al. “Forms of Understanding for XAI-Explanations.”
Cognitive Systems Research, vol. 94, 101419, 2025, doi:10.1016/j.cogsys.2025.101419.
short: H. Buschmeier, H.M. Buhl, F. Kern, A. Grimminger, H. Beierling, J.B. Fisher,
A. Groß, I. Horwath, N. Klowait, S.T. Lazarov, M. Lenke, V. Lohmer, K. Rohlfing,
I. Scharlau, A. Singh, L. Terfloth, A.-L. Vollmer, Y. Wang, A. Wilmes, B. Wrede,
Cognitive Systems Research 94 (2025).
date_created: 2025-09-08T14:24:32Z
date_updated: 2025-12-05T15:32:25Z
ddc:
- '006'
department:
- _id: '660'
doi: 10.1016/j.cogsys.2025.101419
file:
- access_level: closed
content_type: application/pdf
creator: hbuschme
date_created: 2025-12-01T21:02:20Z
date_updated: 2025-12-01T21:02:20Z
file_id: '62730'
file_name: Buschmeier-etal-2025-COGSYS.pdf
file_size: 10114981
relation: main_file
success: 1
file_date_updated: 2025-12-01T21:02:20Z
has_accepted_license: '1'
intvolume: ' 94'
keyword:
- understanding
- explaining
- explanations
- explainable
- AI
- interdisciplinarity
- comprehension
- enabledness
- agency
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://www.sciencedirect.com/science/article/pii/S1389041725000993?via%3Dihub
oa: '1'
project:
- _id: '111'
name: 'TRR 318; TP A01: Adaptives Erklären'
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
- _id: '113'
name: TRR 318 - Subproject A3
- _id: '114'
name: 'TRR 318; TP A04: Integration des technischen Modells in das Partnermodell
bei der Erklärung von digitalen Artefakten'
- _id: '115'
name: 'TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog'
- _id: '122'
name: TRR 318 - Subproject B3
- _id: '123'
name: TRR 318 - Subproject B5
- _id: '119'
name: TRR 318 - Project Area Ö
publication: Cognitive Systems Research
publication_status: published
quality_controlled: '1'
status: public
title: Forms of Understanding for XAI-Explanations
type: journal_article
user_id: '57578'
volume: 94
year: '2025'
...
---
_id: '57204'
abstract:
- lang: eng
text: In this study on the use of gesture deixis during explanations, a sample of
24 videorecorded dyadic interactions of a board game explanation was analyzed.
The relation between the use of gesture deixis by different explainers and their
interpretation of explainees' understanding was investigated. In addition, we
describe explainers' intra-individual variations related to their interactions
with three different explainees consecutively. While we did not find a relation
between interpretations of explainees' complete understanding and a decrease in
explainers' use of gesture deixis, we demonstrated that the overall use of gesture
deixis is related to the process of interactional monitoring and the attendance
of a different explainee.
author:
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
citation:
ama: 'Lazarov ST, Grimminger A. Variations in explainers’ gesture deixis in explanations
related to the monitoring of explainees’ understanding. In: Proceedings of
the Annual Meeting of the Cognitive Science Society. Vol 46. ; 2024.'
apa: Lazarov, S. T., & Grimminger, A. (2024). Variations in explainers’ gesture
deixis in explanations related to the monitoring of explainees’ understanding.
Proceedings of the Annual Meeting of the Cognitive Science Society, 46.
bibtex: '@inproceedings{Lazarov_Grimminger_2024, title={Variations in explainers’
gesture deixis in explanations related to the monitoring of explainees’ understanding},
volume={46}, booktitle={Proceedings of the Annual Meeting of the Cognitive Science
Society}, author={Lazarov, Stefan Teodorov and Grimminger, Angela}, year={2024}
}'
chicago: Lazarov, Stefan Teodorov, and Angela Grimminger. “Variations in Explainers’
Gesture Deixis in Explanations Related to the Monitoring of Explainees’ Understanding.”
In Proceedings of the Annual Meeting of the Cognitive Science Society,
Vol. 46, 2024.
ieee: S. T. Lazarov and A. Grimminger, “Variations in explainers’ gesture deixis
in explanations related to the monitoring of explainees’ understanding,” in Proceedings
of the Annual Meeting of the Cognitive Science Society, Rotterdam, 2024, vol.
46.
mla: Lazarov, Stefan Teodorov, and Angela Grimminger. “Variations in Explainers’
Gesture Deixis in Explanations Related to the Monitoring of Explainees’ Understanding.”
Proceedings of the Annual Meeting of the Cognitive Science Society, vol.
46, 2024.
short: 'S.T. Lazarov, A. Grimminger, in: Proceedings of the Annual Meeting of the
Cognitive Science Society, 2024.'
conference:
end_date: 2024-07-27
location: Rotterdam
name: Sognitive Science Society
start_date: 2024-07-24
date_created: 2024-11-18T13:40:09Z
date_updated: 2024-11-18T13:40:39Z
department:
- _id: '660'
intvolume: ' 46'
keyword:
- explanation
- gesture deixis
- monitoring
- understanding
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://escholarship.org/uc/item/7dz8n8tf
oa: '1'
project:
- _id: '112'
grant_number: '438445824'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
publication: Proceedings of the Annual Meeting of the Cognitive Science Society
publication_status: published
status: public
title: Variations in explainers’ gesture deixis in explanations related to the monitoring
of explainees’ understanding
type: conference
user_id: '90345'
volume: 46
year: '2024'
...
---
_id: '59888'
abstract:
- lang: eng
text: "Everyday explanations are interactive processes with the aim to provide a
less knowledgeable person with reasonable information about other people, objects,
or events. Because explanations are interactive communicative processes, the topical
structure of an explanation may vary dynamically depending on the immediate feedback
of the explainee. In this paper, we analyse topical transitions in medical explanations
organised by different physicians (explainers) related to different forms of multimodal
behaviour of caregivers (explainees) attending an explanation about the procedures
of\r\nan upcoming surgery of a child. The analyses reveal that explainees’ multimodal
behaviour with gaze shifts (and particularly gaze aversion) can predict a transition
from an elaborated topic to a new one, whereas explainees’ forms of multimodal
behaviour with static gaze cannot be related to changes of the topical structure."
article_type: original
author:
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Kai
full_name: Biermeier, Kai
id: '55908'
last_name: Biermeier
orcid: 0000-0002-2879-2359
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
citation:
ama: Lazarov ST, Biermeier K, Grimminger A. Changes in the topical structure of
explanations are related to explainees’ multimodal behaviour. Interaction Studies.
2024;25(3):257-280. doi:10.1075/is.23033.laz
apa: Lazarov, S. T., Biermeier, K., & Grimminger, A. (2024). Changes in the
topical structure of explanations are related to explainees’ multimodal behaviour.
Interaction Studies, 25(3), 257–280. https://doi.org/10.1075/is.23033.laz
bibtex: '@article{Lazarov_Biermeier_Grimminger_2024, title={Changes in the topical
structure of explanations are related to explainees’ multimodal behaviour}, volume={25},
DOI={10.1075/is.23033.laz},
number={3}, journal={Interaction Studies}, publisher={John Benjamins}, author={Lazarov,
Stefan Teodorov and Biermeier, Kai and Grimminger, Angela}, year={2024}, pages={257–280}
}'
chicago: 'Lazarov, Stefan Teodorov, Kai Biermeier, and Angela Grimminger. “Changes
in the Topical Structure of Explanations Are Related to Explainees’ Multimodal
Behaviour.” Interaction Studies 25, no. 3 (2024): 257–80. https://doi.org/10.1075/is.23033.laz.'
ieee: 'S. T. Lazarov, K. Biermeier, and A. Grimminger, “Changes in the topical structure
of explanations are related to explainees’ multimodal behaviour,” Interaction
Studies, vol. 25, no. 3, pp. 257–280, 2024, doi: 10.1075/is.23033.laz.'
mla: Lazarov, Stefan Teodorov, et al. “Changes in the Topical Structure of Explanations
Are Related to Explainees’ Multimodal Behaviour.” Interaction Studies,
vol. 25, no. 3, John Benjamins, 2024, pp. 257–80, doi:10.1075/is.23033.laz.
short: S.T. Lazarov, K. Biermeier, A. Grimminger, Interaction Studies 25 (2024)
257–280.
date_created: 2025-05-14T06:25:13Z
date_updated: 2025-06-27T13:57:36Z
doi: 10.1075/is.23033.laz
intvolume: ' 25'
issue: '3'
keyword:
- explanations
- multimodal behaviour
- elaborations
- conditional probabilities
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://www.jbe-platform.com/content/journals/10.1075/is.23033.laz#metrics_content
oa: '1'
page: 257 - 280
project:
- _id: '112'
grant_number: '438445824'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
publication: Interaction Studies
publication_identifier:
eissn:
- 1572-0381
publication_status: published
publisher: John Benjamins
status: public
title: Changes in the topical structure of explanations are related to explainees’
multimodal behaviour
type: journal_article
user_id: '90345'
volume: 25
year: '2024'
...
---
_id: '55912'
abstract:
- lang: eng
text: In explanatory interactions, explainees are expected to continuously provide
feedback to explainers by signaling whether they understand an ongoing explanation.
The study presented in this paper is based on the hypothesis that explainees use
a set of multimodal cues, including vocalizations, facial expressions, and movements
of the torso, head, and hands, to do so. We test this hypothesis by building a
random forest classifier based on a multimodal corpus of dyadic explanations (21
explainers and explainees), in which windows of understanding or non-understanding
were identified by participants in a retrospective video recall task. Results
show that sequences of understanding can indeed be differentiated from those of
non-understanding, and that a diverse set of predictors covering a wide range
of modalities contributes to this classification. Due to data sparsity and a high
degree of individual variation, the generalizability of our results is currently
limited, but they support our hypothesis of the relevance of multimodal display
in explanatory interactions.
author:
- first_name: Olcay
full_name: Türk, Olcay
last_name: Türk
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
- first_name: Petra
full_name: Wagner, Petra
id: '74505'
last_name: Wagner
citation:
ama: 'Türk O, Lazarov ST, Wang Y, Buschmeier H, Grimminger A, Wagner P. Predictability
of understanding in explanatory interactions based on multimodal cues. In: Proceedings
of the 26th ACM International Conference on Multimodal Interaction. ; 2024:449-458.
doi:10.1145/3678957.3685741'
apa: Türk, O., Lazarov, S. T., Wang, Y., Buschmeier, H., Grimminger, A., & Wagner,
P. (2024). Predictability of understanding in explanatory interactions based on
multimodal cues. Proceedings of the 26th ACM International Conference on Multimodal
Interaction, 449–458. https://doi.org/10.1145/3678957.3685741
bibtex: '@inproceedings{Türk_Lazarov_Wang_Buschmeier_Grimminger_Wagner_2024, place={San
José, Costa Rica}, title={Predictability of understanding in explanatory interactions
based on multimodal cues}, DOI={10.1145/3678957.3685741},
booktitle={Proceedings of the 26th ACM International Conference on Multimodal
Interaction}, author={Türk, Olcay and Lazarov, Stefan Teodorov and Wang, Yu and
Buschmeier, Hendrik and Grimminger, Angela and Wagner, Petra}, year={2024}, pages={449–458}
}'
chicago: Türk, Olcay, Stefan Teodorov Lazarov, Yu Wang, Hendrik Buschmeier, Angela
Grimminger, and Petra Wagner. “Predictability of Understanding in Explanatory
Interactions Based on Multimodal Cues.” In Proceedings of the 26th ACM International
Conference on Multimodal Interaction, 449–58. San José, Costa Rica, 2024.
https://doi.org/10.1145/3678957.3685741.
ieee: 'O. Türk, S. T. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, and P. Wagner,
“Predictability of understanding in explanatory interactions based on multimodal
cues,” in Proceedings of the 26th ACM International Conference on Multimodal
Interaction, San José, Costa Rica, 2024, pp. 449–458, doi: 10.1145/3678957.3685741.'
mla: Türk, Olcay, et al. “Predictability of Understanding in Explanatory Interactions
Based on Multimodal Cues.” Proceedings of the 26th ACM International Conference
on Multimodal Interaction, 2024, pp. 449–58, doi:10.1145/3678957.3685741.
short: 'O. Türk, S.T. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, P. Wagner,
in: Proceedings of the 26th ACM International Conference on Multimodal Interaction,
San José, Costa Rica, 2024, pp. 449–458.'
conference:
end_date: 2024-11-08
location: San José, Costa Rica
name: The 26th ACM International Conference on Multimodal Interaction
start_date: 2024-11-04
date_created: 2024-08-30T07:42:55Z
date_updated: 2025-09-02T14:46:03Z
department:
- _id: '660'
doi: 10.1145/3678957.3685741
language:
- iso: eng
page: 449-458
place: San José, Costa Rica
project:
- _id: '112'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
publication: Proceedings of the 26th ACM International Conference on Multimodal Interaction
publication_status: published
quality_controlled: '1'
status: public
title: Predictability of understanding in explanatory interactions based on multimodal
cues
type: conference
user_id: '57578'
year: '2024'
...
---
_id: '57058'
author:
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Michael
full_name: Schaffer, Michael
id: '92807'
last_name: Schaffer
- first_name: Erick Kiprop
full_name: Ronoh, Erick Kiprop
id: '91665'
last_name: Ronoh
citation:
ama: 'Lazarov ST, Schaffer M, Ronoh EK. Approaches of Assessing Understanding Using
Video-Recall Data. In: ; 2023.'
apa: Lazarov, S. T., Schaffer, M., & Ronoh, E. K. (2023). Approaches of Assessing
Understanding Using Video-Recall Data. 2nd TRR 318 Conference “Measuring Understanding”
, Paderborn.
bibtex: '@inproceedings{Lazarov_Schaffer_Ronoh_2023, title={Approaches of Assessing
Understanding Using Video-Recall Data}, author={Lazarov, Stefan Teodorov and Schaffer,
Michael and Ronoh, Erick Kiprop}, year={2023} }'
chicago: Lazarov, Stefan Teodorov, Michael Schaffer, and Erick Kiprop Ronoh. “Approaches
of Assessing Understanding Using Video-Recall Data,” 2023.
ieee: S. T. Lazarov, M. Schaffer, and E. K. Ronoh, “Approaches of Assessing Understanding
Using Video-Recall Data,” presented at the 2nd TRR 318 Conference “Measuring Understanding”
, Paderborn, 2023.
mla: Lazarov, Stefan Teodorov, et al. Approaches of Assessing Understanding Using
Video-Recall Data. 2023.
short: 'S.T. Lazarov, M. Schaffer, E.K. Ronoh, in: 2023.'
conference:
end_date: 2023-11-7
location: Paderborn
name: '2nd TRR 318 Conference “Measuring Understanding” '
start_date: 2023-11-6
date_created: 2024-11-13T11:58:10Z
date_updated: 2024-11-18T13:40:50Z
department:
- _id: '427'
language:
- iso: eng
project:
- _id: '114'
grant_number: '438445824'
name: 'TRR 318 - A04: TRR 318 - Integration des technischen Modells in das Partnermodell
bei der Erklärung von digitalen Artefakten (Teilprojekt A04)'
status: public
title: Approaches of Assessing Understanding Using Video-Recall Data
type: conference_abstract
user_id: '92807'
year: '2023'
...