---
_id: '64914'
abstract:
- lang: eng
text: 'We investigate how verbal and nonverbal linguistic features, exhibited by
speakers and listeners in dialogue, can contribute to predicting the listener''s
state of understanding in explanatory interactions on a moment-by-moment basis.
Specifically, we examine three linguistic cues related to cognitive load and hypothesised
to correlate with listener understanding: the information value (operationalised
with surprisal) and syntactic complexity of the speaker''s utterances, and the
variation in the listener''s interactive gaze behaviour. Based on statistical
analyses of the MUNDEX corpus of face-to-face dialogic board game explanations,
we find that individual cues vary with the listener''s level of understanding.
Listener states (‘Understanding’, ‘Partial Understanding’, ‘Non-Understanding’
and ‘Misunderstanding’) were self-annotated by the listeners using a retrospective
video-recall method. The results of a subsequent classification experiment, involving
two off-the-shelf classifiers and a fine-tuned German BERT-based multimodal classifier,
demonstrate that prediction of these four states of understanding is generally
possible and improves when the three linguistic cues are considered alongside
textual features.'
author:
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Olcay
full_name: Türk, Olcay
last_name: Türk
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
citation:
ama: 'Wang Y, Türk O, Grimminger A, Buschmeier H. Predicting states of understanding
in explanatory interactions using cognitive load-related linguistic cues. In:
Proceedings of the 15th Biennial Language Resources and Evaluation Conference.
ELRA. doi:10.48550/arXiv.2603.20079'
apa: Wang, Y., Türk, O., Grimminger, A., & Buschmeier, H. (n.d.). Predicting
states of understanding in explanatory interactions using cognitive load-related
linguistic cues. Proceedings of the 15th Biennial Language Resources and Evaluation
Conference. 15th Biennial Language Resources and Evaluation Conference, Palma,
Mallorca, Spain. https://doi.org/10.48550/arXiv.2603.20079
bibtex: '@inproceedings{Wang_Türk_Grimminger_Buschmeier, place={Palma, Mallorca,
Spain}, title={Predicting states of understanding in explanatory interactions
using cognitive load-related linguistic cues}, DOI={10.48550/arXiv.2603.20079},
booktitle={Proceedings of the 15th Biennial Language Resources and Evaluation
Conference}, publisher={ELRA}, author={Wang, Yu and Türk, Olcay and Grimminger,
Angela and Buschmeier, Hendrik} }'
chicago: 'Wang, Yu, Olcay Türk, Angela Grimminger, and Hendrik Buschmeier. “Predicting
States of Understanding in Explanatory Interactions Using Cognitive Load-Related
Linguistic Cues.” In Proceedings of the 15th Biennial Language Resources and
Evaluation Conference. Palma, Mallorca, Spain: ELRA, n.d. https://doi.org/10.48550/arXiv.2603.20079.'
ieee: 'Y. Wang, O. Türk, A. Grimminger, and H. Buschmeier, “Predicting states of
understanding in explanatory interactions using cognitive load-related linguistic
cues,” presented at the 15th Biennial Language Resources and Evaluation Conference,
Palma, Mallorca, Spain, doi: 10.48550/arXiv.2603.20079.'
mla: Wang, Yu, et al. “Predicting States of Understanding in Explanatory Interactions
Using Cognitive Load-Related Linguistic Cues.” Proceedings of the 15th Biennial
Language Resources and Evaluation Conference, ELRA, doi:10.48550/arXiv.2603.20079.
short: 'Y. Wang, O. Türk, A. Grimminger, H. Buschmeier, in: Proceedings of the 15th
Biennial Language Resources and Evaluation Conference, ELRA, Palma, Mallorca,
Spain, n.d.'
conference:
end_date: 2026-05-16
location: Palma, Mallorca, Spain
name: 15th Biennial Language Resources and Evaluation Conference
start_date: 2026-05-11
date_created: 2026-03-13T17:59:22Z
date_updated: 2026-03-25T13:42:48Z
department:
- _id: '660'
doi: 10.48550/arXiv.2603.20079
language:
- iso: eng
place: Palma, Mallorca, Spain
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: Proceedings of the 15th Biennial Language Resources and Evaluation Conference
publication_status: inpress
publisher: ELRA
quality_controlled: '1'
status: public
title: Predicting states of understanding in explanatory interactions using cognitive
load-related linguistic cues
type: conference
user_id: '76456'
year: '2026'
...
---
_id: '61151'
abstract:
- lang: eng
text: In this paper, we discuss the application of retrospective video recall for
the assessment of cognitive processes in explanatory interactions, such as understanding
and mental models. Our purpose is to reflect on the benefits and limitations of
video recall compared to another self-report method, ‘thinking-aloud’. To do so,
we reveal empirical results from the application of video recall in three interdisciplinary
research projects that applied the method for the qualitative and quantitative
assessment of cognitive and behavioral phenomena in everyday explanations. In
all three projects, video recall was applied as a post-hoc procedure following
the recording of dyadic face-to-face explanations of board games. The design of
the video recall procedure differed between individual projects because they pursued
different research objectives – that is the investigation of (1) an interlocutor's
multimodal signals of understanding, (2) the change in assumptions about an interlocutor's
dispositional and situational knowledge, and (3) the differentiated assessment
of an interlocutor's developing understanding of domain knowledge aspects by distinguishing
between mechanistic and functional explanatory stances. By discussing the benefits
and the limitations of each procedure, this article provides critical reflections
on video recall as a versatile research method applied for the analysis of human
multimodal behavior in interaction and cognitive processing.
author:
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Michael
full_name: Schaffer, Michael
id: '92807'
last_name: Schaffer
- first_name: Viviane
full_name: Gladow, Viviane
last_name: Gladow
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Heike M.
full_name: Buhl, Heike M.
id: '27152'
last_name: Buhl
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
citation:
ama: Lazarov ST, Schaffer M, Gladow V, Buschmeier H, Buhl HM, Grimminger A. Retrospective
video recall for analyzing cognitive processes in naturalistic explanations.
apa: Lazarov, S. T., Schaffer, M., Gladow, V., Buschmeier, H., Buhl, H. M., &
Grimminger, A. (n.d.). Retrospective video recall for analyzing cognitive processes
in naturalistic explanations.
bibtex: '@article{Lazarov_Schaffer_Gladow_Buschmeier_Buhl_Grimminger, title={Retrospective
video recall for analyzing cognitive processes in naturalistic explanations},
author={Lazarov, Stefan Teodorov and Schaffer, Michael and Gladow, Viviane and
Buschmeier, Hendrik and Buhl, Heike M. and Grimminger, Angela} }'
chicago: Lazarov, Stefan Teodorov, Michael Schaffer, Viviane Gladow, Hendrik Buschmeier,
Heike M. Buhl, and Angela Grimminger. “Retrospective Video Recall for Analyzing
Cognitive Processes in Naturalistic Explanations,” n.d.
ieee: S. T. Lazarov, M. Schaffer, V. Gladow, H. Buschmeier, H. M. Buhl, and A. Grimminger,
“Retrospective video recall for analyzing cognitive processes in naturalistic
explanations.” .
mla: Lazarov, Stefan Teodorov, et al. Retrospective Video Recall for Analyzing
Cognitive Processes in Naturalistic Explanations.
short: S.T. Lazarov, M. Schaffer, V. Gladow, H. Buschmeier, H.M. Buhl, A. Grimminger,
(n.d.).
date_created: 2025-09-08T14:11:37Z
date_updated: 2026-03-27T16:18:03Z
department:
- _id: '660'
language:
- iso: eng
main_file_link:
- url: https://doi.org/10.31219/osf.io/u24kz_v2
page: '29'
project:
- _id: '111'
name: 'TRR 318; TP A01: Adaptives Erklären'
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
- _id: '114'
name: 'TRR 318; TP A04: Integration des technischen Modells in das Partnermodell
bei der Erklärung von digitalen Artefakten'
publication_status: submitted
status: public
title: Retrospective video recall for analyzing cognitive processes in naturalistic
explanations
type: preprint
user_id: '76456'
year: '2026'
...
---
_id: '61444'
abstract:
- lang: eng
text: Backchannels and fillers are important linguistic expressions in dialogue,
but often treated as ‘noise’ to be bypassed in modern transformer-based language
models. Our work studies the representation of them in language models using three
fine-tuning strategies. The models are trained on three dialogue corpora in English
and Japanese, where backchannels and fillers are preserved and annotated, to investigate
how fine-tuning can help LMs learn their representations. We first apply clustering
analysis to the learnt representation of backchannels and fillers, and have found
increased silhouette scores in representations from fine-tuned models, which suggests
that fine-tuning enables LMs to distinguish the nuanced semantic variation in
different backchannel and filler use. We also use natural language generation
(NLG) metrics and qualitative analysis to confirm that the utterances generated
by fine-tuned language models resemble human-produced utterances more closely.
Our findings suggest the potentials of transforming general LMs into conversational
LMs that are more capable of producing human-like languages adequately.
author:
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Leyi
full_name: Lao, Leyi
last_name: Lao
- first_name: Langchu
full_name: Huang, Langchu
last_name: Huang
- first_name: Gabriel
full_name: Skantze, Gabriel
last_name: Skantze
- first_name: Yang
full_name: Xu, Yang
last_name: Xu
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
citation:
ama: Wang Y, Lao L, Huang L, Skantze G, Xu Y, Buschmeier H. Investigating the representation
of backchannels and fillers in fine-tuned language models.
apa: Wang, Y., Lao, L., Huang, L., Skantze, G., Xu, Y., & Buschmeier, H. (n.d.).
Investigating the representation of backchannels and fillers in fine-tuned
language models. 64th Annual Meeting of the Association for Computational
Linguistics, San Diego, CA, USA.
bibtex: '@inproceedings{Wang_Lao_Huang_Skantze_Xu_Buschmeier, title={Investigating
the representation of backchannels and fillers in fine-tuned language models},
author={Wang, Yu and Lao, Leyi and Huang, Langchu and Skantze, Gabriel and Xu,
Yang and Buschmeier, Hendrik} }'
chicago: Wang, Yu, Leyi Lao, Langchu Huang, Gabriel Skantze, Yang Xu, and Hendrik
Buschmeier. “Investigating the Representation of Backchannels and Fillers in Fine-Tuned
Language Models,” n.d.
ieee: Y. Wang, L. Lao, L. Huang, G. Skantze, Y. Xu, and H. Buschmeier, “Investigating
the representation of backchannels and fillers in fine-tuned language models,”
presented at the 64th Annual Meeting of the Association for Computational Linguistics,
San Diego, CA, USA.
mla: Wang, Yu, et al. Investigating the Representation of Backchannels and Fillers
in Fine-Tuned Language Models.
short: 'Y. Wang, L. Lao, L. Huang, G. Skantze, Y. Xu, H. Buschmeier, in: n.d.'
conference:
end_date: 2026-07-07
location: San Diego, CA, USA
name: 64th Annual Meeting of the Association for Computational Linguistics
start_date: 2026-07-02
date_created: 2025-09-25T19:00:23Z
date_updated: 2026-04-07T09:56:43Z
department:
- _id: '660'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://doi.org/10.48550/arXiv.2509.20237
oa: '1'
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication_status: accepted
quality_controlled: '1'
status: public
title: Investigating the representation of backchannels and fillers in fine-tuned
language models
type: conference
user_id: '76456'
year: '2026'
...
---
_id: '65363'
abstract:
- lang: eng
text: 'Recent theoretical advancement of information density in natural language
has brought the following question on desk: To what degree does natural language
exhibit periodicity pattern in its encoded information? We address this question
by introducing a new method called AutoPeriod of Surprisal (APS). APS adopts a
canonical periodicity detection algorithm and is able to identify any significant
periods that exist in the surprisal sequence of a single document. By applying
the algorithm to a set of corpora, we have obtained the following interesting
results: Firstly, a considerable proportion of human language demonstrates a strong
pattern of periodicity in information; Secondly, new periods that are outside
the distributions of typical structural units in text (e.g., sentence boundaries,
elementary discourse units, etc.) are found and further confirmed via harmonic
regression modeling. We conclude that the periodicity of information in language
is a joint outcome from both structured factors and other driving factors that
take effect at longer distances. The advantages of our periodicity detection method
and its potentials in LLM-generation detection are further discussed.'
author:
- first_name: Yulin
full_name: Ou, Yulin
last_name: Ou
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Yang
full_name: Xu, Yang
last_name: Xu
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
citation:
ama: Ou Y, Wang Y, Xu Y, Buschmeier H. Identifying the periodicity of information
in natural language.
apa: Ou, Y., Wang, Y., Xu, Y., & Buschmeier, H. (n.d.). Identifying the periodicity
of information in natural language. 64th Annual Meeting of the Association
for Computational Linguistics, San Diego, CA, USA.
bibtex: '@inproceedings{Ou_Wang_Xu_Buschmeier, title={Identifying the periodicity
of information in natural language}, author={Ou, Yulin and Wang, Yu and Xu, Yang
and Buschmeier, Hendrik} }'
chicago: Ou, Yulin, Yu Wang, Yang Xu, and Hendrik Buschmeier. “Identifying the Periodicity
of Information in Natural Language,” n.d.
ieee: Y. Ou, Y. Wang, Y. Xu, and H. Buschmeier, “Identifying the periodicity of
information in natural language,” presented at the 64th Annual Meeting of the
Association for Computational Linguistics, San Diego, CA, USA.
mla: Ou, Yulin, et al. Identifying the Periodicity of Information in Natural
Language.
short: 'Y. Ou, Y. Wang, Y. Xu, H. Buschmeier, in: n.d.'
conference:
end_date: 2026-07-07
location: San Diego, CA, USA
name: 64th Annual Meeting of the Association for Computational Linguistics
start_date: 2026-07-02
date_created: 2026-04-07T09:52:23Z
date_updated: 2026-04-07T09:56:53Z
department:
- _id: '660'
language:
- iso: eng
publication_status: accepted
quality_controlled: '1'
status: public
title: Identifying the periodicity of information in natural language
type: conference
user_id: '76456'
year: '2026'
...
---
_id: '61154'
author:
- first_name: Olcay
full_name: Türk, Olcay
last_name: Türk
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Petra
full_name: Wagner, Petra
id: '74505'
last_name: Wagner
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
citation:
ama: 'Türk O, Lazarov ST, Buschmeier H, Wagner P, Grimminger A. Acoustic detection
of false positive backchannels of understanding in explanations. In: LingCologne
2025 – Book of Abstracts. ; 2025:36.'
apa: Türk, O., Lazarov, S. T., Buschmeier, H., Wagner, P., & Grimminger, A.
(2025). Acoustic detection of false positive backchannels of understanding in
explanations. LingCologne 2025 – Book of Abstracts, 36.
bibtex: '@inproceedings{Türk_Lazarov_Buschmeier_Wagner_Grimminger_2025, title={Acoustic
detection of false positive backchannels of understanding in explanations}, booktitle={LingCologne
2025 – Book of Abstracts}, author={Türk, Olcay and Lazarov, Stefan Teodorov and
Buschmeier, Hendrik and Wagner, Petra and Grimminger, Angela}, year={2025}, pages={36}
}'
chicago: Türk, Olcay, Stefan Teodorov Lazarov, Hendrik Buschmeier, Petra Wagner,
and Angela Grimminger. “Acoustic Detection of False Positive Backchannels of Understanding
in Explanations.” In LingCologne 2025 – Book of Abstracts, 36, 2025.
ieee: O. Türk, S. T. Lazarov, H. Buschmeier, P. Wagner, and A. Grimminger, “Acoustic
detection of false positive backchannels of understanding in explanations,” in
LingCologne 2025 – Book of Abstracts, Cologne, Germany, 2025, p. 36.
mla: Türk, Olcay, et al. “Acoustic Detection of False Positive Backchannels of Understanding
in Explanations.” LingCologne 2025 – Book of Abstracts, 2025, p. 36.
short: 'O. Türk, S.T. Lazarov, H. Buschmeier, P. Wagner, A. Grimminger, in: LingCologne
2025 – Book of Abstracts, 2025, p. 36.'
conference:
end_date: 2025-05-23
location: Cologne, Germany
name: LingCologne 2025 International Conference on Feedback in Interaction
start_date: 2025-05-21
date_created: 2025-09-08T14:21:30Z
date_updated: 2025-09-11T06:58:18Z
department:
- _id: '660'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://pub.uni-bielefeld.de/download/3003514/3003515/Turk-etal-2025-lingcologne.pdf
oa: '1'
page: '36'
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: LingCologne 2025 – Book of Abstracts
publication_status: published
quality_controlled: '1'
status: public
title: Acoustic detection of false positive backchannels of understanding in explanations
type: conference_abstract
user_id: '76456'
year: '2025'
...
---
_id: '61150'
abstract:
- lang: eng
text: Since the emergence of the field of eXplainable Artificial Intelligence (XAI),
a growing number of researchers have argued that XAI should consider insights
from the social sciences in order to adapt explanations to the expectations and
needs of human users. This has led to the emergence of a field called Social XAI,
which is concerned with understanding how explanations are actively shaped in
the interaction between a human user and an AI system. Recognizing this turn in
XAI toward making XAI systems more “social” by providing explanations that focus
on human information needs and incorporating insights from human–human explanatory
interactions, in this paper we provide a formal foundation for Social XAI. We
do so by proposing novel ontological accounts of the key terms used in Social
XAI based on Basic Formal Ontology (BFO). Specifically, we provide novel ontological
accounts for explanandum, explanans, understanding, explanation, explainer, explainee,
and context. In doing so, we discuss multifaceted entities in Social XAI (having
both continuant and occurrent facets; e.g., explanation) and the relationship
between understanding and explanation. Additionally, we propose solutions to seemingly
paradoxical views on some terms (e.g., social constructivist vs. individual constructivist
perspective on explanandum).
author:
- first_name: Meisam
full_name: Booshehri, Meisam
id: '93424'
last_name: Booshehri
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Philipp
full_name: Cimiano, Philipp
last_name: Cimiano
citation:
ama: 'Booshehri M, Buschmeier H, Cimiano P. A BFO-based ontological analysis of
entities in Social XAI. In: Proceedings of the 15th International Conference
on Formal Ontology in Information Systems. IOS Press; 2025:255–268. doi:10.3233/faia250498'
apa: Booshehri, M., Buschmeier, H., & Cimiano, P. (2025). A BFO-based ontological
analysis of entities in Social XAI. In Proceedings of the 15th International
Conference on Formal Ontology in Information Systems (pp. 255–268). IOS Press.
https://doi.org/10.3233/faia250498
bibtex: '@inbook{Booshehri_Buschmeier_Cimiano_2025, title={A BFO-based ontological
analysis of entities in Social XAI}, DOI={10.3233/faia250498},
booktitle={Proceedings of the 15th International Conference on Formal Ontology
in Information Systems}, publisher={IOS Press}, author={Booshehri, Meisam and
Buschmeier, Hendrik and Cimiano, Philipp}, year={2025}, pages={255–268} }'
chicago: Booshehri, Meisam, Hendrik Buschmeier, and Philipp Cimiano. “A BFO-Based
Ontological Analysis of Entities in Social XAI.” In Proceedings of the 15th
International Conference on Formal Ontology in Information Systems, 255–268.
IOS Press, 2025. https://doi.org/10.3233/faia250498.
ieee: M. Booshehri, H. Buschmeier, and P. Cimiano, “A BFO-based ontological analysis
of entities in Social XAI,” in Proceedings of the 15th International Conference
on Formal Ontology in Information Systems, IOS Press, 2025, pp. 255–268.
mla: Booshehri, Meisam, et al. “A BFO-Based Ontological Analysis of Entities in
Social XAI.” Proceedings of the 15th International Conference on Formal Ontology
in Information Systems, IOS Press, 2025, pp. 255–268, doi:10.3233/faia250498.
short: 'M. Booshehri, H. Buschmeier, P. Cimiano, in: Proceedings of the 15th International
Conference on Formal Ontology in Information Systems, IOS Press, 2025, pp. 255–268.'
conference:
end_date: 2025-09-12
location: Catania, Italy
name: 15th International Conference on Formal Ontology in Information Systems
start_date: 2025-09-08
date_created: 2025-09-08T14:00:45Z
date_updated: 2025-09-11T10:16:28Z
department:
- _id: '660'
doi: 10.3233/faia250498
extern: '1'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://doi.org/10.3233/FAIA250498
oa: '1'
page: 255–268
project:
- _id: '118'
name: 'TRR 318: Project Area INF'
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: Proceedings of the 15th International Conference on Formal Ontology in
Information Systems
publication_identifier:
isbn:
- '9781643686172'
issn:
- 0922-6389
- 1879-8314
publication_status: published
publisher: IOS Press
quality_controlled: '1'
status: public
title: A BFO-based ontological analysis of entities in Social XAI
type: book_chapter
user_id: '76456'
year: '2025'
...
---
_id: '61153'
author:
- first_name: Meisam
full_name: Booshehri, Meisam
id: '93424'
last_name: Booshehri
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Philipp
full_name: Cimiano, Philipp
last_name: Cimiano
citation:
ama: 'Booshehri M, Buschmeier H, Cimiano P. A BFO-based ontology of context for
Social XAI. In: Abstracts of the 3rd TRR 318 Conference: Contextualizing Explanations.
; 2025.'
apa: 'Booshehri, M., Buschmeier, H., & Cimiano, P. (2025). A BFO-based ontology
of context for Social XAI. Abstracts of the 3rd TRR 318 Conference: Contextualizing
Explanations. 3rd TRR 318 Conference: Contextualizing Explanations, Bielefeld,
Germany.'
bibtex: '@inproceedings{Booshehri_Buschmeier_Cimiano_2025, title={A BFO-based ontology
of context for Social XAI}, booktitle={Abstracts of the 3rd TRR 318 Conference:
Contextualizing Explanations}, author={Booshehri, Meisam and Buschmeier, Hendrik
and Cimiano, Philipp}, year={2025} }'
chicago: 'Booshehri, Meisam, Hendrik Buschmeier, and Philipp Cimiano. “A BFO-Based
Ontology of Context for Social XAI.” In Abstracts of the 3rd TRR 318 Conference:
Contextualizing Explanations, 2025.'
ieee: 'M. Booshehri, H. Buschmeier, and P. Cimiano, “A BFO-based ontology of context
for Social XAI,” presented at the 3rd TRR 318 Conference: Contextualizing Explanations,
Bielefeld, Germany, 2025.'
mla: 'Booshehri, Meisam, et al. “A BFO-Based Ontology of Context for Social XAI.”
Abstracts of the 3rd TRR 318 Conference: Contextualizing Explanations,
2025.'
short: 'M. Booshehri, H. Buschmeier, P. Cimiano, in: Abstracts of the 3rd TRR 318
Conference: Contextualizing Explanations, 2025.'
conference:
end_date: 2025-06-18
location: Bielefeld, Germany
name: '3rd TRR 318 Conference: Contextualizing Explanations'
start_date: 2025-06-17
date_created: 2025-09-08T14:15:42Z
date_updated: 2025-09-12T06:29:37Z
department:
- _id: '660'
extern: '1'
language:
- iso: eng
project:
- _id: '118'
name: 'TRR 318: Project Area INF'
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: 'Abstracts of the 3rd TRR 318 Conference: Contextualizing Explanations'
quality_controlled: '1'
status: public
title: A BFO-based ontology of context for Social XAI
type: conference_abstract
user_id: '76456'
year: '2025'
...
---
_id: '61178'
citation:
ama: Ilinykh N, Robrecht A, Kopp S, Buschmeier H, eds. SemDial 2025 – Bialogue.
Proceedings of the 29th Workshop on the Semantics and Pragmatics of Dialogue.;
2025.
apa: Ilinykh, N., Robrecht, A., Kopp, S., & Buschmeier, H. (Eds.). (2025). SemDial
2025 – Bialogue. Proceedings of the 29th Workshop on the Semantics and Pragmatics
of Dialogue.
bibtex: '@book{Ilinykh_Robrecht_Kopp_Buschmeier_2025, place={Bielefeld, Germany},
series={Proceedings (SemDial)}, title={SemDial 2025 – Bialogue. Proceedings of
the 29th Workshop on the Semantics and Pragmatics of Dialogue}, year={2025}, collection={Proceedings
(SemDial)} }'
chicago: Ilinykh, Nikolai, Amelie Robrecht, Stefan Kopp, and Hendrik Buschmeier,
eds. SemDial 2025 – Bialogue. Proceedings of the 29th Workshop on the Semantics
and Pragmatics of Dialogue. Proceedings (SemDial). Bielefeld, Germany, 2025.
ieee: N. Ilinykh, A. Robrecht, S. Kopp, and H. Buschmeier, Eds., SemDial 2025
– Bialogue. Proceedings of the 29th Workshop on the Semantics and Pragmatics of
Dialogue. Bielefeld, Germany, 2025.
mla: Ilinykh, Nikolai, et al., editors. SemDial 2025 – Bialogue. Proceedings
of the 29th Workshop on the Semantics and Pragmatics of Dialogue. 2025.
short: N. Ilinykh, A. Robrecht, S. Kopp, H. Buschmeier, eds., SemDial 2025 – Bialogue.
Proceedings of the 29th Workshop on the Semantics and Pragmatics of Dialogue,
Bielefeld, Germany, 2025.
conference:
end_date: 2025-09-05
location: Bielefeld, Germany
name: 29th Workshop on the Semantics and Pragmatics of Dialogue
start_date: 2025-09-03
date_created: 2025-09-11T07:16:10Z
date_updated: 2025-09-12T16:56:35Z
department:
- _id: '660'
editor:
- first_name: Nikolai
full_name: Ilinykh, Nikolai
last_name: Ilinykh
- first_name: Amelie
full_name: Robrecht, Amelie
id: '91982'
last_name: Robrecht
orcid: 0000-0001-5622-8248
- first_name: Stefan
full_name: Kopp, Stefan
last_name: Kopp
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
extern: '1'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://purl.org/semdial/2025/proceedings
oa: '1'
page: 271+viii
place: Bielefeld, Germany
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
- _id: '111'
name: 'TRR 318; TP A01: Adaptives Erklären'
publication_identifier:
issn:
- 2308-2275
publication_status: published
quality_controlled: '1'
series_title: Proceedings (SemDial)
status: public
title: SemDial 2025 – Bialogue. Proceedings of the 29th Workshop on the Semantics
and Pragmatics of Dialogue
type: book_editor
user_id: '76456'
year: '2025'
...
---
_id: '61156'
abstract:
- lang: eng
text: Explainability has become an important topic in computer science and artificial
intelligence, leading to a subfield called Explainable Artificial Intelligence
(XAI). The goal of providing or seeking explanations is to achieve (better) ‘understanding’
on the part of the explainee. However, what it means to ‘understand’ is still
not clearly defined, and the concept itself is rarely the subject of scientific
investigation. This conceptual article aims to present a model of forms of understanding
for XAI-explanations and beyond. From an interdisciplinary perspective bringing
together computer science, linguistics, sociology, philosophy and psychology,
a definition of understanding and its forms, assessment, and dynamics during the
process of giving everyday explanations are explored. Two types of understanding
are considered as possible outcomes of explanations, namely enabledness, ‘knowing
how’ to do or decide something, and comprehension, ‘knowing that’ – both in different
degrees (from shallow to deep). Explanations regularly start with shallow understanding
in a specific domain and can lead to deep comprehension and enabledness of the
explanandum, which we see as a prerequisite for human users to gain agency. In
this process, the increase of comprehension and enabledness are highly interdependent.
Against the background of this systematization, special challenges of understanding
in XAI are discussed.
article_number: '101419'
article_type: original
author:
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Heike M.
full_name: Buhl, Heike M.
id: '27152'
last_name: Buhl
- first_name: Friederike
full_name: Kern, Friederike
last_name: Kern
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
- first_name: Helen
full_name: Beierling, Helen
id: '50995'
last_name: Beierling
- first_name: Josephine Beryl
full_name: Fisher, Josephine Beryl
id: '56345'
last_name: Fisher
orcid: 0000-0002-9997-9241
- first_name: André
full_name: Groß, André
id: '93405'
last_name: Groß
orcid: 0000-0002-9593-7220
- first_name: Ilona
full_name: Horwath, Ilona
id: '68836'
last_name: Horwath
- first_name: Nils
full_name: Klowait, Nils
id: '98454'
last_name: Klowait
orcid: 0000-0002-7347-099X
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Michael
full_name: Lenke, Michael
last_name: Lenke
- first_name: Vivien
full_name: Lohmer, Vivien
last_name: Lohmer
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
orcid: 0000-0002-5676-8233
- first_name: Ingrid
full_name: Scharlau, Ingrid
id: '451'
last_name: Scharlau
orcid: 0000-0003-2364-9489
- first_name: Amit
full_name: Singh, Amit
id: '91018'
last_name: Singh
orcid: 0000-0002-7789-1521
- first_name: Lutz
full_name: Terfloth, Lutz
id: '37320'
last_name: Terfloth
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
id: '86589'
last_name: Vollmer
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Annedore
full_name: Wilmes, Annedore
last_name: Wilmes
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
citation:
ama: Buschmeier H, Buhl HM, Kern F, et al. Forms of Understanding for XAI-Explanations.
Cognitive Systems Research. 2025;94. doi:10.1016/j.cogsys.2025.101419
apa: Buschmeier, H., Buhl, H. M., Kern, F., Grimminger, A., Beierling, H., Fisher,
J. B., Groß, A., Horwath, I., Klowait, N., Lazarov, S. T., Lenke, M., Lohmer,
V., Rohlfing, K., Scharlau, I., Singh, A., Terfloth, L., Vollmer, A.-L., Wang,
Y., Wilmes, A., & Wrede, B. (2025). Forms of Understanding for XAI-Explanations.
Cognitive Systems Research, 94, Article 101419. https://doi.org/10.1016/j.cogsys.2025.101419
bibtex: '@article{Buschmeier_Buhl_Kern_Grimminger_Beierling_Fisher_Groß_Horwath_Klowait_Lazarov_et
al._2025, title={Forms of Understanding for XAI-Explanations}, volume={94}, DOI={10.1016/j.cogsys.2025.101419},
number={101419}, journal={Cognitive Systems Research}, author={Buschmeier, Hendrik
and Buhl, Heike M. and Kern, Friederike and Grimminger, Angela and Beierling,
Helen and Fisher, Josephine Beryl and Groß, André and Horwath, Ilona and Klowait,
Nils and Lazarov, Stefan Teodorov and et al.}, year={2025} }'
chicago: Buschmeier, Hendrik, Heike M. Buhl, Friederike Kern, Angela Grimminger,
Helen Beierling, Josephine Beryl Fisher, André Groß, et al. “Forms of Understanding
for XAI-Explanations.” Cognitive Systems Research 94 (2025). https://doi.org/10.1016/j.cogsys.2025.101419.
ieee: 'H. Buschmeier et al., “Forms of Understanding for XAI-Explanations,”
Cognitive Systems Research, vol. 94, Art. no. 101419, 2025, doi: 10.1016/j.cogsys.2025.101419.'
mla: Buschmeier, Hendrik, et al. “Forms of Understanding for XAI-Explanations.”
Cognitive Systems Research, vol. 94, 101419, 2025, doi:10.1016/j.cogsys.2025.101419.
short: H. Buschmeier, H.M. Buhl, F. Kern, A. Grimminger, H. Beierling, J.B. Fisher,
A. Groß, I. Horwath, N. Klowait, S.T. Lazarov, M. Lenke, V. Lohmer, K. Rohlfing,
I. Scharlau, A. Singh, L. Terfloth, A.-L. Vollmer, Y. Wang, A. Wilmes, B. Wrede,
Cognitive Systems Research 94 (2025).
date_created: 2025-09-08T14:24:32Z
date_updated: 2025-12-05T15:32:25Z
ddc:
- '006'
department:
- _id: '660'
doi: 10.1016/j.cogsys.2025.101419
file:
- access_level: closed
content_type: application/pdf
creator: hbuschme
date_created: 2025-12-01T21:02:20Z
date_updated: 2025-12-01T21:02:20Z
file_id: '62730'
file_name: Buschmeier-etal-2025-COGSYS.pdf
file_size: 10114981
relation: main_file
success: 1
file_date_updated: 2025-12-01T21:02:20Z
has_accepted_license: '1'
intvolume: ' 94'
keyword:
- understanding
- explaining
- explanations
- explainable
- AI
- interdisciplinarity
- comprehension
- enabledness
- agency
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://www.sciencedirect.com/science/article/pii/S1389041725000993?via%3Dihub
oa: '1'
project:
- _id: '111'
name: 'TRR 318; TP A01: Adaptives Erklären'
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
- _id: '113'
name: TRR 318 - Subproject A3
- _id: '114'
name: 'TRR 318; TP A04: Integration des technischen Modells in das Partnermodell
bei der Erklärung von digitalen Artefakten'
- _id: '115'
name: 'TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog'
- _id: '122'
name: TRR 318 - Subproject B3
- _id: '123'
name: TRR 318 - Subproject B5
- _id: '119'
name: TRR 318 - Project Area Ö
publication: Cognitive Systems Research
publication_status: published
quality_controlled: '1'
status: public
title: Forms of Understanding for XAI-Explanations
type: journal_article
user_id: '57578'
volume: 94
year: '2025'
...
---
_id: '55403'
abstract:
- lang: eng
text: In this paper we consider the interactive processes by which an explainer
and an explainee cooperate to produce an explanation, which we refer to as co-construction.
Explainable Artificial Intelligence (XAI) is concerned with the development of
intelligent systems and robots that can explain and justify their actions, decisions,
recommendations, and so on. However, the cooperative construction of explanations
remains a key but under-explored issue. This short paper proposes an architecture
for intelligent systems that promotes a co-constructive and interactive approach
to explanation generation. By outlining its basic components and their specific
roles, we aim to contribute to the advancement of XAI computational frameworks
that actively engage users in the explanation process.
author:
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Philipp
full_name: Cimiano, Philipp
last_name: Cimiano
- first_name: Stefan
full_name: Kopp, Stefan
last_name: Kopp
- first_name: Jaroslaw
full_name: Kornowicz, Jaroslaw
id: '44029'
last_name: Kornowicz
orcid: 0000-0002-5654-9911
- first_name: Olesja
full_name: Lammert, Olesja
id: '47384'
last_name: Lammert
orcid: 0000-0001-8201-5166
- first_name: Marco
full_name: Matarese, Marco
last_name: Matarese
- first_name: Dimitry
full_name: Mindlin, Dimitry
last_name: Mindlin
- first_name: Amelie Sophie
full_name: Robrecht, Amelie Sophie
last_name: Robrecht
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
id: '86589'
last_name: Vollmer
- first_name: Petra
full_name: Wagner, Petra
id: '74505'
last_name: Wagner
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
- first_name: Meisam
full_name: Booshehri, Meisam
id: '93424'
last_name: Booshehri
citation:
ama: 'Buschmeier H, Cimiano P, Kopp S, et al. Towards a Computational Architecture
for Co-Constructive Explainable Systems. In: Proceedings of the 2024 Workshop
on Explainability Engineering. ACM; 2024:20-25. doi:10.1145/3648505.3648509'
apa: Buschmeier, H., Cimiano, P., Kopp, S., Kornowicz, J., Lammert, O., Matarese,
M., Mindlin, D., Robrecht, A. S., Vollmer, A.-L., Wagner, P., Wrede, B., &
Booshehri, M. (2024). Towards a Computational Architecture for Co-Constructive
Explainable Systems. Proceedings of the 2024 Workshop on Explainability Engineering,
20–25. https://doi.org/10.1145/3648505.3648509
bibtex: '@inproceedings{Buschmeier_Cimiano_Kopp_Kornowicz_Lammert_Matarese_Mindlin_Robrecht_Vollmer_Wagner_et
al._2024, title={Towards a Computational Architecture for Co-Constructive Explainable
Systems}, DOI={10.1145/3648505.3648509},
booktitle={Proceedings of the 2024 Workshop on Explainability Engineering}, publisher={ACM},
author={Buschmeier, Hendrik and Cimiano, Philipp and Kopp, Stefan and Kornowicz,
Jaroslaw and Lammert, Olesja and Matarese, Marco and Mindlin, Dimitry and Robrecht,
Amelie Sophie and Vollmer, Anna-Lisa and Wagner, Petra and et al.}, year={2024},
pages={20–25} }'
chicago: Buschmeier, Hendrik, Philipp Cimiano, Stefan Kopp, Jaroslaw Kornowicz,
Olesja Lammert, Marco Matarese, Dimitry Mindlin, et al. “Towards a Computational
Architecture for Co-Constructive Explainable Systems.” In Proceedings of the
2024 Workshop on Explainability Engineering, 20–25. ACM, 2024. https://doi.org/10.1145/3648505.3648509.
ieee: 'H. Buschmeier et al., “Towards a Computational Architecture for Co-Constructive
Explainable Systems,” in Proceedings of the 2024 Workshop on Explainability
Engineering, Lisbon, Portugal, 2024, pp. 20–25, doi: 10.1145/3648505.3648509.'
mla: Buschmeier, Hendrik, et al. “Towards a Computational Architecture for Co-Constructive
Explainable Systems.” Proceedings of the 2024 Workshop on Explainability Engineering,
ACM, 2024, pp. 20–25, doi:10.1145/3648505.3648509.
short: 'H. Buschmeier, P. Cimiano, S. Kopp, J. Kornowicz, O. Lammert, M. Matarese,
D. Mindlin, A.S. Robrecht, A.-L. Vollmer, P. Wagner, B. Wrede, M. Booshehri, in:
Proceedings of the 2024 Workshop on Explainability Engineering, ACM, 2024, pp.
20–25.'
conference:
location: Lisbon, Portugal
name: 2024 Workshop on Explainability Engineering
date_created: 2024-07-26T11:57:31Z
date_updated: 2025-03-14T19:24:35Z
department:
- _id: '184'
- _id: '178'
- _id: '660'
doi: 10.1145/3648505.3648509
language:
- iso: eng
main_file_link:
- open_access: '1'
oa: '1'
page: 20-25
project:
- _id: '125'
name: 'TRR 318 - C2: TRR 318 - Subproject C2'
- _id: '113'
name: 'TRR 318 - A3: TRR 318 - Subproject A3'
- _id: '112'
grant_number: '438445824'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
- _id: '118'
name: 'TRR 318 - INF: TRR 318 - Project Area INF'
publication: Proceedings of the 2024 Workshop on Explainability Engineering
publication_status: published
publisher: ACM
quality_controlled: '1'
status: public
title: Towards a Computational Architecture for Co-Constructive Explainable Systems
type: conference
user_id: '44029'
year: '2024'
...
---
_id: '55912'
abstract:
- lang: eng
text: In explanatory interactions, explainees are expected to continuously provide
feedback to explainers by signaling whether they understand an ongoing explanation.
The study presented in this paper is based on the hypothesis that explainees use
a set of multimodal cues, including vocalizations, facial expressions, and movements
of the torso, head, and hands, to do so. We test this hypothesis by building a
random forest classifier based on a multimodal corpus of dyadic explanations (21
explainers and explainees), in which windows of understanding or non-understanding
were identified by participants in a retrospective video recall task. Results
show that sequences of understanding can indeed be differentiated from those of
non-understanding, and that a diverse set of predictors covering a wide range
of modalities contributes to this classification. Due to data sparsity and a high
degree of individual variation, the generalizability of our results is currently
limited, but they support our hypothesis of the relevance of multimodal display
in explanatory interactions.
author:
- first_name: Olcay
full_name: Türk, Olcay
last_name: Türk
- first_name: Stefan Teodorov
full_name: Lazarov, Stefan Teodorov
id: '90345'
last_name: Lazarov
orcid: 0009-0009-0892-9483
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Angela
full_name: Grimminger, Angela
id: '57578'
last_name: Grimminger
- first_name: Petra
full_name: Wagner, Petra
id: '74505'
last_name: Wagner
citation:
ama: 'Türk O, Lazarov ST, Wang Y, Buschmeier H, Grimminger A, Wagner P. Predictability
of understanding in explanatory interactions based on multimodal cues. In: Proceedings
of the 26th ACM International Conference on Multimodal Interaction. ; 2024:449-458.
doi:10.1145/3678957.3685741'
apa: Türk, O., Lazarov, S. T., Wang, Y., Buschmeier, H., Grimminger, A., & Wagner,
P. (2024). Predictability of understanding in explanatory interactions based on
multimodal cues. Proceedings of the 26th ACM International Conference on Multimodal
Interaction, 449–458. https://doi.org/10.1145/3678957.3685741
bibtex: '@inproceedings{Türk_Lazarov_Wang_Buschmeier_Grimminger_Wagner_2024, place={San
José, Costa Rica}, title={Predictability of understanding in explanatory interactions
based on multimodal cues}, DOI={10.1145/3678957.3685741},
booktitle={Proceedings of the 26th ACM International Conference on Multimodal
Interaction}, author={Türk, Olcay and Lazarov, Stefan Teodorov and Wang, Yu and
Buschmeier, Hendrik and Grimminger, Angela and Wagner, Petra}, year={2024}, pages={449–458}
}'
chicago: Türk, Olcay, Stefan Teodorov Lazarov, Yu Wang, Hendrik Buschmeier, Angela
Grimminger, and Petra Wagner. “Predictability of Understanding in Explanatory
Interactions Based on Multimodal Cues.” In Proceedings of the 26th ACM International
Conference on Multimodal Interaction, 449–58. San José, Costa Rica, 2024.
https://doi.org/10.1145/3678957.3685741.
ieee: 'O. Türk, S. T. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, and P. Wagner,
“Predictability of understanding in explanatory interactions based on multimodal
cues,” in Proceedings of the 26th ACM International Conference on Multimodal
Interaction, San José, Costa Rica, 2024, pp. 449–458, doi: 10.1145/3678957.3685741.'
mla: Türk, Olcay, et al. “Predictability of Understanding in Explanatory Interactions
Based on Multimodal Cues.” Proceedings of the 26th ACM International Conference
on Multimodal Interaction, 2024, pp. 449–58, doi:10.1145/3678957.3685741.
short: 'O. Türk, S.T. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, P. Wagner,
in: Proceedings of the 26th ACM International Conference on Multimodal Interaction,
San José, Costa Rica, 2024, pp. 449–458.'
conference:
end_date: 2024-11-08
location: San José, Costa Rica
name: The 26th ACM International Conference on Multimodal Interaction
start_date: 2024-11-04
date_created: 2024-08-30T07:42:55Z
date_updated: 2025-09-02T14:46:03Z
department:
- _id: '660'
doi: 10.1145/3678957.3685741
language:
- iso: eng
page: 449-458
place: San José, Costa Rica
project:
- _id: '112'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
publication: Proceedings of the 26th ACM International Conference on Multimodal Interaction
publication_status: published
quality_controlled: '1'
status: public
title: Predictability of understanding in explanatory interactions based on multimodal
cues
type: conference
user_id: '57578'
year: '2024'
...
---
_id: '61179'
abstract:
- lang: eng
text: 'We examine how users perceive the limitations of an AI system when it encounters
a task that it cannot perform perfectly and whether providing explanations alongside
its answers aids users in constructing an appropriate mental model of the system''s
capabilities and limitations. We employ a visual question answer and explanation
task where we control the AI system''s limitations by manipulating the visual
inputs: during inference, the system either processes full-color or grayscale
images. Our goal is to determine whether participants can perceive the limitations
of the system. We hypothesize that explanations will make limited AI capabilities
more transparent to users. However, our results show that explanations do not
have this effect. Instead of allowing users to more accurately assess the limitations
of the AI system, explanations generally increase users'' perceptions of the system''s
competence – regardless of its actual performance.'
author:
- first_name: Judith
full_name: Sieker, Judith
last_name: Sieker
- first_name: Simeon
full_name: Junker, Simeon
last_name: Junker
- first_name: Ronja
full_name: Utescher, Ronja
last_name: Utescher
- first_name: Nazia
full_name: Attari, Nazia
last_name: Attari
- first_name: Heiko
full_name: Wersing, Heiko
last_name: Wersing
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Sina
full_name: Zarrieß, Sina
last_name: Zarrieß
citation:
ama: 'Sieker J, Junker S, Utescher R, et al. The illusion of competence: Evaluating
the effect of explanations on users’ mental models of visual question answering
systems. In: Proceedings of the 2024 Conference on Empirical Methods in Natural
Language Processing. ACL; 2024:19459–19475. doi:10.18653/v1/2024.emnlp-main.1084'
apa: 'Sieker, J., Junker, S., Utescher, R., Attari, N., Wersing, H., Buschmeier,
H., & Zarrieß, S. (2024). The illusion of competence: Evaluating the effect
of explanations on users’ mental models of visual question answering systems.
Proceedings of the 2024 Conference on Empirical Methods in Natural Language
Processing, 19459–19475. https://doi.org/10.18653/v1/2024.emnlp-main.1084'
bibtex: '@inproceedings{Sieker_Junker_Utescher_Attari_Wersing_Buschmeier_Zarrieß_2024,
place={Miami, FL, USA}, title={The illusion of competence: Evaluating the effect
of explanations on users’ mental models of visual question answering systems},
DOI={10.18653/v1/2024.emnlp-main.1084},
booktitle={Proceedings of the 2024 Conference on Empirical Methods in Natural
Language Processing}, publisher={ACL}, author={Sieker, Judith and Junker, Simeon
and Utescher, Ronja and Attari, Nazia and Wersing, Heiko and Buschmeier, Hendrik
and Zarrieß, Sina}, year={2024}, pages={19459–19475} }'
chicago: 'Sieker, Judith, Simeon Junker, Ronja Utescher, Nazia Attari, Heiko Wersing,
Hendrik Buschmeier, and Sina Zarrieß. “The Illusion of Competence: Evaluating
the Effect of Explanations on Users’ Mental Models of Visual Question Answering
Systems.” In Proceedings of the 2024 Conference on Empirical Methods in Natural
Language Processing, 19459–19475. Miami, FL, USA: ACL, 2024. https://doi.org/10.18653/v1/2024.emnlp-main.1084.'
ieee: 'J. Sieker et al., “The illusion of competence: Evaluating the effect
of explanations on users’ mental models of visual question answering systems,”
in Proceedings of the 2024 Conference on Empirical Methods in Natural Language
Processing, Miami, FL, USA, 2024, pp. 19459–19475, doi: 10.18653/v1/2024.emnlp-main.1084.'
mla: 'Sieker, Judith, et al. “The Illusion of Competence: Evaluating the Effect
of Explanations on Users’ Mental Models of Visual Question Answering Systems.”
Proceedings of the 2024 Conference on Empirical Methods in Natural Language
Processing, ACL, 2024, pp. 19459–19475, doi:10.18653/v1/2024.emnlp-main.1084.'
short: 'J. Sieker, S. Junker, R. Utescher, N. Attari, H. Wersing, H. Buschmeier,
S. Zarrieß, in: Proceedings of the 2024 Conference on Empirical Methods in Natural
Language Processing, ACL, Miami, FL, USA, 2024, pp. 19459–19475.'
conference:
end_date: 2024-11-16
location: Miami, FL, USA
name: 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP)
start_date: 2024-11-12
date_created: 2025-09-11T07:22:05Z
date_updated: 2025-09-11T10:14:50Z
department:
- _id: '660'
doi: 10.18653/v1/2024.emnlp-main.1084
extern: '1'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://doi.org/10.18653/v1/2024.emnlp-main.1084
oa: '1'
page: 19459–19475
place: Miami, FL, USA
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: Proceedings of the 2024 Conference on Empirical Methods in Natural Language
Processing
publication_status: published
publisher: ACL
quality_controlled: '1'
status: public
title: 'The illusion of competence: Evaluating the effect of explanations on users’
mental models of visual question answering systems'
type: conference
user_id: '76456'
year: '2024'
...
---
_id: '55917'
abstract:
- lang: eng
text: This work takes steps towards situating the concepts relevant to explanation
and understanding in explanatory interactions within the scope of Basic Formal
Ontology. We introduce novel ontological accounts of understanding and explanation
in BFO-terms, which foster a shared conceptualization of explanations and explainee's
understanding during explainer-explainee interactions. This approach also enables
the tracking of different aspects of understanding and explanation through cognitive
profiling of various measurable aspects under the heading of process profile in
BFO. Additionally, we differentiate between the private mental process of understanding
and understanding displays. Finally, we characterize the relationship between
understanding displays and explanations.
author:
- first_name: Meisam
full_name: Booshehri, Meisam
last_name: Booshehri
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Philipp
full_name: Cimiano, Philipp
last_name: Cimiano
citation:
ama: 'Booshehri M, Buschmeier H, Cimiano P. Towards a BFO-based ontology of understanding
in explanatory interactions. In: Proceedings of the 4th International Workshop
on Data Meets Applied Ontologies in Explainable AI (DAO-XAI). International
Association for Ontology and its Applications; 2024.'
apa: Booshehri, M., Buschmeier, H., & Cimiano, P. (2024). Towards a BFO-based
ontology of understanding in explanatory interactions. Proceedings of the 4th
International Workshop on Data Meets Applied Ontologies in Explainable AI (DAO-XAI).
4th International Workshop on Data Meets Applied Ontologies in Explainable AI
(DAO-XAI), Santiago de Compostela, Spain.
bibtex: '@inproceedings{Booshehri_Buschmeier_Cimiano_2024, place={Santiago de Compostela,
Spain}, title={Towards a BFO-based ontology of understanding in explanatory interactions},
booktitle={Proceedings of the 4th International Workshop on Data Meets Applied
Ontologies in Explainable AI (DAO-XAI)}, publisher={International Association
for Ontology and its Applications}, author={Booshehri, Meisam and Buschmeier,
Hendrik and Cimiano, Philipp}, year={2024} }'
chicago: 'Booshehri, Meisam, Hendrik Buschmeier, and Philipp Cimiano. “Towards a
BFO-Based Ontology of Understanding in Explanatory Interactions.” In Proceedings
of the 4th International Workshop on Data Meets Applied Ontologies in Explainable
AI (DAO-XAI). Santiago de Compostela, Spain: International Association for
Ontology and its Applications, 2024.'
ieee: M. Booshehri, H. Buschmeier, and P. Cimiano, “Towards a BFO-based ontology
of understanding in explanatory interactions,” presented at the 4th International
Workshop on Data Meets Applied Ontologies in Explainable AI (DAO-XAI), Santiago
de Compostela, Spain, 2024.
mla: Booshehri, Meisam, et al. “Towards a BFO-Based Ontology of Understanding in
Explanatory Interactions.” Proceedings of the 4th International Workshop on
Data Meets Applied Ontologies in Explainable AI (DAO-XAI), International Association
for Ontology and its Applications, 2024.
short: 'M. Booshehri, H. Buschmeier, P. Cimiano, in: Proceedings of the 4th International
Workshop on Data Meets Applied Ontologies in Explainable AI (DAO-XAI), International
Association for Ontology and its Applications, Santiago de Compostela, Spain,
2024.'
conference:
end_date: 2024-10-19
location: Santiago de Compostela, Spain
name: 4th International Workshop on Data Meets Applied Ontologies in Explainable
AI (DAO-XAI)
start_date: 2024-10-19
date_created: 2024-08-30T07:57:06Z
date_updated: 2025-09-11T10:16:42Z
ddc:
- '006'
department:
- _id: '660'
extern: '1'
file:
- access_level: closed
content_type: application/pdf
creator: hbuschme
date_created: 2024-11-18T16:01:17Z
date_updated: 2024-11-18T16:01:17Z
file_id: '57206'
file_name: Booshehri-etal-2024.pdf
file_size: 436217
relation: main_file
success: 1
file_date_updated: 2024-11-18T16:01:17Z
has_accepted_license: '1'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://ceur-ws.org/Vol-3833/paper3.pdf
oa: '1'
place: Santiago de Compostela, Spain
project:
- _id: '118'
name: 'TRR 318 - INF: TRR 318 - Project Area INF'
- _id: '112'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
publication: Proceedings of the 4th International Workshop on Data Meets Applied Ontologies
in Explainable AI (DAO-XAI)
publication_identifier:
issn:
- 1613-0073
publication_status: published
publisher: International Association for Ontology and its Applications
quality_controlled: '1'
status: public
title: Towards a BFO-based ontology of understanding in explanatory interactions
type: conference
user_id: '76456'
year: '2024'
...
---
_id: '56985'
author:
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Stefan
full_name: Kopp, Stefan
last_name: Kopp
- first_name: Teena
full_name: Hassan, Teena
last_name: Hassan
citation:
ama: 'Buschmeier H, Kopp S, Hassan T. Multimodal Co-Construction of Explanations
with XAI Workshop. In: Proceedings of the 26th ACM International Conference
on Multimodal Interaction. ACM; 2024:698-699. doi:10.1145/3678957.3689205'
apa: Buschmeier, H., Kopp, S., & Hassan, T. (2024). Multimodal Co-Construction
of Explanations with XAI Workshop. Proceedings of the 26th ACM International
Conference on Multimodal Interaction, 698–699. https://doi.org/10.1145/3678957.3689205
bibtex: '@inproceedings{Buschmeier_Kopp_Hassan_2024, title={Multimodal Co-Construction
of Explanations with XAI Workshop}, DOI={10.1145/3678957.3689205},
booktitle={Proceedings of the 26th ACM International Conference on Multimodal
Interaction}, publisher={ACM}, author={Buschmeier, Hendrik and Kopp, Stefan and
Hassan, Teena}, year={2024}, pages={698–699} }'
chicago: Buschmeier, Hendrik, Stefan Kopp, and Teena Hassan. “Multimodal Co-Construction
of Explanations with XAI Workshop.” In Proceedings of the 26th ACM International
Conference on Multimodal Interaction, 698–99. ACM, 2024. https://doi.org/10.1145/3678957.3689205.
ieee: 'H. Buschmeier, S. Kopp, and T. Hassan, “Multimodal Co-Construction of Explanations
with XAI Workshop,” in Proceedings of the 26th ACM International Conference
on Multimodal Interaction, San José, Costa Rica, 2024, pp. 698–699, doi: 10.1145/3678957.3689205.'
mla: Buschmeier, Hendrik, et al. “Multimodal Co-Construction of Explanations with
XAI Workshop.” Proceedings of the 26th ACM International Conference on Multimodal
Interaction, ACM, 2024, pp. 698–99, doi:10.1145/3678957.3689205.
short: 'H. Buschmeier, S. Kopp, T. Hassan, in: Proceedings of the 26th ACM International
Conference on Multimodal Interaction, ACM, 2024, pp. 698–699.'
conference:
end_date: 2024-11-08
location: San José, Costa Rica
name: 26th ACM International Conference on Multimodal Interaction
start_date: 2024-11-04
date_created: 2024-11-11T15:56:11Z
date_updated: 2025-09-11T10:16:48Z
department:
- _id: '660'
doi: 10.1145/3678957.3689205
extern: '1'
language:
- iso: eng
page: 698-699
publication: Proceedings of the 26th ACM International Conference on Multimodal Interaction
publication_status: published
publisher: ACM
status: public
title: Multimodal Co-Construction of Explanations with XAI Workshop
type: conference_abstract
user_id: '76456'
year: '2024'
...
---
_id: '55916'
abstract:
- lang: eng
text: To produce explanations that are more likely to be accepted by humans, Explainable
Artificial Intelligence (XAI) systems need to incorporate explanation models grounded
in human communication patterns. So far, little is known about how an explainee,
who lacks understanding of an issue, and an explainer, who has knowledge to fill
the explainee's knowledge gap, actively shape an explanation process, and how
their involvement relates to explanatory success in terms of maximizing the explainee's
level of understanding. In this paper, we characterize explanations as dialogues
in which explainee and explainer take turns to advance the explanation process.
We build on an existing annotation scheme of ‘explanatory moves’ to characterize
such turns, and manually annotate 362 dialogical explanations from the “Explain
Like I'm Five” subreddit. Building on the annotated data, we compute correlations
between explanatory moves and explanatory success, measured on a five-point Likert
scale, in order to identify factors that are significantly correlated with explanatory
success. Based on a qualitative analysis of these factors, we develop a conceptual
model of the main factors that contribute to the success of explanatory dialogues.
author:
- first_name: Meisam
full_name: Booshehri, Meisam
last_name: Booshehri
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Philipp
full_name: Cimiano, Philipp
last_name: Cimiano
citation:
ama: 'Booshehri M, Buschmeier H, Cimiano P. A model of factors contributing to the
success of dialogical explanations. In: Proceedings of the 26th ACM International
Conference on Multimodal Interaction. ACM; 2024:373-381. doi:10.1145/3678957.3685744'
apa: Booshehri, M., Buschmeier, H., & Cimiano, P. (2024). A model of factors
contributing to the success of dialogical explanations. Proceedings of the
26th ACM International Conference on Multimodal Interaction, 373–381. https://doi.org/10.1145/3678957.3685744
bibtex: '@inproceedings{Booshehri_Buschmeier_Cimiano_2024, place={San José, Costa
Rica}, title={A model of factors contributing to the success of dialogical explanations},
DOI={10.1145/3678957.3685744},
booktitle={Proceedings of the 26th ACM International Conference on Multimodal
Interaction}, publisher={ACM}, author={Booshehri, Meisam and Buschmeier, Hendrik
and Cimiano, Philipp}, year={2024}, pages={373–381} }'
chicago: 'Booshehri, Meisam, Hendrik Buschmeier, and Philipp Cimiano. “A Model of
Factors Contributing to the Success of Dialogical Explanations.” In Proceedings
of the 26th ACM International Conference on Multimodal Interaction, 373–81.
San José, Costa Rica: ACM, 2024. https://doi.org/10.1145/3678957.3685744.'
ieee: 'M. Booshehri, H. Buschmeier, and P. Cimiano, “A model of factors contributing
to the success of dialogical explanations,” in Proceedings of the 26th ACM
International Conference on Multimodal Interaction, San José, Costa Rica,
2024, pp. 373–381, doi: 10.1145/3678957.3685744.'
mla: Booshehri, Meisam, et al. “A Model of Factors Contributing to the Success of
Dialogical Explanations.” Proceedings of the 26th ACM International Conference
on Multimodal Interaction, ACM, 2024, pp. 373–81, doi:10.1145/3678957.3685744.
short: 'M. Booshehri, H. Buschmeier, P. Cimiano, in: Proceedings of the 26th ACM
International Conference on Multimodal Interaction, ACM, San José, Costa Rica,
2024, pp. 373–381.'
conference:
end_date: 2024-11-08
location: San José, Costa Rica
name: 26th ACM International Conference on Multimodal Interaction
start_date: 2024-11-04
date_created: 2024-08-30T07:55:36Z
date_updated: 2025-09-11T10:16:55Z
department:
- _id: '660'
doi: 10.1145/3678957.3685744
extern: '1'
language:
- iso: eng
page: 373-381
place: San José, Costa Rica
project:
- _id: '112'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
- _id: '118'
name: 'TRR 318 - INF: TRR 318 - Project Area INF'
publication: Proceedings of the 26th ACM International Conference on Multimodal Interaction
publication_status: published
publisher: ACM
quality_controlled: '1'
status: public
title: A model of factors contributing to the success of dialogical explanations
type: conference
user_id: '76456'
year: '2024'
...
---
_id: '55995'
abstract:
- lang: eng
text: Scripted dialogues such as movie and TV subtitles constitute a widespread
source of training data for conversational NLP models. However, there are notable
linguistic differences between these dialogues and spontaneous interactions, especially
regarding the occurrence of communicative feedback such as backchannels, acknowledgments,
or clarification requests. This paper presents a quantitative analysis of such
feedback phenomena in both subtitles and spontaneous conversations. Based on conversational
data spanning eight languages and multiple genres, we extract lexical statistics,
classifications from a dialogue act tagger, expert annotations and labels derived
from a fine-tuned Large Language Model (LLM). Our main empirical findings are
that (1) communicative feedback is markedly less frequent in subtitles than in
spontaneous dialogues and (2) subtitles contain a higher proportion of negative
feedback. We also show that dialogues generated by standard LLMs lie much closer
to scripted dialogues than spontaneous interactions in terms of communicative
feedback.
author:
- first_name: Ildikó
full_name: Pilán, Ildikó
last_name: Pilán
- first_name: Laurent
full_name: Prévot, Laurent
last_name: Prévot
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Pierre
full_name: Lison, Pierre
last_name: Lison
citation:
ama: 'Pilán I, Prévot L, Buschmeier H, Lison P. Conversational feedback in scripted
versus spontaneous dialogues: A comparative analysis. In: Proceedings of the
25th Meeting of the Special Interest Group on Discourse and Dialogue. ; 2024:440–457.
doi:10.18653/v1/2024.sigdial-1.38'
apa: 'Pilán, I., Prévot, L., Buschmeier, H., & Lison, P. (2024). Conversational
feedback in scripted versus spontaneous dialogues: A comparative analysis. Proceedings
of the 25th Meeting of the Special Interest Group on Discourse and Dialogue,
440–457. https://doi.org/10.18653/v1/2024.sigdial-1.38'
bibtex: '@inproceedings{Pilán_Prévot_Buschmeier_Lison_2024, place={Kyoto, Japan},
title={Conversational feedback in scripted versus spontaneous dialogues: A comparative
analysis}, DOI={10.18653/v1/2024.sigdial-1.38},
booktitle={Proceedings of the 25th Meeting of the Special Interest Group on Discourse
and Dialogue}, author={Pilán, Ildikó and Prévot, Laurent and Buschmeier, Hendrik
and Lison, Pierre}, year={2024}, pages={440–457} }'
chicago: 'Pilán, Ildikó, Laurent Prévot, Hendrik Buschmeier, and Pierre Lison. “Conversational
Feedback in Scripted versus Spontaneous Dialogues: A Comparative Analysis.” In
Proceedings of the 25th Meeting of the Special Interest Group on Discourse
and Dialogue, 440–457. Kyoto, Japan, 2024. https://doi.org/10.18653/v1/2024.sigdial-1.38.'
ieee: 'I. Pilán, L. Prévot, H. Buschmeier, and P. Lison, “Conversational feedback
in scripted versus spontaneous dialogues: A comparative analysis,” in Proceedings
of the 25th Meeting of the Special Interest Group on Discourse and Dialogue,
Kyoto, Japan, 2024, pp. 440–457, doi: 10.18653/v1/2024.sigdial-1.38.'
mla: 'Pilán, Ildikó, et al. “Conversational Feedback in Scripted versus Spontaneous
Dialogues: A Comparative Analysis.” Proceedings of the 25th Meeting of the
Special Interest Group on Discourse and Dialogue, 2024, pp. 440–457, doi:10.18653/v1/2024.sigdial-1.38.'
short: 'I. Pilán, L. Prévot, H. Buschmeier, P. Lison, in: Proceedings of the 25th
Meeting of the Special Interest Group on Discourse and Dialogue, Kyoto, Japan,
2024, pp. 440–457.'
conference:
end_date: 2024-09-20
location: Kyoto, Japan
name: 25th Meeting of the Special Interest Group on Discourse and Dialogue (SIGdial
2024)
start_date: 2024-09-18
date_created: 2024-09-03T07:39:14Z
date_updated: 2025-09-11T10:17:21Z
department:
- _id: '660'
doi: 10.18653/v1/2024.sigdial-1.38
extern: '1'
language:
- iso: eng
main_file_link:
- open_access: '1'
oa: '1'
page: 440–457
place: Kyoto, Japan
project:
- _id: '112'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
publication: Proceedings of the 25th Meeting of the Special Interest Group on Discourse
and Dialogue
publication_status: published
quality_controlled: '1'
status: public
title: 'Conversational feedback in scripted versus spontaneous dialogues: A comparative
analysis'
type: conference
user_id: '76456'
year: '2024'
...
---
_id: '55913'
abstract:
- lang: eng
text: 'We examined the turn-taking dynamics across different phases of explanatory
dialogues, in which 21 different explainers explained a board game to 2–3 explainees
each. Turn-taking dynamics are investigated focusing on >19K floor transitions,
i.e., the detailed patterns characterizing turn keeping or turn yielding events
(Gilmartin et al., 2020). The explanations were characterized by three different
phases (board game absent, board game present, interactive game play), for which
we observed differences in turn-taking dynamics: explanations where the board
game is absent are characterized by less complex floor transitions, while explanations
with a concretely shared reference space are characterized by more complex floor
transitions, as well as more floor transitions between interlocutors. Also, the
speakers’ dialogue role (explainer vs. explainee) appears to have a strong impact
on turn-taking dynamics, as floor transitions that do not conform with the dialogue
role tend to involve more effort, or floor management work.'
author:
- first_name: Petra
full_name: Wagner, Petra
id: '74505'
last_name: Wagner
- first_name: Marcin
full_name: Włodarczak, Marcin
last_name: Włodarczak
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
- first_name: Olcay
full_name: Türk, Olcay
last_name: Türk
- first_name: Emer
full_name: Gilmartin, Emer
last_name: Gilmartin
citation:
ama: 'Wagner P, Włodarczak M, Buschmeier H, Türk O, Gilmartin E. Turn-taking dynamics
across different phases of explanatory dialogues. In: Proceedings of the 28th
Workshop on the Semantics and Pragmatics of Dialogue. ; 2024:6-14.'
apa: Wagner, P., Włodarczak, M., Buschmeier, H., Türk, O., & Gilmartin, E. (2024).
Turn-taking dynamics across different phases of explanatory dialogues. Proceedings
of the 28th Workshop on the Semantics and Pragmatics of Dialogue, 6–14.
bibtex: '@inproceedings{Wagner_Włodarczak_Buschmeier_Türk_Gilmartin_2024, place={Trento,
Italy}, title={Turn-taking dynamics across different phases of explanatory dialogues},
booktitle={Proceedings of the 28th Workshop on the Semantics and Pragmatics of
Dialogue}, author={Wagner, Petra and Włodarczak, Marcin and Buschmeier, Hendrik
and Türk, Olcay and Gilmartin, Emer}, year={2024}, pages={6–14} }'
chicago: Wagner, Petra, Marcin Włodarczak, Hendrik Buschmeier, Olcay Türk, and Emer
Gilmartin. “Turn-Taking Dynamics across Different Phases of Explanatory Dialogues.”
In Proceedings of the 28th Workshop on the Semantics and Pragmatics of Dialogue,
6–14. Trento, Italy, 2024.
ieee: P. Wagner, M. Włodarczak, H. Buschmeier, O. Türk, and E. Gilmartin, “Turn-taking
dynamics across different phases of explanatory dialogues,” in Proceedings
of the 28th Workshop on the Semantics and Pragmatics of Dialogue, Trento,
Italy, 2024, pp. 6–14.
mla: Wagner, Petra, et al. “Turn-Taking Dynamics across Different Phases of Explanatory
Dialogues.” Proceedings of the 28th Workshop on the Semantics and Pragmatics
of Dialogue, 2024, pp. 6–14.
short: 'P. Wagner, M. Włodarczak, H. Buschmeier, O. Türk, E. Gilmartin, in: Proceedings
of the 28th Workshop on the Semantics and Pragmatics of Dialogue, Trento, Italy,
2024, pp. 6–14.'
conference:
end_date: 2024-09-13
location: Trento, Italy
name: The 28th Workshop on the Semantics and Pragmatics of Dialogue
start_date: 2024-09-11
date_created: 2024-08-30T07:43:04Z
date_updated: 2025-09-11T10:17:32Z
department:
- _id: '660'
extern: '1'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://www.semdial.org/anthology/papers/Z/Z24/Z24-3001/
oa: '1'
page: 6-14
place: Trento, Italy
project:
- _id: '112'
name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und
auswerten (Teilprojekt A02)'
publication: Proceedings of the 28th Workshop on the Semantics and Pragmatics of Dialogue
publication_identifier:
issn:
- 2308-2275
publication_status: published
quality_controlled: '1'
status: public
title: Turn-taking dynamics across different phases of explanatory dialogues
type: conference
user_id: '76456'
year: '2024'
...
---
_id: '56190'
abstract:
- lang: eng
text: 'This study investigates the potential of using advanced conversational artificial
intelligence (AI) to help people understand complex AI systems. In line with conversation-analytic
research, we view the participatory role of AI as dynamically unfolding in a situation
rather than being predetermined by its architecture. To study user sensemaking
of intransparent AI systems, we set up a naturalistic encounter between human
participants and two AI systems developed in-house: a reinforcement learning simulation
and a GPT-4-based explainer chatbot. Our results reveal that an explainer-AI only
truly functions as such when participants actively engage with it as a co-constructive
agent. Both the interface’s spatial configuration and the asynchronous temporal
nature of the explainer AI – combined with the users’ presuppositions about its
role – contribute to the decision whether to treat the AI as a dialogical co-participant
in the interaction. Participants establish evidentiality conventions and sensemaking
procedures that may diverge from a system’s intended design or function.'
article_type: original
author:
- first_name: Nils
full_name: Klowait, Nils
id: '98454'
last_name: Klowait
orcid: 0000-0002-7347-099X
- first_name: Maria
full_name: Erofeeva, Maria
last_name: Erofeeva
- first_name: Michael
full_name: Lenke, Michael
id: '32621'
last_name: Lenke
- first_name: Ilona
full_name: Horwath, Ilona
id: '68836'
last_name: Horwath
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
citation:
ama: Klowait N, Erofeeva M, Lenke M, Horwath I, Buschmeier H. Can AI explain AI?
Interactive co-construction of explanations among human and artificial agents.
Discourse & Communication. 2024;18(6):917-930. doi:10.1177/17504813241267069
apa: Klowait, N., Erofeeva, M., Lenke, M., Horwath, I., & Buschmeier, H. (2024).
Can AI explain AI? Interactive co-construction of explanations among human and
artificial agents. Discourse & Communication, 18(6), 917–930.
https://doi.org/10.1177/17504813241267069
bibtex: '@article{Klowait_Erofeeva_Lenke_Horwath_Buschmeier_2024, title={Can AI
explain AI? Interactive co-construction of explanations among human and artificial
agents}, volume={18}, DOI={10.1177/17504813241267069},
number={6}, journal={Discourse & Communication}, publisher={Sage}, author={Klowait,
Nils and Erofeeva, Maria and Lenke, Michael and Horwath, Ilona and Buschmeier,
Hendrik}, year={2024}, pages={917–930} }'
chicago: 'Klowait, Nils, Maria Erofeeva, Michael Lenke, Ilona Horwath, and Hendrik
Buschmeier. “Can AI Explain AI? Interactive Co-Construction of Explanations among
Human and Artificial Agents.” Discourse & Communication 18, no. 6 (2024):
917–30. https://doi.org/10.1177/17504813241267069.'
ieee: 'N. Klowait, M. Erofeeva, M. Lenke, I. Horwath, and H. Buschmeier, “Can AI
explain AI? Interactive co-construction of explanations among human and artificial
agents,” Discourse & Communication, vol. 18, no. 6, pp. 917–930, 2024,
doi: 10.1177/17504813241267069.'
mla: Klowait, Nils, et al. “Can AI Explain AI? Interactive Co-Construction of Explanations
among Human and Artificial Agents.” Discourse & Communication, vol.
18, no. 6, Sage, 2024, pp. 917–30, doi:10.1177/17504813241267069.
short: N. Klowait, M. Erofeeva, M. Lenke, I. Horwath, H. Buschmeier, Discourse &
Communication 18 (2024) 917–930.
date_created: 2024-09-20T09:21:14Z
date_updated: 2025-09-11T14:09:42Z
ddc:
- '300'
department:
- _id: '660'
doi: 10.1177/17504813241267069
file:
- access_level: closed
content_type: application/pdf
creator: hbuschme
date_created: 2024-10-03T16:03:33Z
date_updated: 2024-10-03T16:03:33Z
file_id: '56313'
file_name: klowait-etal-2024-DCM.pdf
file_size: 2488042
relation: main_file
success: 1
file_date_updated: 2024-10-03T16:03:33Z
has_accepted_license: '1'
intvolume: ' 18'
issue: '6'
language:
- iso: eng
page: 917-930
project:
- _id: '119'
name: 'TRR 318 - Ö: TRR 318 - Project Area Ö'
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: Discourse & Communication
publication_status: published
publisher: Sage
quality_controlled: '1'
related_material:
link:
- relation: supplementary_material
url: https://doi.org/10.17605/OSF.IO/4YMT3
status: public
title: Can AI explain AI? Interactive co-construction of explanations among human
and artificial agents
type: journal_article
user_id: '98454'
volume: 18
year: '2024'
...
---
_id: '61180'
abstract:
- lang: eng
text: Starting from the assumption that LLMs are systems bearing only formal but
not functional linguistic competence, this short paper explores how the understanding
capabilities of LLMs could be implicitly explained based on a “pause and refect”
strategy. Specifically, we propose to include a virtual embodied agent in human
interactions with LLM-based chatbots. The agent will use air quotes as multimodal
metalinguistic markers to explicitly point to those parts of the LLM’s output
that are relevant to explaining the LLM’s meaning understanding capabilities.
At the same time, by scafolding users to perceive the output as ‘mentioned language’
inferred from a metalinguistic function of multimodal markers, the agent implicitly
explains how the meaning of the output should be understood. In this proposal,
users will actively participate in the co-construction of the implicit explanation
by providing feedback and deciding when and to what extent the agent’s scafold
(e.g., the air quotes) is used.
author:
- first_name: Milena
full_name: Belosevic, Milena
last_name: Belosevic
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
citation:
ama: 'Belosevic M, Buschmeier H. Quote to explain: Using multimodal metalinguistic
markers to explain large language models’ understanding capabilities. In: ICMI
Companion ’24: Companion Proceedings of the 26th International Conference on Multimodal
Interaction. ACM; 2024:225–227. doi:10.1145/3686215.3689203'
apa: 'Belosevic, M., & Buschmeier, H. (2024). Quote to explain: Using multimodal
metalinguistic markers to explain large language models’ understanding capabilities.
ICMI Companion ’24: Companion Proceedings of the 26th International Conference
on Multimodal Interaction, 225–227. https://doi.org/10.1145/3686215.3689203'
bibtex: '@inproceedings{Belosevic_Buschmeier_2024, place={San José, Costa Rica},
title={Quote to explain: Using multimodal metalinguistic markers to explain large
language models’ understanding capabilities}, DOI={10.1145/3686215.3689203},
booktitle={ICMI Companion ’24: Companion Proceedings of the 26th International
Conference on Multimodal Interaction}, publisher={ACM}, author={Belosevic, Milena
and Buschmeier, Hendrik}, year={2024}, pages={225–227} }'
chicago: 'Belosevic, Milena, and Hendrik Buschmeier. “Quote to Explain: Using Multimodal
Metalinguistic Markers to Explain Large Language Models’ Understanding Capabilities.”
In ICMI Companion ’24: Companion Proceedings of the 26th International Conference
on Multimodal Interaction, 225–227. San José, Costa Rica: ACM, 2024. https://doi.org/10.1145/3686215.3689203.'
ieee: 'M. Belosevic and H. Buschmeier, “Quote to explain: Using multimodal metalinguistic
markers to explain large language models’ understanding capabilities,” in ICMI
Companion ’24: Companion Proceedings of the 26th International Conference on Multimodal
Interaction, San José, Costa Rica, 2024, pp. 225–227, doi: 10.1145/3686215.3689203.'
mla: 'Belosevic, Milena, and Hendrik Buschmeier. “Quote to Explain: Using Multimodal
Metalinguistic Markers to Explain Large Language Models’ Understanding Capabilities.”
ICMI Companion ’24: Companion Proceedings of the 26th International Conference
on Multimodal Interaction, ACM, 2024, pp. 225–227, doi:10.1145/3686215.3689203.'
short: 'M. Belosevic, H. Buschmeier, in: ICMI Companion ’24: Companion Proceedings
of the 26th International Conference on Multimodal Interaction, ACM, San José,
Costa Rica, 2024, pp. 225–227.'
conference:
end_date: 2024-11-04
location: San José, Costa Rica
name: Multimodal Co-Construction of Explanations with XAI Workshop at ICMI 2024
start_date: 2024-11-04
date_created: 2025-09-11T07:32:23Z
date_updated: 2025-09-12T06:25:45Z
doi: 10.1145/3686215.3689203
extern: '1'
language:
- iso: eng
page: 225–227
place: San José, Costa Rica
publication: 'ICMI Companion ’24: Companion Proceedings of the 26th International
Conference on Multimodal Interaction'
publication_status: published
publisher: ACM
quality_controlled: '1'
status: public
title: 'Quote to explain: Using multimodal metalinguistic markers to explain large
language models’ understanding capabilities'
type: conference
user_id: '76456'
year: '2024'
...
---
_id: '61176'
abstract:
- lang: eng
text: We revisit the phenomenon of syntactic complexity convergence in conversational
interaction, originally found for English dialogue, which has theoretical implication
for dialogical concepts such as mutual understanding. We use a modified metric
to quantify syntactic complexity based on dependency parsing. The results show
that syntactic complexity convergence can be statistically confirmed in one of
three selected German datasets that were analysed. Given that the dataset which
shows such convergence is much larger than the other two selected datasets, the
empirical results indicate a certain degree of linguistic generality of syntactic
complexity convergence in conversational interaction. We also found a different
type of syntactic complexity convergence in one of the datasets while further
investigation is still necessary.
author:
- first_name: Yu
full_name: Wang, Yu
last_name: Wang
- first_name: Hendrik
full_name: Buschmeier, Hendrik
id: '76456'
last_name: Buschmeier
orcid: 0000-0002-9613-5713
citation:
ama: 'Wang Y, Buschmeier H. Revisiting the phenomenon of syntactic complexity convergence
on German dialogue data. In: Proceedings of the 20th Conference on Natural
Language Processing (KONVENS 2024). ; 2024:75–80.'
apa: Wang, Y., & Buschmeier, H. (2024). Revisiting the phenomenon of syntactic
complexity convergence on German dialogue data. Proceedings of the 20th Conference
on Natural Language Processing (KONVENS 2024), 75–80.
bibtex: '@inproceedings{Wang_Buschmeier_2024, place={Vienna, Austria}, title={Revisiting
the phenomenon of syntactic complexity convergence on German dialogue data}, booktitle={Proceedings
of the 20th Conference on Natural Language Processing (KONVENS 2024)}, author={Wang,
Yu and Buschmeier, Hendrik}, year={2024}, pages={75–80} }'
chicago: Wang, Yu, and Hendrik Buschmeier. “Revisiting the Phenomenon of Syntactic
Complexity Convergence on German Dialogue Data.” In Proceedings of the 20th
Conference on Natural Language Processing (KONVENS 2024), 75–80. Vienna, Austria,
2024.
ieee: Y. Wang and H. Buschmeier, “Revisiting the phenomenon of syntactic complexity
convergence on German dialogue data,” in Proceedings of the 20th Conference
on Natural Language Processing (KONVENS 2024), Vienna, Austria, 2024, pp.
75–80.
mla: Wang, Yu, and Hendrik Buschmeier. “Revisiting the Phenomenon of Syntactic Complexity
Convergence on German Dialogue Data.” Proceedings of the 20th Conference on
Natural Language Processing (KONVENS 2024), 2024, pp. 75–80.
short: 'Y. Wang, H. Buschmeier, in: Proceedings of the 20th Conference on Natural
Language Processing (KONVENS 2024), Vienna, Austria, 2024, pp. 75–80.'
conference:
end_date: 2024-09-12
location: Vienna, Austria
name: 20th Conference on Natural Language Processing (KONVENS 2024)
start_date: 2024-09-11
date_created: 2025-09-11T07:08:24Z
date_updated: 2025-09-12T06:25:05Z
department:
- _id: '660'
extern: '1'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://aclanthology.org/2024.konvens-main.8
oa: '1'
page: 75–80
place: Vienna, Austria
project:
- _id: '112'
name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten'
publication: Proceedings of the 20th Conference on Natural Language Processing (KONVENS
2024)
publication_status: published
quality_controlled: '1'
status: public
title: Revisiting the phenomenon of syntactic complexity convergence on German dialogue
data
type: conference
user_id: '76456'
year: '2024'
...