--- _id: '55311' abstract: - lang: eng text: Addressing the limitations of individual attribution scores via the Shapley value (SV), the field of explainable AI (XAI) has recently explored intricate interactions of features or data points. In particular, extensions of the SV, such as the Shapley Interaction Index (SII), have been proposed as a measure to still benefit from the axiomatic basis of the SV. However, similar to the SV, their exact computation remains computationally prohibitive. Hence, we propose with SVARM-IQ a sampling-based approach to efficiently approximate Shapley-based interaction indices of any order. SVARM-IQ can be applied to a broad class of interaction indices, including the SII, by leveraging a novel stratified representation. We provide non-asymptotic theoretical guarantees on its approximation quality and empirically demonstrate that SVARM-IQ achieves state-of-the-art estimation results in practical XAI scenarios on different model classes and application domains. author: - first_name: Patrick full_name: Kolpaczki, Patrick last_name: Kolpaczki - first_name: Maximilian full_name: Muschalik, Maximilian last_name: Muschalik - first_name: Fabian full_name: Fumagalli, Fabian id: '93420' last_name: Fumagalli - first_name: Barbara full_name: Hammer, Barbara last_name: Hammer - first_name: Eyke full_name: Huellermeier, Eyke id: '48129' last_name: Huellermeier citation: ama: 'Kolpaczki P, Muschalik M, Fumagalli F, Hammer B, Huellermeier E. SVARM-IQ: Efficient Approximation of Any-order Shapley Interactions through Stratification. In: Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS). Vol 238. Proceedings of Machine Learning Research. PMLR; 2024:3520–3528.' apa: 'Kolpaczki, P., Muschalik, M., Fumagalli, F., Hammer, B., & Huellermeier, E. (2024). SVARM-IQ: Efficient Approximation of Any-order Shapley Interactions through Stratification. Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS), 238, 3520–3528.' bibtex: '@inproceedings{Kolpaczki_Muschalik_Fumagalli_Hammer_Huellermeier_2024, series={Proceedings of Machine Learning Research}, title={SVARM-IQ: Efficient Approximation of Any-order Shapley Interactions through Stratification}, volume={238}, booktitle={Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS)}, publisher={PMLR}, author={Kolpaczki, Patrick and Muschalik, Maximilian and Fumagalli, Fabian and Hammer, Barbara and Huellermeier, Eyke}, year={2024}, pages={3520–3528}, collection={Proceedings of Machine Learning Research} }' chicago: 'Kolpaczki, Patrick, Maximilian Muschalik, Fabian Fumagalli, Barbara Hammer, and Eyke Huellermeier. “SVARM-IQ: Efficient Approximation of Any-Order Shapley Interactions through Stratification.” In Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS), 238:3520–3528. Proceedings of Machine Learning Research. PMLR, 2024.' ieee: 'P. Kolpaczki, M. Muschalik, F. Fumagalli, B. Hammer, and E. Huellermeier, “SVARM-IQ: Efficient Approximation of Any-order Shapley Interactions through Stratification,” in Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS), 2024, vol. 238, pp. 3520–3528.' mla: 'Kolpaczki, Patrick, et al. “SVARM-IQ: Efficient Approximation of Any-Order Shapley Interactions through Stratification.” Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS), vol. 238, PMLR, 2024, pp. 3520–3528.' short: 'P. Kolpaczki, M. Muschalik, F. Fumagalli, B. Hammer, E. Huellermeier, in: Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS), PMLR, 2024, pp. 3520–3528.' date_created: 2024-07-18T09:39:14Z date_updated: 2025-09-11T16:22:30Z department: - _id: '660' intvolume: ' 238' language: - iso: eng page: 3520–3528 project: - _id: '109' name: 'TRR 318: TRR 318 - Erklärbarkeit konstruieren' - _id: '117' name: 'TRR 318 - C: TRR 318 - Project Area C' - _id: '126' name: 'TRR 318 - C3: TRR 318 - Subproject C3' publication: Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS) publisher: PMLR series_title: Proceedings of Machine Learning Research status: public title: 'SVARM-IQ: Efficient Approximation of Any-order Shapley Interactions through Stratification' type: conference user_id: '93420' volume: 238 year: '2024' ... --- _id: '58223' abstract: - lang: eng text: The Shapley value (SV) is a prevalent approach of allocating credit to machine learning (ML) entities to understand black box ML models. Enriching such interpretations with higher-order interactions is inevitable for complex systems, where the Shapley Interaction Index (SII) is a direct axiomatic extension of the SV. While it is well-known that the SV yields an optimal approximation of any game via a weighted least square (WLS) objective, an extension of this result to SII has been a long-standing open problem, which even led to the proposal of an alternative index. In this work, we characterize higher-order SII as a solution to a WLS problem, which constructs an optimal approximation via SII and k-Shapley values (k-SII). We prove this representation for the SV and pairwise SII and give empirically validated conjectures for higher orders. As a result, we propose KernelSHAP-IQ, a direct extension of KernelSHAP for SII, and demonstrate state-of-the-art performance for feature interactions. author: - first_name: Fabian full_name: Fumagalli, Fabian last_name: Fumagalli - first_name: Maximilian full_name: Muschalik, Maximilian last_name: Muschalik - first_name: Patrick full_name: Kolpaczki, Patrick last_name: Kolpaczki - first_name: Eyke full_name: Hüllermeier, Eyke last_name: Hüllermeier - first_name: Barbara full_name: Hammer, Barbara last_name: Hammer citation: ama: 'Fumagalli F, Muschalik M, Kolpaczki P, Hüllermeier E, Hammer B. KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions. In: Proceedings of the 41st International Conference on Machine Learning (ICML). Vol 235. Proceedings of Machine Learning Research. PMLR; 2024:14308–14342.' apa: 'Fumagalli, F., Muschalik, M., Kolpaczki, P., Hüllermeier, E., & Hammer, B. (2024). KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions. Proceedings of the 41st International Conference on Machine Learning (ICML), 235, 14308–14342.' bibtex: '@inproceedings{Fumagalli_Muschalik_Kolpaczki_Hüllermeier_Hammer_2024, series={Proceedings of Machine Learning Research}, title={KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions}, volume={235}, booktitle={Proceedings of the 41st International Conference on Machine Learning (ICML)}, publisher={PMLR}, author={Fumagalli, Fabian and Muschalik, Maximilian and Kolpaczki, Patrick and Hüllermeier, Eyke and Hammer, Barbara}, year={2024}, pages={14308–14342}, collection={Proceedings of Machine Learning Research} }' chicago: 'Fumagalli, Fabian, Maximilian Muschalik, Patrick Kolpaczki, Eyke Hüllermeier, and Barbara Hammer. “KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions.” In Proceedings of the 41st International Conference on Machine Learning (ICML), 235:14308–14342. Proceedings of Machine Learning Research. PMLR, 2024.' ieee: 'F. Fumagalli, M. Muschalik, P. Kolpaczki, E. Hüllermeier, and B. Hammer, “KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions,” in Proceedings of the 41st International Conference on Machine Learning (ICML), 2024, vol. 235, pp. 14308–14342.' mla: 'Fumagalli, Fabian, et al. “KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions.” Proceedings of the 41st International Conference on Machine Learning (ICML), vol. 235, PMLR, 2024, pp. 14308–14342.' short: 'F. Fumagalli, M. Muschalik, P. Kolpaczki, E. Hüllermeier, B. Hammer, in: Proceedings of the 41st International Conference on Machine Learning (ICML), PMLR, 2024, pp. 14308–14342.' date_created: 2025-01-16T16:12:16Z date_updated: 2025-09-11T16:27:05Z department: - _id: '660' intvolume: ' 235' language: - iso: eng page: 14308–14342 project: - _id: '109' name: 'TRR 318: TRR 318 - Erklärbarkeit konstruieren' - _id: '117' name: 'TRR 318 - C: TRR 318 - Project Area C' - _id: '126' name: 'TRR 318 - C3: TRR 318 - Subproject C3' publication: Proceedings of the 41st International Conference on Machine Learning (ICML) publisher: PMLR series_title: Proceedings of Machine Learning Research status: public title: 'KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions' type: conference user_id: '93420' volume: 235 year: '2024' ... --- _id: '61228' author: - first_name: Maximilian full_name: Muschalik, Maximilian last_name: Muschalik - first_name: Hubert full_name: Baniecki, Hubert last_name: Baniecki - first_name: Fabian full_name: Fumagalli, Fabian id: '93420' last_name: Fumagalli - first_name: Patrick full_name: Kolpaczki, Patrick last_name: Kolpaczki - first_name: Barbara full_name: Hammer, Barbara last_name: Hammer - first_name: Eyke full_name: Huellermeier, Eyke id: '48129' last_name: Huellermeier citation: ama: 'Muschalik M, Baniecki H, Fumagalli F, Kolpaczki P, Hammer B, Huellermeier E. shapiq: Shapley interactions for machine learning. In: Advances in Neural Information Processing Systems (NeurIPS). Vol 37. ; 2024:130324–130357.' apa: 'Muschalik, M., Baniecki, H., Fumagalli, F., Kolpaczki, P., Hammer, B., & Huellermeier, E. (2024). shapiq: Shapley interactions for machine learning. Advances in Neural Information Processing Systems (NeurIPS), 37, 130324–130357.' bibtex: '@inproceedings{Muschalik_Baniecki_Fumagalli_Kolpaczki_Hammer_Huellermeier_2024, title={shapiq: Shapley interactions for machine learning}, volume={37}, booktitle={Advances in Neural Information Processing Systems (NeurIPS)}, author={Muschalik, Maximilian and Baniecki, Hubert and Fumagalli, Fabian and Kolpaczki, Patrick and Hammer, Barbara and Huellermeier, Eyke}, year={2024}, pages={130324–130357} }' chicago: 'Muschalik, Maximilian, Hubert Baniecki, Fabian Fumagalli, Patrick Kolpaczki, Barbara Hammer, and Eyke Huellermeier. “Shapiq: Shapley Interactions for Machine Learning.” In Advances in Neural Information Processing Systems (NeurIPS), 37:130324–130357, 2024.' ieee: 'M. Muschalik, H. Baniecki, F. Fumagalli, P. Kolpaczki, B. Hammer, and E. Huellermeier, “shapiq: Shapley interactions for machine learning,” in Advances in Neural Information Processing Systems (NeurIPS), 2024, vol. 37, pp. 130324–130357.' mla: 'Muschalik, Maximilian, et al. “Shapiq: Shapley Interactions for Machine Learning.” Advances in Neural Information Processing Systems (NeurIPS), vol. 37, 2024, pp. 130324–130357.' short: 'M. Muschalik, H. Baniecki, F. Fumagalli, P. Kolpaczki, B. Hammer, E. Huellermeier, in: Advances in Neural Information Processing Systems (NeurIPS), 2024, pp. 130324–130357.' date_created: 2025-09-11T15:39:01Z date_updated: 2025-09-11T16:17:35Z department: - _id: '660' intvolume: ' 37' language: - iso: eng page: 130324–130357 project: - _id: '117' name: TRR 318 - Project Area C - _id: '126' name: TRR 318 - Subproject C3 - _id: '109' name: 'TRR 318: Erklärbarkeit konstruieren' publication: Advances in Neural Information Processing Systems (NeurIPS) status: public title: 'shapiq: Shapley interactions for machine learning' type: conference user_id: '93420' volume: 37 year: '2024' ... --- _id: '61230' author: - first_name: Patrick full_name: Kolpaczki, Patrick last_name: Kolpaczki - first_name: Viktor full_name: Bengs, Viktor last_name: Bengs - first_name: Maximilian full_name: Muschalik, Maximilian last_name: Muschalik - first_name: Eyke full_name: Hüllermeier, Eyke last_name: Hüllermeier citation: ama: 'Kolpaczki P, Bengs V, Muschalik M, Hüllermeier E. Approximating the shapley value without marginal contributions. In: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI). Vol 38. ; 2024:13246–13255.' apa: Kolpaczki, P., Bengs, V., Muschalik, M., & Hüllermeier, E. (2024). Approximating the shapley value without marginal contributions. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 38(12), 13246–13255. bibtex: '@inproceedings{Kolpaczki_Bengs_Muschalik_Hüllermeier_2024, title={Approximating the shapley value without marginal contributions}, volume={38}, number={12}, booktitle={Proceedings of the AAAI conference on Artificial Intelligence (AAAI)}, author={Kolpaczki, Patrick and Bengs, Viktor and Muschalik, Maximilian and Hüllermeier, Eyke}, year={2024}, pages={13246–13255} }' chicago: Kolpaczki, Patrick, Viktor Bengs, Maximilian Muschalik, and Eyke Hüllermeier. “Approximating the Shapley Value without Marginal Contributions.” In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 38:13246–13255, 2024. ieee: P. Kolpaczki, V. Bengs, M. Muschalik, and E. Hüllermeier, “Approximating the shapley value without marginal contributions,” in Proceedings of the AAAI conference on Artificial Intelligence (AAAI), 2024, vol. 38, no. 12, pp. 13246–13255. mla: Kolpaczki, Patrick, et al. “Approximating the Shapley Value without Marginal Contributions.” Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), vol. 38, no. 12, 2024, pp. 13246–13255. short: 'P. Kolpaczki, V. Bengs, M. Muschalik, E. Hüllermeier, in: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024, pp. 13246–13255.' date_created: 2025-09-11T15:46:40Z date_updated: 2025-09-11T16:17:54Z department: - _id: '660' intvolume: ' 38' issue: '12' language: - iso: eng page: 13246–13255 project: - _id: '117' name: TRR 318 - Project Area C - _id: '126' name: TRR 318 - Subproject C3 - _id: '109' name: 'TRR 318: Erklärbarkeit konstruieren' publication: Proceedings of the AAAI conference on Artificial Intelligence (AAAI) status: public title: Approximating the shapley value without marginal contributions type: conference user_id: '93420' volume: 38 year: '2024' ... --- _id: '61176' abstract: - lang: eng text: We revisit the phenomenon of syntactic complexity convergence in conversational interaction, originally found for English dialogue, which has theoretical implication for dialogical concepts such as mutual understanding. We use a modified metric to quantify syntactic complexity based on dependency parsing. The results show that syntactic complexity convergence can be statistically confirmed in one of three selected German datasets that were analysed. Given that the dataset which shows such convergence is much larger than the other two selected datasets, the empirical results indicate a certain degree of linguistic generality of syntactic complexity convergence in conversational interaction. We also found a different type of syntactic complexity convergence in one of the datasets while further investigation is still necessary. author: - first_name: Yu full_name: Wang, Yu last_name: Wang - first_name: Hendrik full_name: Buschmeier, Hendrik id: '76456' last_name: Buschmeier orcid: 0000-0002-9613-5713 citation: ama: 'Wang Y, Buschmeier H. Revisiting the phenomenon of syntactic complexity convergence on German dialogue data. In: Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024). ; 2024:75–80.' apa: Wang, Y., & Buschmeier, H. (2024). Revisiting the phenomenon of syntactic complexity convergence on German dialogue data. Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024), 75–80. bibtex: '@inproceedings{Wang_Buschmeier_2024, place={Vienna, Austria}, title={Revisiting the phenomenon of syntactic complexity convergence on German dialogue data}, booktitle={Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024)}, author={Wang, Yu and Buschmeier, Hendrik}, year={2024}, pages={75–80} }' chicago: Wang, Yu, and Hendrik Buschmeier. “Revisiting the Phenomenon of Syntactic Complexity Convergence on German Dialogue Data.” In Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024), 75–80. Vienna, Austria, 2024. ieee: Y. Wang and H. Buschmeier, “Revisiting the phenomenon of syntactic complexity convergence on German dialogue data,” in Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024), Vienna, Austria, 2024, pp. 75–80. mla: Wang, Yu, and Hendrik Buschmeier. “Revisiting the Phenomenon of Syntactic Complexity Convergence on German Dialogue Data.” Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024), 2024, pp. 75–80. short: 'Y. Wang, H. Buschmeier, in: Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024), Vienna, Austria, 2024, pp. 75–80.' conference: end_date: 2024-09-12 location: Vienna, Austria name: 20th Conference on Natural Language Processing (KONVENS 2024) start_date: 2024-09-11 date_created: 2025-09-11T07:08:24Z date_updated: 2025-09-12T06:25:05Z department: - _id: '660' extern: '1' language: - iso: eng main_file_link: - open_access: '1' url: https://aclanthology.org/2024.konvens-main.8 oa: '1' page: 75–80 place: Vienna, Austria project: - _id: '112' name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten' publication: Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024) publication_status: published quality_controlled: '1' status: public title: Revisiting the phenomenon of syntactic complexity convergence on German dialogue data type: conference user_id: '76456' year: '2024' ... --- _id: '55911' abstract: - lang: eng text: According to the Entropy Rate Constancy (ERC) principle, the information density of a text is approximately constant over its length. Whether this principle also applies to nonverbal communication signals is still under investigation. We perform empirical analyses of video-recorded dialogue data and investigate whether listener gaze, as an important nonverbal communication signal, adheres to the ERC principle. Results show (1) that the ERC principle holds for listener gaze; and (2) that the two linguistic factors syntactic complexity and turn transition potential are weakly correlated with local entropy of listener gaze. author: - first_name: Yu full_name: Wang, Yu last_name: Wang - first_name: Yang full_name: Xu, Yang last_name: Xu - first_name: Gabriel full_name: Skantze, Gabriel last_name: Skantze - first_name: Hendrik full_name: Buschmeier, Hendrik id: '76456' last_name: Buschmeier orcid: 0000-0002-9613-5713 citation: ama: 'Wang Y, Xu Y, Skantze G, Buschmeier H. How much does nonverbal communication conform to entropy rate constancy?: A case study on listener gaze in interaction. In: Findings of the Association for Computational Linguistics ACL 2024. ; 2024:3533–3545.' apa: 'Wang, Y., Xu, Y., Skantze, G., & Buschmeier, H. (2024). How much does nonverbal communication conform to entropy rate constancy?: A case study on listener gaze in interaction. Findings of the Association for Computational Linguistics ACL 2024, 3533–3545.' bibtex: '@inproceedings{Wang_Xu_Skantze_Buschmeier_2024, place={Bangkok, Thailand}, title={How much does nonverbal communication conform to entropy rate constancy?: A case study on listener gaze in interaction}, booktitle={Findings of the Association for Computational Linguistics ACL 2024}, author={Wang, Yu and Xu, Yang and Skantze, Gabriel and Buschmeier, Hendrik}, year={2024}, pages={3533–3545} }' chicago: 'Wang, Yu, Yang Xu, Gabriel Skantze, and Hendrik Buschmeier. “How Much Does Nonverbal Communication Conform to Entropy Rate Constancy?: A Case Study on Listener Gaze in Interaction.” In Findings of the Association for Computational Linguistics ACL 2024, 3533–3545. Bangkok, Thailand, 2024.' ieee: 'Y. Wang, Y. Xu, G. Skantze, and H. Buschmeier, “How much does nonverbal communication conform to entropy rate constancy?: A case study on listener gaze in interaction,” in Findings of the Association for Computational Linguistics ACL 2024, Bangkok, Thailand, 2024, pp. 3533–3545.' mla: 'Wang, Yu, et al. “How Much Does Nonverbal Communication Conform to Entropy Rate Constancy?: A Case Study on Listener Gaze in Interaction.” Findings of the Association for Computational Linguistics ACL 2024, 2024, pp. 3533–3545.' short: 'Y. Wang, Y. Xu, G. Skantze, H. Buschmeier, in: Findings of the Association for Computational Linguistics ACL 2024, Bangkok, Thailand, 2024, pp. 3533–3545.' conference: location: Bangkok, Thailand name: 62nd Annual Meeting of the Association for Computational Linguistics date_created: 2024-08-30T07:42:28Z date_updated: 2025-09-12T06:25:05Z department: - _id: '660' language: - iso: eng main_file_link: - open_access: '1' url: https://aclanthology.org/2024.findings-acl.210/ oa: '1' page: 3533–3545 place: Bangkok, Thailand project: - _id: '112' name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und auswerten (Teilprojekt A02)' publication: Findings of the Association for Computational Linguistics ACL 2024 quality_controlled: '1' status: public title: 'How much does nonverbal communication conform to entropy rate constancy?: A case study on listener gaze in interaction' type: conference user_id: '76456' year: '2024' ... --- _id: '56314' author: - first_name: Alina Naomi full_name: Riechmann, Alina Naomi last_name: Riechmann - first_name: Hendrik full_name: Buschmeier, Hendrik id: '76456' last_name: Buschmeier orcid: 0000-0002-9613-5713 citation: ama: 'Riechmann AN, Buschmeier H. Automatic reconstruction of dialogue participants’ coordinating gaze behavior from multiple camera perspectives. In: Book of Abstracts of the 2nd International Multimodal Communication Symposium. ; 2024:38–39.' apa: Riechmann, A. N., & Buschmeier, H. (2024). Automatic reconstruction of dialogue participants’ coordinating gaze behavior from multiple camera perspectives. Book of Abstracts of the 2nd International Multimodal Communication Symposium, 38–39. bibtex: '@inproceedings{Riechmann_Buschmeier_2024, place={Frankfurt am Main, Germany}, title={Automatic reconstruction of dialogue participants’ coordinating gaze behavior from multiple camera perspectives}, booktitle={Book of Abstracts of the 2nd International Multimodal Communication Symposium}, author={Riechmann, Alina Naomi and Buschmeier, Hendrik}, year={2024}, pages={38–39} }' chicago: Riechmann, Alina Naomi, and Hendrik Buschmeier. “Automatic Reconstruction of Dialogue Participants’ Coordinating Gaze Behavior from Multiple Camera Perspectives.” In Book of Abstracts of the 2nd International Multimodal Communication Symposium, 38–39. Frankfurt am Main, Germany, 2024. ieee: A. N. Riechmann and H. Buschmeier, “Automatic reconstruction of dialogue participants’ coordinating gaze behavior from multiple camera perspectives,” in Book of Abstracts of the 2nd International Multimodal Communication Symposium, Frankfurt am Main, Germany, 2024, pp. 38–39. mla: Riechmann, Alina Naomi, and Hendrik Buschmeier. “Automatic Reconstruction of Dialogue Participants’ Coordinating Gaze Behavior from Multiple Camera Perspectives.” Book of Abstracts of the 2nd International Multimodal Communication Symposium, 2024, pp. 38–39. short: 'A.N. Riechmann, H. Buschmeier, in: Book of Abstracts of the 2nd International Multimodal Communication Symposium, Frankfurt am Main, Germany, 2024, pp. 38–39.' conference: end_date: 2024-09-27 location: Frankfurt am Main, Germany name: 2nd International Multimodal Communication Symposium start_date: 2024-09-25 date_created: 2024-10-03T16:08:04Z date_updated: 2025-09-12T06:30:39Z department: - _id: '660' extern: '1' language: - iso: eng page: 38–39 place: Frankfurt am Main, Germany project: - _id: '112' name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und auswerten (Teilprojekt A02)' publication: Book of Abstracts of the 2nd International Multimodal Communication Symposium publication_status: published quality_controlled: '1' related_material: link: - relation: poster url: https://doi.org/10.6084/m9.figshare.27080500 status: public title: Automatic reconstruction of dialogue participants’ coordinating gaze behavior from multiple camera perspectives type: conference_abstract user_id: '76456' year: '2024' ... --- _id: '58722' abstract: - lang: eng text: Dialects introduce syntactic and lexical variations in language that occur in regional or social groups. Most NLP methods are not sensitive to such variations. This may lead to unfair behavior of the methods, conveying negative bias towards dialect speakers. While previous work has studied dialect-related fairness for aspects like hate speech, other aspects of biased language, such as lewdness, remain fully unexplored. To fill this gap, we investigate performance disparities between dialects in the detection of five aspects of biased language and how to mitigate them. To alleviate bias, we present a multitask learning approach that models dialect language as an auxiliary task to incorporate syntactic and lexical variations. In our experiments with African-American English dialect, we provide empirical evidence that complementing common learning approaches with dialect modeling improves their fairness. Furthermore, the results suggest that multitask learning achieves state-of-the-art performance and helps to detect properties of biased language more reliably. author: - first_name: Maximilian full_name: Spliethöver, Maximilian id: '84035' last_name: Spliethöver orcid: 0000-0003-4364-1409 - first_name: Sai Nikhil full_name: Menon, Sai Nikhil last_name: Menon - first_name: Henning full_name: Wachsmuth, Henning id: '3900' last_name: Wachsmuth citation: ama: 'Spliethöver M, Menon SN, Wachsmuth H. Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness. In: Ku L-W, Martins A, Srikumar V, eds. Findings of the Association for Computational Linguistics: ACL 2024. Association for Computational Linguistics; 2024:9294–9313. doi:10.18653/v1/2024.findings-acl.553' apa: 'Spliethöver, M., Menon, S. N., & Wachsmuth, H. (2024). Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness. In L.-W. Ku, A. Martins, & V. Srikumar (Eds.), Findings of the Association for Computational Linguistics: ACL 2024 (pp. 9294–9313). Association for Computational Linguistics. https://doi.org/10.18653/v1/2024.findings-acl.553' bibtex: '@inproceedings{Spliethöver_Menon_Wachsmuth_2024, place={Bangkok, Thailand}, title={Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness}, DOI={10.18653/v1/2024.findings-acl.553}, booktitle={Findings of the Association for Computational Linguistics: ACL 2024}, publisher={Association for Computational Linguistics}, author={Spliethöver, Maximilian and Menon, Sai Nikhil and Wachsmuth, Henning}, editor={Ku, Lun-Wei and Martins, Andre and Srikumar, Vivek}, year={2024}, pages={9294–9313} }' chicago: 'Spliethöver, Maximilian, Sai Nikhil Menon, and Henning Wachsmuth. “Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness.” In Findings of the Association for Computational Linguistics: ACL 2024, edited by Lun-Wei Ku, Andre Martins, and Vivek Srikumar, 9294–9313. Bangkok, Thailand: Association for Computational Linguistics, 2024. https://doi.org/10.18653/v1/2024.findings-acl.553.' ieee: 'M. Spliethöver, S. N. Menon, and H. Wachsmuth, “Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness,” in Findings of the Association for Computational Linguistics: ACL 2024, 2024, pp. 9294–9313, doi: 10.18653/v1/2024.findings-acl.553.' mla: 'Spliethöver, Maximilian, et al. “Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness.” Findings of the Association for Computational Linguistics: ACL 2024, edited by Lun-Wei Ku et al., Association for Computational Linguistics, 2024, pp. 9294–9313, doi:10.18653/v1/2024.findings-acl.553.' short: 'M. Spliethöver, S.N. Menon, H. Wachsmuth, in: L.-W. Ku, A. Martins, V. Srikumar (Eds.), Findings of the Association for Computational Linguistics: ACL 2024, Association for Computational Linguistics, Bangkok, Thailand, 2024, pp. 9294–9313.' date_created: 2025-02-20T08:18:01Z date_updated: 2025-09-12T09:52:59Z department: - _id: '600' - _id: '660' doi: 10.18653/v1/2024.findings-acl.553 editor: - first_name: Lun-Wei full_name: Ku, Lun-Wei last_name: Ku - first_name: Andre full_name: Martins, Andre last_name: Martins - first_name: Vivek full_name: Srikumar, Vivek last_name: Srikumar language: - iso: eng main_file_link: - open_access: '1' url: https://aclanthology.org/2024.findings-acl.553/ oa: '1' page: 9294–9313 place: Bangkok, Thailand project: - _id: '118' name: 'TRR 318 - INF: TRR 318 - Project Area INF' publication: 'Findings of the Association for Computational Linguistics: ACL 2024' publisher: Association for Computational Linguistics related_material: link: - relation: software url: https://github.com/webis-de/acl24-dialect-aware-bias-detection status: public title: Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness type: conference user_id: '84035' year: '2024' ... --- _id: '61273' abstract: - lang: eng text: "In human-machine explanation interactions, such as tutoring systems or customer support chatbots, it is important for the machine explainer to infer the human user's understanding. Nonverbal signals play an important role for expressing mental states like understanding and confusion in these interactions. However, an individual's expressions may vary depending on other factors. In cases where these factors are unknown, machine learning methods that infer understanding from nonverbal cues become unreliable. Stress for example has been shown to affect human expression, but it is not clear from the current research how stress affects the expression of understanding.\r\nTo address this gap, we design a paradigm that induces understanding and confusion through game rule explanations. During the explanations, self-perceived understanding and confusion are annotated by the participants. A stress condition is also introduced to enable the investigation of changes in the expression of social signals under stress.\r\nWe conducted a study to validate the stress induction and participants reported a statistically significant increase in stress during the stress condition compared to the neutral control condition. \r\nAdditionally, feedback from participants shows that the paradigm is effective in inducing understanding and confusion. \r\nThis paradigm paves the way for further studies investigating social signals of understanding to improve human-machine explanation interactions for varying contexts." author: - first_name: Jonas full_name: Paletschek, Jonas id: '98941' last_name: Paletschek citation: ama: 'Paletschek J. A Paradigm to Investigate Social Signals of Understanding and Their Susceptibility to Stress. In: 12th International Conference on  Affective Computing & Intelligent Interaction. IEEE; 2024. doi:10.1109/ACII63134.2024.00040' apa: Paletschek, J. (2024). A Paradigm to Investigate Social Signals of Understanding and Their Susceptibility to Stress. 12th International Conference on  Affective Computing & Intelligent Interaction. 12th International Conference on  Affective Computing & Intelligent Interaction, Glasgow. https://doi.org/10.1109/ACII63134.2024.00040 bibtex: '@inproceedings{Paletschek_2024, title={A Paradigm to Investigate Social Signals of Understanding and Their Susceptibility to Stress}, DOI={10.1109/ACII63134.2024.00040}, booktitle={12th International Conference on  Affective Computing & Intelligent Interaction}, publisher={IEEE}, author={Paletschek, Jonas}, year={2024} }' chicago: Paletschek, Jonas. “A Paradigm to Investigate Social Signals of Understanding and Their Susceptibility to Stress.” In 12th International Conference on  Affective Computing & Intelligent Interaction. IEEE, 2024. https://doi.org/10.1109/ACII63134.2024.00040. ieee: 'J. Paletschek, “A Paradigm to Investigate Social Signals of Understanding and Their Susceptibility to Stress,” presented at the 12th International Conference on  Affective Computing & Intelligent Interaction, Glasgow, 2024, doi: 10.1109/ACII63134.2024.00040.' mla: Paletschek, Jonas. “A Paradigm to Investigate Social Signals of Understanding and Their Susceptibility to Stress.” 12th International Conference on  Affective Computing & Intelligent Interaction, IEEE, 2024, doi:10.1109/ACII63134.2024.00040. short: 'J. Paletschek, in: 12th International Conference on  Affective Computing & Intelligent Interaction, IEEE, 2024.' conference: end_date: 2024-09-18 location: Glasgow name: 12th International Conference on Affective Computing & Intelligent Interaction start_date: 2024-09-15 date_created: 2025-09-15T11:24:56Z date_updated: 2025-09-16T07:57:53Z ddc: - '150' department: - _id: '660' doi: 10.1109/ACII63134.2024.00040 file: - access_level: closed content_type: application/pdf creator: paletsch date_created: 2025-09-15T11:18:01Z date_updated: 2025-09-15T11:18:01Z file_id: '61274' file_name: ACII2024_Camera_Ready.pdf file_size: 8807478 relation: main_file success: 1 file_date_updated: 2025-09-15T11:18:01Z has_accepted_license: '1' keyword: - Understanding - Nonverbal Social Signals - Stress Induction - Explanation - Machine Learning Bias language: - iso: eng project: - _id: '1200' name: TRR 318 - Teilprojekt A6 - Inklusive Ko-Konstruktion sozialer Signale des Verstehens publication: 12th International Conference on Affective Computing & Intelligent Interaction publication_status: published publisher: IEEE status: public title: A Paradigm to Investigate Social Signals of Understanding and Their Susceptibility to Stress type: conference user_id: '98941' year: '2024' ... --- _id: '61290' abstract: - lang: eng text: ffective computing often relies on audiovisual data to identify affective states from non-verbal signals, such as facial expressions and vocal cues. Since automatic affect recognition can be used in sensitive applications, such as healthcare and education, it is crucial to understand how models arrive at their decisions. Interpretability of machine learning models is the goal of the emerging research area of Explainable AI (explainable AI (XAI)). This scoping review aims to survey the field of audiovisual affective machine learning to identify how XAI is applied in this domain. We first provide an overview of XAI concepts relevant to affective computing. Next, following the recommended PRISMA guidelines, we perform a literature search in the ACM, IEEE, Web of Science and PubMed databases. After systematically reviewing 1190 articles, a final set of 65 papers is included in our analysis. We quantitatively summarize the scope, methods and evaluation of the XAI techniques used in the identified papers. Our findings show encouraging developments for using XAI to explain models in audiovisual affective computing, yet only a limited set of methods are used in the reviewed works. Following a critical discussion, we provide recommendations for incorporating interpretability in future work for affective machine learnin article_type: review author: - first_name: David full_name: Johnson, David id: '97208' last_name: Johnson - first_name: Olya full_name: Hakobyan, Olya last_name: Hakobyan - first_name: Jonas full_name: Paletschek, Jonas id: '98941' last_name: Paletschek - first_name: Hanna full_name: Drimalla, Hanna last_name: Drimalla citation: ama: 'Johnson D, Hakobyan O, Paletschek J, Drimalla H. Explainable AI for Audio and Visual Affective Computing: A Scoping Review. IEEE Transactions on Affective Computing. 2024;16(2):518-536. doi:10.1109/taffc.2024.3505269' apa: 'Johnson, D., Hakobyan, O., Paletschek, J., & Drimalla, H. (2024). Explainable AI for Audio and Visual Affective Computing: A Scoping Review. IEEE Transactions on Affective Computing, 16(2), 518–536. https://doi.org/10.1109/taffc.2024.3505269' bibtex: '@article{Johnson_Hakobyan_Paletschek_Drimalla_2024, title={Explainable AI for Audio and Visual Affective Computing: A Scoping Review}, volume={16}, DOI={10.1109/taffc.2024.3505269}, number={2}, journal={IEEE Transactions on Affective Computing}, publisher={Institute of Electrical and Electronics Engineers (IEEE)}, author={Johnson, David and Hakobyan, Olya and Paletschek, Jonas and Drimalla, Hanna}, year={2024}, pages={518–536} }' chicago: 'Johnson, David, Olya Hakobyan, Jonas Paletschek, and Hanna Drimalla. “Explainable AI for Audio and Visual Affective Computing: A Scoping Review.” IEEE Transactions on Affective Computing 16, no. 2 (2024): 518–36. https://doi.org/10.1109/taffc.2024.3505269.' ieee: 'D. Johnson, O. Hakobyan, J. Paletschek, and H. Drimalla, “Explainable AI for Audio and Visual Affective Computing: A Scoping Review,” IEEE Transactions on Affective Computing, vol. 16, no. 2, pp. 518–536, 2024, doi: 10.1109/taffc.2024.3505269.' mla: 'Johnson, David, et al. “Explainable AI for Audio and Visual Affective Computing: A Scoping Review.” IEEE Transactions on Affective Computing, vol. 16, no. 2, Institute of Electrical and Electronics Engineers (IEEE), 2024, pp. 518–36, doi:10.1109/taffc.2024.3505269.' short: D. Johnson, O. Hakobyan, J. Paletschek, H. Drimalla, IEEE Transactions on Affective Computing 16 (2024) 518–536. date_created: 2025-09-16T07:24:07Z date_updated: 2025-09-16T08:02:23Z ddc: - '000' department: - _id: '660' doi: 10.1109/taffc.2024.3505269 file: - access_level: closed content_type: application/pdf creator: johnson date_created: 2025-09-16T07:34:27Z date_updated: 2025-09-16T07:34:27Z file_id: '61291' file_name: Explainable_AI_for_Audio_and_Visual_Affective_Computing_A_Scoping_Review.pdf file_size: 3252812 relation: main_file success: 1 file_date_updated: 2025-09-16T07:34:27Z has_accepted_license: '1' intvolume: ' 16' issue: '2' language: - iso: eng page: 518-536 project: - _id: '110' name: TRR 318 - Project Area A - _id: '1204' name: TRR 318 - Teilprojekt IRG BI - _id: '1200' name: TRR 318 - Teilprojekt A6 - Inklusive Ko-Konstruktion sozialer Signale des Verstehens publication: IEEE Transactions on Affective Computing publication_identifier: issn: - 1949-3045 - 2371-9850 publication_status: published publisher: Institute of Electrical and Electronics Engineers (IEEE) status: public title: 'Explainable AI for Audio and Visual Affective Computing: A Scoping Review' type: journal_article user_id: '97208' volume: 16 year: '2024' ... --- _id: '55429' abstract: - lang: eng text: A detailed understanding of the cognitive process underlying diagnostic reasoning in medical experts is currently lacking. While high-level theories like hypothetico-deductive reasoning were proposed long ago, the inner workings of the step-by-step dynamics within the mind remain unknown. We present a fully automated approach to elicit, monitor, and record diagnostic reasoning processes at a fine-grained level. A web-based user interface enables physicians to carry out a full diagnosis process on a simulated patient, given as a pre-defined clinical vignette. By collecting the physician’s information queries and hypothesis revisions, highly detailed diagnostic reasoning trajectories are captured leading to a diagnosis and its justification. Four expert epileptologists with a mean experience of 19 years were recruited to evaluate the system and share their impressions in semi-structured interviews. We find that the recorded trajectories validate proposed theories on broader diagnostic reasoning, while also providing valuable additional details extending previous findings. author: - first_name: Dominik full_name: Battefeld, Dominik id: '91864' last_name: Battefeld orcid: 0000-0002-5480-0594 - first_name: Sigrid full_name: Mues, Sigrid last_name: Mues - first_name: Tim full_name: Wehner, Tim last_name: Wehner - first_name: Patrick full_name: House, Patrick last_name: House - first_name: Christoph full_name: Kellinghaus, Christoph last_name: Kellinghaus - first_name: Jörg full_name: Wellmer, Jörg last_name: Wellmer - first_name: Stefan full_name: Kopp, Stefan last_name: Kopp citation: ama: 'Battefeld D, Mues S, Wehner T, et al. Revealing the Dynamics of Medical Diagnostic Reasoning as Step-by-Step Cognitive Process Trajectories. In: Proceedings of the 46th Annual Conference of the Cognitive Science Society. ; 2024.' apa: Battefeld, D., Mues, S., Wehner, T., House, P., Kellinghaus, C., Wellmer, J., & Kopp, S. (2024). Revealing the Dynamics of Medical Diagnostic Reasoning as Step-by-Step Cognitive Process Trajectories. Proceedings of the 46th Annual Conference of the Cognitive Science Society. The Annual Meeting of the Cognitive Science Society, Rotterdam, NL. bibtex: '@inproceedings{Battefeld_Mues_Wehner_House_Kellinghaus_Wellmer_Kopp_2024, title={Revealing the Dynamics of Medical Diagnostic Reasoning as Step-by-Step Cognitive Process Trajectories}, booktitle={Proceedings of the 46th Annual Conference of the Cognitive Science Society}, author={Battefeld, Dominik and Mues, Sigrid and Wehner, Tim and House, Patrick and Kellinghaus, Christoph and Wellmer, Jörg and Kopp, Stefan}, year={2024} }' chicago: Battefeld, Dominik, Sigrid Mues, Tim Wehner, Patrick House, Christoph Kellinghaus, Jörg Wellmer, and Stefan Kopp. “Revealing the Dynamics of Medical Diagnostic Reasoning as Step-by-Step Cognitive Process Trajectories.” In Proceedings of the 46th Annual Conference of the Cognitive Science Society, 2024. ieee: D. Battefeld et al., “Revealing the Dynamics of Medical Diagnostic Reasoning as Step-by-Step Cognitive Process Trajectories,” presented at the The Annual Meeting of the Cognitive Science Society, Rotterdam, NL, 2024. mla: Battefeld, Dominik, et al. “Revealing the Dynamics of Medical Diagnostic Reasoning as Step-by-Step Cognitive Process Trajectories.” Proceedings of the 46th Annual Conference of the Cognitive Science Society, 2024. short: 'D. Battefeld, S. Mues, T. Wehner, P. House, C. Kellinghaus, J. Wellmer, S. Kopp, in: Proceedings of the 46th Annual Conference of the Cognitive Science Society, 2024.' conference: end_date: 2024-07-27 location: Rotterdam, NL name: The Annual Meeting of the Cognitive Science Society start_date: 2024-07-24 date_created: 2024-07-30T08:17:35Z date_updated: 2025-09-23T15:11:19Z ddc: - '000' department: - _id: '660' file: - access_level: closed content_type: application/pdf creator: doba2 date_created: 2024-07-30T08:21:13Z date_updated: 2024-07-30T08:21:13Z file_id: '55430' file_name: Battefeld_2024_Revealing-the-dynamics.pdf file_size: 486513 relation: main_file success: 1 file_date_updated: 2024-07-30T08:21:13Z has_accepted_license: '1' keyword: - Differential Diagnosis - Diagnostic Reasoning - Reasoning Process Analysis - Seizure - Epilepsy language: - iso: eng project: - _id: '128' name: 'TRR 318 - C5: TRR 318 - Subproject C5' publication: Proceedings of the 46th Annual Conference of the Cognitive Science Society publication_status: published quality_controlled: '1' status: public title: Revealing the Dynamics of Medical Diagnostic Reasoning as Step-by-Step Cognitive Process Trajectories type: conference user_id: '91864' year: '2024' ... --- _id: '54907' article_number: '109190' author: - first_name: Stefan full_name: Heid, Stefan id: '39640' last_name: Heid orcid: 0000-0002-9461-7372 - first_name: Jonas Manuel full_name: Hanselle, Jonas Manuel id: '43980' last_name: Hanselle orcid: 0000-0002-1231-4985 - first_name: Johannes full_name: Fürnkranz, Johannes last_name: Fürnkranz - first_name: Eyke full_name: Hüllermeier, Eyke id: '48129' last_name: Hüllermeier citation: ama: 'Heid S, Hanselle JM, Fürnkranz J, Hüllermeier E. Learning decision catalogues for situated decision making: The case of scoring systems. International Journal of Approximate Reasoning. 2024;171. doi:10.1016/j.ijar.2024.109190' apa: 'Heid, S., Hanselle, J. M., Fürnkranz, J., & Hüllermeier, E. (2024). Learning decision catalogues for situated decision making: The case of scoring systems. International Journal of Approximate Reasoning, 171, Article 109190. https://doi.org/10.1016/j.ijar.2024.109190' bibtex: '@article{Heid_Hanselle_Fürnkranz_Hüllermeier_2024, title={Learning decision catalogues for situated decision making: The case of scoring systems}, volume={171}, DOI={10.1016/j.ijar.2024.109190}, number={109190}, journal={International Journal of Approximate Reasoning}, publisher={Elsevier BV}, author={Heid, Stefan and Hanselle, Jonas Manuel and Fürnkranz, Johannes and Hüllermeier, Eyke}, year={2024} }' chicago: 'Heid, Stefan, Jonas Manuel Hanselle, Johannes Fürnkranz, and Eyke Hüllermeier. “Learning Decision Catalogues for Situated Decision Making: The Case of Scoring Systems.” International Journal of Approximate Reasoning 171 (2024). https://doi.org/10.1016/j.ijar.2024.109190.' ieee: 'S. Heid, J. M. Hanselle, J. Fürnkranz, and E. Hüllermeier, “Learning decision catalogues for situated decision making: The case of scoring systems,” International Journal of Approximate Reasoning, vol. 171, Art. no. 109190, 2024, doi: 10.1016/j.ijar.2024.109190.' mla: 'Heid, Stefan, et al. “Learning Decision Catalogues for Situated Decision Making: The Case of Scoring Systems.” International Journal of Approximate Reasoning, vol. 171, 109190, Elsevier BV, 2024, doi:10.1016/j.ijar.2024.109190.' short: S. Heid, J.M. Hanselle, J. Fürnkranz, E. Hüllermeier, International Journal of Approximate Reasoning 171 (2024). date_created: 2024-06-26T14:19:19Z date_updated: 2024-11-20T09:44:54Z department: - _id: '660' doi: 10.1016/j.ijar.2024.109190 intvolume: ' 171' language: - iso: eng project: - _id: '125' name: 'TRR 318 - C2: TRR 318 - Subproject C2' publication: International Journal of Approximate Reasoning publication_identifier: issn: - 0888-613X publication_status: published publisher: Elsevier BV status: public title: 'Learning decision catalogues for situated decision making: The case of scoring systems' type: journal_article user_id: '72497' volume: 171 year: '2024' ... --- _id: '57204' abstract: - lang: eng text: In this study on the use of gesture deixis during explanations, a sample of 24 videorecorded dyadic interactions of a board game explanation was analyzed. The relation between the use of gesture deixis by different explainers and their interpretation of explainees' understanding was investigated. In addition, we describe explainers' intra-individual variations related to their interactions with three different explainees consecutively. While we did not find a relation between interpretations of explainees' complete understanding and a decrease in explainers' use of gesture deixis, we demonstrated that the overall use of gesture deixis is related to the process of interactional monitoring and the attendance of a different explainee. author: - first_name: Stefan Teodorov full_name: Lazarov, Stefan Teodorov id: '90345' last_name: Lazarov orcid: 0009-0009-0892-9483 - first_name: Angela full_name: Grimminger, Angela id: '57578' last_name: Grimminger citation: ama: 'Lazarov ST, Grimminger A. Variations in explainers’ gesture deixis in explanations related to the monitoring of explainees’ understanding. In: Proceedings of the Annual Meeting of the Cognitive Science Society. Vol 46. ; 2024.' apa: Lazarov, S. T., & Grimminger, A. (2024). Variations in explainers’ gesture deixis in explanations related to the monitoring of explainees’ understanding. Proceedings of the Annual Meeting of the Cognitive Science Society, 46. bibtex: '@inproceedings{Lazarov_Grimminger_2024, title={Variations in explainers’ gesture deixis in explanations related to the monitoring of explainees’ understanding}, volume={46}, booktitle={Proceedings of the Annual Meeting of the Cognitive Science Society}, author={Lazarov, Stefan Teodorov and Grimminger, Angela}, year={2024} }' chicago: Lazarov, Stefan Teodorov, and Angela Grimminger. “Variations in Explainers’ Gesture Deixis in Explanations Related to the Monitoring of Explainees’ Understanding.” In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol. 46, 2024. ieee: S. T. Lazarov and A. Grimminger, “Variations in explainers’ gesture deixis in explanations related to the monitoring of explainees’ understanding,” in Proceedings of the Annual Meeting of the Cognitive Science Society, Rotterdam, 2024, vol. 46. mla: Lazarov, Stefan Teodorov, and Angela Grimminger. “Variations in Explainers’ Gesture Deixis in Explanations Related to the Monitoring of Explainees’ Understanding.” Proceedings of the Annual Meeting of the Cognitive Science Society, vol. 46, 2024. short: 'S.T. Lazarov, A. Grimminger, in: Proceedings of the Annual Meeting of the Cognitive Science Society, 2024.' conference: end_date: 2024-07-27 location: Rotterdam name: Sognitive Science Society start_date: 2024-07-24 date_created: 2024-11-18T13:40:09Z date_updated: 2024-11-18T13:40:39Z department: - _id: '660' intvolume: ' 46' keyword: - explanation - gesture deixis - monitoring - understanding language: - iso: eng main_file_link: - open_access: '1' url: https://escholarship.org/uc/item/7dz8n8tf oa: '1' project: - _id: '112' grant_number: '438445824' name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und auswerten (Teilprojekt A02)' publication: Proceedings of the Annual Meeting of the Cognitive Science Society publication_status: published status: public title: Variations in explainers’ gesture deixis in explanations related to the monitoring of explainees’ understanding type: conference user_id: '90345' volume: 46 year: '2024' ... --- _id: '53072' abstract: - lang: eng text: "Negated statements require more processing efforts than assertions. However, in certain contexts, repeating negations undergo adaptation, which over time mitigates the effort.\r\nHere, we ask negations hamper visual processing and whether consecutive repetitions mitigate its influence. \r\nWe assessed the overall attentional capacity and its distribution, the relative weight, quantitatively using \r\nthe formal Theory of Visual Attention (TVA).\r\nWe employed a very simple form for negations, binary negations. Negated instructions, expressing the only alternative to the core supposition, were cognitively demanding, resulting in a loss of attentional capacity in three experiments. The overall attentional capacity recovered gradually but stagnated at a lower level than with assertions, even after many repetitions. Additionally, negations distributed the attention equally between target and reference stimulus. Repetitions slightly increased the reference' share of attention. Assertions, on the other hand, shifted the attentional weight towards the target. Few repetitions slightly decreased the bias towards the target, many repetitions increased the bias." article_type: original author: - first_name: Ngoc Chi full_name: Banh, Ngoc Chi id: '38219' last_name: Banh orcid: 0000-0002-5946-4542 - first_name: Jan full_name: Tünnermann, Jan last_name: Tünnermann - first_name: Katharina J. full_name: Rohlfing, Katharina J. id: '50352' last_name: Rohlfing - first_name: Ingrid full_name: Scharlau, Ingrid id: '451' last_name: Scharlau orcid: 0000-0003-2364-9489 citation: ama: Banh NC, Tünnermann J, Rohlfing KJ, Scharlau I. Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution. Frontiers in Psychology. 2024;15. doi:10.3389/fpsyg.2024.1451309 apa: Banh, N. C., Tünnermann, J., Rohlfing, K. J., & Scharlau, I. (2024). Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution. Frontiers in Psychology, 15. https://doi.org/10.3389/fpsyg.2024.1451309 bibtex: '@article{Banh_Tünnermann_Rohlfing_Scharlau_2024, title={Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution}, volume={15}, DOI={10.3389/fpsyg.2024.1451309}, journal={Frontiers in Psychology}, author={Banh, Ngoc Chi and Tünnermann, Jan and Rohlfing, Katharina J. and Scharlau, Ingrid}, year={2024} }' chicago: Banh, Ngoc Chi, Jan Tünnermann, Katharina J. Rohlfing, and Ingrid Scharlau. “Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution.” Frontiers in Psychology 15 (2024). https://doi.org/10.3389/fpsyg.2024.1451309. ieee: 'N. C. Banh, J. Tünnermann, K. J. Rohlfing, and I. Scharlau, “Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution,” Frontiers in Psychology, vol. 15, 2024, doi: 10.3389/fpsyg.2024.1451309.' mla: Banh, Ngoc Chi, et al. “Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution.” Frontiers in Psychology, vol. 15, 2024, doi:10.3389/fpsyg.2024.1451309. short: N.C. Banh, J. Tünnermann, K.J. Rohlfing, I. Scharlau, Frontiers in Psychology 15 (2024). date_created: 2024-03-27T12:16:33Z date_updated: 2024-12-02T09:41:36Z department: - _id: '424' - _id: '660' doi: 10.3389/fpsyg.2024.1451309 intvolume: ' 15' language: - iso: eng main_file_link: - open_access: '1' url: https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2024.1451309/abstract oa: '1' project: - _id: '115' grant_number: '438445824' name: 'TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog (Teilprojekt A05)' - _id: '52' name: 'PC2: Computing Resources Provided by the Paderborn Center for Parallel Computing' publication: Frontiers in Psychology publication_status: published status: public title: Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution type: journal_article user_id: '38219' volume: 15 year: '2024' ... --- _id: '55404' abstract: - lang: eng text: Explanations are pervasive in our lives. Mostly, they occur in dialogical form where an explainer discusses a concept or phenomenon of interest with an explainee. Leaving the explainee with a clear understanding is not straightforward due to the knowledge gap between the two participants. Previous research looked at the interaction of explanation moves, dialogue acts, and topics in successful dialogues with expert explainers. However, daily-life explanations often fail, raising the question of what makes a dialogue successful. In this work, we study explanation dialogues in terms of the interactions between the explainer and explainee and how they correlate with the quality of explanations in terms of a successful understanding on the explainee{’}s side. In particular, we first construct a corpus of 399 dialogues from the Reddit forum {Explain Like I am Five} and annotate it for interaction flows and explanation quality. We then analyze the interaction flows, comparing them to those appearing in expert dialogues. Finally, we encode the interaction flows using two language models that can handle long inputs, and we provide empirical evidence for the effectiveness boost gained through the encoding in predicting the success of explanation dialogues. author: - first_name: Milad full_name: Alshomary, Milad id: '73059' last_name: Alshomary - first_name: Felix full_name: Lange, Felix id: '67893' last_name: Lange - first_name: Meisam full_name: Booshehri, Meisam last_name: Booshehri - first_name: Meghdut full_name: Sengupta, Meghdut id: '99459' last_name: Sengupta - first_name: Philipp full_name: Cimiano, Philipp last_name: Cimiano - first_name: Henning full_name: Wachsmuth, Henning id: '3900' last_name: Wachsmuth citation: ama: 'Alshomary M, Lange F, Booshehri M, Sengupta M, Cimiano P, Wachsmuth H. Modeling the Quality of Dialogical Explanations. In: Calzolari N, Kan M-Y, Hoste V, Lenci A, Sakti S, Xue N, eds. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024). ELRA and ICCL; 2024:11523–11536.' apa: Alshomary, M., Lange, F., Booshehri, M., Sengupta, M., Cimiano, P., & Wachsmuth, H. (2024). Modeling the Quality of Dialogical Explanations. In N. Calzolari, M.-Y. Kan, V. Hoste, A. Lenci, S. Sakti, & N. Xue (Eds.), Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) (pp. 11523–11536). ELRA and ICCL. bibtex: '@inproceedings{Alshomary_Lange_Booshehri_Sengupta_Cimiano_Wachsmuth_2024, place={Torino, Italia}, title={Modeling the Quality of Dialogical Explanations}, booktitle={Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)}, publisher={ELRA and ICCL}, author={Alshomary, Milad and Lange, Felix and Booshehri, Meisam and Sengupta, Meghdut and Cimiano, Philipp and Wachsmuth, Henning}, editor={Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro and Sakti, Sakriani and Xue, Nianwen}, year={2024}, pages={11523–11536} }' chicago: 'Alshomary, Milad, Felix Lange, Meisam Booshehri, Meghdut Sengupta, Philipp Cimiano, and Henning Wachsmuth. “Modeling the Quality of Dialogical Explanations.” In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), edited by Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, and Nianwen Xue, 11523–11536. Torino, Italia: ELRA and ICCL, 2024.' ieee: M. Alshomary, F. Lange, M. Booshehri, M. Sengupta, P. Cimiano, and H. Wachsmuth, “Modeling the Quality of Dialogical Explanations,” in Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), 2024, pp. 11523–11536. mla: Alshomary, Milad, et al. “Modeling the Quality of Dialogical Explanations.” Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), edited by Nicoletta Calzolari et al., ELRA and ICCL, 2024, pp. 11523–11536. short: 'M. Alshomary, F. Lange, M. Booshehri, M. Sengupta, P. Cimiano, H. Wachsmuth, in: N. Calzolari, M.-Y. Kan, V. Hoste, A. Lenci, S. Sakti, N. Xue (Eds.), Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), ELRA and ICCL, Torino, Italia, 2024, pp. 11523–11536.' date_created: 2024-07-26T13:04:25Z date_updated: 2024-12-17T11:30:25Z department: - _id: '600' - _id: '660' editor: - first_name: Nicoletta full_name: Calzolari, Nicoletta last_name: Calzolari - first_name: Min-Yen full_name: Kan, Min-Yen last_name: Kan - first_name: Veronique full_name: Hoste, Veronique last_name: Hoste - first_name: Alessandro full_name: Lenci, Alessandro last_name: Lenci - first_name: Sakriani full_name: Sakti, Sakriani last_name: Sakti - first_name: Nianwen full_name: Xue, Nianwen last_name: Xue language: - iso: eng page: 11523–11536 place: Torino, Italia project: - _id: '118' name: 'TRR 318 - INF: TRR 318 - Project Area INF' publication: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) publisher: ELRA and ICCL quality_controlled: '1' status: public title: Modeling the Quality of Dialogical Explanations type: conference user_id: '67893' year: '2024' ... --- _id: '58109' abstract: - lang: eng text: The present study aims to understand how metaphors are used in explanations. According to many current theories, metaphors have a conceptual function for the understanding of abstract objects. From this theoretical assumption, we derived the hypothesis that the lower the expertise of the addressee of an explanation, the more metaphors should be used. We tested this hypothesis on a relatively natural data set of 24 published videos with close to 100,000 words overall in which experts explain abstract, mostly scientific concepts to persons of different expertise, varying from minimal (children) to profound (expert). Contrary to our expectations, the frequency of metaphors did not decrease with expertise, but actually increased. This increase could be statistically substantiated with higher differences in expertise. The study contributes to a better understanding of the use of metaphors in actual explanatory processes and how metaphor use depends on contextual factors. It thus supports the expansion of the conceptual and linguistic perspective on metaphors to include the aspect of how metaphors are used by speakers. article_type: original author: - first_name: Ingrid full_name: Scharlau, Ingrid id: '451' last_name: Scharlau orcid: 0000-0003-2364-9489 - first_name: Miriam full_name: Körber, Miriam last_name: Körber - first_name: Meghdut full_name: Sengupta, Meghdut last_name: Sengupta - first_name: Henning full_name: Wachsmuth, Henning last_name: Wachsmuth citation: ama: 'Scharlau I, Körber M, Sengupta M, Wachsmuth H. When to use a metaphor: Metaphors in dialogical explanations with addressees of different expertise. Frontiers in Language Sciences. 2024;3:1474924.' apa: 'Scharlau, I., Körber, M., Sengupta, M., & Wachsmuth, H. (2024). When to use a metaphor: Metaphors in dialogical explanations with addressees of different expertise. Frontiers in Language Sciences, 3, 1474924.' bibtex: '@article{Scharlau_Körber_Sengupta_Wachsmuth_2024, title={When to use a metaphor: Metaphors in dialogical explanations with addressees of different expertise}, volume={3}, journal={Frontiers in Language Sciences}, author={Scharlau, Ingrid and Körber, Miriam and Sengupta, Meghdut and Wachsmuth, Henning}, year={2024}, pages={1474924} }' chicago: 'Scharlau, Ingrid, Miriam Körber, Meghdut Sengupta, and Henning Wachsmuth. “When to Use a Metaphor: Metaphors in Dialogical Explanations with Addressees of Different Expertise.” Frontiers in Language Sciences 3 (2024): 1474924.' ieee: 'I. Scharlau, M. Körber, M. Sengupta, and H. Wachsmuth, “When to use a metaphor: Metaphors in dialogical explanations with addressees of different expertise,” Frontiers in Language Sciences, vol. 3, p. 1474924, 2024.' mla: 'Scharlau, Ingrid, et al. “When to Use a Metaphor: Metaphors in Dialogical Explanations with Addressees of Different Expertise.” Frontiers in Language Sciences, vol. 3, 2024, p. 1474924.' short: I. Scharlau, M. Körber, M. Sengupta, H. Wachsmuth, Frontiers in Language Sciences 3 (2024) 1474924. date_created: 2025-01-08T11:59:24Z date_updated: 2025-01-08T11:59:34Z department: - _id: '660' funded_apc: '1' intvolume: ' 3' keyword: - metaphor - conceptual metaphor - conceptual metaphor theory - metaphor usage - explaining - explanation language: - iso: eng main_file_link: - open_access: '1' url: https://www.frontiersin.org/journals/language-sciences/articles/10.3389/flang.2024.1474924/full oa: '1' page: '1474924' project: - _id: '127' name: 'TRR 318 - C4: TRR 318 - Subproject C4 - Metaphern als Werkzeug des Erklärens' publication: Frontiers in Language Sciences quality_controlled: '1' status: public title: 'When to use a metaphor: Metaphors in dialogical explanations with addressees of different expertise' type: journal_article user_id: '451' volume: 3 year: '2024' ... --- _id: '55403' abstract: - lang: eng text: In this paper we consider the interactive processes by which an explainer and an explainee cooperate to produce an explanation, which we refer to as co-construction. Explainable Artificial Intelligence (XAI) is concerned with the development of intelligent systems and robots that can explain and justify their actions, decisions, recommendations, and so on. However, the cooperative construction of explanations remains a key but under-explored issue. This short paper proposes an architecture for intelligent systems that promotes a co-constructive and interactive approach to explanation generation. By outlining its basic components and their specific roles, we aim to contribute to the advancement of XAI computational frameworks that actively engage users in the explanation process. author: - first_name: Hendrik full_name: Buschmeier, Hendrik id: '76456' last_name: Buschmeier orcid: 0000-0002-9613-5713 - first_name: Philipp full_name: Cimiano, Philipp last_name: Cimiano - first_name: Stefan full_name: Kopp, Stefan last_name: Kopp - first_name: Jaroslaw full_name: Kornowicz, Jaroslaw id: '44029' last_name: Kornowicz orcid: 0000-0002-5654-9911 - first_name: Olesja full_name: Lammert, Olesja id: '47384' last_name: Lammert orcid: 0000-0001-8201-5166 - first_name: Marco full_name: Matarese, Marco last_name: Matarese - first_name: Dimitry full_name: Mindlin, Dimitry last_name: Mindlin - first_name: Amelie Sophie full_name: Robrecht, Amelie Sophie last_name: Robrecht - first_name: Anna-Lisa full_name: Vollmer, Anna-Lisa id: '86589' last_name: Vollmer - first_name: Petra full_name: Wagner, Petra id: '74505' last_name: Wagner - first_name: Britta full_name: Wrede, Britta last_name: Wrede - first_name: Meisam full_name: Booshehri, Meisam id: '93424' last_name: Booshehri citation: ama: 'Buschmeier H, Cimiano P, Kopp S, et al. Towards a Computational Architecture for Co-Constructive Explainable Systems. In: Proceedings of the 2024 Workshop on Explainability Engineering. ACM; 2024:20-25. doi:10.1145/3648505.3648509' apa: Buschmeier, H., Cimiano, P., Kopp, S., Kornowicz, J., Lammert, O., Matarese, M., Mindlin, D., Robrecht, A. S., Vollmer, A.-L., Wagner, P., Wrede, B., & Booshehri, M. (2024). Towards a Computational Architecture for Co-Constructive Explainable Systems. Proceedings of the 2024 Workshop on Explainability Engineering, 20–25. https://doi.org/10.1145/3648505.3648509 bibtex: '@inproceedings{Buschmeier_Cimiano_Kopp_Kornowicz_Lammert_Matarese_Mindlin_Robrecht_Vollmer_Wagner_et al._2024, title={Towards a Computational Architecture for Co-Constructive Explainable Systems}, DOI={10.1145/3648505.3648509}, booktitle={Proceedings of the 2024 Workshop on Explainability Engineering}, publisher={ACM}, author={Buschmeier, Hendrik and Cimiano, Philipp and Kopp, Stefan and Kornowicz, Jaroslaw and Lammert, Olesja and Matarese, Marco and Mindlin, Dimitry and Robrecht, Amelie Sophie and Vollmer, Anna-Lisa and Wagner, Petra and et al.}, year={2024}, pages={20–25} }' chicago: Buschmeier, Hendrik, Philipp Cimiano, Stefan Kopp, Jaroslaw Kornowicz, Olesja Lammert, Marco Matarese, Dimitry Mindlin, et al. “Towards a Computational Architecture for Co-Constructive Explainable Systems.” In Proceedings of the 2024 Workshop on Explainability Engineering, 20–25. ACM, 2024. https://doi.org/10.1145/3648505.3648509. ieee: 'H. Buschmeier et al., “Towards a Computational Architecture for Co-Constructive Explainable Systems,” in Proceedings of the 2024 Workshop on Explainability Engineering, Lisbon, Portugal, 2024, pp. 20–25, doi: 10.1145/3648505.3648509.' mla: Buschmeier, Hendrik, et al. “Towards a Computational Architecture for Co-Constructive Explainable Systems.” Proceedings of the 2024 Workshop on Explainability Engineering, ACM, 2024, pp. 20–25, doi:10.1145/3648505.3648509. short: 'H. Buschmeier, P. Cimiano, S. Kopp, J. Kornowicz, O. Lammert, M. Matarese, D. Mindlin, A.S. Robrecht, A.-L. Vollmer, P. Wagner, B. Wrede, M. Booshehri, in: Proceedings of the 2024 Workshop on Explainability Engineering, ACM, 2024, pp. 20–25.' conference: location: Lisbon, Portugal name: 2024 Workshop on Explainability Engineering date_created: 2024-07-26T11:57:31Z date_updated: 2025-03-14T19:24:35Z department: - _id: '184' - _id: '178' - _id: '660' doi: 10.1145/3648505.3648509 language: - iso: eng main_file_link: - open_access: '1' oa: '1' page: 20-25 project: - _id: '125' name: 'TRR 318 - C2: TRR 318 - Subproject C2' - _id: '113' name: 'TRR 318 - A3: TRR 318 - Subproject A3' - _id: '112' grant_number: '438445824' name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und auswerten (Teilprojekt A02)' - _id: '118' name: 'TRR 318 - INF: TRR 318 - Project Area INF' publication: Proceedings of the 2024 Workshop on Explainability Engineering publication_status: published publisher: ACM quality_controlled: '1' status: public title: Towards a Computational Architecture for Co-Constructive Explainable Systems type: conference user_id: '44029' year: '2024' ... --- _id: '55912' abstract: - lang: eng text: In explanatory interactions, explainees are expected to continuously provide feedback to explainers by signaling whether they understand an ongoing explanation. The study presented in this paper is based on the hypothesis that explainees use a set of multimodal cues, including vocalizations, facial expressions, and movements of the torso, head, and hands, to do so. We test this hypothesis by building a random forest classifier based on a multimodal corpus of dyadic explanations (21 explainers and explainees), in which windows of understanding or non-understanding were identified by participants in a retrospective video recall task. Results show that sequences of understanding can indeed be differentiated from those of non-understanding, and that a diverse set of predictors covering a wide range of modalities contributes to this classification. Due to data sparsity and a high degree of individual variation, the generalizability of our results is currently limited, but they support our hypothesis of the relevance of multimodal display in explanatory interactions. author: - first_name: Olcay full_name: Türk, Olcay last_name: Türk - first_name: Stefan Teodorov full_name: Lazarov, Stefan Teodorov id: '90345' last_name: Lazarov orcid: 0009-0009-0892-9483 - first_name: Yu full_name: Wang, Yu last_name: Wang - first_name: Hendrik full_name: Buschmeier, Hendrik id: '76456' last_name: Buschmeier orcid: 0000-0002-9613-5713 - first_name: Angela full_name: Grimminger, Angela id: '57578' last_name: Grimminger - first_name: Petra full_name: Wagner, Petra id: '74505' last_name: Wagner citation: ama: 'Türk O, Lazarov ST, Wang Y, Buschmeier H, Grimminger A, Wagner P. Predictability of understanding in explanatory interactions based on multimodal cues. In: Proceedings of the 26th ACM International Conference on Multimodal Interaction. ; 2024:449-458. doi:10.1145/3678957.3685741' apa: Türk, O., Lazarov, S. T., Wang, Y., Buschmeier, H., Grimminger, A., & Wagner, P. (2024). Predictability of understanding in explanatory interactions based on multimodal cues. Proceedings of the 26th ACM International Conference on Multimodal Interaction, 449–458. https://doi.org/10.1145/3678957.3685741 bibtex: '@inproceedings{Türk_Lazarov_Wang_Buschmeier_Grimminger_Wagner_2024, place={San José, Costa Rica}, title={Predictability of understanding in explanatory interactions based on multimodal cues}, DOI={10.1145/3678957.3685741}, booktitle={Proceedings of the 26th ACM International Conference on Multimodal Interaction}, author={Türk, Olcay and Lazarov, Stefan Teodorov and Wang, Yu and Buschmeier, Hendrik and Grimminger, Angela and Wagner, Petra}, year={2024}, pages={449–458} }' chicago: Türk, Olcay, Stefan Teodorov Lazarov, Yu Wang, Hendrik Buschmeier, Angela Grimminger, and Petra Wagner. “Predictability of Understanding in Explanatory Interactions Based on Multimodal Cues.” In Proceedings of the 26th ACM International Conference on Multimodal Interaction, 449–58. San José, Costa Rica, 2024. https://doi.org/10.1145/3678957.3685741. ieee: 'O. Türk, S. T. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, and P. Wagner, “Predictability of understanding in explanatory interactions based on multimodal cues,” in Proceedings of the 26th ACM International Conference on Multimodal Interaction, San José, Costa Rica, 2024, pp. 449–458, doi: 10.1145/3678957.3685741.' mla: Türk, Olcay, et al. “Predictability of Understanding in Explanatory Interactions Based on Multimodal Cues.” Proceedings of the 26th ACM International Conference on Multimodal Interaction, 2024, pp. 449–58, doi:10.1145/3678957.3685741. short: 'O. Türk, S.T. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, P. Wagner, in: Proceedings of the 26th ACM International Conference on Multimodal Interaction, San José, Costa Rica, 2024, pp. 449–458.' conference: end_date: 2024-11-08 location: San José, Costa Rica name: The 26th ACM International Conference on Multimodal Interaction start_date: 2024-11-04 date_created: 2024-08-30T07:42:55Z date_updated: 2025-09-02T14:46:03Z department: - _id: '660' doi: 10.1145/3678957.3685741 language: - iso: eng page: 449-458 place: San José, Costa Rica project: - _id: '112' name: 'TRR 318 - A02: TRR 318 - Verstehensprozess einer Erklärung beobachten und auswerten (Teilprojekt A02)' publication: Proceedings of the 26th ACM International Conference on Multimodal Interaction publication_status: published quality_controlled: '1' status: public title: Predictability of understanding in explanatory interactions based on multimodal cues type: conference user_id: '57578' year: '2024' ... --- _id: '61179' abstract: - lang: eng text: 'We examine how users perceive the limitations of an AI system when it encounters a task that it cannot perform perfectly and whether providing explanations alongside its answers aids users in constructing an appropriate mental model of the system''s capabilities and limitations. We employ a visual question answer and explanation task where we control the AI system''s limitations by manipulating the visual inputs: during inference, the system either processes full-color or grayscale images. Our goal is to determine whether participants can perceive the limitations of the system. We hypothesize that explanations will make limited AI capabilities more transparent to users. However, our results show that explanations do not have this effect. Instead of allowing users to more accurately assess the limitations of the AI system, explanations generally increase users'' perceptions of the system''s competence – regardless of its actual performance.' author: - first_name: Judith full_name: Sieker, Judith last_name: Sieker - first_name: Simeon full_name: Junker, Simeon last_name: Junker - first_name: Ronja full_name: Utescher, Ronja last_name: Utescher - first_name: Nazia full_name: Attari, Nazia last_name: Attari - first_name: Heiko full_name: Wersing, Heiko last_name: Wersing - first_name: Hendrik full_name: Buschmeier, Hendrik id: '76456' last_name: Buschmeier orcid: 0000-0002-9613-5713 - first_name: Sina full_name: Zarrieß, Sina last_name: Zarrieß citation: ama: 'Sieker J, Junker S, Utescher R, et al. The illusion of competence: Evaluating the effect of explanations on users’ mental models of visual question answering systems. In: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. ACL; 2024:19459–19475. doi:10.18653/v1/2024.emnlp-main.1084' apa: 'Sieker, J., Junker, S., Utescher, R., Attari, N., Wersing, H., Buschmeier, H., & Zarrieß, S. (2024). The illusion of competence: Evaluating the effect of explanations on users’ mental models of visual question answering systems. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 19459–19475. https://doi.org/10.18653/v1/2024.emnlp-main.1084' bibtex: '@inproceedings{Sieker_Junker_Utescher_Attari_Wersing_Buschmeier_Zarrieß_2024, place={Miami, FL, USA}, title={The illusion of competence: Evaluating the effect of explanations on users’ mental models of visual question answering systems}, DOI={10.18653/v1/2024.emnlp-main.1084}, booktitle={Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing}, publisher={ACL}, author={Sieker, Judith and Junker, Simeon and Utescher, Ronja and Attari, Nazia and Wersing, Heiko and Buschmeier, Hendrik and Zarrieß, Sina}, year={2024}, pages={19459–19475} }' chicago: 'Sieker, Judith, Simeon Junker, Ronja Utescher, Nazia Attari, Heiko Wersing, Hendrik Buschmeier, and Sina Zarrieß. “The Illusion of Competence: Evaluating the Effect of Explanations on Users’ Mental Models of Visual Question Answering Systems.” In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 19459–19475. Miami, FL, USA: ACL, 2024. https://doi.org/10.18653/v1/2024.emnlp-main.1084.' ieee: 'J. Sieker et al., “The illusion of competence: Evaluating the effect of explanations on users’ mental models of visual question answering systems,” in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Miami, FL, USA, 2024, pp. 19459–19475, doi: 10.18653/v1/2024.emnlp-main.1084.' mla: 'Sieker, Judith, et al. “The Illusion of Competence: Evaluating the Effect of Explanations on Users’ Mental Models of Visual Question Answering Systems.” Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, ACL, 2024, pp. 19459–19475, doi:10.18653/v1/2024.emnlp-main.1084.' short: 'J. Sieker, S. Junker, R. Utescher, N. Attari, H. Wersing, H. Buschmeier, S. Zarrieß, in: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, ACL, Miami, FL, USA, 2024, pp. 19459–19475.' conference: end_date: 2024-11-16 location: Miami, FL, USA name: 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP) start_date: 2024-11-12 date_created: 2025-09-11T07:22:05Z date_updated: 2025-09-11T10:14:50Z department: - _id: '660' doi: 10.18653/v1/2024.emnlp-main.1084 extern: '1' language: - iso: eng main_file_link: - open_access: '1' url: https://doi.org/10.18653/v1/2024.emnlp-main.1084 oa: '1' page: 19459–19475 place: Miami, FL, USA project: - _id: '112' name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten' publication: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing publication_status: published publisher: ACL quality_controlled: '1' status: public title: 'The illusion of competence: Evaluating the effect of explanations on users’ mental models of visual question answering systems' type: conference user_id: '76456' year: '2024' ... --- _id: '48355' abstract: - lang: eng text: "Unsupervised speech disentanglement aims at separating fast varying from\r\nslowly varying components of a speech signal. In this contribution, we take a\r\ncloser look at the embedding vector representing the slowly varying signal\r\ncomponents, commonly named the speaker embedding vector. We ask, which\r\nproperties of a speaker's voice are captured and investigate to which extent do\r\nindividual embedding vector components sign responsible for them, using the\r\nconcept of Shapley values. Our findings show that certain speaker-specific\r\nacoustic-phonetic properties can be fairly well predicted from the speaker\r\nembedding, while the investigated more abstract voice quality features cannot." author: - first_name: Frederik full_name: Rautenberg, Frederik id: '72602' last_name: Rautenberg - first_name: Michael full_name: Kuhlmann, Michael id: '49871' last_name: Kuhlmann - first_name: Jana full_name: Wiechmann, Jana last_name: Wiechmann - first_name: Fritz full_name: Seebauer, Fritz last_name: Seebauer - first_name: Petra full_name: Wagner, Petra last_name: Wagner - first_name: Reinhold full_name: Haeb-Umbach, Reinhold id: '242' last_name: Haeb-Umbach citation: ama: 'Rautenberg F, Kuhlmann M, Wiechmann J, Seebauer F, Wagner P, Haeb-Umbach R. On Feature Importance and Interpretability of Speaker Representations. In: ITG Conference on Speech Communication. ; 2023.' apa: Rautenberg, F., Kuhlmann, M., Wiechmann, J., Seebauer, F., Wagner, P., & Haeb-Umbach, R. (2023). On Feature Importance and Interpretability of Speaker Representations. ITG Conference on Speech Communication. ITG Conference on Speech Communication, Aachen. bibtex: '@inproceedings{Rautenberg_Kuhlmann_Wiechmann_Seebauer_Wagner_Haeb-Umbach_2023, title={On Feature Importance and Interpretability of Speaker Representations}, booktitle={ITG Conference on Speech Communication}, author={Rautenberg, Frederik and Kuhlmann, Michael and Wiechmann, Jana and Seebauer, Fritz and Wagner, Petra and Haeb-Umbach, Reinhold}, year={2023} }' chicago: Rautenberg, Frederik, Michael Kuhlmann, Jana Wiechmann, Fritz Seebauer, Petra Wagner, and Reinhold Haeb-Umbach. “On Feature Importance and Interpretability of Speaker Representations.” In ITG Conference on Speech Communication, 2023. ieee: F. Rautenberg, M. Kuhlmann, J. Wiechmann, F. Seebauer, P. Wagner, and R. Haeb-Umbach, “On Feature Importance and Interpretability of Speaker Representations,” presented at the ITG Conference on Speech Communication, Aachen, 2023. mla: Rautenberg, Frederik, et al. “On Feature Importance and Interpretability of Speaker Representations.” ITG Conference on Speech Communication, 2023. short: 'F. Rautenberg, M. Kuhlmann, J. Wiechmann, F. Seebauer, P. Wagner, R. Haeb-Umbach, in: ITG Conference on Speech Communication, 2023.' conference: end_date: 2023-09-22 location: Aachen name: ITG Conference on Speech Communication start_date: 2023-09-20 date_created: 2023-10-20T08:04:46Z date_updated: 2023-11-22T13:44:33Z ddc: - '000' department: - _id: '54' - _id: '660' external_id: arxiv: - '2310.12599' file: - access_level: closed content_type: application/pdf creator: frra date_created: 2023-10-20T08:20:58Z date_updated: 2023-10-20T08:20:58Z file_id: '48359' file_name: arxiv.pdf file_size: 272390 relation: main_file success: 1 file_date_updated: 2023-10-20T08:20:58Z has_accepted_license: '1' language: - iso: eng main_file_link: - open_access: '1' url: https://arxiv.org/abs/2310.12599 oa: '1' project: - _id: '129' grant_number: '438445824' name: 'TRR 318 - C06: TRR 318 - Technisch unterstütztes Erklären von Stimmcharakteristika (Teilprojekt C06)' publication: ITG Conference on Speech Communication status: public title: On Feature Importance and Interpretability of Speaker Representations type: conference user_id: '72602' year: '2023' ...