--- _id: '60935' abstract: - lang: eng text: Research suggests that presenting an action via multimodal stimulation (verbal and visual) enhances its perception. To highlight this, in most studies, assertive instructions are generally presented before the occurrence of the visual subevent(s). However, verbal instructions need not always be assertive; they can also include negation to contrast the present event with a prior one, thereby facilitating processing—a phenomenon known as contextual facilitation. In our study, we investigated whether using negation to guide an action sequence facilitates action perception, particularly when two consecutive subactions contrast with each other. Stimuli from previous studies on action demonstration were used to create (non)contrastive actions, that is, a ball following noncontrastive and identical (Over–Over or Under–Under) versus contrastive and opposite paths (Over–Under or Under–Over) before terminating at a goal location. In Experiment 1, either an assertive or a negative instruction was provided as verbal guidance before onset of each path. Analyzing data from 35 participants, we found that, whereas assertive instructions facilitate overall action recall, negating the later path for contrastive actions is equally facilitative. Given that action goal is the most salient aspect in event memory due to goal-path bias in attention, a second experiment was conducted to test the effect of multimodal synchrony on goal attention and action memory. Experiment 2 revealed that when instructions overlap with actions, they become more tailored—assertive instructions effectively guide noncontrastive actions, while assertive–negative instruction particularly guides contrastive actions. Both studies suggest that increased attention to the goal leads to coarser perception of midevents, with action-instruction synchrony modulating goal bias in real-time event apprehension to serve distinct purposes for action conceptualization. Whereas presenting instructions before subactions attenuates goal attention, overlapping instructions increase goal attention and reveal the selective roles of assertive and negative instructions in guiding contrastive and noncontrastive actions. article_number: e70096 article_type: original author: - first_name: Amit full_name: Singh, Amit id: '91018' last_name: Singh orcid: 0000-0002-7789-1521 - first_name: Katharina J. full_name: Rohlfing, Katharina J. id: '50352' last_name: Rohlfing orcid: 0000-0002-5676-8233 citation: ama: 'Singh A, Rohlfing KJ. Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory? Cognitive Science. 2025;49(8). doi:10.1111/cogs.70096' apa: 'Singh, A., & Rohlfing, K. J. (2025). Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory? Cognitive Science, 49(8), Article e70096. https://doi.org/10.1111/cogs.70096' bibtex: '@article{Singh_Rohlfing_2025, title={Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?}, volume={49}, DOI={10.1111/cogs.70096}, number={8e70096}, journal={Cognitive Science}, publisher={Wiley}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2025} }' chicago: 'Singh, Amit, and Katharina J. Rohlfing. “Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?” Cognitive Science 49, no. 8 (2025). https://doi.org/10.1111/cogs.70096.' ieee: 'A. Singh and K. J. Rohlfing, “Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?,” Cognitive Science, vol. 49, no. 8, Art. no. e70096, 2025, doi: 10.1111/cogs.70096.' mla: 'Singh, Amit, and Katharina J. Rohlfing. “Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?” Cognitive Science, vol. 49, no. 8, e70096, Wiley, 2025, doi:10.1111/cogs.70096.' short: A. Singh, K.J. Rohlfing, Cognitive Science 49 (2025). date_created: 2025-08-18T08:30:30Z date_updated: 2025-08-18T08:31:04Z department: - _id: '749' - _id: '660' doi: 10.1111/cogs.70096 external_id: pmid: - '40810767' intvolume: ' 49' issue: '8' language: - iso: eng main_file_link: - open_access: '1' url: https://pubmed.ncbi.nlm.nih.gov/40810767/ oa: '1' pmid: '1' project: - _id: '115' name: 'TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog' publication: Cognitive Science publication_status: published publisher: Wiley quality_controlled: '1' status: public title: 'Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?' type: journal_article user_id: '91018' volume: 49 year: '2025' ... --- _id: '61432' abstract: - lang: eng text: 'This study investigated how action histories – unfolding sequences of actions with objects – provide a context for both attentional allocation and linguistic repair strategies. Building on theories of enactive cognition and sensorimotor contingency theory, we experimentally manipulated action sequences (action history) to create either simple or rich “situational models,” and investigated how these models interact with attention and reflect in linguistic processes during human–robot interaction. Participants (N = 30) engaged in a controlled object placement task with a humanoid robot, where the action (manner) information was either provided or omitted. The omission elicited repair behaviors in participants that were in focus of our investigation. For rich models (competing action possibilities) participants demonstrated: a) increased attentional reorientation, reflecting active engagement with the situational model b) preference for restricted repairs, targeting the specific source of trouble in action selection. Conversely, a simple situational model led to more generalized attention patterns and open repair strategies, suggesting weaker constraints on internal processing. These findings highlight how situational structures emerge externally to scaffold internal cognitive processes, with action histories serving as a crucial context for the interface between perception, action, and language. We discuss how to implement such a tight loop in the assistance of a system.' author: - first_name: Amit full_name: Singh, Amit id: '91018' last_name: Singh orcid: 0000-0002-7789-1521 - first_name: Katharina J. full_name: Rohlfing, Katharina J. id: '50352' last_name: Rohlfing orcid: 0000-0002-5676-8233 citation: ama: 'Singh A, Rohlfing KJ. Manners Matter: Action history guides attention and repair choices during interaction. In: IEEE International Conference on Development and Learning (ICDL). ; 2025. doi:10.31234/osf.io/yn2we_v1' apa: 'Singh, A., & Rohlfing, K. J. (2025). Manners Matter: Action history guides attention and repair choices during interaction. IEEE International Conference on Development and Learning (ICDL). IEEE International Conference on Development and Learning (ICDL), Prague. https://doi.org/10.31234/osf.io/yn2we_v1' bibtex: '@inproceedings{Singh_Rohlfing_2025, place={ Prague}, title={Manners Matter: Action history guides attention and repair choices during interaction}, DOI={10.31234/osf.io/yn2we_v1}, booktitle={IEEE International Conference on Development and Learning (ICDL)}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2025} }' chicago: 'Singh, Amit, and Katharina J. Rohlfing. “Manners Matter: Action History Guides Attention and Repair Choices during Interaction.” In IEEE International Conference on Development and Learning (ICDL). Prague, 2025. https://doi.org/10.31234/osf.io/yn2we_v1.' ieee: 'A. Singh and K. J. Rohlfing, “Manners Matter: Action history guides attention and repair choices during interaction,” presented at the IEEE International Conference on Development and Learning (ICDL), Prague, 2025, doi: 10.31234/osf.io/yn2we_v1.' mla: 'Singh, Amit, and Katharina J. Rohlfing. “Manners Matter: Action History Guides Attention and Repair Choices during Interaction.” IEEE International Conference on Development and Learning (ICDL), 2025, doi:10.31234/osf.io/yn2we_v1.' short: 'A. Singh, K.J. Rohlfing, in: IEEE International Conference on Development and Learning (ICDL), Prague, 2025.' conference: end_date: 2025-09-19 location: Prague name: IEEE International Conference on Development and Learning (ICDL) start_date: 2025-09-15 date_created: 2025-09-24T12:32:52Z date_updated: 2025-09-24T12:39:25Z department: - _id: '749' - _id: '660' doi: 10.31234/osf.io/yn2we_v1 keyword: - Attention - Action - Repairs - Task model - HRI - Eyemovement language: - iso: eng main_file_link: - open_access: '1' url: https://doi.org/10.31234/osf.io/yn2we_v1 oa: '1' place: ' Prague' project: - _id: '115' name: 'TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog' publication: IEEE International Conference on Development and Learning (ICDL) publication_status: published quality_controlled: '1' status: public title: 'Manners Matter: Action history guides attention and repair choices during interaction' type: conference user_id: '91018' year: '2025' ... --- _id: '61401' abstract: - lang: eng text: "We introduce a method to study online language processes in human--robot interactive setup. In this interaction, language mediated eye movements can be studied as the dialogue unfolds between human and a robot. \r\nTraditionally, real-time linguistic processes are studied using visual world paradigms (VWP), where either the comprehension or the production tasks are implemented on screens for controlled investigations. Going beyond these traditional and unidirectional approach, we bring together production--comprehension loop with the help of a humanoid robot to preserve interactivity in an ecologically valid yet controlled setup. We discuss the potential of such setups for designing and evaluating findings from language--vision interplay in psycholinguistics. Our setup shows a potential to depart from traditional screen based experiments, balancing the dynamics of the interaction with control of the human behaviors. " author: - first_name: Amit full_name: Singh, Amit id: '91018' last_name: Singh orcid: 0000-0002-7789-1521 - first_name: Katharina J. full_name: Rohlfing, Katharina J. id: '50352' last_name: Rohlfing orcid: 0000-0002-5676-8233 citation: ama: 'Singh A, Rohlfing KJ. Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action. In: 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany. ; 2025. doi:10.17605/OSF.IO/8PR23' apa: 'Singh, A., & Rohlfing, K. J. (2025). Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action. 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany. 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany, Bochum. https://doi.org/10.17605/OSF.IO/8PR23' bibtex: '@inproceedings{Singh_Rohlfing_2025, place={Bochum}, title={Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action}, DOI={10.17605/OSF.IO/8PR23}, booktitle={6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2025} }' chicago: 'Singh, Amit, and Katharina J. Rohlfing. “Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action.” In 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany. Bochum, 2025. https://doi.org/10.17605/OSF.IO/8PR23.' ieee: 'A. Singh and K. J. Rohlfing, “Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action,” presented at the 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany, Bochum, 2025, doi: 10.17605/OSF.IO/8PR23.' mla: 'Singh, Amit, and Katharina J. Rohlfing. “Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action.” 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany, 2025, doi:10.17605/OSF.IO/8PR23.' short: 'A. Singh, K.J. Rohlfing, in: 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany, Bochum, 2025.' conference: end_date: 2025-09-03 location: Bochum name: 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany start_date: 2025-09-01 date_created: 2025-09-23T09:04:40Z date_updated: 2025-09-24T12:47:47Z department: - _id: '749' - _id: '660' doi: 10.17605/OSF.IO/8PR23 language: - iso: eng main_file_link: - url: https://osf.io/ghymr place: Bochum project: - _id: '115' name: 'TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog' publication: 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany publication_status: published quality_controlled: '1' status: public title: 'Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action' type: conference user_id: '91018' year: '2025' ... --- _id: '61156' abstract: - lang: eng text: Explainability has become an important topic in computer science and artificial intelligence, leading to a subfield called Explainable Artificial Intelligence (XAI). The goal of providing or seeking explanations is to achieve (better) ‘understanding’ on the part of the explainee. However, what it means to ‘understand’ is still not clearly defined, and the concept itself is rarely the subject of scientific investigation. This conceptual article aims to present a model of forms of understanding for XAI-explanations and beyond. From an interdisciplinary perspective bringing together computer science, linguistics, sociology, philosophy and psychology, a definition of understanding and its forms, assessment, and dynamics during the process of giving everyday explanations are explored. Two types of understanding are considered as possible outcomes of explanations, namely enabledness, ‘knowing how’ to do or decide something, and comprehension, ‘knowing that’ – both in different degrees (from shallow to deep). Explanations regularly start with shallow understanding in a specific domain and can lead to deep comprehension and enabledness of the explanandum, which we see as a prerequisite for human users to gain agency. In this process, the increase of comprehension and enabledness are highly interdependent. Against the background of this systematization, special challenges of understanding in XAI are discussed. article_number: '101419' article_type: original author: - first_name: Hendrik full_name: Buschmeier, Hendrik id: '76456' last_name: Buschmeier orcid: 0000-0002-9613-5713 - first_name: Heike M. full_name: Buhl, Heike M. id: '27152' last_name: Buhl - first_name: Friederike full_name: Kern, Friederike last_name: Kern - first_name: Angela full_name: Grimminger, Angela id: '57578' last_name: Grimminger - first_name: Helen full_name: Beierling, Helen id: '50995' last_name: Beierling - first_name: Josephine Beryl full_name: Fisher, Josephine Beryl id: '56345' last_name: Fisher orcid: 0000-0002-9997-9241 - first_name: André full_name: Groß, André id: '93405' last_name: Groß orcid: 0000-0002-9593-7220 - first_name: Ilona full_name: Horwath, Ilona id: '68836' last_name: Horwath - first_name: Nils full_name: Klowait, Nils id: '98454' last_name: Klowait orcid: 0000-0002-7347-099X - first_name: Stefan Teodorov full_name: Lazarov, Stefan Teodorov id: '90345' last_name: Lazarov orcid: 0009-0009-0892-9483 - first_name: Michael full_name: Lenke, Michael last_name: Lenke - first_name: Vivien full_name: Lohmer, Vivien last_name: Lohmer - first_name: Katharina full_name: Rohlfing, Katharina id: '50352' last_name: Rohlfing orcid: 0000-0002-5676-8233 - first_name: Ingrid full_name: Scharlau, Ingrid id: '451' last_name: Scharlau orcid: 0000-0003-2364-9489 - first_name: Amit full_name: Singh, Amit id: '91018' last_name: Singh orcid: 0000-0002-7789-1521 - first_name: Lutz full_name: Terfloth, Lutz id: '37320' last_name: Terfloth - first_name: Anna-Lisa full_name: Vollmer, Anna-Lisa id: '86589' last_name: Vollmer - first_name: Yu full_name: Wang, Yu last_name: Wang - first_name: Annedore full_name: Wilmes, Annedore last_name: Wilmes - first_name: Britta full_name: Wrede, Britta last_name: Wrede citation: ama: Buschmeier H, Buhl HM, Kern F, et al. Forms of Understanding for XAI-Explanations. Cognitive Systems Research. 2025;94. doi:10.1016/j.cogsys.2025.101419 apa: Buschmeier, H., Buhl, H. M., Kern, F., Grimminger, A., Beierling, H., Fisher, J. B., Groß, A., Horwath, I., Klowait, N., Lazarov, S. T., Lenke, M., Lohmer, V., Rohlfing, K., Scharlau, I., Singh, A., Terfloth, L., Vollmer, A.-L., Wang, Y., Wilmes, A., & Wrede, B. (2025). Forms of Understanding for XAI-Explanations. Cognitive Systems Research, 94, Article 101419. https://doi.org/10.1016/j.cogsys.2025.101419 bibtex: '@article{Buschmeier_Buhl_Kern_Grimminger_Beierling_Fisher_Groß_Horwath_Klowait_Lazarov_et al._2025, title={Forms of Understanding for XAI-Explanations}, volume={94}, DOI={10.1016/j.cogsys.2025.101419}, number={101419}, journal={Cognitive Systems Research}, author={Buschmeier, Hendrik and Buhl, Heike M. and Kern, Friederike and Grimminger, Angela and Beierling, Helen and Fisher, Josephine Beryl and Groß, André and Horwath, Ilona and Klowait, Nils and Lazarov, Stefan Teodorov and et al.}, year={2025} }' chicago: Buschmeier, Hendrik, Heike M. Buhl, Friederike Kern, Angela Grimminger, Helen Beierling, Josephine Beryl Fisher, André Groß, et al. “Forms of Understanding for XAI-Explanations.” Cognitive Systems Research 94 (2025). https://doi.org/10.1016/j.cogsys.2025.101419. ieee: 'H. Buschmeier et al., “Forms of Understanding for XAI-Explanations,” Cognitive Systems Research, vol. 94, Art. no. 101419, 2025, doi: 10.1016/j.cogsys.2025.101419.' mla: Buschmeier, Hendrik, et al. “Forms of Understanding for XAI-Explanations.” Cognitive Systems Research, vol. 94, 101419, 2025, doi:10.1016/j.cogsys.2025.101419. short: H. Buschmeier, H.M. Buhl, F. Kern, A. Grimminger, H. Beierling, J.B. Fisher, A. Groß, I. Horwath, N. Klowait, S.T. Lazarov, M. Lenke, V. Lohmer, K. Rohlfing, I. Scharlau, A. Singh, L. Terfloth, A.-L. Vollmer, Y. Wang, A. Wilmes, B. Wrede, Cognitive Systems Research 94 (2025). date_created: 2025-09-08T14:24:32Z date_updated: 2025-12-05T15:32:25Z ddc: - '006' department: - _id: '660' doi: 10.1016/j.cogsys.2025.101419 file: - access_level: closed content_type: application/pdf creator: hbuschme date_created: 2025-12-01T21:02:20Z date_updated: 2025-12-01T21:02:20Z file_id: '62730' file_name: Buschmeier-etal-2025-COGSYS.pdf file_size: 10114981 relation: main_file success: 1 file_date_updated: 2025-12-01T21:02:20Z has_accepted_license: '1' intvolume: ' 94' keyword: - understanding - explaining - explanations - explainable - AI - interdisciplinarity - comprehension - enabledness - agency language: - iso: eng main_file_link: - open_access: '1' url: https://www.sciencedirect.com/science/article/pii/S1389041725000993?via%3Dihub oa: '1' project: - _id: '111' name: 'TRR 318; TP A01: Adaptives Erklären' - _id: '112' name: 'TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten' - _id: '113' name: TRR 318 - Subproject A3 - _id: '114' name: 'TRR 318; TP A04: Integration des technischen Modells in das Partnermodell bei der Erklärung von digitalen Artefakten' - _id: '115' name: 'TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog' - _id: '122' name: TRR 318 - Subproject B3 - _id: '123' name: TRR 318 - Subproject B5 - _id: '119' name: TRR 318 - Project Area Ö publication: Cognitive Systems Research publication_status: published quality_controlled: '1' status: public title: Forms of Understanding for XAI-Explanations type: journal_article user_id: '57578' volume: 94 year: '2025' ... --- _id: '56660' abstract: - lang: eng text: In a successful dialogue in general and a successful explanation in specific, partners need to account for both, the task model (what is relevant for the task) and the partner model (what one can con- tribute). The phenomenon of coupling between task and the partner model becomes especially interesting in the context of Human– Robot Interaction where humans have to deal with unknown ca- pabilities of the robot, which can momentarily be perceived when the robot is unable to contribute to the task. Following research on the path over manner prominence in an action [31–33], a robot ex- plained actions to a human by emphasizing two aspects – the path ("where" component) and the manner ("how" component). On criti- cal trials, the robot occasionally omitted one of these components where participants sought missing information for the path or the manner. Participants’ information-seeking and gaze behaviour were analysed. Analysis confirms the initial predictions for, a) task model (path over manner prominence), i.e., earlier information-seeking for path-missing than manner-missing trials, and b) partner model, i.e., while information-seeking is predominantly tied to the attention on the robot’s face, when robot fails to provide resolution, attention shifts more often towards its torso – a behavior likely to indicate an exploration of the robot’s capabilities. An individual-level anal- ysis further confirms that the intra-individual variation in the task model is partly influenced by the perceived capability of the robot. author: - first_name: Amit full_name: Singh, Amit id: '91018' last_name: Singh orcid: 0000-0002-7789-1521 - first_name: Katharina J. full_name: Rohlfing, Katharina J. id: '50352' last_name: Rohlfing citation: ama: 'Singh A, Rohlfing KJ. Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue. In: Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024). ; 2024. doi:10.1145/3686215.3689202' apa: 'Singh, A., & Rohlfing, K. J. (2024). Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue. Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024). 26th ACM International Conference on Multimodal Interaction (ICMI 2024), San Jose, Costa Rica. https://doi.org/10.1145/3686215.3689202' bibtex: '@inproceedings{Singh_Rohlfing_2024, title={Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue}, DOI={10.1145/3686215.3689202}, booktitle={Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024)}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2024} }' chicago: 'Singh, Amit, and Katharina J. Rohlfing. “Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue.” In Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024), 2024. https://doi.org/10.1145/3686215.3689202.' ieee: 'A. Singh and K. J. Rohlfing, “Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue,” presented at the 26th ACM International Conference on Multimodal Interaction (ICMI 2024), San Jose, Costa Rica, 2024, doi: 10.1145/3686215.3689202.' mla: 'Singh, Amit, and Katharina J. Rohlfing. “Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue.” Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024), 2024, doi:10.1145/3686215.3689202.' short: 'A. Singh, K.J. Rohlfing, in: Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024), 2024.' conference: location: San Jose, Costa Rica name: 26th ACM International Conference on Multimodal Interaction (ICMI 2024) date_created: 2024-10-17T09:35:32Z date_updated: 2024-11-06T10:56:34Z ddc: - '410' department: - _id: '749' - _id: '660' doi: 10.1145/3686215.3689202 has_accepted_license: '1' keyword: - Explanation - Scaffolding - Eyetracking - Partner Model - HRI language: - iso: eng project: - _id: '115' grant_number: '438445824' name: 'TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog (Teilprojekt A05)' publication: Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024) status: public title: 'Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue' type: conference user_id: '91018' year: '2024' ... --- _id: '48543' abstract: - lang: eng text: Explanation has been identified as an important capability for AI-based systems, but research on systematic strategies for achieving understanding in interaction with such systems is still sparse. Negation is a linguistic strategy that is often used in explanations. It creates a contrast space between the affirmed and the negated item that enriches explaining processes with additional contextual information. While negation in human speech has been shown to lead to higher processing costs and worse task performance in terms of recall or action execution when used in isolation, it can decrease processing costs when used in context. So far, it has not been considered as a guiding strategy for explanations in human-robot interaction. We conducted an empirical study to investigate the use of negation as a guiding strategy in explanatory human-robot dialogue, in which a virtual robot explains tasks and possible actions to a human explainee to solve them in terms of gestures on a touchscreen. Our results show that negation vs. affirmation 1) increases processing costs measured as reaction time and 2) increases several aspects of task performance. While there was no significant effect of negation on the number of initially correctly executed gestures, we found a significantly lower number of attempts—measured as breaks in the finger movement data before the correct gesture was carried out—when being instructed through a negation. We further found that the gestures significantly resembled the presented prototype gesture more following an instruction with a negation as opposed to an affirmation. Also, the participants rated the benefit of contrastive vs. affirmative explanations significantly higher. Repeating the instructions decreased the effects of negation, yielding similar processing costs and task performance measures for negation and affirmation after several iterations. We discuss our results with respect to possible effects of negation on linguistic processing of explanations and limitations of our study. article_type: original author: - first_name: A. full_name: Groß, A. last_name: Groß - first_name: Amit full_name: Singh, Amit id: '91018' last_name: Singh orcid: 0000-0002-7789-1521 - first_name: Ngoc Chi full_name: Banh, Ngoc Chi id: '38219' last_name: Banh orcid: 0000-0002-5946-4542 - first_name: B. full_name: Richter, B. last_name: Richter - first_name: Ingrid full_name: Scharlau, Ingrid id: '451' last_name: Scharlau orcid: 0000-0003-2364-9489 - first_name: Katharina J. full_name: Rohlfing, Katharina J. id: '50352' last_name: Rohlfing - first_name: B. full_name: Wrede, B. last_name: Wrede citation: ama: Groß A, Singh A, Banh NC, et al. Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue. Frontiers in Robotics and AI. 2023;10. doi:10.3389/frobt.2023.1236184 apa: Groß, A., Singh, A., Banh, N. C., Richter, B., Scharlau, I., Rohlfing, K. J., & Wrede, B. (2023). Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue. Frontiers in Robotics and AI, 10. https://doi.org/10.3389/frobt.2023.1236184 bibtex: '@article{Groß_Singh_Banh_Richter_Scharlau_Rohlfing_Wrede_2023, title={Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue}, volume={10}, DOI={10.3389/frobt.2023.1236184}, journal={Frontiers in Robotics and AI}, author={Groß, A. and Singh, Amit and Banh, Ngoc Chi and Richter, B. and Scharlau, Ingrid and Rohlfing, Katharina J. and Wrede, B.}, year={2023} }' chicago: Groß, A., Amit Singh, Ngoc Chi Banh, B. Richter, Ingrid Scharlau, Katharina J. Rohlfing, and B. Wrede. “Scaffolding the Human Partner by Contrastive Guidance in an Explanatory Human-Robot Dialogue.” Frontiers in Robotics and AI 10 (2023). https://doi.org/10.3389/frobt.2023.1236184. ieee: 'A. Groß et al., “Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue,” Frontiers in Robotics and AI, vol. 10, 2023, doi: 10.3389/frobt.2023.1236184.' mla: Groß, A., et al. “Scaffolding the Human Partner by Contrastive Guidance in an Explanatory Human-Robot Dialogue.” Frontiers in Robotics and AI, vol. 10, 2023, doi:10.3389/frobt.2023.1236184. short: A. Groß, A. Singh, N.C. Banh, B. Richter, I. Scharlau, K.J. Rohlfing, B. Wrede, Frontiers in Robotics and AI 10 (2023). date_created: 2023-10-30T09:29:16Z date_updated: 2024-06-26T08:01:50Z department: - _id: '749' doi: 10.3389/frobt.2023.1236184 funded_apc: '1' intvolume: ' 10' keyword: - HRI - XAI - negation - understanding - explaining - touch interaction - gesture language: - iso: eng main_file_link: - open_access: '1' url: https://www.frontiersin.org/articles/10.3389/frobt.2023.1236184/full oa: '1' project: - _id: '115' grant_number: '438445824' name: 'TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog (Teilprojekt A05)' publication: Frontiers in Robotics and AI publication_status: published quality_controlled: '1' status: public title: Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue type: journal_article user_id: '38219' volume: 10 year: '2023' ... --- _id: '46067' abstract: - lang: eng text: '

The study investigates two different ways of guiding the addressee of an explanation - an explainee, through action demonstration: contrastive and non-contrastive. Their effect was tested on attention to specific action elements (goal) as well as on event memory. In an eye-tracking experiment, participants were shown different motion videos that were either contrastive or non-contrastive with respect to the segments of movement presentation. Given that everyday action demonstration is often multimodal, the stimuli were created with re- spect to their visual and verbal presentation. For visual presentation, a video combined two movements in a contrastive (e.g., Up-motion following a Down-motion) or non-contrastive way (e.g., two Up-motions following each other). For verbal presentation, each video was combined with a sequence of instruction descriptions in the form of negative (i.e., contrastive) or assertive (i.e., non-contrastive) guidance. It was found that a) attention to the event goal increased for this condition in the later time window, and b) participants’ recall of the event was facilitated when a visually contrastive motion was combined with a verbal contrast.

' author: - first_name: Amit full_name: Singh, Amit id: '91018' last_name: Singh orcid: 0000-0002-7789-1521 - first_name: Katharina J. full_name: Rohlfing, Katharina J. id: '50352' last_name: Rohlfing citation: ama: 'Singh A, Rohlfing KJ. Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall. In: Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45). Cognitive Science Society; 2023.' apa: 'Singh, A., & Rohlfing, K. J. (2023). Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall. Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45). 45th Annual Conference of the Cognitive Science Society, Sydney.' bibtex: '@inproceedings{Singh_Rohlfing_2023, place={Sydney, Australia}, title={Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall}, booktitle={Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45)}, publisher={Cognitive Science Society}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2023} }' chicago: 'Singh, Amit, and Katharina J. Rohlfing. “Contrastiveness in the Context of Action Demonstration: An Eye-Tracking Study on Its Effects on Action Perception and Action Recall.” In Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45). Sydney, Australia: Cognitive Science Society, 2023.' ieee: 'A. Singh and K. J. Rohlfing, “Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall,” presented at the 45th Annual Conference of the Cognitive Science Society, Sydney, 2023.' mla: 'Singh, Amit, and Katharina J. Rohlfing. “Contrastiveness in the Context of Action Demonstration: An Eye-Tracking Study on Its Effects on Action Perception and Action Recall.” Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45), Cognitive Science Society, 2023.' short: 'A. Singh, K.J. Rohlfing, in: Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45), Cognitive Science Society, Sydney, Australia, 2023.' conference: location: Sydney name: 45th Annual Conference of the Cognitive Science Society date_created: 2023-07-15T12:16:42Z date_updated: 2023-09-27T13:51:42Z department: - _id: '749' - _id: '660' keyword: - Attention - negation - contrastive guidance - eye-movements - action understanding - event representation language: - iso: eng main_file_link: - open_access: '1' url: https://escholarship.org/uc/item/2w94t4cv oa: '1' place: Sydney, Australia popular_science: '1' project: - _id: '115' grant_number: '438445824' name: 'TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog (Teilprojekt A05)' publication: Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45) publication_status: published publisher: Cognitive Science Society quality_controlled: '1' related_material: record: - id: '46067' relation: contains status: public status: public title: 'Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall' type: conference user_id: '91018' year: '2023' ...