[{"language":[{"iso":"eng"}],"external_id":{"pmid":["40810767"]},"abstract":[{"lang":"eng","text":"Research suggests that presenting an action via multimodal stimulation (verbal and visual) enhances its perception. To highlight this, in most studies, assertive instructions are generally presented before the occurrence of the visual subevent(s). However, verbal instructions need not always be assertive; they can also include negation to contrast the present event with a prior one, thereby facilitating processing—a phenomenon known as contextual facilitation. In our study, we investigated whether using negation to guide an action sequence facilitates action perception, particularly when two consecutive subactions contrast with each other. Stimuli from previous studies on action demonstration were used to create (non)contrastive actions, that is, a ball following noncontrastive and identical (Over–Over or Under–Under) versus contrastive and opposite paths (Over–Under or Under–Over) before terminating at a goal location. In Experiment 1, either an assertive or a negative instruction was provided as verbal guidance before onset of each path. Analyzing data from 35 participants, we found that, whereas assertive instructions facilitate overall action recall, negating the later path for contrastive actions is equally facilitative. Given that action goal is the most salient aspect in event memory due to goal-path bias in attention, a second experiment was conducted to test the effect of multimodal synchrony on goal attention and action memory. Experiment 2 revealed that when instructions overlap with actions, they become more tailored—assertive instructions effectively guide noncontrastive actions, while assertive–negative instruction particularly guides contrastive actions. Both studies suggest that increased attention to the goal leads to coarser perception of midevents, with action-instruction synchrony modulating goal bias in real-time event apprehension to serve distinct purposes for action conceptualization. Whereas presenting instructions before subactions attenuates goal attention, overlapping instructions increase goal attention and reveal the selective roles of assertive and negative instructions in guiding contrastive and noncontrastive actions."}],"publication":"Cognitive Science","title":"Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?","publisher":"Wiley","date_created":"2025-08-18T08:30:30Z","year":"2025","quality_controlled":"1","issue":"8","article_type":"original","article_number":"e70096","project":[{"_id":"115","name":"TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog"}],"_id":"60935","user_id":"91018","department":[{"_id":"749"},{"_id":"660"}],"status":"public","type":"journal_article","main_file_link":[{"url":"https://pubmed.ncbi.nlm.nih.gov/40810767/","open_access":"1"}],"doi":"10.1111/cogs.70096","date_updated":"2025-08-18T08:31:04Z","oa":"1","author":[{"first_name":"Amit","full_name":"Singh, Amit","id":"91018","orcid":"0000-0002-7789-1521","last_name":"Singh"},{"orcid":"0000-0002-5676-8233","last_name":"Rohlfing","id":"50352","full_name":"Rohlfing, Katharina J.","first_name":"Katharina J."}],"volume":49,"citation":{"apa":"Singh, A., &#38; Rohlfing, K. J. (2025). Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory? <i>Cognitive Science</i>, <i>49</i>(8), Article e70096. <a href=\"https://doi.org/10.1111/cogs.70096\">https://doi.org/10.1111/cogs.70096</a>","bibtex":"@article{Singh_Rohlfing_2025, title={Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?}, volume={49}, DOI={<a href=\"https://doi.org/10.1111/cogs.70096\">10.1111/cogs.70096</a>}, number={8e70096}, journal={Cognitive Science}, publisher={Wiley}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2025} }","short":"A. Singh, K.J. Rohlfing, Cognitive Science 49 (2025).","mla":"Singh, Amit, and Katharina J. Rohlfing. “Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?” <i>Cognitive Science</i>, vol. 49, no. 8, e70096, Wiley, 2025, doi:<a href=\"https://doi.org/10.1111/cogs.70096\">10.1111/cogs.70096</a>.","ama":"Singh A, Rohlfing KJ. Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory? <i>Cognitive Science</i>. 2025;49(8). doi:<a href=\"https://doi.org/10.1111/cogs.70096\">10.1111/cogs.70096</a>","chicago":"Singh, Amit, and Katharina J. Rohlfing. “Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?” <i>Cognitive Science</i> 49, no. 8 (2025). <a href=\"https://doi.org/10.1111/cogs.70096\">https://doi.org/10.1111/cogs.70096</a>.","ieee":"A. Singh and K. J. Rohlfing, “Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?,” <i>Cognitive Science</i>, vol. 49, no. 8, Art. no. e70096, 2025, doi: <a href=\"https://doi.org/10.1111/cogs.70096\">10.1111/cogs.70096</a>."},"intvolume":"        49","publication_status":"published","pmid":"1"},{"publication":"IEEE International Conference on Development and Learning (ICDL)","abstract":[{"text":"This study investigated how action histories – unfolding sequences of actions with objects – provide a context for both attentional allocation and linguistic repair strategies. Building on theories of enactive cognition and sensorimotor contingency theory, we experimentally manipulated action sequences (action history) to create either simple or rich “situational models,” and investigated how these models interact with attention and reflect in linguistic processes during human–robot interaction. Participants (N = 30) engaged in a controlled object placement task with a humanoid robot, where the action (manner) information was either provided or omitted. The omission elicited repair behaviors in participants that were in focus of our investigation. For rich models (competing action possibilities) participants demonstrated: a) increased attentional reorientation, reflecting active engagement with the situational model b) preference for restricted repairs, targeting the specific source of trouble in action selection. Conversely, a simple situational model led to more generalized attention patterns and open repair strategies, suggesting weaker constraints on internal processing. These findings highlight how situational structures emerge externally to scaffold internal cognitive processes, with action histories serving as a crucial context for the interface between perception, action, and language. We discuss how to implement such a tight loop in the assistance of a system.","lang":"eng"}],"keyword":["Attention","Action","Repairs","Task model","HRI","Eyemovement"],"language":[{"iso":"eng"}],"quality_controlled":"1","year":"2025","date_created":"2025-09-24T12:32:52Z","title":"Manners Matter: Action history guides attention and repair choices during interaction","type":"conference","status":"public","project":[{"name":"TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog","_id":"115"}],"_id":"61432","user_id":"91018","department":[{"_id":"749"},{"_id":"660"}],"publication_status":"published","place":" Prague","citation":{"ama":"Singh A, Rohlfing KJ. Manners Matter: Action history guides attention and repair choices during interaction. In: <i>IEEE International Conference on Development and Learning (ICDL)</i>. ; 2025. doi:<a href=\"https://doi.org/10.31234/osf.io/yn2we_v1\">10.31234/osf.io/yn2we_v1</a>","chicago":"Singh, Amit, and Katharina J. Rohlfing. “Manners Matter: Action History Guides Attention and Repair Choices during Interaction.” In <i>IEEE International Conference on Development and Learning (ICDL)</i>.  Prague, 2025. <a href=\"https://doi.org/10.31234/osf.io/yn2we_v1\">https://doi.org/10.31234/osf.io/yn2we_v1</a>.","ieee":"A. Singh and K. J. Rohlfing, “Manners Matter: Action history guides attention and repair choices during interaction,” presented at the IEEE International Conference on Development and Learning (ICDL), Prague, 2025, doi: <a href=\"https://doi.org/10.31234/osf.io/yn2we_v1\">10.31234/osf.io/yn2we_v1</a>.","apa":"Singh, A., &#38; Rohlfing, K. J. (2025). Manners Matter: Action history guides attention and repair choices during interaction. <i>IEEE International Conference on Development and Learning (ICDL)</i>. IEEE International Conference on Development and Learning (ICDL), Prague. <a href=\"https://doi.org/10.31234/osf.io/yn2we_v1\">https://doi.org/10.31234/osf.io/yn2we_v1</a>","mla":"Singh, Amit, and Katharina J. Rohlfing. “Manners Matter: Action History Guides Attention and Repair Choices during Interaction.” <i>IEEE International Conference on Development and Learning (ICDL)</i>, 2025, doi:<a href=\"https://doi.org/10.31234/osf.io/yn2we_v1\">10.31234/osf.io/yn2we_v1</a>.","short":"A. Singh, K.J. Rohlfing, in: IEEE International Conference on Development and Learning (ICDL),  Prague, 2025.","bibtex":"@inproceedings{Singh_Rohlfing_2025, place={ Prague}, title={Manners Matter: Action history guides attention and repair choices during interaction}, DOI={<a href=\"https://doi.org/10.31234/osf.io/yn2we_v1\">10.31234/osf.io/yn2we_v1</a>}, booktitle={IEEE International Conference on Development and Learning (ICDL)}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2025} }"},"oa":"1","date_updated":"2025-09-24T12:39:25Z","author":[{"first_name":"Amit","id":"91018","full_name":"Singh, Amit","last_name":"Singh","orcid":"0000-0002-7789-1521"},{"last_name":"Rohlfing","orcid":"0000-0002-5676-8233","full_name":"Rohlfing, Katharina J.","id":"50352","first_name":"Katharina J."}],"main_file_link":[{"url":"https://doi.org/10.31234/osf.io/yn2we_v1","open_access":"1"}],"conference":{"location":"Prague","end_date":"2025-09-19","start_date":"2025-09-15","name":"IEEE International Conference on Development and Learning (ICDL)"},"doi":"10.31234/osf.io/yn2we_v1"},{"date_created":"2025-09-23T09:04:40Z","author":[{"first_name":"Amit","last_name":"Singh","orcid":"0000-0002-7789-1521","id":"91018","full_name":"Singh, Amit"},{"last_name":"Rohlfing","orcid":"0000-0002-5676-8233","full_name":"Rohlfing, Katharina J.","id":"50352","first_name":"Katharina J."}],"date_updated":"2025-09-24T12:47:47Z","doi":"10.17605/OSF.IO/8PR23","conference":{"start_date":"2025-09-01","name":"6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany","location":"Bochum","end_date":"2025-09-03"},"main_file_link":[{"url":"https://osf.io/ghymr"}],"title":"Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action","quality_controlled":"1","publication_status":"published","citation":{"chicago":"Singh, Amit, and Katharina J. Rohlfing. “Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action.” In <i>6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany</i>. Bochum, 2025. <a href=\"https://doi.org/10.17605/OSF.IO/8PR23\">https://doi.org/10.17605/OSF.IO/8PR23</a>.","ieee":"A. Singh and K. J. Rohlfing, “Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action,” presented at the 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany, Bochum, 2025, doi: <a href=\"https://doi.org/10.17605/OSF.IO/8PR23\">10.17605/OSF.IO/8PR23</a>.","ama":"Singh A, Rohlfing KJ. Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action. In: <i>6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany</i>. ; 2025. doi:<a href=\"https://doi.org/10.17605/OSF.IO/8PR23\">10.17605/OSF.IO/8PR23</a>","bibtex":"@inproceedings{Singh_Rohlfing_2025, place={Bochum}, title={Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action}, DOI={<a href=\"https://doi.org/10.17605/OSF.IO/8PR23\">10.17605/OSF.IO/8PR23</a>}, booktitle={6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2025} }","mla":"Singh, Amit, and Katharina J. Rohlfing. “Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action.” <i>6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany</i>, 2025, doi:<a href=\"https://doi.org/10.17605/OSF.IO/8PR23\">10.17605/OSF.IO/8PR23</a>.","short":"A. Singh, K.J. Rohlfing, in: 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany, Bochum, 2025.","apa":"Singh, A., &#38; Rohlfing, K. J. (2025). Embedding Psycholinguistics: An Interactive Framework for Studying Language in Action. <i>6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany</i>. 6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany, Bochum. <a href=\"https://doi.org/10.17605/OSF.IO/8PR23\">https://doi.org/10.17605/OSF.IO/8PR23</a>"},"place":"Bochum","year":"2025","department":[{"_id":"749"},{"_id":"660"}],"user_id":"91018","_id":"61401","project":[{"name":"TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog","_id":"115"}],"language":[{"iso":"eng"}],"publication":"6th Biannual Conference of the German Society for Cognitive Science, Bochum, Germany","type":"conference","status":"public","abstract":[{"lang":"eng","text":"We introduce a method to study online language processes in human--robot interactive setup. In this interaction, language mediated eye movements can be studied as the dialogue unfolds between human and a robot.  \r\nTraditionally, real-time linguistic processes are studied using visual world paradigms (VWP), where either the comprehension or the production tasks are implemented on screens for controlled investigations. Going beyond these traditional and unidirectional approach, we bring together production--comprehension loop with the help of a humanoid robot to preserve interactivity in an ecologically valid yet controlled setup. We discuss the potential of such setups for designing and evaluating findings from language--vision interplay in psycholinguistics. Our setup shows a potential to depart from traditional screen based experiments, balancing the dynamics of the interaction with control of the human behaviors. "}]},{"ddc":["006"],"keyword":["understanding","explaining","explanations","explainable","AI","interdisciplinarity","comprehension","enabledness","agency"],"language":[{"iso":"eng"}],"abstract":[{"text":"Explainability has become an important topic in computer science and artificial intelligence, leading to a subfield called Explainable Artificial Intelligence (XAI). The goal of providing or seeking explanations is to achieve (better) ‘understanding’ on the part of the explainee. However, what it means to ‘understand’ is still not clearly defined, and the concept itself is rarely the subject of scientific investigation. This conceptual article aims to present a model of forms of understanding for XAI-explanations and beyond. From an interdisciplinary perspective bringing together computer science, linguistics, sociology, philosophy and psychology, a definition of understanding and its forms, assessment, and dynamics during the process of giving everyday explanations are explored. Two types of understanding are considered as possible outcomes of explanations, namely enabledness, ‘knowing how’ to do or decide something, and comprehension, ‘knowing that’ – both in different degrees (from shallow to deep). Explanations regularly start with shallow understanding in a specific domain and can lead to deep comprehension and enabledness of the explanandum, which we see as a prerequisite for human users to gain agency. In this process, the increase of comprehension and enabledness are highly interdependent. Against the background of this systematization, special challenges of understanding in XAI are discussed.","lang":"eng"}],"file":[{"access_level":"closed","file_id":"62730","file_name":"Buschmeier-etal-2025-COGSYS.pdf","file_size":10114981,"date_created":"2025-12-01T21:02:20Z","creator":"hbuschme","date_updated":"2025-12-01T21:02:20Z","relation":"main_file","success":1,"content_type":"application/pdf"}],"publication":"Cognitive Systems Research","title":"Forms of Understanding for XAI-Explanations","date_created":"2025-09-08T14:24:32Z","year":"2025","quality_controlled":"1","article_number":"101419","article_type":"original","file_date_updated":"2025-12-01T21:02:20Z","project":[{"_id":"111","name":"TRR 318; TP A01: Adaptives Erklären"},{"name":"TRR 318; TP A02: Verstehensprozess einer Erklärung beobachten und auswerten","_id":"112"},{"_id":"113","name":"TRR 318 - Subproject A3"},{"_id":"114","name":"TRR 318; TP A04: Integration des technischen Modells in das Partnermodell bei der Erklärung von digitalen Artefakten"},{"_id":"115","name":"TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog"},{"_id":"122","name":"TRR 318 - Subproject B3"},{"_id":"123","name":"TRR 318 - Subproject B5"},{"_id":"119","name":"TRR 318 - Project Area Ö"}],"_id":"61156","user_id":"57578","department":[{"_id":"660"}],"status":"public","type":"journal_article","main_file_link":[{"url":"https://www.sciencedirect.com/science/article/pii/S1389041725000993?via%3Dihub","open_access":"1"}],"doi":"10.1016/j.cogsys.2025.101419","oa":"1","date_updated":"2025-12-05T15:32:25Z","author":[{"last_name":"Buschmeier","orcid":"0000-0002-9613-5713","id":"76456","full_name":"Buschmeier, Hendrik","first_name":"Hendrik"},{"first_name":"Heike M.","last_name":"Buhl","id":"27152","full_name":"Buhl, Heike M."},{"last_name":"Kern","full_name":"Kern, Friederike","first_name":"Friederike"},{"first_name":"Angela","last_name":"Grimminger","full_name":"Grimminger, Angela","id":"57578"},{"first_name":"Helen","id":"50995","full_name":"Beierling, Helen","last_name":"Beierling"},{"full_name":"Fisher, Josephine Beryl","id":"56345","last_name":"Fisher","orcid":"0000-0002-9997-9241","first_name":"Josephine Beryl"},{"first_name":"André","full_name":"Groß, André","id":"93405","last_name":"Groß","orcid":"0000-0002-9593-7220"},{"first_name":"Ilona","full_name":"Horwath, Ilona","id":"68836","last_name":"Horwath"},{"first_name":"Nils","full_name":"Klowait, Nils","id":"98454","last_name":"Klowait","orcid":"0000-0002-7347-099X"},{"first_name":"Stefan Teodorov","id":"90345","full_name":"Lazarov, Stefan Teodorov","orcid":"0009-0009-0892-9483","last_name":"Lazarov"},{"first_name":"Michael","last_name":"Lenke","full_name":"Lenke, Michael"},{"first_name":"Vivien","last_name":"Lohmer","full_name":"Lohmer, Vivien"},{"first_name":"Katharina","id":"50352","full_name":"Rohlfing, Katharina","last_name":"Rohlfing","orcid":"0000-0002-5676-8233"},{"orcid":"0000-0003-2364-9489","last_name":"Scharlau","id":"451","full_name":"Scharlau, Ingrid","first_name":"Ingrid"},{"first_name":"Amit","orcid":"0000-0002-7789-1521","last_name":"Singh","full_name":"Singh, Amit","id":"91018"},{"first_name":"Lutz","id":"37320","full_name":"Terfloth, Lutz","last_name":"Terfloth"},{"first_name":"Anna-Lisa","id":"86589","full_name":"Vollmer, Anna-Lisa","last_name":"Vollmer"},{"last_name":"Wang","full_name":"Wang, Yu","first_name":"Yu"},{"first_name":"Annedore","full_name":"Wilmes, Annedore","last_name":"Wilmes"},{"last_name":"Wrede","full_name":"Wrede, Britta","first_name":"Britta"}],"volume":94,"citation":{"ama":"Buschmeier H, Buhl HM, Kern F, et al. Forms of Understanding for XAI-Explanations. <i>Cognitive Systems Research</i>. 2025;94. doi:<a href=\"https://doi.org/10.1016/j.cogsys.2025.101419\">10.1016/j.cogsys.2025.101419</a>","chicago":"Buschmeier, Hendrik, Heike M. Buhl, Friederike Kern, Angela Grimminger, Helen Beierling, Josephine Beryl Fisher, André Groß, et al. “Forms of Understanding for XAI-Explanations.” <i>Cognitive Systems Research</i> 94 (2025). <a href=\"https://doi.org/10.1016/j.cogsys.2025.101419\">https://doi.org/10.1016/j.cogsys.2025.101419</a>.","ieee":"H. Buschmeier <i>et al.</i>, “Forms of Understanding for XAI-Explanations,” <i>Cognitive Systems Research</i>, vol. 94, Art. no. 101419, 2025, doi: <a href=\"https://doi.org/10.1016/j.cogsys.2025.101419\">10.1016/j.cogsys.2025.101419</a>.","apa":"Buschmeier, H., Buhl, H. M., Kern, F., Grimminger, A., Beierling, H., Fisher, J. B., Groß, A., Horwath, I., Klowait, N., Lazarov, S. T., Lenke, M., Lohmer, V., Rohlfing, K., Scharlau, I., Singh, A., Terfloth, L., Vollmer, A.-L., Wang, Y., Wilmes, A., &#38; Wrede, B. (2025). Forms of Understanding for XAI-Explanations. <i>Cognitive Systems Research</i>, <i>94</i>, Article 101419. <a href=\"https://doi.org/10.1016/j.cogsys.2025.101419\">https://doi.org/10.1016/j.cogsys.2025.101419</a>","bibtex":"@article{Buschmeier_Buhl_Kern_Grimminger_Beierling_Fisher_Groß_Horwath_Klowait_Lazarov_et al._2025, title={Forms of Understanding for XAI-Explanations}, volume={94}, DOI={<a href=\"https://doi.org/10.1016/j.cogsys.2025.101419\">10.1016/j.cogsys.2025.101419</a>}, number={101419}, journal={Cognitive Systems Research}, author={Buschmeier, Hendrik and Buhl, Heike M. and Kern, Friederike and Grimminger, Angela and Beierling, Helen and Fisher, Josephine Beryl and Groß, André and Horwath, Ilona and Klowait, Nils and Lazarov, Stefan Teodorov and et al.}, year={2025} }","mla":"Buschmeier, Hendrik, et al. “Forms of Understanding for XAI-Explanations.” <i>Cognitive Systems Research</i>, vol. 94, 101419, 2025, doi:<a href=\"https://doi.org/10.1016/j.cogsys.2025.101419\">10.1016/j.cogsys.2025.101419</a>.","short":"H. Buschmeier, H.M. Buhl, F. Kern, A. Grimminger, H. Beierling, J.B. Fisher, A. Groß, I. Horwath, N. Klowait, S.T. Lazarov, M. Lenke, V. Lohmer, K. Rohlfing, I. Scharlau, A. Singh, L. Terfloth, A.-L. Vollmer, Y. Wang, A. Wilmes, B. Wrede, Cognitive Systems Research 94 (2025)."},"intvolume":"        94","publication_status":"published","has_accepted_license":"1"},{"publication":"Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024)","type":"conference","abstract":[{"lang":"eng","text":"In a successful dialogue in general and a successful explanation in specific, partners need to account for both, the task model (what is relevant for the task) and the partner model (what one can con- tribute). The phenomenon of coupling between task and the partner model becomes especially interesting in the context of Human– Robot Interaction where humans have to deal with unknown ca- pabilities of the robot, which can momentarily be perceived when the robot is unable to contribute to the task. Following research on the path over manner prominence in an action [31–33], a robot ex- plained actions to a human by emphasizing two aspects – the path (\"where\" component) and the manner (\"how\" component). On criti- cal trials, the robot occasionally omitted one of these components where participants sought missing information for the path or the manner. Participants’ information-seeking and gaze behaviour were analysed. Analysis confirms the initial predictions for, a) task model (path over manner prominence), i.e., earlier information-seeking for path-missing than manner-missing trials, and b) partner model, i.e., while information-seeking is predominantly tied to the attention on the robot’s face, when robot fails to provide resolution, attention shifts more often towards its torso – a behavior likely to indicate an exploration of the robot’s capabilities. An individual-level anal- ysis further confirms that the intra-individual variation in the task model is partly influenced by the perceived capability of the robot."}],"status":"public","_id":"56660","project":[{"grant_number":"438445824","name":"TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog (Teilprojekt A05)","_id":"115"}],"department":[{"_id":"749"},{"_id":"660"}],"user_id":"91018","keyword":["Explanation","Scaffolding","Eyetracking","Partner Model","HRI"],"ddc":["410"],"language":[{"iso":"eng"}],"has_accepted_license":"1","year":"2024","citation":{"ama":"Singh A, Rohlfing KJ. Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue. In: <i>Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024)</i>. ; 2024. doi:<a href=\"https://doi.org/10.1145/3686215.3689202\">10.1145/3686215.3689202</a>","ieee":"A. Singh and K. J. Rohlfing, “Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue,” presented at the 26th ACM International Conference on Multimodal Interaction (ICMI 2024), San Jose, Costa Rica, 2024, doi: <a href=\"https://doi.org/10.1145/3686215.3689202\">10.1145/3686215.3689202</a>.","chicago":"Singh, Amit, and Katharina J. Rohlfing. “Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue.” In <i>Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024)</i>, 2024. <a href=\"https://doi.org/10.1145/3686215.3689202\">https://doi.org/10.1145/3686215.3689202</a>.","apa":"Singh, A., &#38; Rohlfing, K. J. (2024). Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue. <i>Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024)</i>. 26th ACM International Conference on Multimodal Interaction (ICMI 2024), San Jose, Costa Rica. <a href=\"https://doi.org/10.1145/3686215.3689202\">https://doi.org/10.1145/3686215.3689202</a>","bibtex":"@inproceedings{Singh_Rohlfing_2024, title={Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue}, DOI={<a href=\"https://doi.org/10.1145/3686215.3689202\">10.1145/3686215.3689202</a>}, booktitle={Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024)}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2024} }","mla":"Singh, Amit, and Katharina J. Rohlfing. “Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue.” <i>Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024)</i>, 2024, doi:<a href=\"https://doi.org/10.1145/3686215.3689202\">10.1145/3686215.3689202</a>.","short":"A. Singh, K.J. Rohlfing, in: Proceedings of 26th ACM International Conference on Multimodal Interaction (ICMI 2024), 2024."},"date_updated":"2024-11-06T10:56:34Z","author":[{"first_name":"Amit","id":"91018","full_name":"Singh, Amit","last_name":"Singh","orcid":"0000-0002-7789-1521"},{"first_name":"Katharina J.","full_name":"Rohlfing, Katharina J.","id":"50352","last_name":"Rohlfing"}],"date_created":"2024-10-17T09:35:32Z","title":"Coupling of Task and Partner Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue","doi":"10.1145/3686215.3689202","conference":{"location":"San Jose, Costa Rica","name":"26th ACM International Conference on Multimodal Interaction (ICMI 2024)"}},{"publication_status":"published","citation":{"chicago":"Groß, A., Amit Singh, Ngoc Chi Banh, B. Richter, Ingrid Scharlau, Katharina J. Rohlfing, and B. Wrede. “Scaffolding the Human Partner by Contrastive Guidance in an Explanatory Human-Robot Dialogue.” <i>Frontiers in Robotics and AI</i> 10 (2023). <a href=\"https://doi.org/10.3389/frobt.2023.1236184\">https://doi.org/10.3389/frobt.2023.1236184</a>.","ieee":"A. Groß <i>et al.</i>, “Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue,” <i>Frontiers in Robotics and AI</i>, vol. 10, 2023, doi: <a href=\"https://doi.org/10.3389/frobt.2023.1236184\">10.3389/frobt.2023.1236184</a>.","ama":"Groß A, Singh A, Banh NC, et al. Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue. <i>Frontiers in Robotics and AI</i>. 2023;10. doi:<a href=\"https://doi.org/10.3389/frobt.2023.1236184\">10.3389/frobt.2023.1236184</a>","bibtex":"@article{Groß_Singh_Banh_Richter_Scharlau_Rohlfing_Wrede_2023, title={Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue}, volume={10}, DOI={<a href=\"https://doi.org/10.3389/frobt.2023.1236184\">10.3389/frobt.2023.1236184</a>}, journal={Frontiers in Robotics and AI}, author={Groß, A. and Singh, Amit and Banh, Ngoc Chi and Richter, B. and Scharlau, Ingrid and Rohlfing, Katharina J. and Wrede, B.}, year={2023} }","short":"A. Groß, A. Singh, N.C. Banh, B. Richter, I. Scharlau, K.J. Rohlfing, B. Wrede, Frontiers in Robotics and AI 10 (2023).","mla":"Groß, A., et al. “Scaffolding the Human Partner by Contrastive Guidance in an Explanatory Human-Robot Dialogue.” <i>Frontiers in Robotics and AI</i>, vol. 10, 2023, doi:<a href=\"https://doi.org/10.3389/frobt.2023.1236184\">10.3389/frobt.2023.1236184</a>.","apa":"Groß, A., Singh, A., Banh, N. C., Richter, B., Scharlau, I., Rohlfing, K. J., &#38; Wrede, B. (2023). Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue. <i>Frontiers in Robotics and AI</i>, <i>10</i>. <a href=\"https://doi.org/10.3389/frobt.2023.1236184\">https://doi.org/10.3389/frobt.2023.1236184</a>"},"intvolume":"        10","date_updated":"2024-06-26T08:01:50Z","oa":"1","author":[{"last_name":"Groß","full_name":"Groß, A.","first_name":"A."},{"last_name":"Singh","orcid":"0000-0002-7789-1521","id":"91018","full_name":"Singh, Amit","first_name":"Amit"},{"orcid":"0000-0002-5946-4542","last_name":"Banh","full_name":"Banh, Ngoc Chi","id":"38219","first_name":"Ngoc Chi"},{"first_name":"B.","full_name":"Richter, B.","last_name":"Richter"},{"id":"451","full_name":"Scharlau, Ingrid","last_name":"Scharlau","orcid":"0000-0003-2364-9489","first_name":"Ingrid"},{"last_name":"Rohlfing","full_name":"Rohlfing, Katharina J.","id":"50352","first_name":"Katharina J."},{"first_name":"B.","full_name":"Wrede, B.","last_name":"Wrede"}],"volume":10,"main_file_link":[{"url":"https://www.frontiersin.org/articles/10.3389/frobt.2023.1236184/full","open_access":"1"}],"doi":"10.3389/frobt.2023.1236184","type":"journal_article","status":"public","project":[{"name":"TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog (Teilprojekt A05)","_id":"115","grant_number":"438445824"}],"_id":"48543","user_id":"38219","department":[{"_id":"749"}],"article_type":"original","funded_apc":"1","quality_controlled":"1","year":"2023","date_created":"2023-10-30T09:29:16Z","title":"Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue","publication":"Frontiers in Robotics and AI","abstract":[{"text":"Explanation has been identified as an important capability for AI-based systems, but research on systematic strategies for achieving understanding in interaction with such systems is still sparse. Negation is a linguistic strategy that is often used in explanations. It creates a contrast space between the affirmed and the negated item that enriches explaining processes with additional contextual information. While negation in human speech has been shown to lead to higher processing costs and worse task performance in terms of recall or action execution when used in isolation, it can decrease processing costs when used in context. So far, it has not been considered as a guiding strategy for explanations in human-robot interaction. We conducted an empirical study to investigate the use of negation as a guiding strategy in explanatory human-robot dialogue, in which a virtual robot explains tasks and possible actions to a human explainee to solve them in terms of gestures on a touchscreen. Our results show that negation vs. affirmation 1) increases processing costs measured as reaction time and 2) increases several aspects of task performance. While there was no significant effect of negation on the number of initially correctly executed gestures, we found a significantly lower number of attempts—measured as breaks in the finger movement data before the correct gesture was carried out—when being instructed through a negation. We further found that the gestures significantly resembled the presented prototype gesture more following an instruction with a negation as opposed to an affirmation. Also, the participants rated the benefit of contrastive vs. affirmative explanations significantly higher. Repeating the instructions decreased the effects of negation, yielding similar processing costs and task performance measures for negation and affirmation after several iterations. We discuss our results with respect to possible effects of negation on linguistic processing of explanations and limitations of our study.","lang":"eng"}],"keyword":["HRI","XAI","negation","understanding","explaining","touch interaction","gesture"],"language":[{"iso":"eng"}]},{"language":[{"iso":"eng"}],"keyword":["Attention","negation","contrastive  guidance","eye-movements","action understanding","event representation"],"publication":"Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45)","abstract":[{"lang":"eng","text":"<p>The study investigates two different ways of guiding the addressee of an explanation - an explainee, through action demonstration: contrastive and non-contrastive. Their effect was tested on attention to specific action elements (goal) as well as on event memory. In an eye-tracking experiment, participants were shown different motion videos that were either contrastive or non-contrastive with respect to the segments of movement presentation. Given that everyday action demonstration is often multimodal, the stimuli were created with re- spect to their visual and verbal presentation. For visual presentation, a video combined two movements in a contrastive (e.g., Up-motion following a Down-motion) or non-contrastive way (e.g., two Up-motions following each other). For verbal presentation, each video was combined with a sequence of instruction descriptions in the form of negative (i.e., contrastive) or assertive (i.e., non-contrastive) guidance. It was found that a) attention to the event goal increased for this condition in the later time window, and b) participants’ recall of the event was facilitated when a visually contrastive motion was combined with a verbal contrast.</p>"}],"date_created":"2023-07-15T12:16:42Z","publisher":"Cognitive Science Society","title":"Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall","quality_controlled":"1","year":"2023","user_id":"91018","department":[{"_id":"749"},{"_id":"660"}],"project":[{"grant_number":"438445824","name":"TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog (Teilprojekt A05)","_id":"115"}],"_id":"46067","type":"conference","popular_science":"1","status":"public","author":[{"full_name":"Singh, Amit","id":"91018","last_name":"Singh","orcid":"0000-0002-7789-1521","first_name":"Amit"},{"first_name":"Katharina J.","full_name":"Rohlfing, Katharina J.","id":"50352","last_name":"Rohlfing"}],"date_updated":"2023-09-27T13:51:42Z","oa":"1","main_file_link":[{"open_access":"1","url":"https://escholarship.org/uc/item/2w94t4cv"}],"conference":{"name":"45th Annual Conference of the Cognitive Science Society","location":"Sydney"},"related_material":{"record":[{"status":"public","relation":"contains","id":"46067"}]},"publication_status":"published","citation":{"mla":"Singh, Amit, and Katharina J. Rohlfing. “Contrastiveness in the Context of Action Demonstration: An Eye-Tracking Study on Its Effects on Action Perception and Action Recall.” <i>Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45)</i>, Cognitive Science Society, 2023.","short":"A. Singh, K.J. Rohlfing, in: Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45), Cognitive Science Society, Sydney, Australia, 2023.","bibtex":"@inproceedings{Singh_Rohlfing_2023, place={Sydney, Australia}, title={Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall}, booktitle={Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45)}, publisher={Cognitive Science Society}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2023} }","apa":"Singh, A., &#38; Rohlfing, K. J. (2023). Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall. <i>Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45)</i>. 45th Annual Conference of the Cognitive Science Society, Sydney.","chicago":"Singh, Amit, and Katharina J. Rohlfing. “Contrastiveness in the Context of Action Demonstration: An Eye-Tracking Study on Its Effects on Action Perception and Action Recall.” In <i>Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45)</i>. Sydney, Australia: Cognitive Science Society, 2023.","ieee":"A. Singh and K. J. Rohlfing, “Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall,” presented at the 45th Annual Conference of the Cognitive Science Society, Sydney, 2023.","ama":"Singh A, Rohlfing KJ. Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall. In: <i>Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45)</i>. Cognitive Science Society; 2023."},"place":"Sydney, Australia"}]