TY - JOUR AB - Negated statements require more processing efforts than assertions. However, in certain contexts, repeating negations undergo adaptation, which over time mitigates the effort. Here, we ask negations hamper visual processing and whether consecutive repetitions mitigate its influence. We assessed the overall attentional capacity and its distribution, the relative weight, quantitatively using the formal Theory of Visual Attention (TVA). Here, we employed a very simple form for negations, binary negations. Negated instructions, expressing the only alternative to the core supposition, were cognitively demanding, resulting in a loss of attentional capacity in three experiments. The overall attentional capacity recovered gradually but stagnated at a lower level than with assertions, even after many repetitions. Additionally, negations distributed the attention equally between target and reference stimulus. Repetitions slightly increased the reference' share of attention. Assertions, on the other hand, shifted the attentional weight towards the target. Few repetitions slightly decreased the bias towards the target, many repetitions increased the bias. AU - Banh, Ngoc Chi AU - Tünnermann, Jan AU - Rohlfing, Katharina J. AU - Scharlau, Ingrid ID - 53072 JF - Attention, Perception, & Psychophysics TI - Benefiting from Binary Negations? Verbal Negations Decrease Visual Attention and Balance Its Distribution ER - TY - CONF AB -

The study investigates two different ways of guiding the addressee of an explanation - an explainee, through action demonstration: contrastive and non-contrastive. Their effect was tested on attention to specific action elements (goal) as well as on event memory. In an eye-tracking experiment, participants were shown different motion videos that were either contrastive or non-contrastive with respect to the segments of movement presentation. Given that everyday action demonstration is often multimodal, the stimuli were created with re- spect to their visual and verbal presentation. For visual presentation, a video combined two movements in a contrastive (e.g., Up-motion following a Down-motion) or non-contrastive way (e.g., two Up-motions following each other). For verbal presentation, each video was combined with a sequence of instruction descriptions in the form of negative (i.e., contrastive) or assertive (i.e., non-contrastive) guidance. It was found that a) attention to the event goal increased for this condition in the later time window, and b) participants’ recall of the event was facilitated when a visually contrastive motion was combined with a verbal contrast.

AU - Singh, Amit AU - Rohlfing, Katharina J. ID - 46067 KW - Attention KW - negation KW - contrastive guidance KW - eye-movements KW - action understanding KW - event representation T2 - Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45) TI - Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall ER - TY - JOUR AB - Explanation has been identified as an important capability for AI-based systems, but research on systematic strategies for achieving understanding in interaction with such systems is still sparse. Negation is a linguistic strategy that is often used in explanations. It creates a contrast space between the affirmed and the negated item that enriches explaining processes with additional contextual information. While negation in human speech has been shown to lead to higher processing costs and worse task performance in terms of recall or action execution when used in isolation, it can decrease processing costs when used in context. So far, it has not been considered as a guiding strategy for explanations in human-robot interaction. We conducted an empirical study to investigate the use of negation as a guiding strategy in explanatory human-robot dialogue, in which a virtual robot explains tasks and possible actions to a human explainee to solve them in terms of gestures on a touchscreen. Our results show that negation vs. affirmation 1) increases processing costs measured as reaction time and 2) increases several aspects of task performance. While there was no significant effect of negation on the number of initially correctly executed gestures, we found a significantly lower number of attempts—measured as breaks in the finger movement data before the correct gesture was carried out—when being instructed through a negation. We further found that the gestures significantly resembled the presented prototype gesture more following an instruction with a negation as opposed to an affirmation. Also, the participants rated the benefit of contrastive vs. affirmative explanations significantly higher. Repeating the instructions decreased the effects of negation, yielding similar processing costs and task performance measures for negation and affirmation after several iterations. We discuss our results with respect to possible effects of negation on linguistic processing of explanations and limitations of our study. AU - Groß, A. AU - Singh, Amit AU - Banh, Ngoc Chi AU - Richter, B. AU - Scharlau, Ingrid AU - Rohlfing, Katharina J. AU - Wrede, B. ID - 48543 JF - Frontiers in Robotics and AI KW - HRI KW - XAI KW - negation KW - understanding KW - explaining KW - touch interaction KW - gesture TI - Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue VL - 10 ER - TY - JOUR AB - One of the many purposes for which social robots are designed is education, and there have been many attempts to systematize their potential in this field. What these attempts have in common is the recognition that learning can be supported in a variety of ways because a learner can be engaged in different activities that foster learning. Up to now, three roles have been proposed when designing these activities for robots: as a teacher or tutor, a learning peer, or a novice. Current research proposes that deciding in favor of one role over another depends on the content or preferred pedagogical form. However, the design of activities changes not only the content of learning, but also the nature of a human–robot social relationship. This is particularly important in language acquisition, which has been recognized as a social endeavor. The following review aims to specify the differences in human–robot social relationships when children learn language through interacting with a social robot. After proposing categories for comparing these different relationships, we review established and more specific, innovative roles that a robot can play in language-learning scenarios. This follows Mead’s (1946) theoretical approach proposing that social roles are performed in interactive acts. These acts are crucial for learning, because not only can they shape the social environment of learning but also engage the learner to different degrees. We specify the degree of engagement by referring to Chi’s (2009) progression of learning activities that range from active, constructive, toward interactive with the latter fostering deeper learning. Taken together, this approach enables us to compare and evaluate different human–robot social relationships that arise when applying a robot in a particular social role. AU - Rohlfing, Katharina AU - Altvater-Mackensen, Nicole AU - Caruana, Nathan AU - van den Berghe, Rianne AU - Bruno, Barbara AU - Tolksdorf, Nils Frederik AU - Hanulíková, Adriana ID - 34703 JF - Frontiers in Robotics and AI KW - Artificial Intelligence KW - Computer Science Applications SN - 2296-9144 TI - Social/dialogical roles of social robots in supporting children’s learning of language and literacy—A review and analysis of innovative roles VL - 9 ER - TY - JOUR AB - Pointing is one of the first conventional means of communication and infants have various motives for engaging in it such as imperative, declarative, or informative. Little is known about the developmental paths of producing and understanding these different motives. In our longitudinal study (N = 58) during the second year of life, we experimentally elicited infants’ pointing production and comprehension in various settings and under pragmatically valid conditions. We followed two steps in our analyses and assessed the occurrence of canonical index-finger pointing for different motives and the engagement in an ongoing interaction in pursuit of a joint goal revealed by frequency and multimodal utterances. For understanding the developmental paths, we compared two groups: typically developing infants (TD) and infants who have been assessed as having delayed language development (LD). Results showed that the developmental paths differed according to the various motives. When comparing the two groups, for all motives, LD infants produced index-finger pointing 2 months later than TD infants. For the engagement, although the pattern was less consistent across settings, the frequency of pointing was comparable in both groups, but infants with LD used less canonical forms of pointing and made fewer multimodal contributions than TD children. AU - Rohlfing, Katharina J. AU - Lüke, Carina AU - Liszkowski, Ulf AU - Ritterfeld, Ute AU - Grimminger, Angela ID - 37074 IS - 9 JF - International Journal of Environmental Research and Public Health KW - Health KW - Toxicology and Mutagenesis KW - Public Health KW - Environmental and Occupational Health SN - 1660-4601 TI - Developmental Paths of Pointing for Various Motives in Infants with and without Language Delay VL - 19 ER - TY - CONF AB - In child-robot interaction research, many studies pursue the goal to support children's language development. While research in human-human interaction suggests that changing human partners during children's language learning can reduce their recall performance of the learning content, little is known whether a change in social robots as interaction partners influence children's learning in the same way. In this paper, we present findings from a word learning study, in which we changed the robotic partner for one group of children while the other group interacted with the same robot. Contrary to work with human social partners, we found that children did not retrieve words differently when interacting with different humanoid robots as their social interaction partners. AU - Tolksdorf, Nils Frederik AU - Hönemann, Dirk AU - Viertel, Franziska E. AU - Rohlfing, Katharina ID - 30952 T2 - Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction TI - Who is that?! Does Changing the Robot as a Learning Companion Impact Preschoolers’Language Learning? ER - TY - GEN AU - Banh, Ngoc Chi AU - Scharlau, Ingrid AU - Rohlfing, Katharina J. ED - Bermeitinger, Christina ED - Greve, Werner ID - 46289 T2 - 52. Kongress der Deutschen Gesellschaft für Psychologie TI - Folgen wiederholter Negation auf die Aufmerksamkeit ER - TY - JOUR AB - AbstractRecent approaches to Explainable AI (XAI) promise to satisfy diverse user expectations by allowing them to steer the interaction in order to elicit content relevant to them. However, little is known about how and to what extent the explainee takes part actively in the process of explaining. To tackle this empirical gap, we exploratively examined naturally occurring everyday explanations in doctor–patient interactions (N = 11). Following the social design of XAI, we view explanations as emerging in interactions: first, we identified the verbal behavior of both the explainer and the explainee in the sequential context, which we could assign to phases that were either monological or dialogical; second, we investigated in particular who was responsible for the initiation of the different phases. Finally, we took a closer look at the global conversational structure of explanations by applying a context-sensitive model of organizational jobs, thus adding a third layer of analysis. Results show that in our small sample of conversational explanations, both monological and dialogical phases varied in their length, timing of occurrence (at the early or later stages of the interaction) and their initiation (by the explainer or the explainee). They alternated several times in the course of the interaction. However, we also found some patterns suggesting that all interactions started with a monological phase initiated by the explainer. Both conversational partners contributed to the core organizational job that constitutes an explanation. We interpret the results as an indication for naturally occurring everyday explanations in doctor–patient interactions to be co-constructed on three levels of linguistic description: (1) by switching back and forth between monological to dialogical phases that (2) can be initiated by both partners and (3) by the mutual accomplishment and thus responsibility for an explanation’s core job that is crucial for the success of the explanation. Because of the explorative nature of our study, these results need to be investigated (a) with a larger sample and (b) in other contexts. However, our results suggest that future designs of artificial explainable systems should design the explanatory dialogue in such a way that it includes monological and dialogical phases that can be initiated not only by the explainer but also by the explainee, as both contribute to the core job of explicating procedural, clausal, or conceptual relations in explanations. AU - Fisher, Josephine B. AU - Lohmer, Vivien AU - Kern, Friederike AU - Barthlen, Winfried AU - Gaus, Sebastian AU - Rohlfing, Katharina ID - 51349 IS - 3-4 JF - KI - Künstliche Intelligenz KW - Artificial Intelligence SN - 0933-1875 TI - Exploring Monological and Dialogical Phases in Naturally Occurring Explanations VL - 36 ER - TY - JOUR AB - Modified action demonstration—dubbed motionese—has been proposed as a way to help children recognize the structure and meaning of actions. However, until now, it has been investigated only in young infants. This brief research report presents findings from a cross-sectional study of parental action demonstrations to three groups of 8–11, 12–23, and 24–30-month-old children that applied seven motionese parameters; a second study investigated the youngest group of participants longitudinally to corroborate the cross-sectional results. Results of both studies suggested that four motionese parameters (Motion Pauses, Pace, Velocity, Acceleration) seem to structure the action by organizing it in motion pauses. Whereas these parameters persist over different ages, three other parameters (Demonstration Length, Roundness, and Range) occur predominantly in the younger group and seem to serve to organize infants' attention on the basis of movement. Results are discussed in terms of facilitative vs. pedagogical learning. AU - Rohlfing, Katharina AU - Vollmer, Anna-Lisa AU - Fritsch, Jannik AU - Wrede, Britta ID - 51344 JF - Frontiers in Communication KW - Social Sciences (miscellaneous) KW - Communication SN - 2297-900X TI - Which “motionese” parameters change with children's age? Disentangling attention-getting from action-structuring modifications VL - 7 ER - TY - JOUR AU - Scharlau, Ingrid AU - Karsten, A. AU - Rohlfing, Katharina J. ID - 31680 IS - vol. 12 issue 3 JF - Journal of Writing Research KW - Literature and Literary Theory KW - Linguistics and Language KW - Language and Linguistics KW - Education SN - 2030-1006 TI - Building, emptying out, or dreaming? Action structures and space in students’ metaphors of academic writing VL - 12 ER - TY - JOUR AB - Social robots have emerged as a new digital technology that is increasingly being implemented in the educational landscape. While social robots could be deployed to assist young children with their learning in a variety of different ways, the typical approach in educational practices is to supplement the learning process rather than to replace the human caregiver, e.g., the teacher, parent, educator or therapist. When functioning in the role of an educational assistant, social robots will likely constitute a part of a triadic interaction with the child and the human caregiver. Surprisingly, there is little research that systematically investigates the role of the caregiver by examining the ways in which children involve or check in with them during their interaction with another partnera phenomenon that is known as social referencing. In the present study, we investigated social referencing in the context of a dyadic child–robot interaction. Over the course of four sessions within our longitudinal language-learning study, we observed how 20 pre-school children aged 4–5 years checked in with their accompanying caregivers who were not actively involved in the language-learning procedure. The children participating in the study were randomly assigned to either an interaction with a social robot or a human partner. Our results revealed that all children across both conditions utilized social referencing behaviors to address their caregiver. However, we found that the children who interacted with the social robot did so significantly more frequently in each of the four sessions than those who interacted with the human partner. Further analyses showed that no significant change in their behavior over the course of the sessions could be observed. Findings are discussed with regard to the caregiver's role during children's interactions with social robots and the implications for future interaction design. AU - Tolksdorf, Nils Frederik AU - Crawshaw, Camilla E. AU - Rohlfing, Katharina J. ID - 24902 JF - Frontiers in Education SN - 2504-284X TI - Comparing the Effects of a Different Social Partner (Social Robot vs. Human) on Children's Social Referencing in Interaction ER - TY - CONF AU - Tolksdorf, Nils Frederik AU - Viertel, Fanziska E. AU - Crawshaw, Camilla E. AU - Rohlfing, Katharina J. ID - 24900 T2 - Interaction Design and Children TI - Do Shy Children Keep more Distance from a Social Robot? Exploring Shy Children’s Proxemics with a Social Robot or a Human ER - TY - JOUR AB - Social robots have emerged as a new digital technology that is increasingly being implemented in the educational landscape. While social robots could be deployed to assist young children with their learning in a variety of different ways, the typical approach in educational practices is to supplement the learning process rather than to replace the human caregiver, e.g., the teacher, parent, educator or therapist. When functioning in the role of an educational assistant, social robots will likely constitute a part of a triadic interaction with the child and the human caregiver. Surprisingly, there is little research that systematically investigates the role of the caregiver by examining the ways in which children involve or check in with them during their interaction with another partnera phenomenon that is known as social referencing. In the present study, we investigated social referencing in the context of a dyadic child–robot interaction. Over the course of four sessions within our longitudinal language-learning study, we observed how 20 pre-school children aged 4–5 years checked in with their accompanying caregivers who were not actively involved in the language-learning procedure. The children participating in the study were randomly assigned to either an interaction with a social robot or a human partner. Our results revealed that all children across both conditions utilized social referencing behaviors to address their caregiver. However, we found that the children who interacted with the social robot did so significantly more frequently in each of the four sessions than those who interacted with the human partner. Further analyses showed that no significant change in their behavior over the course of the sessions could be observed. Findings are discussed with regard to the caregiver's role during children's interactions with social robots and the implications for future interaction design. AU - Tolksdorf, Nils F. AU - Crawshaw, Camilla E. AU - Rohlfing, Katharina ID - 37185 JF - Frontiers in Education KW - Education SN - 2504-284X TI - Comparing the Effects of a Different Social Partner (Social Robot vs. Human) on Children's Social Referencing in Interaction VL - 5 ER - TY - JOUR AU - Rohlfing, Katharina AU - Mertens, Ulrich ID - 37184 JF - Frontiers in Psychology TI - Progressive Reduction of Iconic Gestures Contributes to School-Aged Children’s Increased Word Production ER - TY - JOUR AB - Temperamental traits can decisively influence how children enter into social interaction with their environment. Yet, in the field of child–robot interaction, little is known about how individual differences such as shyness impact on how children interact with social robots in educational settings. The present study systematically assessed the temperament of 28 preschool children aged 4–5 years in order to investigate the role of shyness within a dyadic child–robot interaction. Over the course of four consecutive sessions, we observed how shy compared to nonshy children interacted with a social robot during a word-learning educational setting and how shyness influenced children’s learning outcomes. Overall, results suggested that shy children not only interacted differently with a robot compared to nonshy children, but also changed their behavior over the course of the sessions. Critically, shy children interacted less expressively with the robot in general. With regard to children’s language learning outcomes, shy children scored lower on an initial posttest, but were able to close this gap on a later test, resulting in all children retrieving the learned words on a similar level. When intertest learning gain was considered, regression analyses even confirmed a positive predictive role of shyness on language learning gains. Findings are discussed with regard to the role of shyness in educational settings with social robots and the implications for future interaction design. AU - Tolksdorf, Nils Frederik AU - Viertel, Franziska E. AU - Rohlfing, Katharina J. ID - 24899 JF - Frontiers in Robotics and AI SN - 2296-9144 TI - Do Shy Preschoolers Interact Differently When Learning Language With a Social Robot? An Analysis of Interactional Behavior and Word Learning ER - TY - JOUR AB - AbstractIn child–robot interaction (cHRI) research, many studies pursue the goal to develop interactive systems that can be applied in everyday settings. For early education, increasingly, the setting of a kindergarten is targeted. However, when cHRI and research are brought into a kindergarten, a range of ethical and related procedural aspects have to be considered and dealt with. While ethical models elaborated within other human–robot interaction settings, e.g., assisted living contexts, can provide some important indicators for relevant issues, we argue that it is important to start developing a systematic approach to identify and tackle those ethical issues which rise with cHRI in kindergarten settings on a more global level and address the impact of the technology from a macroperspective beyond the effects on the individual. Based on our experience in conducting studies with children in general and pedagogical considerations on the role of the institution of kindergarten in specific, in this paper, we enfold some relevant aspects that have barely been addressed in an explicit way in current cHRI research. Four areas are analyzed and key ethical issues are identified in each area: (1) the institutional setting of a kindergarten, (2) children as a vulnerable group, (3) the caregivers’ role, and (4) pedagogical concepts. With our considerations, we aim at (i) broadening the methodology of the current studies within the area of cHRI, (ii) revalidate it based on our comprehensive empirical experience with research in kindergarten settings, both laboratory and real-world contexts, and (iii) provide a framework for the development of a more systematic approach to address the ethical issues in cHRI research within kindergarten settings. AU - Tolksdorf, Nils Frederik AU - Siebert, Scarlet AU - Zorn, Isabel AU - Horwath, Ilona AU - Rohlfing, Katharina J. ID - 24901 JF - International Journal of Social Robotics SN - 1875-4791 TI - Ethical Considerations of Applying Robots in Kindergarten Settings: Towards an Approach from a Macroperspective ER - TY - JOUR AB - One objective of current research in explainable intelligent systems is to implement social aspects in order to increase the relevance of explanations. In this paper, we argue that a novel conceptual framework is needed to overcome shortcomings of existing AI systems with little attention to processes of interaction and learning. Drawing from research in interaction and development, we first outline the novel conceptual framework that pushes the design of AI systems toward true interactivity with an emphasis on the role of the partner and social relevance. We propose that AI systems will be able to provide a meaningful and relevant explanation only if the process of explaining is extended to active contribution of both partners that brings about dynamics that is modulated by different levels of analysis. Accordingly, our conceptual framework comprises monitoring and scaffolding as key concepts and claims that the process of explaining is not only modulated by the interaction between explainee and explainer but is embedded into a larger social context in which conventionalized and routinized behaviors are established. We discuss our conceptual framework in relation to the established objectives of transparency and autonomy that are raised for the design of explainable AI systems currently. AU - Rohlfing, Katharina J. AU - Cimiano, Philipp AU - Scharlau, Ingrid AU - Matzner, Tobias AU - Buhl, Heike M. AU - Buschmeier, Hendrik AU - Esposito, Elena AU - Grimminger, Angela AU - Hammer, Barbara AU - Haeb-Umbach, Reinhold AU - Horwath, Ilona AU - Hüllermeier, Eyke AU - Kern, Friederike AU - Kopp, Stefan AU - Thommes, Kirsten AU - Ngonga Ngomo, Axel-Cyrille AU - Schulte, Carsten AU - Wachsmuth, Henning AU - Wagner, Petra AU - Wrede, Britta ID - 24456 IS - 3 JF - IEEE Transactions on Cognitive and Developmental Systems KW - Explainability KW - process ofexplaining andunderstanding KW - explainable artificial systems SN - 2379-8920 TI - Explanation as a Social Practice: Toward a Conceptual Framework for the Social Design of AI Systems VL - 13 ER - TY - JOUR AB - The aim of the present study is to bring new momentum into research on students’ understanding of academic writing. Drawing on the idea that metaphors give insight into implicit conceptions of abstract entities and processes, we developed a detailed and differentiated set of conceptual metaphors that can be used to study student ideas about writing in research, teaching, and interventions. A large sample of undergraduates produced their everyday understanding of writing in short texts beginning with a self-generated metaphor. Based on theories from cognitive linguistics, the conceptual metaphors in their texts were analyzed in terms of their action quality (transitivity) and spatiality (spatial primitives). The undergraduates’ conceptualizations were very heterogeneous. Most metaphors depart strongly from scientific approaches to academic writing within cognitive psychology and sociocultural theory. Roughly half of the metaphors could be collated to one of four metaphor systems. Depending on the desired degree of abstraction or concreteness, conceptual metaphors or metaphor systems can be employed in further studies to illuminate thinking about writing. AU - Scharlau, Ingrid AU - Karsten, Andrea AU - Rohlfing, Katharina ID - 28696 IS - 3 JF - Journal of Writing Research KW - metaphor analysis KW - academic writing KW - transitivity KW - spatial primitives SN - 2030-1006 TI - Building, emptying out, or dreaming? Action structures and space in undergraduates’ metaphors of academic writing VL - 12 ER - TY - CONF AU - Tolksdorf, Nils Frederik AU - Viertel, Fanziska AU - Rohlfing, Katharina J. ID - 24903 T2 - Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction TI - Do Shy Children Behave Differently than Non-shy Children in a Long-term Child-robot Interaction? ER - TY - CONF AU - Tolksdorf, Nils Frederik AU - Rohlfing, Katharina J. ID - 24904 T2 - 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) TI - Parents’ Views on Using Social Robots for Language Learning ER -