---
_id: '61432'
abstract:
- lang: eng
text: 'This study investigated how action histories – unfolding sequences of actions
with objects – provide a context for both attentional allocation and linguistic
repair strategies. Building on theories of enactive cognition and sensorimotor
contingency theory, we experimentally manipulated action sequences (action history)
to create either simple or rich “situational models,” and investigated how these
models interact with attention and reflect in linguistic processes during human–robot
interaction. Participants (N = 30) engaged in a controlled object placement task
with a humanoid robot, where the action (manner) information was either provided
or omitted. The omission elicited repair behaviors in participants that were in
focus of our investigation. For rich models (competing action possibilities) participants
demonstrated: a) increased attentional reorientation, reflecting active engagement
with the situational model b) preference for restricted repairs, targeting the
specific source of trouble in action selection. Conversely, a simple situational
model led to more generalized attention patterns and open repair strategies, suggesting
weaker constraints on internal processing. These findings highlight how situational
structures emerge externally to scaffold internal cognitive processes, with action
histories serving as a crucial context for the interface between perception, action,
and language. We discuss how to implement such a tight loop in the assistance
of a system.'
author:
- first_name: Amit
full_name: Singh, Amit
id: '91018'
last_name: Singh
orcid: 0000-0002-7789-1521
- first_name: Katharina J.
full_name: Rohlfing, Katharina J.
id: '50352'
last_name: Rohlfing
orcid: 0000-0002-5676-8233
citation:
ama: 'Singh A, Rohlfing KJ. Manners Matter: Action history guides attention and
repair choices during interaction. In: IEEE International Conference on Development
and Learning (ICDL). ; 2025. doi:10.31234/osf.io/yn2we_v1'
apa: 'Singh, A., & Rohlfing, K. J. (2025). Manners Matter: Action history guides
attention and repair choices during interaction. IEEE International Conference
on Development and Learning (ICDL). IEEE International Conference on Development
and Learning (ICDL), Prague. https://doi.org/10.31234/osf.io/yn2we_v1'
bibtex: '@inproceedings{Singh_Rohlfing_2025, place={ Prague}, title={Manners Matter:
Action history guides attention and repair choices during interaction}, DOI={10.31234/osf.io/yn2we_v1},
booktitle={IEEE International Conference on Development and Learning (ICDL)},
author={Singh, Amit and Rohlfing, Katharina J.}, year={2025} }'
chicago: 'Singh, Amit, and Katharina J. Rohlfing. “Manners Matter: Action History
Guides Attention and Repair Choices during Interaction.” In IEEE International
Conference on Development and Learning (ICDL). Prague, 2025. https://doi.org/10.31234/osf.io/yn2we_v1.'
ieee: 'A. Singh and K. J. Rohlfing, “Manners Matter: Action history guides attention
and repair choices during interaction,” presented at the IEEE International Conference
on Development and Learning (ICDL), Prague, 2025, doi: 10.31234/osf.io/yn2we_v1.'
mla: 'Singh, Amit, and Katharina J. Rohlfing. “Manners Matter: Action History Guides
Attention and Repair Choices during Interaction.” IEEE International Conference
on Development and Learning (ICDL), 2025, doi:10.31234/osf.io/yn2we_v1.'
short: 'A. Singh, K.J. Rohlfing, in: IEEE International Conference on Development
and Learning (ICDL), Prague, 2025.'
conference:
end_date: 2025-09-19
location: Prague
name: IEEE International Conference on Development and Learning (ICDL)
start_date: 2025-09-15
date_created: 2025-09-24T12:32:52Z
date_updated: 2025-09-24T12:39:25Z
department:
- _id: '749'
- _id: '660'
doi: 10.31234/osf.io/yn2we_v1
keyword:
- Attention
- Action
- Repairs
- Task model
- HRI
- Eyemovement
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://doi.org/10.31234/osf.io/yn2we_v1
oa: '1'
place: ' Prague'
project:
- _id: '115'
name: 'TRR 318; TP A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog'
publication: IEEE International Conference on Development and Learning (ICDL)
publication_status: published
quality_controlled: '1'
status: public
title: 'Manners Matter: Action history guides attention and repair choices during
interaction'
type: conference
user_id: '91018'
year: '2025'
...
---
_id: '56660'
abstract:
- lang: eng
text: In a successful dialogue in general and a successful explanation in specific,
partners need to account for both, the task model (what is relevant for the task)
and the partner model (what one can con- tribute). The phenomenon of coupling
between task and the partner model becomes especially interesting in the context
of Human– Robot Interaction where humans have to deal with unknown ca- pabilities
of the robot, which can momentarily be perceived when the robot is unable to contribute
to the task. Following research on the path over manner prominence in an action
[31–33], a robot ex- plained actions to a human by emphasizing two aspects – the
path ("where" component) and the manner ("how" component). On criti- cal trials,
the robot occasionally omitted one of these components where participants sought
missing information for the path or the manner. Participants’ information-seeking
and gaze behaviour were analysed. Analysis confirms the initial predictions for,
a) task model (path over manner prominence), i.e., earlier information-seeking
for path-missing than manner-missing trials, and b) partner model, i.e., while
information-seeking is predominantly tied to the attention on the robot’s face,
when robot fails to provide resolution, attention shifts more often towards its
torso – a behavior likely to indicate an exploration of the robot’s capabilities.
An individual-level anal- ysis further confirms that the intra-individual variation
in the task model is partly influenced by the perceived capability of the robot.
author:
- first_name: Amit
full_name: Singh, Amit
id: '91018'
last_name: Singh
orcid: 0000-0002-7789-1521
- first_name: Katharina J.
full_name: Rohlfing, Katharina J.
id: '50352'
last_name: Rohlfing
citation:
ama: 'Singh A, Rohlfing KJ. Coupling of Task and Partner Model: Investigating the
Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue.
In: Proceedings of 26th ACM International Conference on Multimodal Interaction
(ICMI 2024). ; 2024. doi:10.1145/3686215.3689202'
apa: 'Singh, A., & Rohlfing, K. J. (2024). Coupling of Task and Partner Model:
Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory
Dialogue. Proceedings of 26th ACM International Conference on Multimodal Interaction
(ICMI 2024). 26th ACM International Conference on Multimodal Interaction (ICMI
2024), San Jose, Costa Rica. https://doi.org/10.1145/3686215.3689202'
bibtex: '@inproceedings{Singh_Rohlfing_2024, title={Coupling of Task and Partner
Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot
Explanatory Dialogue}, DOI={10.1145/3686215.3689202},
booktitle={Proceedings of 26th ACM International Conference on Multimodal Interaction
(ICMI 2024)}, author={Singh, Amit and Rohlfing, Katharina J.}, year={2024} }'
chicago: 'Singh, Amit, and Katharina J. Rohlfing. “Coupling of Task and Partner
Model: Investigating the Intra-Individual Variability in Gaze during Human–Robot
Explanatory Dialogue.” In Proceedings of 26th ACM International Conference
on Multimodal Interaction (ICMI 2024), 2024. https://doi.org/10.1145/3686215.3689202.'
ieee: 'A. Singh and K. J. Rohlfing, “Coupling of Task and Partner Model: Investigating
the Intra-Individual Variability in Gaze during Human–Robot Explanatory Dialogue,”
presented at the 26th ACM International Conference on Multimodal Interaction (ICMI
2024), San Jose, Costa Rica, 2024, doi: 10.1145/3686215.3689202.'
mla: 'Singh, Amit, and Katharina J. Rohlfing. “Coupling of Task and Partner Model:
Investigating the Intra-Individual Variability in Gaze during Human–Robot Explanatory
Dialogue.” Proceedings of 26th ACM International Conference on Multimodal Interaction
(ICMI 2024), 2024, doi:10.1145/3686215.3689202.'
short: 'A. Singh, K.J. Rohlfing, in: Proceedings of 26th ACM International Conference
on Multimodal Interaction (ICMI 2024), 2024.'
conference:
location: San Jose, Costa Rica
name: 26th ACM International Conference on Multimodal Interaction (ICMI 2024)
date_created: 2024-10-17T09:35:32Z
date_updated: 2024-11-06T10:56:34Z
ddc:
- '410'
department:
- _id: '749'
- _id: '660'
doi: 10.1145/3686215.3689202
has_accepted_license: '1'
keyword:
- Explanation
- Scaffolding
- Eyetracking
- Partner Model
- HRI
language:
- iso: eng
project:
- _id: '115'
grant_number: '438445824'
name: 'TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog
(Teilprojekt A05)'
publication: Proceedings of 26th ACM International Conference on Multimodal Interaction
(ICMI 2024)
status: public
title: 'Coupling of Task and Partner Model: Investigating the Intra-Individual Variability
in Gaze during Human–Robot Explanatory Dialogue'
type: conference
user_id: '91018'
year: '2024'
...
---
_id: '55394'
abstract:
- lang: eng
text: Nowadays we deal with robots and AI more and more in our everyday life. However,
their behavior is not always apparent to most lay users, especially in error situations.
This can lead to misconceptions about the behavior of the technologies being used.
This in turn can lead to misuse and rejection by users. Explanation, for example
through transparency, can address these misconceptions. However, explaining the
entire software or hardware would be confusing and overwhelming for users. Therefore,
this paper focuses on the ‘enabling’ architecture. It describes those aspects
of a robotic system that may need to be explained to enable someone to use the
technology effectively. Furthermore, this paper deals with the ‘explanandum’,
i.e. the corresponding misunderstandings or missing concepts of the enabling architecture
that need to be clarified. Thus, we have developed and are presenting an approach
to determine the ‘enabling’ architecture and the resulting ‘explanandum’ of complex
technologies.
article_type: original
author:
- first_name: Helen
full_name: Beierling, Helen
last_name: Beierling
- first_name: Phillip
full_name: Richter, Phillip
last_name: Richter
- first_name: Mara
full_name: Brandt, Mara
last_name: Brandt
- first_name: Lutz
full_name: Terfloth, Lutz
last_name: Terfloth
- first_name: Carsten
full_name: Schulte, Carsten
last_name: Schulte
- first_name: Heiko
full_name: Wersing, Heiko
last_name: Wersing
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
last_name: Vollmer
citation:
ama: 'Beierling H, Richter P, Brandt M, et al. What you need to know about a learning
robot: Identifying the enabling architecture of complex systems. Cognitive
Systems Research. 2024;88.'
apa: 'Beierling, H., Richter, P., Brandt, M., Terfloth, L., Schulte, C., Wersing,
H., & Vollmer, A.-L. (2024). What you need to know about a learning robot:
Identifying the enabling architecture of complex systems. Cognitive Systems
Research, 88.'
bibtex: '@article{Beierling_Richter_Brandt_Terfloth_Schulte_Wersing_Vollmer_2024,
title={What you need to know about a learning robot: Identifying the enabling
architecture of complex systems}, volume={88}, journal={Cognitive Systems Research},
publisher={Elsevier}, author={Beierling, Helen and Richter, Phillip and Brandt,
Mara and Terfloth, Lutz and Schulte, Carsten and Wersing, Heiko and Vollmer, Anna-Lisa},
year={2024} }'
chicago: 'Beierling, Helen, Phillip Richter, Mara Brandt, Lutz Terfloth, Carsten
Schulte, Heiko Wersing, and Anna-Lisa Vollmer. “What You Need to Know about a
Learning Robot: Identifying the Enabling Architecture of Complex Systems.” Cognitive
Systems Research 88 (2024).'
ieee: 'H. Beierling et al., “What you need to know about a learning robot:
Identifying the enabling architecture of complex systems,” Cognitive Systems
Research, vol. 88, 2024.'
mla: 'Beierling, Helen, et al. “What You Need to Know about a Learning Robot: Identifying
the Enabling Architecture of Complex Systems.” Cognitive Systems Research,
vol. 88, Elsevier, 2024.'
short: H. Beierling, P. Richter, M. Brandt, L. Terfloth, C. Schulte, H. Wersing,
A.-L. Vollmer, Cognitive Systems Research 88 (2024).
date_created: 2024-07-26T08:01:23Z
date_updated: 2025-09-17T13:32:31Z
ddc:
- '006'
file:
- access_level: closed
content_type: application/pdf
creator: helebeen
date_created: 2025-09-17T13:31:11Z
date_updated: 2025-09-17T13:31:11Z
file_id: '61330'
file_name: mentaleModelle.pdf
file_size: 1577897
relation: main_file
success: 1
file_date_updated: 2025-09-17T13:31:11Z
funded_apc: '1'
has_accepted_license: '1'
intvolume: ' 88'
keyword:
- Robotics HRI Explainability Didactics Didactic reconstruction
language:
- iso: eng
main_file_link:
- open_access: '1'
oa: '1'
project:
- _id: '123'
name: 'TRR 318 - B5: TRR 318 - Subproject B5'
publication: Cognitive Systems Research
publication_status: published
publisher: Elsevier
status: public
title: 'What you need to know about a learning robot: Identifying the enabling architecture
of complex systems'
type: journal_article
user_id: '50995'
volume: 88
year: '2024'
...
---
_id: '48543'
abstract:
- lang: eng
text: Explanation has been identified as an important capability for AI-based systems,
but research on systematic strategies for achieving understanding in interaction
with such systems is still sparse. Negation is a linguistic strategy that is often
used in explanations. It creates a contrast space between the affirmed and the
negated item that enriches explaining processes with additional contextual information.
While negation in human speech has been shown to lead to higher processing costs
and worse task performance in terms of recall or action execution when used in
isolation, it can decrease processing costs when used in context. So far, it has
not been considered as a guiding strategy for explanations in human-robot interaction.
We conducted an empirical study to investigate the use of negation as a guiding
strategy in explanatory human-robot dialogue, in which a virtual robot explains
tasks and possible actions to a human explainee to solve them in terms of gestures
on a touchscreen. Our results show that negation vs. affirmation 1) increases
processing costs measured as reaction time and 2) increases several aspects of
task performance. While there was no significant effect of negation on the number
of initially correctly executed gestures, we found a significantly lower number
of attempts—measured as breaks in the finger movement data before the correct
gesture was carried out—when being instructed through a negation. We further found
that the gestures significantly resembled the presented prototype gesture more
following an instruction with a negation as opposed to an affirmation. Also, the
participants rated the benefit of contrastive vs. affirmative explanations significantly
higher. Repeating the instructions decreased the effects of negation, yielding
similar processing costs and task performance measures for negation and affirmation
after several iterations. We discuss our results with respect to possible effects
of negation on linguistic processing of explanations and limitations of our study.
article_type: original
author:
- first_name: A.
full_name: Groß, A.
last_name: Groß
- first_name: Amit
full_name: Singh, Amit
id: '91018'
last_name: Singh
orcid: 0000-0002-7789-1521
- first_name: Ngoc Chi
full_name: Banh, Ngoc Chi
id: '38219'
last_name: Banh
orcid: 0000-0002-5946-4542
- first_name: B.
full_name: Richter, B.
last_name: Richter
- first_name: Ingrid
full_name: Scharlau, Ingrid
id: '451'
last_name: Scharlau
orcid: 0000-0003-2364-9489
- first_name: Katharina J.
full_name: Rohlfing, Katharina J.
id: '50352'
last_name: Rohlfing
- first_name: B.
full_name: Wrede, B.
last_name: Wrede
citation:
ama: Groß A, Singh A, Banh NC, et al. Scaffolding the human partner by contrastive
guidance in an explanatory human-robot dialogue. Frontiers in Robotics and
AI. 2023;10. doi:10.3389/frobt.2023.1236184
apa: Groß, A., Singh, A., Banh, N. C., Richter, B., Scharlau, I., Rohlfing, K. J.,
& Wrede, B. (2023). Scaffolding the human partner by contrastive guidance
in an explanatory human-robot dialogue. Frontiers in Robotics and AI, 10.
https://doi.org/10.3389/frobt.2023.1236184
bibtex: '@article{Groß_Singh_Banh_Richter_Scharlau_Rohlfing_Wrede_2023, title={Scaffolding
the human partner by contrastive guidance in an explanatory human-robot dialogue},
volume={10}, DOI={10.3389/frobt.2023.1236184},
journal={Frontiers in Robotics and AI}, author={Groß, A. and Singh, Amit and Banh,
Ngoc Chi and Richter, B. and Scharlau, Ingrid and Rohlfing, Katharina J. and Wrede,
B.}, year={2023} }'
chicago: Groß, A., Amit Singh, Ngoc Chi Banh, B. Richter, Ingrid Scharlau, Katharina
J. Rohlfing, and B. Wrede. “Scaffolding the Human Partner by Contrastive Guidance
in an Explanatory Human-Robot Dialogue.” Frontiers in Robotics and AI 10
(2023). https://doi.org/10.3389/frobt.2023.1236184.
ieee: 'A. Groß et al., “Scaffolding the human partner by contrastive guidance
in an explanatory human-robot dialogue,” Frontiers in Robotics and AI,
vol. 10, 2023, doi: 10.3389/frobt.2023.1236184.'
mla: Groß, A., et al. “Scaffolding the Human Partner by Contrastive Guidance in
an Explanatory Human-Robot Dialogue.” Frontiers in Robotics and AI, vol.
10, 2023, doi:10.3389/frobt.2023.1236184.
short: A. Groß, A. Singh, N.C. Banh, B. Richter, I. Scharlau, K.J. Rohlfing, B.
Wrede, Frontiers in Robotics and AI 10 (2023).
date_created: 2023-10-30T09:29:16Z
date_updated: 2024-06-26T08:01:50Z
department:
- _id: '749'
doi: 10.3389/frobt.2023.1236184
funded_apc: '1'
intvolume: ' 10'
keyword:
- HRI
- XAI
- negation
- understanding
- explaining
- touch interaction
- gesture
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://www.frontiersin.org/articles/10.3389/frobt.2023.1236184/full
oa: '1'
project:
- _id: '115'
grant_number: '438445824'
name: 'TRR 318 - A05: TRR 318 - Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog
(Teilprojekt A05)'
publication: Frontiers in Robotics and AI
publication_status: published
quality_controlled: '1'
status: public
title: Scaffolding the human partner by contrastive guidance in an explanatory human-robot
dialogue
type: journal_article
user_id: '38219'
volume: 10
year: '2023'
...
---
_id: '17182'
abstract:
- lang: eng
text: Co-development of action, conceptualization and social interaction mutually
scaffold and support each other within a virtuous feedback cycle in the development
of human language in children. Within this framework, the purpose of this article
is to bring together diverse but complementary accounts of research methods that
jointly contribute to our understanding of cognitive development and in particular,
language acquisition in robots. Thus, we include research pertaining to developmental
robotics, cognitive science, psychology, linguistics and neuroscience, as well
as practical computer science and engineering. The different studies are not at
this stage all connected into a cohesive whole; rather, they are presented to
illuminate the need for multiple different approaches that complement each other
in the pursuit of understanding cognitive development in robots. Extensive experiments
involving the humanoid robot iCub are reported, while human learning relevant
to developmental robotics has also contributed useful results. Disparate approaches
are brought together via common underlying design principles. Without claiming
to model human language acquisition directly, we are nonetheless inspired by analogous
development in humans and consequently, our investigations include the parallel
co-development of action, conceptualization and social interaction. Though these
different approaches need to ultimately be integrated into a coherent, unified
body of knowledge, progress is currently also being made by pursuing individual
methods.
author:
- first_name: Caroline
full_name: Lyon, Caroline
last_name: Lyon
- first_name: Chrystopher L.
full_name: Nehaniv, Chrystopher L.
last_name: Nehaniv
- first_name: Joe
full_name: Saunders, Joe
last_name: Saunders
- first_name: Tony
full_name: Belpaeme, Tony
last_name: Belpaeme
- first_name: Ambra
full_name: Bisio, Ambra
last_name: Bisio
- first_name: Kerstin
full_name: Fischer, Kerstin
last_name: Fischer
- first_name: Frank
full_name: Forster, Frank
last_name: Forster
- first_name: Hagen
full_name: Lehmann, Hagen
last_name: Lehmann
- first_name: Giorgio
full_name: Metta, Giorgio
last_name: Metta
- first_name: Vishwanathan
full_name: Mohan, Vishwanathan
last_name: Mohan
- first_name: Anthony
full_name: Morse, Anthony
last_name: Morse
- first_name: Stefano
full_name: Nolfi, Stefano
last_name: Nolfi
- first_name: Francesco
full_name: Nori, Francesco
last_name: Nori
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Alessandra
full_name: Sciutti, Alessandra
last_name: Sciutti
- first_name: Jun
full_name: Tani, Jun
last_name: Tani
- first_name: Elio
full_name: Tuci, Elio
last_name: Tuci
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
- first_name: Arne
full_name: Zeschel, Arne
last_name: Zeschel
- first_name: Angelo
full_name: Cangelosi, Angelo
last_name: Cangelosi
citation:
ama: 'Lyon C, Nehaniv CL, Saunders J, et al. Embodied Language Learning and Cognitive
Bootstrapping: Methods and Design Principles. International Journal of Advanced
Robotic Systems. 2016;13(3). doi:10.5772/63462'
apa: 'Lyon, C., Nehaniv, C. L., Saunders, J., Belpaeme, T., Bisio, A., Fischer,
K., Forster, F., Lehmann, H., Metta, G., Mohan, V., Morse, A., Nolfi, S., Nori,
F., Rohlfing, K., Sciutti, A., Tani, J., Tuci, E., Wrede, B., Zeschel, A., &
Cangelosi, A. (2016). Embodied Language Learning and Cognitive Bootstrapping:
Methods and Design Principles. International Journal of Advanced Robotic Systems,
13(3). https://doi.org/10.5772/63462'
bibtex: '@article{Lyon_Nehaniv_Saunders_Belpaeme_Bisio_Fischer_Forster_Lehmann_Metta_Mohan_et
al._2016, title={Embodied Language Learning and Cognitive Bootstrapping: Methods
and Design Principles}, volume={13}, DOI={10.5772/63462},
number={3}, journal={International Journal of Advanced Robotic Systems}, publisher={Intech
Europe}, author={Lyon, Caroline and Nehaniv, Chrystopher L. and Saunders, Joe
and Belpaeme, Tony and Bisio, Ambra and Fischer, Kerstin and Forster, Frank and
Lehmann, Hagen and Metta, Giorgio and Mohan, Vishwanathan and et al.}, year={2016}
}'
chicago: 'Lyon, Caroline, Chrystopher L. Nehaniv, Joe Saunders, Tony Belpaeme, Ambra
Bisio, Kerstin Fischer, Frank Forster, et al. “Embodied Language Learning and
Cognitive Bootstrapping: Methods and Design Principles.” International Journal
of Advanced Robotic Systems 13, no. 3 (2016). https://doi.org/10.5772/63462.'
ieee: 'C. Lyon et al., “Embodied Language Learning and Cognitive Bootstrapping:
Methods and Design Principles,” International Journal of Advanced Robotic Systems,
vol. 13, no. 3, 2016, doi: 10.5772/63462.'
mla: 'Lyon, Caroline, et al. “Embodied Language Learning and Cognitive Bootstrapping:
Methods and Design Principles.” International Journal of Advanced Robotic Systems,
vol. 13, no. 3, Intech Europe, 2016, doi:10.5772/63462.'
short: C. Lyon, C.L. Nehaniv, J. Saunders, T. Belpaeme, A. Bisio, K. Fischer, F.
Forster, H. Lehmann, G. Metta, V. Mohan, A. Morse, S. Nolfi, F. Nori, K. Rohlfing,
A. Sciutti, J. Tani, E. Tuci, B. Wrede, A. Zeschel, A. Cangelosi, International
Journal of Advanced Robotic Systems 13 (2016).
date_created: 2020-06-24T13:00:58Z
date_updated: 2023-02-01T16:04:48Z
department:
- _id: '749'
doi: 10.5772/63462
intvolume: ' 13'
issue: '3'
keyword:
- Robot Language
- Human Robot Interaction
- HRI
- Developmental Robotics
- Cognitive Bootstrapping
- Statistical Learning
language:
- iso: eng
publication: International Journal of Advanced Robotic Systems
publication_identifier:
issn:
- 1729-8814
publisher: Intech Europe
status: public
title: 'Embodied Language Learning and Cognitive Bootstrapping: Methods and Design
Principles'
type: journal_article
user_id: '14931'
volume: 13
year: '2016'
...
---
_id: '17233'
abstract:
- lang: eng
text: 'It has been proposed that the design of robots might benefit from interactions
that are similar to caregiver–child interactions, which is tailored to children’s
respective capacities to a high degree. However, so far little is known about
how people adapt their tutoring behaviour to robots and whether robots can evoke
input that is similar to child-directed interaction. The paper presents detailed
analyses of speakers’ linguistic and non-linguistic behaviour, such as action
demonstration, in two comparable situations: In one experiment, parents described
and explained to their nonverbal infants the use of certain everyday objects;
in the other experiment, participants tutored a simulated robot on the same objects.
The results, which show considerable differences between the two situations on
almost all measures, are discussed in the light of the computer-as-social-actor
paradigm and the register hypothesis.'
author:
- first_name: Kerstin
full_name: Fischer, Kerstin
last_name: Fischer
- first_name: Kilian
full_name: Foth, Kilian
last_name: Foth
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
citation:
ama: 'Fischer K, Foth K, Rohlfing K, Wrede B. Mindful tutors: Linguistic choice
and action demonstration in speech to infants and a simulated robot. Interaction
Studies. 2011;12(1):134-161. doi:10.1075/is.12.1.06fis'
apa: 'Fischer, K., Foth, K., Rohlfing, K., & Wrede, B. (2011). Mindful tutors:
Linguistic choice and action demonstration in speech to infants and a simulated
robot. Interaction Studies, 12(1), 134–161. https://doi.org/10.1075/is.12.1.06fis'
bibtex: '@article{Fischer_Foth_Rohlfing_Wrede_2011, title={Mindful tutors: Linguistic
choice and action demonstration in speech to infants and a simulated robot}, volume={12},
DOI={10.1075/is.12.1.06fis},
number={1}, journal={Interaction Studies}, publisher={John Benjamins Publishing
Company}, author={Fischer, Kerstin and Foth, Kilian and Rohlfing, Katharina and
Wrede, Britta}, year={2011}, pages={134–161} }'
chicago: 'Fischer, Kerstin, Kilian Foth, Katharina Rohlfing, and Britta Wrede. “Mindful
Tutors: Linguistic Choice and Action Demonstration in Speech to Infants and a
Simulated Robot.” Interaction Studies 12, no. 1 (2011): 134–61. https://doi.org/10.1075/is.12.1.06fis.'
ieee: 'K. Fischer, K. Foth, K. Rohlfing, and B. Wrede, “Mindful tutors: Linguistic
choice and action demonstration in speech to infants and a simulated robot,” Interaction
Studies, vol. 12, no. 1, pp. 134–161, 2011, doi: 10.1075/is.12.1.06fis.'
mla: 'Fischer, Kerstin, et al. “Mindful Tutors: Linguistic Choice and Action Demonstration
in Speech to Infants and a Simulated Robot.” Interaction Studies, vol.
12, no. 1, John Benjamins Publishing Company, 2011, pp. 134–61, doi:10.1075/is.12.1.06fis.'
short: K. Fischer, K. Foth, K. Rohlfing, B. Wrede, Interaction Studies 12 (2011)
134–161.
date_created: 2020-06-24T13:01:57Z
date_updated: 2023-02-01T12:56:04Z
department:
- _id: '749'
doi: 10.1075/is.12.1.06fis
intvolume: ' 12'
issue: '1'
keyword:
- human–robot interaction (HRI)
- social communication
- register theory
- motionese
- robotese
- child-directed speech (CDS)
- motherese
- mindless transfer
- computers-as-social-actors
language:
- iso: eng
page: 134-161
publication: Interaction Studies
publication_identifier:
issn:
- 1572-0381
publisher: John Benjamins Publishing Company
status: public
title: 'Mindful tutors: Linguistic choice and action demonstration in speech to infants
and a simulated robot'
type: journal_article
user_id: '14931'
volume: 12
year: '2011'
...
---
_id: '17264'
abstract:
- lang: eng
text: In developmental research, tutoring behavior has been identified as scaffolding
infants’ learning processes. Infants seem sensitive to tutoring situations and
they detect these by ostensive cues [4]. Some social signals such as eye-gaze,
child-directed speech (Motherese), child-directed motion (Motionese), and contingency
have been shown to serve as ostensive cues. The concept of contingency describes
exchanges in which two agents interact with each other reciprocally. Csibra and
Gergely argued that contingency is a characteristic ostensive stimulus of a tutoring
situation [4]. In order for a robot to be treated similar to an infant, it has
to both, be sensitive to the ostensive stimuli on the one hand and induce tutoring
behavior by its feedback about its capabilities on the other hand. In this paper,
we raise the question whether a robot can be treated similar to an infant in an
interaction. We present results concerning the acceptance of a robotic agent in
a social learning scenario, which we obtained via comparison to interactions with
8-11 months old infants and adults in equal conditions. We applied measurements
for motion modifications (Motionese) and eye-gaze behavior. Our results reveal
significant differences between Adult-Child Interaction (ACI), Adult-Adult Interaction
(AAI) and Adult- Robot Interaction (ARI) suggesting that in ARI, robotdirected
tutoring behavior is even more accentuated in terms of Motionese, but contingent
responsivity is impaired. Our results confirm previous findings [14] concerning
the differences between ACI, AAI, and ARI and constitute an important empirical
basis for making use of ostensive stimuli as social signals for tutoring behavior
in social robotics.
author:
- first_name: Katrin Solveig
full_name: Lohan, Katrin Solveig
last_name: Lohan
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
last_name: Vollmer
- first_name: Jannik
full_name: Fritsch, Jannik
last_name: Fritsch
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
citation:
ama: 'Lohan KS, Vollmer A-L, Fritsch J, Rohlfing K, Wrede B. Which ostensive stimuli
can be used for a robot to detect and maintain tutoring situations? In: IEEE
International Workshop on Social Signal Processing. International Computer
Science Institute; 2009. doi:10.1109/acii.2009.5349507'
apa: Lohan, K. S., Vollmer, A.-L., Fritsch, J., Rohlfing, K., & Wrede, B. (2009).
Which ostensive stimuli can be used for a robot to detect and maintain tutoring
situations? IEEE International Workshop on Social Signal Processing. https://doi.org/10.1109/acii.2009.5349507
bibtex: '@inproceedings{Lohan_Vollmer_Fritsch_Rohlfing_Wrede_2009, title={Which
ostensive stimuli can be used for a robot to detect and maintain tutoring situations?},
DOI={10.1109/acii.2009.5349507},
booktitle={IEEE International Workshop on Social Signal Processing}, publisher={International
Computer Science Institute}, author={Lohan, Katrin Solveig and Vollmer, Anna-Lisa
and Fritsch, Jannik and Rohlfing, Katharina and Wrede, Britta}, year={2009} }'
chicago: Lohan, Katrin Solveig, Anna-Lisa Vollmer, Jannik Fritsch, Katharina Rohlfing,
and Britta Wrede. “Which Ostensive Stimuli Can Be Used for a Robot to Detect and
Maintain Tutoring Situations?” In IEEE International Workshop on Social Signal
Processing. International Computer Science Institute, 2009. https://doi.org/10.1109/acii.2009.5349507.
ieee: 'K. S. Lohan, A.-L. Vollmer, J. Fritsch, K. Rohlfing, and B. Wrede, “Which
ostensive stimuli can be used for a robot to detect and maintain tutoring situations?,”
2009, doi: 10.1109/acii.2009.5349507.'
mla: Lohan, Katrin Solveig, et al. “Which Ostensive Stimuli Can Be Used for a Robot
to Detect and Maintain Tutoring Situations?” IEEE International Workshop on
Social Signal Processing, International Computer Science Institute, 2009,
doi:10.1109/acii.2009.5349507.
short: 'K.S. Lohan, A.-L. Vollmer, J. Fritsch, K. Rohlfing, B. Wrede, in: IEEE International
Workshop on Social Signal Processing, International Computer Science Institute,
2009.'
date_created: 2020-06-24T13:02:33Z
date_updated: 2023-02-01T13:04:03Z
department:
- _id: '749'
doi: 10.1109/acii.2009.5349507
keyword:
- Ostensive Signals
- Contingency
- Motionese
- hri
language:
- iso: eng
publication: IEEE International Workshop on Social Signal Processing
publication_identifier:
isbn:
- '9781424448005'
publisher: International Computer Science Institute
status: public
title: Which ostensive stimuli can be used for a robot to detect and maintain tutoring
situations?
type: conference
user_id: '14931'
year: '2009'
...