---
_id: '55400'
abstract:
- lang: eng
text: "This study contributes to the evolving field of robot learning in interaction\r\nwith
humans, examining the impact of diverse input modalities on learning\r\noutcomes.
It introduces the concept of \"meta-modalities\" which encapsulate\r\nadditional
forms of feedback beyond the traditional preference and scalar\r\nfeedback mechanisms.
Unlike prior research that focused on individual\r\nmeta-modalities, this work
evaluates their combined effect on learning\r\noutcomes. Through a study with
human participants, we explore user preferences\r\nfor these modalities and their
impact on robot learning performance. Our\r\nfindings reveal that while individual
modalities are perceived differently,\r\ntheir combination significantly improves
learning behavior and usability. This\r\nresearch not only provides valuable insights
into the optimization of\r\nhuman-robot interactive task learning but also opens
new avenues for enhancing\r\nthe interactive freedom and scaffolding capabilities
provided to users in such\r\nsettings."
article_type: original
author:
- first_name: Helen
full_name: Beierling, Helen
last_name: Beierling
- first_name: 'Robin '
full_name: 'Beierling, Robin '
last_name: Beierling
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
last_name: Vollmer
citation:
ama: Beierling H, Beierling R, Vollmer A-L. The power of combined modalities in
interactive robot learning. Frontiers in Robotics and AI. 2025;12.
apa: Beierling, H., Beierling, R., & Vollmer, A.-L. (2025). The power of combined
modalities in interactive robot learning. Frontiers in Robotics and AI,
12.
bibtex: '@article{Beierling_Beierling_Vollmer_2025, title={The power of combined
modalities in interactive robot learning}, volume={12}, journal={Frontiers in
Robotics and AI}, publisher={Frontiers }, author={Beierling, Helen and Beierling,
Robin and Vollmer, Anna-Lisa}, year={2025} }'
chicago: Beierling, Helen, Robin Beierling, and Anna-Lisa Vollmer. “The Power of
Combined Modalities in Interactive Robot Learning.” Frontiers in Robotics and
AI 12 (2025).
ieee: H. Beierling, R. Beierling, and A.-L. Vollmer, “The power of combined modalities
in interactive robot learning,” Frontiers in Robotics and AI, vol. 12,
2025.
mla: Beierling, Helen, et al. “The Power of Combined Modalities in Interactive Robot
Learning.” Frontiers in Robotics and AI, vol. 12, Frontiers , 2025.
short: H. Beierling, R. Beierling, A.-L. Vollmer, Frontiers in Robotics and AI 12
(2025).
date_created: 2024-07-26T08:35:24Z
date_updated: 2025-09-17T13:38:18Z
ddc:
- '004'
extern: '1'
file:
- access_level: closed
content_type: application/pdf
creator: helebeen
date_created: 2025-09-17T13:36:09Z
date_updated: 2025-09-17T13:36:09Z
file_id: '61331'
file_name: frobt-12-1598968.pdf
file_size: 36978223
relation: main_file
success: 1
file_date_updated: 2025-09-17T13:36:09Z
funded_apc: '1'
has_accepted_license: '1'
intvolume: ' 12'
keyword:
- human-robot interaction
- human-in-the-loop learning
- reinforcement learning
- interactive robot learning
- multi-modal feedback
- learning from demonstration
- preference-based learning
- scaffolding in robot learning
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12312635/
oa: '1'
project:
- _id: '123'
name: 'TRR 318 - B5: TRR 318 - Subproject B5'
publication: Frontiers in Robotics and AI
publication_status: published
publisher: 'Frontiers '
status: public
title: The power of combined modalities in interactive robot learning
type: journal_article
user_id: '50995'
volume: 12
year: '2025'
...
---
_id: '61327'
abstract:
- lang: eng
text: "Robot learning from humans has been proposed and researched for several decades
as a means to enable robots to learn new skills or\r\nadapt existing ones to new
situations. Recent advances in artificial intelligence, including learning approaches
like reinforcement\r\nlearning and architectures like transformers and foundation
models, combined with access to massive datasets, has created attractive\r\nopportunities
to apply those data-hungry techniques to this problem. We argue that the focus
on massive amounts of pre-collected\r\ndata, and the resulting learning paradigm,
where humans demonstrate and robots learn in isolation, is overshadowing a specialized\r\narea
of work we term Human-Interactive-Robot-Learning (HIRL). This paradigm, wherein
robots and humans interact during the\r\nlearning process, is at the intersection
of multiple fields (artificial intelligence, robotics, human-computer interaction,
design and others)\r\nand holds unique promise. Using HIRL, robots can achieve
greater sample efficiency (as humans can provide task knowledge through\r\ninteraction),
align with human preferences (as humans can guide the robot behavior towards their
expectations), and explore more\r\nmeaningfully and safely (as humans can utilize
domain knowledge to guide learning and prevent catastrophic failures). This can
result\r\nin robotic systems that can more quickly and easily adapt to new tasks
in human environments. The objective of this paper is to\r\nprovide a broad and
consistent overview of HIRL research and to guide researchers toward understanding
the scope of HIRL, and\r\ncurrent open or underexplored challenges related to
four themes — namely, human, robot learning, interaction, and broader context.\r\nThe
paper includes concrete use cases to illustrate the interaction between these
challenges and inspire further research according to\r\nbroad recommendations
and a call for action for the growing HIRL community"
article_type: original
author:
- first_name: 'Kim '
full_name: 'Baraka, Kim '
last_name: Baraka
- first_name: Ifrah
full_name: Idrees, Ifrah
last_name: Idrees
- first_name: Taylor Kessler
full_name: Faulkner, Taylor Kessler
last_name: Faulkner
- first_name: Erdem
full_name: Biyik, Erdem
last_name: Biyik
- first_name: Serena
full_name: Booth, Serena
last_name: Booth
- first_name: Mohamed
full_name: Chetouani, Mohamed
last_name: Chetouani
- first_name: Daniel H.
full_name: Grollman, Daniel H.
last_name: Grollman
- first_name: Akanksha
full_name: Saran, Akanksha
last_name: Saran
- first_name: Emmanuel
full_name: Senft, Emmanuel
last_name: Senft
- first_name: Silvia
full_name: Tulli, Silvia
last_name: Tulli
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
last_name: Vollmer
- first_name: Antonio
full_name: Andriella, Antonio
last_name: Andriella
- first_name: Helen
full_name: Beierling, Helen
last_name: Beierling
- first_name: Tiffany
full_name: Horter, Tiffany
last_name: Horter
- first_name: Jens
full_name: Kober, Jens
last_name: Kober
- first_name: Isaac
full_name: Sheidlower, Isaac
last_name: Sheidlower
- first_name: Matthew E.
full_name: Taylor, Matthew E.
last_name: Taylor
- first_name: Sanne
full_name: van Waveren, Sanne
last_name: van Waveren
- first_name: Xuesu
full_name: Xiao, Xuesu
last_name: Xiao
citation:
ama: 'Baraka K, Idrees I, Faulkner TK, et al. Human-Interactive Robot Learning:
Definition, Challenges, and Recommendations. Transactions on Human-Robot Interaction.'
apa: 'Baraka, K., Idrees, I., Faulkner, T. K., Biyik, E., Booth, S., Chetouani,
M., Grollman, D. H., Saran, A., Senft, E., Tulli, S., Vollmer, A.-L., Andriella,
A., Beierling, H., Horter, T., Kober, J., Sheidlower, I., Taylor, M. E., van Waveren,
S., & Xiao, X. (n.d.). Human-Interactive Robot Learning: Definition, Challenges,
and Recommendations. Transactions on Human-Robot Interaction.'
bibtex: '@article{Baraka_Idrees_Faulkner_Biyik_Booth_Chetouani_Grollman_Saran_Senft_Tulli_et
al., title={Human-Interactive Robot Learning: Definition, Challenges, and Recommendations},
journal={Transactions on Human-Robot Interaction}, author={Baraka, Kim and Idrees,
Ifrah and Faulkner, Taylor Kessler and Biyik, Erdem and Booth, Serena and Chetouani,
Mohamed and Grollman, Daniel H. and Saran, Akanksha and Senft, Emmanuel and Tulli,
Silvia and et al.} }'
chicago: 'Baraka, Kim , Ifrah Idrees, Taylor Kessler Faulkner, Erdem Biyik, Serena
Booth, Mohamed Chetouani, Daniel H. Grollman, et al. “Human-Interactive Robot
Learning: Definition, Challenges, and Recommendations.” Transactions on Human-Robot
Interaction, n.d.'
ieee: 'K. Baraka et al., “Human-Interactive Robot Learning: Definition, Challenges,
and Recommendations,” Transactions on Human-Robot Interaction.'
mla: 'Baraka, Kim, et al. “Human-Interactive Robot Learning: Definition, Challenges,
and Recommendations.” Transactions on Human-Robot Interaction.'
short: K. Baraka, I. Idrees, T.K. Faulkner, E. Biyik, S. Booth, M. Chetouani, D.H.
Grollman, A. Saran, E. Senft, S. Tulli, A.-L. Vollmer, A. Andriella, H. Beierling,
T. Horter, J. Kober, I. Sheidlower, M.E. Taylor, S. van Waveren, X. Xiao, Transactions
on Human-Robot Interaction (n.d.).
date_created: 2025-09-17T12:42:45Z
date_updated: 2025-09-17T13:40:16Z
keyword:
- Robot learning
- Interactive learning systems
- Human-robot interaction
- Human-in-the-loop machine learning
- Teaching and learning
language:
- iso: eng
project:
- _id: '123'
name: TRR 318 - Subproject B5
publication: Transactions on Human-Robot Interaction
publication_status: submitted
status: public
title: 'Human-Interactive Robot Learning: Definition, Challenges, and Recommendations'
type: journal_article
user_id: '50995'
year: '2025'
...
---
_id: '17182'
abstract:
- lang: eng
text: Co-development of action, conceptualization and social interaction mutually
scaffold and support each other within a virtuous feedback cycle in the development
of human language in children. Within this framework, the purpose of this article
is to bring together diverse but complementary accounts of research methods that
jointly contribute to our understanding of cognitive development and in particular,
language acquisition in robots. Thus, we include research pertaining to developmental
robotics, cognitive science, psychology, linguistics and neuroscience, as well
as practical computer science and engineering. The different studies are not at
this stage all connected into a cohesive whole; rather, they are presented to
illuminate the need for multiple different approaches that complement each other
in the pursuit of understanding cognitive development in robots. Extensive experiments
involving the humanoid robot iCub are reported, while human learning relevant
to developmental robotics has also contributed useful results. Disparate approaches
are brought together via common underlying design principles. Without claiming
to model human language acquisition directly, we are nonetheless inspired by analogous
development in humans and consequently, our investigations include the parallel
co-development of action, conceptualization and social interaction. Though these
different approaches need to ultimately be integrated into a coherent, unified
body of knowledge, progress is currently also being made by pursuing individual
methods.
author:
- first_name: Caroline
full_name: Lyon, Caroline
last_name: Lyon
- first_name: Chrystopher L.
full_name: Nehaniv, Chrystopher L.
last_name: Nehaniv
- first_name: Joe
full_name: Saunders, Joe
last_name: Saunders
- first_name: Tony
full_name: Belpaeme, Tony
last_name: Belpaeme
- first_name: Ambra
full_name: Bisio, Ambra
last_name: Bisio
- first_name: Kerstin
full_name: Fischer, Kerstin
last_name: Fischer
- first_name: Frank
full_name: Forster, Frank
last_name: Forster
- first_name: Hagen
full_name: Lehmann, Hagen
last_name: Lehmann
- first_name: Giorgio
full_name: Metta, Giorgio
last_name: Metta
- first_name: Vishwanathan
full_name: Mohan, Vishwanathan
last_name: Mohan
- first_name: Anthony
full_name: Morse, Anthony
last_name: Morse
- first_name: Stefano
full_name: Nolfi, Stefano
last_name: Nolfi
- first_name: Francesco
full_name: Nori, Francesco
last_name: Nori
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Alessandra
full_name: Sciutti, Alessandra
last_name: Sciutti
- first_name: Jun
full_name: Tani, Jun
last_name: Tani
- first_name: Elio
full_name: Tuci, Elio
last_name: Tuci
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
- first_name: Arne
full_name: Zeschel, Arne
last_name: Zeschel
- first_name: Angelo
full_name: Cangelosi, Angelo
last_name: Cangelosi
citation:
ama: 'Lyon C, Nehaniv CL, Saunders J, et al. Embodied Language Learning and Cognitive
Bootstrapping: Methods and Design Principles. International Journal of Advanced
Robotic Systems. 2016;13(3). doi:10.5772/63462'
apa: 'Lyon, C., Nehaniv, C. L., Saunders, J., Belpaeme, T., Bisio, A., Fischer,
K., Forster, F., Lehmann, H., Metta, G., Mohan, V., Morse, A., Nolfi, S., Nori,
F., Rohlfing, K., Sciutti, A., Tani, J., Tuci, E., Wrede, B., Zeschel, A., &
Cangelosi, A. (2016). Embodied Language Learning and Cognitive Bootstrapping:
Methods and Design Principles. International Journal of Advanced Robotic Systems,
13(3). https://doi.org/10.5772/63462'
bibtex: '@article{Lyon_Nehaniv_Saunders_Belpaeme_Bisio_Fischer_Forster_Lehmann_Metta_Mohan_et
al._2016, title={Embodied Language Learning and Cognitive Bootstrapping: Methods
and Design Principles}, volume={13}, DOI={10.5772/63462},
number={3}, journal={International Journal of Advanced Robotic Systems}, publisher={Intech
Europe}, author={Lyon, Caroline and Nehaniv, Chrystopher L. and Saunders, Joe
and Belpaeme, Tony and Bisio, Ambra and Fischer, Kerstin and Forster, Frank and
Lehmann, Hagen and Metta, Giorgio and Mohan, Vishwanathan and et al.}, year={2016}
}'
chicago: 'Lyon, Caroline, Chrystopher L. Nehaniv, Joe Saunders, Tony Belpaeme, Ambra
Bisio, Kerstin Fischer, Frank Forster, et al. “Embodied Language Learning and
Cognitive Bootstrapping: Methods and Design Principles.” International Journal
of Advanced Robotic Systems 13, no. 3 (2016). https://doi.org/10.5772/63462.'
ieee: 'C. Lyon et al., “Embodied Language Learning and Cognitive Bootstrapping:
Methods and Design Principles,” International Journal of Advanced Robotic Systems,
vol. 13, no. 3, 2016, doi: 10.5772/63462.'
mla: 'Lyon, Caroline, et al. “Embodied Language Learning and Cognitive Bootstrapping:
Methods and Design Principles.” International Journal of Advanced Robotic Systems,
vol. 13, no. 3, Intech Europe, 2016, doi:10.5772/63462.'
short: C. Lyon, C.L. Nehaniv, J. Saunders, T. Belpaeme, A. Bisio, K. Fischer, F.
Forster, H. Lehmann, G. Metta, V. Mohan, A. Morse, S. Nolfi, F. Nori, K. Rohlfing,
A. Sciutti, J. Tani, E. Tuci, B. Wrede, A. Zeschel, A. Cangelosi, International
Journal of Advanced Robotic Systems 13 (2016).
date_created: 2020-06-24T13:00:58Z
date_updated: 2023-02-01T16:04:48Z
department:
- _id: '749'
doi: 10.5772/63462
intvolume: ' 13'
issue: '3'
keyword:
- Robot Language
- Human Robot Interaction
- HRI
- Developmental Robotics
- Cognitive Bootstrapping
- Statistical Learning
language:
- iso: eng
publication: International Journal of Advanced Robotic Systems
publication_identifier:
issn:
- 1729-8814
publisher: Intech Europe
status: public
title: 'Embodied Language Learning and Cognitive Bootstrapping: Methods and Design
Principles'
type: journal_article
user_id: '14931'
volume: 13
year: '2016'
...
---
_id: '17189'
abstract:
- lang: eng
text: 'Alignment is a phenomenon observed in human conversation: Dialog partners''
behavior converges in many respects. Such alignment has been proposed to be automatic
and the basis for communicating successfully. Recent research on human-computer
dialog promotes a mediated communicative design account of alignment according
to which the extent of alignment is influenced by interlocutors'' beliefs about
each other. Our work aims at adding to these findings in two ways. (a) Our work
investigates alignment of manual actions, instead of lexical choice. (b) Participants
interact with the iCub humanoid robot, instead of an artificial computer dialog
system. Our results confirm that alignment also takes place in the domain of actions.
We were not able to replicate the results of the original study in general in
this setting, but in accordance with its findings, participants with a high questionnaire
score for emotional stability and participants who are familiar with robots align
their actions more to a robot they believe to be basic than to one they believe
to be advanced. Regarding alignment over the course of an interaction, the extent
of alignment seems to remain constant, when participants believe the robot to
be advanced, but it increases over time, when participants believe the robot to
be a basic version.'
author:
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
last_name: Vollmer
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
- first_name: Angelo
full_name: Cangelosi, Angelo
last_name: Cangelosi
citation:
ama: Vollmer A-L, Rohlfing K, Wrede B, Cangelosi A. Alignment to the Actions of
a Robot. International Journal of Social Robotics. 2015;7(2):241-252. doi:10.1007/s12369-014-0252-0
apa: Vollmer, A.-L., Rohlfing, K., Wrede, B., & Cangelosi, A. (2015). Alignment
to the Actions of a Robot. International Journal of Social Robotics, 7(2),
241–252. https://doi.org/10.1007/s12369-014-0252-0
bibtex: '@article{Vollmer_Rohlfing_Wrede_Cangelosi_2015, title={Alignment to the
Actions of a Robot}, volume={7}, DOI={10.1007/s12369-014-0252-0},
number={2}, journal={International Journal of Social Robotics}, publisher={Springer-Verlag},
author={Vollmer, Anna-Lisa and Rohlfing, Katharina and Wrede, Britta and Cangelosi,
Angelo}, year={2015}, pages={241–252} }'
chicago: 'Vollmer, Anna-Lisa, Katharina Rohlfing, Britta Wrede, and Angelo Cangelosi.
“Alignment to the Actions of a Robot.” International Journal of Social Robotics
7, no. 2 (2015): 241–52. https://doi.org/10.1007/s12369-014-0252-0.'
ieee: 'A.-L. Vollmer, K. Rohlfing, B. Wrede, and A. Cangelosi, “Alignment to the
Actions of a Robot,” International Journal of Social Robotics, vol. 7,
no. 2, pp. 241–252, 2015, doi: 10.1007/s12369-014-0252-0.'
mla: Vollmer, Anna-Lisa, et al. “Alignment to the Actions of a Robot.” International
Journal of Social Robotics, vol. 7, no. 2, Springer-Verlag, 2015, pp. 241–52,
doi:10.1007/s12369-014-0252-0.
short: A.-L. Vollmer, K. Rohlfing, B. Wrede, A. Cangelosi, International Journal
of Social Robotics 7 (2015) 241–252.
date_created: 2020-06-24T13:01:06Z
date_updated: 2023-02-01T16:07:40Z
department:
- _id: '749'
doi: 10.1007/s12369-014-0252-0
intvolume: ' 7'
issue: '2'
keyword:
- learning
- Human-robot interaction
- Alignment
- Robot social
- Action understanding
language:
- iso: eng
page: 241-252
publication: International Journal of Social Robotics
publication_identifier:
issn:
- 1875-4791
publisher: Springer-Verlag
status: public
title: Alignment to the Actions of a Robot
type: journal_article
user_id: '14931'
volume: 7
year: '2015'
...
---
_id: '17192'
abstract:
- lang: eng
text: 'In order for artificial intelligent systems to interact naturally with human
users, they need to be able to learn from human instructions when actions should
be imitated. Human tutoring will typically consist of action demonstrations accompanied
by speech. In the following, the characteristics of human tutoring during action
demonstration will be examined. A special focus will be put on the distinction
between two kinds of motion events: path-oriented actions and manner-oriented
actions. Such a distinction is inspired by the literature pertaining to cognitive
linguistics, which indicates that the human conceptual system can distinguish
these two distinct types of motion. These two kinds of actions are described in
language by more path-oriented or more manner-oriented utterances. In path-oriented
utterances, the source, trajectory, or goal is emphasized, whereas in manner-oriented
utterances the medium, velocity, or means of motion are highlighted. We examined
a video corpus of adult-child interactions comprised of three age groups of children-pre-lexical,
early lexical, and lexical-and two different tasks, one emphasizing manner more
strongly and one emphasizing path more strongly. We analyzed the language and
motion of the caregiver and the gazing behavior of the child to highlight the
differences between the tutoring and the acquisition of the manner and path concepts.
The results suggest that age is an important factor in the development of these
action categories. The analysis of this corpus has also been exploited to develop
an intelligent robotic behavior -the tutoring spotter system-able to emulate children''s
behaviors in a tutoring situation, with the aim of evoking in human subjects a
natural and effective behavior in teaching to a robot. The findings related to
the development of manner and path concepts have been used to implement new effective
feedback strategies in the tutoring spotter system, which should provide improvements
in human-robot interaction.'
author:
- first_name: Katrin S.
full_name: Lohan, Katrin S.
last_name: Lohan
- first_name: Sascha
full_name: Griffiths, Sascha
last_name: Griffiths
- first_name: Alessandra
full_name: Sciutti, Alessandra
last_name: Sciutti
- first_name: Tim C.
full_name: Partmann, Tim C.
last_name: Partmann
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
citation:
ama: Lohan KS, Griffiths S, Sciutti A, Partmann TC, Rohlfing K. Co-development of
manner and path concepts in language, action, and eye-gaze behavior. Topics
in Cognitive Science. 2014;6(3):492-512. doi:10.1111/tops.12098
apa: Lohan, K. S., Griffiths, S., Sciutti, A., Partmann, T. C., & Rohlfing,
K. (2014). Co-development of manner and path concepts in language, action, and
eye-gaze behavior. Topics in Cognitive Science, 6(3), 492–512. https://doi.org/10.1111/tops.12098
bibtex: '@article{Lohan_Griffiths_Sciutti_Partmann_Rohlfing_2014, title={Co-development
of manner and path concepts in language, action, and eye-gaze behavior}, volume={6},
DOI={10.1111/tops.12098}, number={3},
journal={Topics in Cognitive Science}, publisher={Wiley-Blackwell}, author={Lohan,
Katrin S. and Griffiths, Sascha and Sciutti, Alessandra and Partmann, Tim C. and
Rohlfing, Katharina}, year={2014}, pages={492–512} }'
chicago: 'Lohan, Katrin S., Sascha Griffiths, Alessandra Sciutti, Tim C. Partmann,
and Katharina Rohlfing. “Co-Development of Manner and Path Concepts in Language,
Action, and Eye-Gaze Behavior.” Topics in Cognitive Science 6, no. 3 (2014):
492–512. https://doi.org/10.1111/tops.12098.'
ieee: 'K. S. Lohan, S. Griffiths, A. Sciutti, T. C. Partmann, and K. Rohlfing, “Co-development
of manner and path concepts in language, action, and eye-gaze behavior,” Topics
in Cognitive Science, vol. 6, no. 3, pp. 492–512, 2014, doi: 10.1111/tops.12098.'
mla: Lohan, Katrin S., et al. “Co-Development of Manner and Path Concepts in Language,
Action, and Eye-Gaze Behavior.” Topics in Cognitive Science, vol. 6, no.
3, Wiley-Blackwell, 2014, pp. 492–512, doi:10.1111/tops.12098.
short: K.S. Lohan, S. Griffiths, A. Sciutti, T.C. Partmann, K. Rohlfing, Topics
in Cognitive Science 6 (2014) 492–512.
date_created: 2020-06-24T13:01:09Z
date_updated: 2023-02-01T16:08:33Z
department:
- _id: '749'
doi: 10.1111/tops.12098
intvolume: ' 6'
issue: '3'
keyword:
- Imitation
- Tutoring
- Adult-child interaction
- Human-robot interaction
- Semantics
- Teachable robots
language:
- iso: eng
page: 492-512
publication: Topics in Cognitive Science
publication_identifier:
issn:
- 1756-8757
publisher: Wiley-Blackwell
status: public
title: Co-development of manner and path concepts in language, action, and eye-gaze
behavior
type: journal_article
user_id: '14931'
volume: 6
year: '2014'
...
---
_id: '17225'
abstract:
- lang: eng
text: How is communicative gesture behavior in robots perceived by humans? Although
gesture is crucial in social interaction, this research question is still largely
unexplored in the field of social robotics. Thus, the main objective of the present
work is to investigate how gestural machine behaviors can be used to design more
natural communication in social robots. The chosen approach is twofold. Firstly,
the technical challenges encountered when implementing a speech-gesture generation
model on a robotic platform are tackled. We present a framework that enables the
humanoid robot to flexibly produce synthetic speech and co-verbal hand and arm
gestures at run-time, while not being limited to a predefined repertoire of motor
actions. Secondly, the achieved flexibility in robot gesture is exploited in controlled
experiments. To gain a deeper understanding of how communicative robot gesture
might impact and shape human perception and evaluation of human-robot interaction,
we conducted a between-subjects experimental study using the humanoid robot in
a joint task scenario. We manipulated the non-verbal behaviors of the robot in
three experimental conditions, so that it would refer to objects by utilizing
either (1) unimodal (i.e., speech only) utterances, (2) congruent multimodal (i.e.,
semantically matching speech and gesture) or (3) incongruent multimodal (i.e.,
semantically non-matching speech and gesture) utterances. Our findings reveal
that the robot is evaluated more positively when non-verbal behaviors such as
hand and arm gestures are displayed along with speech, even if they do not semantically
match the spoken utterance.
author:
- first_name: Maha
full_name: Salem, Maha
last_name: Salem
- first_name: Stefan
full_name: Kopp, Stefan
last_name: Kopp
- first_name: Ipke
full_name: Wachsmuth, Ipke
last_name: Wachsmuth
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Frank
full_name: Joublin, Frank
last_name: Joublin
citation:
ama: Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F. Generation and evaluation
of communicative robot gesture. International Journal of Social Robotics, Special
Issue on Expectations, Intentions, and Actions. 2012;4(2):201-217. doi:10.1007/s12369-011-0124-9
apa: Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., & Joublin, F. (2012).
Generation and evaluation of communicative robot gesture. International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions,
4(2), 201–217. https://doi.org/10.1007/s12369-011-0124-9
bibtex: '@article{Salem_Kopp_Wachsmuth_Rohlfing_Joublin_2012, title={Generation
and evaluation of communicative robot gesture}, volume={4}, DOI={10.1007/s12369-011-0124-9},
number={2}, journal={International Journal of Social Robotics, Special Issue on
Expectations, Intentions, and Actions}, publisher={Springer Science + Business
Media}, author={Salem, Maha and Kopp, Stefan and Wachsmuth, Ipke and Rohlfing,
Katharina and Joublin, Frank}, year={2012}, pages={201–217} }'
chicago: 'Salem, Maha, Stefan Kopp, Ipke Wachsmuth, Katharina Rohlfing, and Frank
Joublin. “Generation and Evaluation of Communicative Robot Gesture.” International
Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions
4, no. 2 (2012): 201–17. https://doi.org/10.1007/s12369-011-0124-9.'
ieee: 'M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, and F. Joublin, “Generation
and evaluation of communicative robot gesture,” International Journal of Social
Robotics, Special Issue on Expectations, Intentions, and Actions, vol. 4,
no. 2, pp. 201–217, 2012, doi: 10.1007/s12369-011-0124-9.'
mla: Salem, Maha, et al. “Generation and Evaluation of Communicative Robot Gesture.”
International Journal of Social Robotics, Special Issue on Expectations, Intentions,
and Actions, vol. 4, no. 2, Springer Science + Business Media, 2012, pp. 201–17,
doi:10.1007/s12369-011-0124-9.
short: M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, F. Joublin, International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions 4 (2012)
201–217.
date_created: 2020-06-24T13:01:48Z
date_updated: 2023-02-01T16:21:50Z
department:
- _id: '749'
doi: 10.1007/s12369-011-0124-9
intvolume: ' 4'
issue: '2'
keyword:
- Social Human-Robot Interaction
- Multimodal Interaction and Conversational Skills
- Robot Companions and Social Robots
- Non-verbal Cues and Expressiveness
language:
- iso: eng
page: 201-217
publication: International Journal of Social Robotics, Special Issue on Expectations,
Intentions, and Actions
publication_identifier:
issn:
- 1875-4805
publisher: Springer Science + Business Media
status: public
title: Generation and evaluation of communicative robot gesture
type: journal_article
user_id: '14931'
volume: 4
year: '2012'
...
---
_id: '17428'
abstract:
- lang: eng
text: How is communicative gesture behavior in robots perceived by humans? Although
gesture is crucial in social interaction, this research question is still largely
unexplored in the field of social robotics. Thus, the main objective of the present
work is to investigate how gestural machine behaviors can be used to design more
natural communication in social robots. The chosen approach is twofold. Firstly,
the technical challenges encountered when implementing a speech-gesture generation
model on a robotic platform are tackled. We present a framework that enables the
humanoid robot to flexibly produce synthetic speech and co-verbal hand and arm
gestures at run-time, while not being limited to a predefined repertoire of motor
actions. Secondly, the achieved flexibility in robot gesture is exploited in controlled
experiments. To gain a deeper understanding of how communicative robot gesture
might impact and shape human perception and evaluation of human-robot interaction,
we conducted a between-subjects experimental study using the humanoid robot in
a joint task scenario. We manipulated the non-verbal behaviors of the robot in
three experimental conditions, so that it would refer to objects by utilizing
either (1) unimodal (i.e., speech only) utterances, (2) congruent multimodal (i.e.,
semantically matching speech and gesture) or (3) incongruent multimodal (i.e.,
semantically non-matching speech and gesture) utterances. Our findings reveal
that the robot is evaluated more positively when non-verbal behaviors such as
hand and arm gestures are displayed along with speech, even if they do not semantically
match the spoken utterance.
author:
- first_name: Maha
full_name: Salem, Maha
last_name: Salem
- first_name: Stefan
full_name: Kopp, Stefan
last_name: Kopp
- first_name: Ipke
full_name: Wachsmuth, Ipke
last_name: Wachsmuth
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Frank
full_name: Joublin, Frank
last_name: Joublin
citation:
ama: Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F. Generation and evaluation
of communicative robot gesture. International Journal of Social Robotics, Special
Issue on Expectations, Intentions, and Actions. 2012;4(2):201-217. doi:10.1007/s12369-011-0124-9
apa: Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., & Joublin, F. (2012).
Generation and evaluation of communicative robot gesture. International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions,
4(2), 201–217. https://doi.org/10.1007/s12369-011-0124-9
bibtex: '@article{Salem_Kopp_Wachsmuth_Rohlfing_Joublin_2012, title={Generation
and evaluation of communicative robot gesture}, volume={4}, DOI={10.1007/s12369-011-0124-9},
number={2}, journal={International Journal of Social Robotics, Special Issue on
Expectations, Intentions, and Actions}, publisher={Springer Science + Business
Media}, author={Salem, Maha and Kopp, Stefan and Wachsmuth, Ipke and Rohlfing,
Katharina and Joublin, Frank}, year={2012}, pages={201–217} }'
chicago: 'Salem, Maha, Stefan Kopp, Ipke Wachsmuth, Katharina Rohlfing, and Frank
Joublin. “Generation and Evaluation of Communicative Robot Gesture.” International
Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions
4, no. 2 (2012): 201–17. https://doi.org/10.1007/s12369-011-0124-9.'
ieee: 'M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, and F. Joublin, “Generation
and evaluation of communicative robot gesture,” International Journal of Social
Robotics, Special Issue on Expectations, Intentions, and Actions, vol. 4,
no. 2, pp. 201–217, 2012, doi: 10.1007/s12369-011-0124-9.'
mla: Salem, Maha, et al. “Generation and Evaluation of Communicative Robot Gesture.”
International Journal of Social Robotics, Special Issue on Expectations, Intentions,
and Actions, vol. 4, no. 2, Springer Science + Business Media, 2012, pp. 201–17,
doi:10.1007/s12369-011-0124-9.
short: M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, F. Joublin, International Journal
of Social Robotics, Special Issue on Expectations, Intentions, and Actions 4 (2012)
201–217.
date_created: 2020-07-28T11:44:02Z
date_updated: 2023-02-01T12:52:23Z
department:
- _id: '749'
doi: 10.1007/s12369-011-0124-9
intvolume: ' 4'
issue: '2'
keyword:
- Social Human-Robot Interaction
- Multimodal Interaction and Conversational Skills
- Robot Companions and Social Robots
- Non-verbal Cues and Expressiveness
language:
- iso: eng
page: 201-217
publication: International Journal of Social Robotics, Special Issue on Expectations,
Intentions, and Actions
publication_identifier:
issn:
- 1875-4805
publisher: Springer Science + Business Media
status: public
title: Generation and evaluation of communicative robot gesture
type: journal_article
user_id: '14931'
volume: 4
year: '2012'
...
---
_id: '17233'
abstract:
- lang: eng
text: 'It has been proposed that the design of robots might benefit from interactions
that are similar to caregiver–child interactions, which is tailored to children’s
respective capacities to a high degree. However, so far little is known about
how people adapt their tutoring behaviour to robots and whether robots can evoke
input that is similar to child-directed interaction. The paper presents detailed
analyses of speakers’ linguistic and non-linguistic behaviour, such as action
demonstration, in two comparable situations: In one experiment, parents described
and explained to their nonverbal infants the use of certain everyday objects;
in the other experiment, participants tutored a simulated robot on the same objects.
The results, which show considerable differences between the two situations on
almost all measures, are discussed in the light of the computer-as-social-actor
paradigm and the register hypothesis.'
author:
- first_name: Kerstin
full_name: Fischer, Kerstin
last_name: Fischer
- first_name: Kilian
full_name: Foth, Kilian
last_name: Foth
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
citation:
ama: 'Fischer K, Foth K, Rohlfing K, Wrede B. Mindful tutors: Linguistic choice
and action demonstration in speech to infants and a simulated robot. Interaction
Studies. 2011;12(1):134-161. doi:10.1075/is.12.1.06fis'
apa: 'Fischer, K., Foth, K., Rohlfing, K., & Wrede, B. (2011). Mindful tutors:
Linguistic choice and action demonstration in speech to infants and a simulated
robot. Interaction Studies, 12(1), 134–161. https://doi.org/10.1075/is.12.1.06fis'
bibtex: '@article{Fischer_Foth_Rohlfing_Wrede_2011, title={Mindful tutors: Linguistic
choice and action demonstration in speech to infants and a simulated robot}, volume={12},
DOI={10.1075/is.12.1.06fis},
number={1}, journal={Interaction Studies}, publisher={John Benjamins Publishing
Company}, author={Fischer, Kerstin and Foth, Kilian and Rohlfing, Katharina and
Wrede, Britta}, year={2011}, pages={134–161} }'
chicago: 'Fischer, Kerstin, Kilian Foth, Katharina Rohlfing, and Britta Wrede. “Mindful
Tutors: Linguistic Choice and Action Demonstration in Speech to Infants and a
Simulated Robot.” Interaction Studies 12, no. 1 (2011): 134–61. https://doi.org/10.1075/is.12.1.06fis.'
ieee: 'K. Fischer, K. Foth, K. Rohlfing, and B. Wrede, “Mindful tutors: Linguistic
choice and action demonstration in speech to infants and a simulated robot,” Interaction
Studies, vol. 12, no. 1, pp. 134–161, 2011, doi: 10.1075/is.12.1.06fis.'
mla: 'Fischer, Kerstin, et al. “Mindful Tutors: Linguistic Choice and Action Demonstration
in Speech to Infants and a Simulated Robot.” Interaction Studies, vol.
12, no. 1, John Benjamins Publishing Company, 2011, pp. 134–61, doi:10.1075/is.12.1.06fis.'
short: K. Fischer, K. Foth, K. Rohlfing, B. Wrede, Interaction Studies 12 (2011)
134–161.
date_created: 2020-06-24T13:01:57Z
date_updated: 2023-02-01T12:56:04Z
department:
- _id: '749'
doi: 10.1075/is.12.1.06fis
intvolume: ' 12'
issue: '1'
keyword:
- human–robot interaction (HRI)
- social communication
- register theory
- motionese
- robotese
- child-directed speech (CDS)
- motherese
- mindless transfer
- computers-as-social-actors
language:
- iso: eng
page: 134-161
publication: Interaction Studies
publication_identifier:
issn:
- 1572-0381
publisher: John Benjamins Publishing Company
status: public
title: 'Mindful tutors: Linguistic choice and action demonstration in speech to infants
and a simulated robot'
type: journal_article
user_id: '14931'
volume: 12
year: '2011'
...
---
_id: '17244'
abstract:
- lang: eng
text: 'Robots interacting with humans need to understand actions and make use of
language in social interactions. Research on infant development has shown that
language helps the learner to structure visual observations of action. This acoustic
information typically in the form of narration overlaps with action sequences
and provides infants with a bottom-up guide to find structure within them. This
concept has been introduced as acoustic packaging by Hirsh-Pasek and Golinkoff.
We developed and integrated a prominence detection module in our acoustic packaging
system to detect semantically relevant information linguistically highlighted
by the tutor. Evaluation results on speech data from adult-infant interactions
show a significant agreement with human raters. Furthermore a first approach based
on acoustic packages which uses the prominence detection results to generate acoustic
feedback is presented. Index Terms: prominence, multimodal action segmentation,
human robot interaction, feedback'
author:
- first_name: Lars
full_name: Schillingmann, Lars
last_name: Schillingmann
- first_name: Petra
full_name: Wagner, Petra
last_name: Wagner
- first_name: Christian
full_name: Munier, Christian
last_name: Munier
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
citation:
ama: 'Schillingmann L, Wagner P, Munier C, Wrede B, Rohlfing K. Using Prominence
Detection to Generate Acoustic Feedback in Tutoring Scenarios. In: Interspeech
2011 (12th Annual Conference of the International Speech Communication Association).
; 2011:3105-3108.'
apa: Schillingmann, L., Wagner, P., Munier, C., Wrede, B., & Rohlfing, K. (2011).
Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios.
Interspeech 2011 (12th Annual Conference of the International Speech Communication
Association), 3105–3108.
bibtex: '@inproceedings{Schillingmann_Wagner_Munier_Wrede_Rohlfing_2011, title={Using
Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios}, booktitle={Interspeech
2011 (12th Annual Conference of the International Speech Communication Association)},
author={Schillingmann, Lars and Wagner, Petra and Munier, Christian and Wrede,
Britta and Rohlfing, Katharina}, year={2011}, pages={3105–3108} }'
chicago: Schillingmann, Lars, Petra Wagner, Christian Munier, Britta Wrede, and
Katharina Rohlfing. “Using Prominence Detection to Generate Acoustic Feedback
in Tutoring Scenarios.” In Interspeech 2011 (12th Annual Conference of the
International Speech Communication Association), 3105–8, 2011.
ieee: L. Schillingmann, P. Wagner, C. Munier, B. Wrede, and K. Rohlfing, “Using
Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios,” in
Interspeech 2011 (12th Annual Conference of the International Speech Communication
Association), 2011, pp. 3105–3108.
mla: Schillingmann, Lars, et al. “Using Prominence Detection to Generate Acoustic
Feedback in Tutoring Scenarios.” Interspeech 2011 (12th Annual Conference of
the International Speech Communication Association), 2011, pp. 3105–08.
short: 'L. Schillingmann, P. Wagner, C. Munier, B. Wrede, K. Rohlfing, in: Interspeech
2011 (12th Annual Conference of the International Speech Communication Association),
2011, pp. 3105–3108.'
date_created: 2020-06-24T13:02:10Z
date_updated: 2023-02-01T12:53:54Z
department:
- _id: '749'
keyword:
- Feedback
- Human Robot Interaction
- Prominence
- Multimodal Action Segmentation
language:
- iso: eng
page: 3105-3108
publication: Interspeech 2011 (12th Annual Conference of the International Speech
Communication Association)
status: public
title: Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios
type: conference
user_id: '14931'
year: '2011'
...
---
_id: '17245'
author:
- first_name: Lars
full_name: Schillingmann, Lars
last_name: Schillingmann
- first_name: Petra
full_name: Wagner, Petra
last_name: Wagner
- first_name: Christian
full_name: Munier, Christian
last_name: Munier
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
citation:
ama: 'Schillingmann L, Wagner P, Munier C, Wrede B, Rohlfing K. Acoustic Packaging
and the Learning of Words. In: ; 2011. doi:10.3389/conf.fncom.2011.52.00020'
apa: Schillingmann, L., Wagner, P., Munier, C., Wrede, B., & Rohlfing, K. (2011).
Acoustic Packaging and the Learning of Words. https://doi.org/10.3389/conf.fncom.2011.52.00020
bibtex: '@inproceedings{Schillingmann_Wagner_Munier_Wrede_Rohlfing_2011, title={Acoustic
Packaging and the Learning of Words}, DOI={10.3389/conf.fncom.2011.52.00020},
author={Schillingmann, Lars and Wagner, Petra and Munier, Christian and Wrede,
Britta and Rohlfing, Katharina}, year={2011} }'
chicago: Schillingmann, Lars, Petra Wagner, Christian Munier, Britta Wrede, and
Katharina Rohlfing. “Acoustic Packaging and the Learning of Words,” 2011. https://doi.org/10.3389/conf.fncom.2011.52.00020.
ieee: 'L. Schillingmann, P. Wagner, C. Munier, B. Wrede, and K. Rohlfing, “Acoustic
Packaging and the Learning of Words,” 2011, doi: 10.3389/conf.fncom.2011.52.00020.'
mla: Schillingmann, Lars, et al. Acoustic Packaging and the Learning of Words.
2011, doi:10.3389/conf.fncom.2011.52.00020.
short: 'L. Schillingmann, P. Wagner, C. Munier, B. Wrede, K. Rohlfing, in: 2011.'
date_created: 2020-06-24T13:02:11Z
date_updated: 2023-02-01T12:54:16Z
department:
- _id: '749'
doi: 10.3389/conf.fncom.2011.52.00020
keyword:
- Prominence
- Multimodal Action Segmentation
- Feedback
- Color Saliency
- Human Robot Interaction
language:
- iso: eng
publication_identifier:
issn:
- 1662-5188
status: public
title: Acoustic Packaging and the Learning of Words
type: conference
user_id: '14931'
year: '2011'
...
---
_id: '17272'
abstract:
- lang: eng
text: In developmental research, tutoring behavior has been identified as scaffolding
infants' learning processes. It has been defined in terms of child-directed speech
(Motherese), child-directed motion (Motionese), and contingency. In the field
of developmental robotics, research often assumes that in human-robot interaction
(HRI), robots are treated similar to infants, because their immature cognitive
capabilities benefit from this behavior. However, according to our knowledge,
it has barely been studied whether this is true and how exactly humans alter their
behavior towards a robotic interaction partner. In this paper, we present results
concerning the acceptance of a robotic agent in a social learning scenario obtained
via comparison to adults and 8-11 months old infants in equal conditions. These
results constitute an important empirical basis for making use of tutoring behavior
in social robotics. In our study, we performed a detailed multimodal analysis
of HRI in a tutoring situation using the example of a robot simulation equipped
with a bottom-up saliency-based attention model. Our results reveal significant
differences in hand movement velocity, motion pauses, range of motion, and eye
gaze suggesting that for example adults decrease their hand movement velocity
in an Adult-Child Interaction (ACI), opposed to an Adult-Adult Interaction (AAI)
and this decrease is even higher in the Adult-Robot Interaction (ARI). We also
found important differences between ACI and ARI in how the behavior is modified
over time as the interaction unfolds. These findings indicate the necessity of
integrating top-down feedback structures into a bottom-up system for robots to
be fully accepted as interaction partners.
author:
- first_name: Anna-Lisa
full_name: Vollmer, Anna-Lisa
last_name: Vollmer
- first_name: Katrin Solveig
full_name: Lohan, Katrin Solveig
last_name: Lohan
- first_name: Kerstin
full_name: Fischer, Kerstin
last_name: Fischer
- first_name: Yukie
full_name: Nagai, Yukie
last_name: Nagai
- first_name: Karola
full_name: Pitsch, Karola
last_name: Pitsch
- first_name: Jannik
full_name: Fritsch, Jannik
last_name: Fritsch
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
citation:
ama: 'Vollmer A-L, Lohan KS, Fischer K, et al. People modify their tutoring behavior
in robot-directed interaction for action learning. In: Development and Learning,
2009. ICDL 2009. IEEE 8th International Conference on Development and Learning.
IEEE; 2009:1-6. doi:10.1109/DEVLRN.2009.5175516'
apa: Vollmer, A.-L., Lohan, K. S., Fischer, K., Nagai, Y., Pitsch, K., Fritsch,
J., Rohlfing, K., & Wrede, B. (2009). People modify their tutoring behavior
in robot-directed interaction for action learning. Development and Learning,
2009. ICDL 2009. IEEE 8th International Conference on Development and Learning,
1–6. https://doi.org/10.1109/DEVLRN.2009.5175516
bibtex: '@inproceedings{Vollmer_Lohan_Fischer_Nagai_Pitsch_Fritsch_Rohlfing_Wrede_2009,
title={People modify their tutoring behavior in robot-directed interaction for
action learning}, DOI={10.1109/DEVLRN.2009.5175516},
booktitle={Development and Learning, 2009. ICDL 2009. IEEE 8th International Conference
on Development and Learning}, publisher={IEEE}, author={Vollmer, Anna-Lisa and
Lohan, Katrin Solveig and Fischer, Kerstin and Nagai, Yukie and Pitsch, Karola
and Fritsch, Jannik and Rohlfing, Katharina and Wrede, Britta}, year={2009}, pages={1–6}
}'
chicago: Vollmer, Anna-Lisa, Katrin Solveig Lohan, Kerstin Fischer, Yukie Nagai,
Karola Pitsch, Jannik Fritsch, Katharina Rohlfing, and Britta Wrede. “People Modify
Their Tutoring Behavior in Robot-Directed Interaction for Action Learning.” In
Development and Learning, 2009. ICDL 2009. IEEE 8th International Conference
on Development and Learning, 1–6. IEEE, 2009. https://doi.org/10.1109/DEVLRN.2009.5175516.
ieee: 'A.-L. Vollmer et al., “People modify their tutoring behavior in robot-directed
interaction for action learning,” in Development and Learning, 2009. ICDL 2009.
IEEE 8th International Conference on Development and Learning, 2009, pp. 1–6,
doi: 10.1109/DEVLRN.2009.5175516.'
mla: Vollmer, Anna-Lisa, et al. “People Modify Their Tutoring Behavior in Robot-Directed
Interaction for Action Learning.” Development and Learning, 2009. ICDL 2009.
IEEE 8th International Conference on Development and Learning, IEEE, 2009,
pp. 1–6, doi:10.1109/DEVLRN.2009.5175516.
short: 'A.-L. Vollmer, K.S. Lohan, K. Fischer, Y. Nagai, K. Pitsch, J. Fritsch,
K. Rohlfing, B. Wrede, in: Development and Learning, 2009. ICDL 2009. IEEE 8th
International Conference on Development and Learning, IEEE, 2009, pp. 1–6.'
date_created: 2020-06-24T13:02:43Z
date_updated: 2023-02-01T13:06:43Z
department:
- _id: '749'
doi: 10.1109/DEVLRN.2009.5175516
keyword:
- robot simulation
- hand movement velocity
- robotic interaction partner
- robotic agent
- robot-directed interaction
- multimodal analysis
- Motionese
- Motherese
- intelligent tutoring systems
- immature cognitive capability
- human computer interaction
- eye gaze
- child-directed speech
- child-directed motion
- bottom-up system
- bottom-up saliency-based attention model
- adult-robot interaction
- adult-child interaction
- adult-adult interaction
- human-robot interaction
- action learning
- social learning scenario
- social robotics
- software agents
- top-down feedback structures
- tutoring behavior
language:
- iso: eng
page: 1-6
publication: Development and Learning, 2009. ICDL 2009. IEEE 8th International Conference
on Development and Learning
publisher: IEEE
status: public
title: People modify their tutoring behavior in robot-directed interaction for action
learning
type: conference
user_id: '14931'
year: '2009'
...
---
_id: '17267'
author:
- first_name: Manja
full_name: Lohse, Manja
last_name: Lohse
- first_name: Marc
full_name: Hanheide, Marc
last_name: Hanheide
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Gerhard
full_name: Sagerer, Gerhard
last_name: Sagerer
citation:
ama: 'Lohse M, Hanheide M, Rohlfing K, Sagerer G. Systemic interaction analysis
(SInA) in HRI. In: Proceedings of the 4th ACM/IEEE International Conference
on Human Robot Interaction - HRI ’09. ; 2009:93-100. doi:10.1145/1514095.1514114'
apa: Lohse, M., Hanheide, M., Rohlfing, K., & Sagerer, G. (2009). Systemic interaction
analysis (SInA) in HRI. Proceedings of the 4th ACM/IEEE International Conference
on Human Robot Interaction - HRI ’09, 93–100. https://doi.org/10.1145/1514095.1514114
bibtex: '@inproceedings{Lohse_Hanheide_Rohlfing_Sagerer_2009, title={Systemic interaction
analysis (SInA) in HRI}, DOI={10.1145/1514095.1514114},
booktitle={Proceedings of the 4th ACM/IEEE international conference on Human robot
interaction - HRI ’09}, author={Lohse, Manja and Hanheide, Marc and Rohlfing,
Katharina and Sagerer, Gerhard}, year={2009}, pages={93–100} }'
chicago: Lohse, Manja, Marc Hanheide, Katharina Rohlfing, and Gerhard Sagerer. “Systemic
Interaction Analysis (SInA) in HRI.” In Proceedings of the 4th ACM/IEEE International
Conference on Human Robot Interaction - HRI ’09, 93–100, 2009. https://doi.org/10.1145/1514095.1514114.
ieee: 'M. Lohse, M. Hanheide, K. Rohlfing, and G. Sagerer, “Systemic interaction
analysis (SInA) in HRI,” in Proceedings of the 4th ACM/IEEE international conference
on Human robot interaction - HRI ’09, 2009, pp. 93–100, doi: 10.1145/1514095.1514114.'
mla: Lohse, Manja, et al. “Systemic Interaction Analysis (SInA) in HRI.” Proceedings
of the 4th ACM/IEEE International Conference on Human Robot Interaction - HRI
’09, 2009, pp. 93–100, doi:10.1145/1514095.1514114.
short: 'M. Lohse, M. Hanheide, K. Rohlfing, G. Sagerer, in: Proceedings of the 4th
ACM/IEEE International Conference on Human Robot Interaction - HRI ’09, 2009,
pp. 93–100.'
date_created: 2020-06-24T13:02:37Z
date_updated: 2023-02-01T13:05:01Z
department:
- _id: '749'
doi: 10.1145/1514095.1514114
keyword:
- SINA
- human robot interaction
- biron
language:
- iso: eng
page: 93-100
publication: Proceedings of the 4th ACM/IEEE international conference on Human robot
interaction - HRI '09
status: public
title: Systemic interaction analysis (SInA) in HRI
type: conference
user_id: '14931'
year: '2009'
...
---
_id: '17278'
abstract:
- lang: eng
text: This paper investigates the influence of feedback provided by an autonomous
robot (BIRON) on users’ discursive behavior. A user study is described during
which users show objects to the robot. The results of the experiment indicate,
that the robot’s verbal feedback utterances cause the humans to adapt their own
way of speaking. The changes in users’ verbal behavior are due to their beliefs
about the robots knowledge and abilities. In this paper they are identified and
grouped. Moreover, the data implies variations in user behavior regarding gestures.
Unlike speech, the robot was not able to give feedback with gestures. Due to the
lack of feedback, users did not seem to have a consistent mental representation
of the robot’s abilities to recognize gestures. As a result, changes between different
gestures are interpreted to be unconscious variations accompanying speech.
author:
- first_name: Manja
full_name: Lohse, Manja
last_name: Lohse
- first_name: Katharina
full_name: Rohlfing, Katharina
id: '50352'
last_name: Rohlfing
- first_name: Britta
full_name: Wrede, Britta
last_name: Wrede
- first_name: Gerhard
full_name: Sagerer, Gerhard
last_name: Sagerer
citation:
ama: 'Lohse M, Rohlfing K, Wrede B, Sagerer G. “Try something else!” — When users
change their discursive behavior in human-robot interaction. In: ; 2008:3481-3486.
doi:10.1109/ROBOT.2008.4543743'
apa: Lohse, M., Rohlfing, K., Wrede, B., & Sagerer, G. (2008). “Try something
else!” — When users change their discursive behavior in human-robot interaction.
3481–3486. https://doi.org/10.1109/ROBOT.2008.4543743
bibtex: '@inproceedings{Lohse_Rohlfing_Wrede_Sagerer_2008, title={“Try something
else!” — When users change their discursive behavior in human-robot interaction},
DOI={10.1109/ROBOT.2008.4543743},
author={Lohse, Manja and Rohlfing, Katharina and Wrede, Britta and Sagerer, Gerhard},
year={2008}, pages={3481–3486} }'
chicago: Lohse, Manja, Katharina Rohlfing, Britta Wrede, and Gerhard Sagerer. “‘Try
Something Else!’ — When Users Change Their Discursive Behavior in Human-Robot
Interaction,” 3481–86, 2008. https://doi.org/10.1109/ROBOT.2008.4543743.
ieee: 'M. Lohse, K. Rohlfing, B. Wrede, and G. Sagerer, “‘Try something else!’ —
When users change their discursive behavior in human-robot interaction,” 2008,
pp. 3481–3486, doi: 10.1109/ROBOT.2008.4543743.'
mla: Lohse, Manja, et al. “Try Something Else!” — When Users Change Their Discursive
Behavior in Human-Robot Interaction. 2008, pp. 3481–86, doi:10.1109/ROBOT.2008.4543743.
short: 'M. Lohse, K. Rohlfing, B. Wrede, G. Sagerer, in: 2008, pp. 3481–3486.'
date_created: 2020-06-24T13:02:49Z
date_updated: 2023-02-01T13:08:20Z
department:
- _id: '749'
doi: 10.1109/ROBOT.2008.4543743
keyword:
- discursive behavior
- autonomous robot
- BIRON
- man-machine systems
- robot abilities
- robot knowledge
- user gestures
- robot verbal feedback utterance
- speech processing
- user verbal behavior
- service robots
- human-robot interaction
- human computer interaction
- gesture recognition
language:
- iso: eng
page: 3481-3486
publication_identifier:
isbn:
- 1050-4729
status: public
title: “Try something else!” — When users change their discursive behavior in human-robot
interaction
type: conference
user_id: '14931'
year: '2008'
...