---
_id: '17206'
abstract:
- lang: eng
  text: If they are to learn and interact with humans, robots need to understand actions
    and make use of language in social interactions. Hirsh-Pasek and Golinkoff (1996)
    have emphasized the use of language to learn actions when introducing the idea
    of acoustic packaging in human development. This idea suggests that acoustic information,
    typically in the form of narration, overlaps with action sequences, thereby providing
    infants with a bottom-up guide to attend to relevant parts and to find structure
    within them. The authors developed a computational model of the multimodal interplay
    of action and language in tutoring situations. This chapter presents the results
    of applying this model to multimodal parent-infant interaction data. Results are
    twofold and indicate that (a) infant-directed interaction is more structured than
    adult-directed interaction in that it contains more packages, and these packages
    have fewer motion segments; and (b) the synchronous structure within infant-directed
    packages contains redundant information making it possible to solve the reference
    problem when tying color adjectives to a moving object.
author:
- first_name: Britta
  full_name: Wrede, Britta
  last_name: Wrede
- first_name: Lars
  full_name: Schillingmann, Lars
  last_name: Schillingmann
- first_name: Katharina
  full_name: Rohlfing, Katharina
  id: '50352'
  last_name: Rohlfing
citation:
  ama: 'Wrede B, Schillingmann L, Rohlfing K. Making Use of Multi-Modal Synchrony:
    A Model of Acoustic Packaging to Tie Words to Actions. In: Gogate L, Hollich G,
    eds. <i>Theoretical and Computational Models of Word Learning: Trends in Psychology
    and Artificial Intelligence</i>. IGI Global; 2013:224-240. doi:<a href="https://doi.org/10.4018/978-1-4666-2973-8.ch010">10.4018/978-1-4666-2973-8.ch010</a>'
  apa: 'Wrede, B., Schillingmann, L., &#38; Rohlfing, K. (2013). Making Use of Multi-Modal
    Synchrony: A Model of Acoustic Packaging to Tie Words to Actions. In L. Gogate
    &#38; G. Hollich (Eds.), <i>Theoretical and Computational Models of Word Learning:
    Trends in Psychology and Artificial Intelligence</i> (pp. 224–240). IGI Global.
    <a href="https://doi.org/10.4018/978-1-4666-2973-8.ch010">https://doi.org/10.4018/978-1-4666-2973-8.ch010</a>'
  bibtex: '@inbook{Wrede_Schillingmann_Rohlfing_2013, title={Making Use of Multi-Modal
    Synchrony: A Model of Acoustic Packaging to Tie Words to Actions}, DOI={<a href="https://doi.org/10.4018/978-1-4666-2973-8.ch010">10.4018/978-1-4666-2973-8.ch010</a>},
    booktitle={Theoretical and Computational Models of Word Learning: Trends in Psychology
    and Artificial Intelligence}, publisher={IGI Global}, author={Wrede, Britta and
    Schillingmann, Lars and Rohlfing, Katharina}, editor={Gogate, Lakshmi and Hollich,
    George}, year={2013}, pages={224–240} }'
  chicago: 'Wrede, Britta, Lars Schillingmann, and Katharina Rohlfing. “Making Use
    of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions.”
    In <i>Theoretical and Computational Models of Word Learning: Trends in Psychology
    and Artificial Intelligence</i>, edited by Lakshmi Gogate and George Hollich,
    224–40. IGI Global, 2013. <a href="https://doi.org/10.4018/978-1-4666-2973-8.ch010">https://doi.org/10.4018/978-1-4666-2973-8.ch010</a>.'
  ieee: 'B. Wrede, L. Schillingmann, and K. Rohlfing, “Making Use of Multi-Modal Synchrony:
    A Model of Acoustic Packaging to Tie Words to Actions,” in <i>Theoretical and
    Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence</i>,
    L. Gogate and G. Hollich, Eds. IGI Global, 2013, pp. 224–240.'
  mla: 'Wrede, Britta, et al. “Making Use of Multi-Modal Synchrony: A Model of Acoustic
    Packaging to Tie Words to Actions.” <i>Theoretical and Computational Models of
    Word Learning: Trends in Psychology and Artificial Intelligence</i>, edited by
    Lakshmi Gogate and George Hollich, IGI Global, 2013, pp. 224–40, doi:<a href="https://doi.org/10.4018/978-1-4666-2973-8.ch010">10.4018/978-1-4666-2973-8.ch010</a>.'
  short: 'B. Wrede, L. Schillingmann, K. Rohlfing, in: L. Gogate, G. Hollich (Eds.),
    Theoretical and Computational Models of Word Learning: Trends in Psychology and
    Artificial Intelligence, IGI Global, 2013, pp. 224–240.'
date_created: 2020-06-24T13:01:26Z
date_updated: 2023-02-01T16:13:30Z
department:
- _id: '749'
doi: 10.4018/978-1-4666-2973-8.ch010
editor:
- first_name: Lakshmi
  full_name: Gogate, Lakshmi
  last_name: Gogate
- first_name: George
  full_name: Hollich, George
  last_name: Hollich
language:
- iso: eng
page: 224-240
publication: 'Theoretical and Computational Models of Word Learning: Trends in Psychology
  and Artificial Intelligence'
publication_identifier:
  isbn:
  - '1466629738'
publisher: IGI Global
status: public
title: 'Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie
  Words to Actions'
type: book_chapter
user_id: '14931'
year: '2013'
...