Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions

B. Wrede, L. Schillingmann, K. Rohlfing, in: L. Gogate, G. Hollich (Eds.), Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence, IGI Global, 2013, pp. 224–240.

Download
No fulltext has been uploaded.
Book Chapter | English
Author
; ;
Book Editor
;
Abstract
If they are to learn and interact with humans, robots need to understand actions and make use of language in social interactions. Hirsh-Pasek and Golinkoff (1996) have emphasized the use of language to learn actions when introducing the idea of acoustic packaging in human development. This idea suggests that acoustic information, typically in the form of narration, overlaps with action sequences, thereby providing infants with a bottom-up guide to attend to relevant parts and to find structure within them. The authors developed a computational model of the multimodal interplay of action and language in tutoring situations. This chapter presents the results of applying this model to multimodal parent-infant interaction data. Results are twofold and indicate that (a) infant-directed interaction is more structured than adult-directed interaction in that it contains more packages, and these packages have fewer motion segments; and (b) the synchronous structure within infant-directed packages contains redundant information making it possible to solve the reference problem when tying color adjectives to a moving object.
Publishing Year
Book Title
Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence
Page
224-240
ISBN
LibreCat-ID

Cite this

Wrede B, Schillingmann L, Rohlfing K. Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions. In: Gogate L, Hollich G, eds. Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence. IGI Global; 2013:224-240. doi:10.4018/978-1-4666-2973-8.ch010
Wrede, B., Schillingmann, L., & Rohlfing, K. (2013). Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions. In L. Gogate & G. Hollich (Eds.), Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence (pp. 224–240). IGI Global. https://doi.org/10.4018/978-1-4666-2973-8.ch010
@inbook{Wrede_Schillingmann_Rohlfing_2013, title={Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions}, DOI={10.4018/978-1-4666-2973-8.ch010}, booktitle={Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence}, publisher={IGI Global}, author={Wrede, Britta and Schillingmann, Lars and Rohlfing, Katharina}, editor={Gogate, Lakshmi and Hollich, GeorgeEditors}, year={2013}, pages={224–240} }
Wrede, Britta, Lars Schillingmann, and Katharina Rohlfing. “Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions.” In Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence, edited by Lakshmi Gogate and George Hollich, 224–40. IGI Global, 2013. https://doi.org/10.4018/978-1-4666-2973-8.ch010.
B. Wrede, L. Schillingmann, and K. Rohlfing, “Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions,” in Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence, L. Gogate and G. Hollich, Eds. IGI Global, 2013, pp. 224–240.
Wrede, Britta, et al. “Making Use of Multi-Modal Synchrony: A Model of Acoustic Packaging to Tie Words to Actions.” Theoretical and Computational Models of Word Learning: Trends in Psychology and Artificial Intelligence, edited by Lakshmi Gogate and George Hollich, IGI Global, 2013, pp. 224–40, doi:10.4018/978-1-4666-2973-8.ch010.

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar
ISBN Search