A Computational Model of Acoustic Packaging

L. Schillingmann, B. Wrede, K. Rohlfing, IEEE Transactions on Autonomous Mental Development 1 (2009) 226–237.

Download
No fulltext has been uploaded.
Journal Article | English
Author
; ;
Abstract
In order to learn and interact with humans, robots need to understand actions and make use of language in social interactions. The use of language for the learning of actions has been emphasized by Hirsh-Pasek and Golinkoff (MIT Press, 1996), introducing the idea of acoustic packaging. Accordingly, it has been suggested that acoustic information, typically in the form of narration, overlaps with action sequences and provides infants with a bottom-up guide to attend to relevant parts and to find structure within them. In this article, we present a computational model of the multimodal interplay of action and language in tutoring situations. For our purpose, we understand events as temporal intervals, which have to be segmented in both, the visual and the acoustic modality. Our acoustic packaging algorithm merges the segments from both modalities based on temporal overlap. First evaluation results show that acoustic packaging can provide a meaningful segmentation of action demonstration within tutoring behavior. We discuss our findings with regard to a meaningful action segmentation. Based on our future vision of acoustic packaging we point out a roadmap describing the further development of acoustic packaging and interactive scenarios it is employed in.
Publishing Year
Journal Title
IEEE Transactions on Autonomous Mental Development
Volume
1
Issue
4
Page
226-237
ISSN
LibreCat-ID

Cite this

Schillingmann L, Wrede B, Rohlfing K. A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development. 2009;1(4):226-237. doi:10.1109/TAMD.2009.2039135
Schillingmann, L., Wrede, B., & Rohlfing, K. (2009). A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development, 1(4), 226–237. https://doi.org/10.1109/TAMD.2009.2039135
@article{Schillingmann_Wrede_Rohlfing_2009, title={A Computational Model of Acoustic Packaging}, volume={1}, DOI={10.1109/TAMD.2009.2039135}, number={4}, journal={IEEE Transactions on Autonomous Mental Development}, publisher={Institute of Electrical & Electronics Engineers (IEEE)}, author={Schillingmann, Lars and Wrede, Britta and Rohlfing, Katharina}, year={2009}, pages={226–237} }
Schillingmann, Lars, Britta Wrede, and Katharina Rohlfing. “A Computational Model of Acoustic Packaging.” IEEE Transactions on Autonomous Mental Development 1, no. 4 (2009): 226–37. https://doi.org/10.1109/TAMD.2009.2039135.
L. Schillingmann, B. Wrede, and K. Rohlfing, “A Computational Model of Acoustic Packaging,” IEEE Transactions on Autonomous Mental Development, vol. 1, no. 4, pp. 226–237, 2009.
Schillingmann, Lars, et al. “A Computational Model of Acoustic Packaging.” IEEE Transactions on Autonomous Mental Development, vol. 1, no. 4, Institute of Electrical & Electronics Engineers (IEEE), 2009, pp. 226–37, doi:10.1109/TAMD.2009.2039135.

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar