Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study

Y. Wang, H. Buschmeier, in: Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, 2023, pp. 15372–15379.

Conference Paper | Published | English
Author
Abstract
It is generally assumed that language (written and spoken) follows the entropy rate constancy (ERC) principle, which states that the information density of a text is constant over time. Recently, this has also been found for nonverbal gestures used in monologue, but it is still unclear whether the ERC principle also applies to listeners' nonverbal signals. We focus on listeners' gaze behaviour extracted from video-recorded conversations and trained a transformer-based neural sequence model to process the gaze data of the dialogues and compute its information density. We also compute the information density of the corresponding speech using a pre-trained language model. Our results show (1) that listeners' gaze behaviour in dialogues roughly follows the ERC principle, as well as (2) a congruence between information density of speech and listeners' gaze behaviour.
Publishing Year
Proceedings Title
Findings of the Association for Computational Linguistics: EMNLP 2023
Page
15372–15379
Conference
The 2023 Conference on Empirical Methods in Natural Language Processing
Conference Location
Singapore
LibreCat-ID

Cite this

Wang Y, Buschmeier H. Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study. In: Findings of the Association for Computational Linguistics: EMNLP 2023. ; 2023:15372–15379.
Wang, Y., & Buschmeier, H. (2023). Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study. Findings of the Association for Computational Linguistics: EMNLP 2023, 15372–15379.
@inproceedings{Wang_Buschmeier_2023, place={Singapore}, title={Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study}, booktitle={Findings of the Association for Computational Linguistics: EMNLP 2023}, author={Wang, Yu and Buschmeier, Hendrik}, year={2023}, pages={15372–15379} }
Wang, Yu, and Hendrik Buschmeier. “Does Listener Gaze in Face-to-Face Interaction Follow the Entropy Rate Constancy Principle: An Empirical Study.” In Findings of the Association for Computational Linguistics: EMNLP 2023, 15372–15379. Singapore, 2023.
Y. Wang and H. Buschmeier, “Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study,” in Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, 2023, pp. 15372–15379.
Wang, Yu, and Hendrik Buschmeier. “Does Listener Gaze in Face-to-Face Interaction Follow the Entropy Rate Constancy Principle: An Empirical Study.” Findings of the Association for Computational Linguistics: EMNLP 2023, 2023, pp. 15372–15379.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
Restricted Closed Access

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar