---
_id: '66854'
abstract:
- lang: eng
  text: |-
    <jats:title>Abstract</jats:title>
                      <jats:p>Investigating the real-time interplay between language and vision has traditionally involved a trade-off between experimental control and interactive setups. To address this challenge, we present a methodological framework that embeds the visual world paradigm (VWP) within a continuous, goal-directed human–robot interaction (HRI) task. By augmenting VWP in an HRI setup to produce standardized yet responsive verbal and non-verbal behaviours, the framework makes it possible to selectively examine comprehension, production, actions and their relation to visual attention in real-time. We demonstrate the utility of the framework through a proof-of-concept manipulating action structure, specifically path and manner, as well as other-initiated repair formats, namely open and restricted requests. The findings show that the setup reliably captures time-locked referential gaze dynamics following comprehension and preceding production processes. They further indicate that differences in action history systematically influence speakers’ pre-verbal cognitive processes and their subsequent linguistic choices. These findings suggest that HRI can provide a useful methodological middle ground to investigate language processes online in a tightly controlled setup without disrupting the interaction. More broadly, the framework offers a test bed for examining whether established psycholinguistic findings extend to HRI setups. At the same time, it provides HRI researchers with an empirical basis for developing adaptive agents informed by online language-vision interaction theories.</jats:p>
article_number: '112'
author:
- first_name: Amit
  full_name: Singh, Amit
  last_name: Singh
- first_name: Katharina J.
  full_name: Rohlfing, Katharina J.
  last_name: Rohlfing
citation:
  ama: Singh A, Rohlfing KJ. A Methodological Framework for Studying Online Language–Vision
    Interplay in Human–Robot Interaction. <i>Journal of Psycholinguistic Research</i>.
    2026;55(5). doi:<a href="https://doi.org/10.1007/s10936-026-10296-z">10.1007/s10936-026-10296-z</a>
  apa: Singh, A., &#38; Rohlfing, K. J. (2026). A Methodological Framework for Studying
    Online Language–Vision Interplay in Human–Robot Interaction. <i>Journal of Psycholinguistic
    Research</i>, <i>55</i>(5), Article 112. <a href="https://doi.org/10.1007/s10936-026-10296-z">https://doi.org/10.1007/s10936-026-10296-z</a>
  bibtex: '@article{Singh_Rohlfing_2026, title={A Methodological Framework for Studying
    Online Language–Vision Interplay in Human–Robot Interaction}, volume={55}, DOI={<a
    href="https://doi.org/10.1007/s10936-026-10296-z">10.1007/s10936-026-10296-z</a>},
    number={5112}, journal={Journal of Psycholinguistic Research}, publisher={Springer
    Science and Business Media LLC}, author={Singh, Amit and Rohlfing, Katharina J.},
    year={2026} }'
  chicago: Singh, Amit, and Katharina J. Rohlfing. “A Methodological Framework for
    Studying Online Language–Vision Interplay in Human–Robot Interaction.” <i>Journal
    of Psycholinguistic Research</i> 55, no. 5 (2026). <a href="https://doi.org/10.1007/s10936-026-10296-z">https://doi.org/10.1007/s10936-026-10296-z</a>.
  ieee: 'A. Singh and K. J. Rohlfing, “A Methodological Framework for Studying Online
    Language–Vision Interplay in Human–Robot Interaction,” <i>Journal of Psycholinguistic
    Research</i>, vol. 55, no. 5, Art. no. 112, 2026, doi: <a href="https://doi.org/10.1007/s10936-026-10296-z">10.1007/s10936-026-10296-z</a>.'
  mla: Singh, Amit, and Katharina J. Rohlfing. “A Methodological Framework for Studying
    Online Language–Vision Interplay in Human–Robot Interaction.” <i>Journal of Psycholinguistic
    Research</i>, vol. 55, no. 5, 112, Springer Science and Business Media LLC, 2026,
    doi:<a href="https://doi.org/10.1007/s10936-026-10296-z">10.1007/s10936-026-10296-z</a>.
  short: A. Singh, K.J. Rohlfing, Journal of Psycholinguistic Research 55 (2026).
date_created: 2026-08-26T10:28:57Z
date_updated: 2026-08-26T10:30:40Z
department:
- _id: '749'
- _id: '660'
doi: 10.1007/s10936-026-10296-z
intvolume: '        55'
issue: '5'
language:
- iso: eng
publication: Journal of Psycholinguistic Research
publication_identifier:
  issn:
  - 0090-6905
  - 1573-6555
publication_status: published
publisher: Springer Science and Business Media LLC
status: public
title: A Methodological Framework for Studying Online Language–Vision Interplay in
  Human–Robot Interaction
type: journal_article
user_id: '91018'
volume: 55
year: '2026'
...