---
_id: '43437'
abstract:
- lang: eng
  text: '<jats:p>In virtual reality (VR), participants may not always have hands,
    bodies, eyes, or even voices—using VR helmets and two controllers, participants
    control an avatar through virtual worlds that do not necessarily obey familiar
    laws of physics; moreover, the avatar’s bodily characteristics may not neatly
    match our bodies in the physical world. Despite these limitations and specificities,
    humans get things done through collaboration and the creative use of the environment.
    While multiuser interactive VR is attracting greater numbers of participants,
    there are currently few attempts to analyze the in situ interaction systematically.
    This paper proposes a video-analytic detail-oriented methodological framework
    for studying virtual reality interaction. Using multimodal conversation analysis,
    the paper investigates a nonverbal, embodied, two-person interaction: two players
    in a survival game strive to gesturally resolve a misunderstanding regarding an
    in-game mechanic—however, both of their microphones are turned off for the duration
    of play. The players’ inability to resort to complex language to resolve this
    issue results in a dense sequence of back-and-forth activity involving gestures,
    object manipulation, gaze, and body work. Most crucially, timing and modified
    repetitions of previously produced actions turn out to be the key to overcome
    both technical and communicative challenges. The paper analyzes these action sequences,
    demonstrates how they generate intended outcomes, and proposes a vocabulary to
    speak about these types of interaction more generally. The findings demonstrate
    the viability of multimodal analysis of VR interaction, shed light on unique challenges
    of analyzing interaction in virtual reality, and generate broader methodological
    insights about the study of nonverbal action.</jats:p>'
article_type: original
author:
- first_name: Nils
  full_name: Klowait, Nils
  id: '98454'
  last_name: Klowait
  orcid: 0000-0002-7347-099X
citation:
  ama: Klowait N. On the Multimodal Resolution of a Search Sequence in Virtual Reality.
    <i>Human Behavior and Emerging Technologies</i>. 2023;2023:1-15. doi:<a href="https://doi.org/10.1155/2023/8417012">10.1155/2023/8417012</a>
  apa: Klowait, N. (2023). On the Multimodal Resolution of a Search Sequence in Virtual
    Reality. <i>Human Behavior and Emerging Technologies</i>, <i>2023</i>, 1–15. <a
    href="https://doi.org/10.1155/2023/8417012">https://doi.org/10.1155/2023/8417012</a>
  bibtex: '@article{Klowait_2023, title={On the Multimodal Resolution of a Search
    Sequence in Virtual Reality}, volume={2023}, DOI={<a href="https://doi.org/10.1155/2023/8417012">10.1155/2023/8417012</a>},
    journal={Human Behavior and Emerging Technologies}, publisher={Hindawi Limited},
    author={Klowait, Nils}, year={2023}, pages={1–15} }'
  chicago: 'Klowait, Nils. “On the Multimodal Resolution of a Search Sequence in Virtual
    Reality.” <i>Human Behavior and Emerging Technologies</i> 2023 (2023): 1–15. <a
    href="https://doi.org/10.1155/2023/8417012">https://doi.org/10.1155/2023/8417012</a>.'
  ieee: 'N. Klowait, “On the Multimodal Resolution of a Search Sequence in Virtual
    Reality,” <i>Human Behavior and Emerging Technologies</i>, vol. 2023, pp. 1–15,
    2023, doi: <a href="https://doi.org/10.1155/2023/8417012">10.1155/2023/8417012</a>.'
  mla: Klowait, Nils. “On the Multimodal Resolution of a Search Sequence in Virtual
    Reality.” <i>Human Behavior and Emerging Technologies</i>, vol. 2023, Hindawi
    Limited, 2023, pp. 1–15, doi:<a href="https://doi.org/10.1155/2023/8417012">10.1155/2023/8417012</a>.
  short: N. Klowait, Human Behavior and Emerging Technologies 2023 (2023) 1–15.
date_created: 2023-04-06T10:57:28Z
date_updated: 2024-03-26T09:40:53Z
ddc:
- '300'
department:
- _id: '9'
doi: 10.1155/2023/8417012
file:
- access_level: closed
  content_type: application/pdf
  creator: nklowait
  date_created: 2023-04-06T11:00:01Z
  date_updated: 2023-04-06T11:00:01Z
  file_id: '43438'
  file_name: Klowait_2023a.pdf
  file_size: 2877385
  relation: main_file
  success: 1
file_date_updated: 2023-04-06T11:00:01Z
funded_apc: '1'
has_accepted_license: '1'
intvolume: '      2023'
keyword:
- Human-Computer Interaction
- General Social Sciences
- Social Psychology
- 'Virtual Reality : Multimodality'
- Nonverbal Interaction
- Search Sequence
- Gesture
- Co-Operative Action
- Goodwin
- Ethnomethodology
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: https://doi.org/10.1155/2023/8417012
oa: '1'
page: 1-15
project:
- _id: '119'
  name: 'TRR 318 - Ö: TRR 318 - Project Area Ö'
publication: Human Behavior and Emerging Technologies
publication_identifier:
  issn:
  - 2578-1863
publication_status: published
publisher: Hindawi Limited
quality_controlled: '1'
status: public
title: On the Multimodal Resolution of a Search Sequence in Virtual Reality
type: journal_article
user_id: '98454'
volume: 2023
year: '2023'
...