Syntactic complexity convergence in dialogue: Analysis of the phenomenon and application to LLM detection

Y. Wang, Y. Chen, Y. Wang, S. Eger, H. Buschmeier, in: Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, ACL, Budapest, Hungary, n.d.

Download
No fulltext has been uploaded.
Conference Paper | Accepted | English
Author
Wang, Yu; Chen, Yanran; Wang, Yifan; Eger, Steffen; Buschmeier, HendrikLibreCat
Abstract
We revisit the under-explored phenomenon of syntactic complexity convergence in dialogue. Extending prior topic-level analyses to full conversations, we examine five human-human datasets and a set of human-LLM dialogues. We integrate and evaluate a multidimensional set of syntactic complexity metrics to quantify structural variation in dialogue. Our analyses reveal robust syntactic complexity convergence across human-human datasets, especially in task-oriented interactions, and statistical tests confirm that these effects are not due to chance. In contrast, human-LLM dialogues show no significant convergence under individual metrics; however, linear-CKA uncovers a distinct cross-metric convergence pattern. Motivated by these differences, we use syntactic complexity as a feature for detecting LLM-involved dialogue, achieving 96\% accuracy. Our classification results demonstrate its potential without relying on likelihood-based signals such as surprisal, which require a language model as the estimator.
Publishing Year
Proceedings Title
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Conference
2026 Conference on Empirical Methods in Natural Language Processing
Conference Location
Budapest, Hungary
Conference Date
2026-10-24 – 2026-10-29
LibreCat-ID

Cite this

Wang Y, Chen Y, Wang Y, Eger S, Buschmeier H. Syntactic complexity convergence in dialogue: Analysis of the phenomenon and application to LLM detection. In: Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing. ACL.
Wang, Y., Chen, Y., Wang, Y., Eger, S., & Buschmeier, H. (n.d.). Syntactic complexity convergence in dialogue: Analysis of the phenomenon and application to LLM detection. Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing. 2026 Conference on Empirical Methods in Natural Language Processing, Budapest, Hungary.
@inproceedings{Wang_Chen_Wang_Eger_Buschmeier, place={Budapest, Hungary}, title={Syntactic complexity convergence in dialogue: Analysis of the phenomenon and application to LLM detection}, booktitle={Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing}, publisher={ACL}, author={Wang, Yu and Chen, Yanran and Wang, Yifan and Eger, Steffen and Buschmeier, Hendrik} }
Wang, Yu, Yanran Chen, Yifan Wang, Steffen Eger, and Hendrik Buschmeier. “Syntactic Complexity Convergence in Dialogue: Analysis of the Phenomenon and Application to LLM Detection.” In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing. Budapest, Hungary: ACL, n.d.
Y. Wang, Y. Chen, Y. Wang, S. Eger, and H. Buschmeier, “Syntactic complexity convergence in dialogue: Analysis of the phenomenon and application to LLM detection,” presented at the 2026 Conference on Empirical Methods in Natural Language Processing, Budapest, Hungary.
Wang, Yu, et al. “Syntactic Complexity Convergence in Dialogue: Analysis of the Phenomenon and Application to LLM Detection.” Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, ACL.

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar