Is It Worth the Attention? A Comparative Evaluation of Attention Layers for Argument Unit Segmentation

M. Spliethöver, J. Klaff, H. Heuer, in: Proceedings of the 6th Workshop on Argument Mining, Association for Computational Linguistics, Florence, Italy, 2019, pp. 74–82.

Conference Paper | Published | English
Author
; ;
Abstract
Attention mechanisms have seen some success for natural language processing downstream tasks in recent years and generated new state-of-the-art results. A thorough evaluation of the attention mechanism for the task of Argumentation Mining is missing. With this paper, we report a comparative evaluation of attention layers in combination with a bidirectional long short-term memory network, which is the current state-of-the-art approach for the unit segmentation task. We also compare sentence-level contextualized word embeddings to pre-generated ones. Our findings suggest that for this task, the additional attention layer does not improve the performance. In most cases, contextualized embeddings do also not show an improvement on the score achieved by pre-defined embeddings.
Publishing Year
Proceedings Title
Proceedings of the 6th Workshop on Argument Mining
Page
74-82
Conference
6th Workshop on Argument Mining
Conference Location
Florence, Italy
LibreCat-ID

Cite this

Spliethöver M, Klaff J, Heuer H. Is It Worth the Attention? A Comparative Evaluation of Attention Layers for Argument Unit Segmentation. In: Proceedings of the 6th Workshop on Argument Mining. Florence, Italy: Association for Computational Linguistics; 2019:74-82. doi:10.18653/v1/W19-4509
Spliethöver, M., Klaff, J., & Heuer, H. (2019). Is It Worth the Attention? A Comparative Evaluation of Attention Layers for Argument Unit Segmentation. In Proceedings of the 6th Workshop on Argument Mining (pp. 74–82). Florence, Italy: Association for Computational Linguistics. https://doi.org/10.18653/v1/W19-4509
@inproceedings{Spliethöver_Klaff_Heuer_2019, place={Florence, Italy}, title={Is It Worth the Attention? A Comparative Evaluation of Attention Layers for Argument Unit Segmentation}, DOI={10.18653/v1/W19-4509}, booktitle={Proceedings of the 6th Workshop on Argument Mining}, publisher={Association for Computational Linguistics}, author={Spliethöver, Maximilian and Klaff, Jonas and Heuer, Hendrik}, year={2019}, pages={74–82} }
Spliethöver, Maximilian, Jonas Klaff, and Hendrik Heuer. “Is It Worth the Attention? A Comparative Evaluation of Attention Layers for Argument Unit Segmentation.” In Proceedings of the 6th Workshop on Argument Mining, 74–82. Florence, Italy: Association for Computational Linguistics, 2019. https://doi.org/10.18653/v1/W19-4509.
M. Spliethöver, J. Klaff, and H. Heuer, “Is It Worth the Attention? A Comparative Evaluation of Attention Layers for Argument Unit Segmentation,” in Proceedings of the 6th Workshop on Argument Mining, Florence, Italy, 2019, pp. 74–82.
Spliethöver, Maximilian, et al. “Is It Worth the Attention? A Comparative Evaluation of Attention Layers for Argument Unit Segmentation.” Proceedings of the 6th Workshop on Argument Mining, Association for Computational Linguistics, 2019, pp. 74–82, doi:10.18653/v1/W19-4509.

Link(s) to Main File(s)
Access Level
Restricted Closed Access

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar