ExPrompt: Augmenting Prompts Using Examples as Modern Baseline for Stance Classification
U. Qudus, M. Röder, D. Vollmers, A.-C. Ngonga Ngomo, in: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, ACM, 2024, pp. 3994–3999.
Download
public.pdf
531.58 KB
Conference Paper
| Published
| English
Author
Abstract
Detecting the veracity of a statement automatically is a challenge the world is grappling with due to the vast amount of data spread across the web. Verifying a given claim typically entails validating it within the framework of supporting evidence like a retrieved piece of text. Classifying the stance of the text with respect to the claim is called stance classification. Despite advancements in automated fact-checking, most systems still rely on a substantial quantity of labeled training data, which can be costly. In this work, we avoid the costly training or fine-tuning of models by reusing pre-trained large language models together with few-shot in-context learning. Since we do not train any model, our approach ExPrompt is lightweight, demands fewer resources than other stance classification methods and can serve as a modern baseline for future developments. At the same time, our evaluation shows that our approach is able to outperform former state-of-the-art stance classification approaches regarding accuracy by at least 2 percent. Our scripts and data used in this paper are available at https://github.com/dice-group/ExPrompt.
Publishing Year
Proceedings Title
Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
Volume
9
Page
3994 - 3999
Conference
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
Conference Location
Boise, ID, USA
Conference Date
2024-10-21 – 2024-10-25
LibreCat-ID
Cite this
Qudus U, Röder M, Vollmers D, Ngonga Ngomo A-C. ExPrompt: Augmenting Prompts Using Examples as Modern Baseline for Stance Classification. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. Vol 9. ACM; 2024:3994-3999. doi:10.1145/3627673.3679923
Qudus, U., Röder, M., Vollmers, D., & Ngonga Ngomo, A.-C. (2024). ExPrompt: Augmenting Prompts Using Examples as Modern Baseline for Stance Classification. Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, 9, 3994–3999. https://doi.org/10.1145/3627673.3679923
@inproceedings{Qudus_Röder_Vollmers_Ngonga Ngomo_2024, title={ExPrompt: Augmenting Prompts Using Examples as Modern Baseline for Stance Classification}, volume={9}, DOI={10.1145/3627673.3679923}, booktitle={Proceedings of the 33rd ACM International Conference on Information and Knowledge Management}, publisher={ACM}, author={Qudus, Umair and Röder, Michael and Vollmers, Daniel and Ngonga Ngomo, Axel-Cyrille}, year={2024}, pages={3994–3999} }
Qudus, Umair, Michael Röder, Daniel Vollmers, and Axel-Cyrille Ngonga Ngomo. “ExPrompt: Augmenting Prompts Using Examples as Modern Baseline for Stance Classification.” In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, 9:3994–99. ACM, 2024. https://doi.org/10.1145/3627673.3679923.
U. Qudus, M. Röder, D. Vollmers, and A.-C. Ngonga Ngomo, “ExPrompt: Augmenting Prompts Using Examples as Modern Baseline for Stance Classification,” in Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, Boise, ID, USA, 2024, vol. 9, pp. 3994–3999, doi: 10.1145/3627673.3679923.
Qudus, Umair, et al. “ExPrompt: Augmenting Prompts Using Examples as Modern Baseline for Stance Classification.” Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, vol. 9, ACM, 2024, pp. 3994–99, doi:10.1145/3627673.3679923.
All files available under the following license(s):
Creative Commons Attribution 4.0 International Public License (CC-BY 4.0):
Main File(s)
File Name
public.pdf
531.58 KB
Access Level
Closed Access
Last Uploaded
2024-11-11T13:24:19Z
Link(s) to Main File(s)
Access Level
Closed Access