Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017
S. Heindorf, M. Potthast, G. Engels, B. Stein, in: WSDM Cup 2017 Notebook Papers, 2017.
Download (ext.)
Conference Paper
| English
Author
Department
Abstract
We report on the Wikidata vandalism detection task at the WSDM Cup 2017. The
task received five submissions for which this paper describes their evaluation
and a comparison to state of the art baselines. Unlike previous work, we recast
Wikidata vandalism detection as an online learning problem, requiring
participant software to predict vandalism in near real-time. The
best-performing approach achieves a ROC-AUC of 0.947 at a PR-AUC of 0.458. In
particular, this task was organized as a software submission task: to maximize
reproducibility as well as to foster future research and development on this
task, the participants were asked to submit their working software to the TIRA
experimentation platform along with the source code for open source release.
Publishing Year
Proceedings Title
WSDM Cup 2017 Notebook Papers
LibreCat-ID
Cite this
Heindorf S, Potthast M, Engels G, Stein B. Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017. In: WSDM Cup 2017 Notebook Papers. ; 2017.
Heindorf, S., Potthast, M., Engels, G., & Stein, B. (2017). Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017. WSDM Cup 2017 Notebook Papers.
@inproceedings{Heindorf_Potthast_Engels_Stein_2017, title={Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017}, booktitle={WSDM Cup 2017 Notebook Papers}, author={Heindorf, Stefan and Potthast, Martin and Engels, Gregor and Stein, Benno}, year={2017} }
Heindorf, Stefan, Martin Potthast, Gregor Engels, and Benno Stein. “Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017.” In WSDM Cup 2017 Notebook Papers, 2017.
S. Heindorf, M. Potthast, G. Engels, and B. Stein, “Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017,” 2017.
Heindorf, Stefan, et al. “Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017.” WSDM Cup 2017 Notebook Papers, 2017.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Link(s) to Main File(s)
Access Level
Closed Access
Google Scholar