{"status":"public","year":"2017","abstract":[{"lang":"eng","text":"We report on the Wikidata vandalism detection task at the WSDM Cup 2017. The\r\ntask received five submissions for which this paper describes their evaluation\r\nand a comparison to state of the art baselines. Unlike previous work, we recast\r\nWikidata vandalism detection as an online learning problem, requiring\r\nparticipant software to predict vandalism in near real-time. The\r\nbest-performing approach achieves a ROC-AUC of 0.947 at a PR-AUC of 0.458. In\r\nparticular, this task was organized as a software submission task: to maximize\r\nreproducibility as well as to foster future research and development on this\r\ntask, the participants were asked to submit their working software to the TIRA\r\nexperimentation platform along with the source code for open source release."}],"author":[{"first_name":"Stefan","orcid":"0000-0002-4525-6865","last_name":"Heindorf","id":"11871","full_name":"Heindorf, Stefan"},{"last_name":"Potthast","full_name":"Potthast, Martin","first_name":"Martin"},{"first_name":"Gregor","last_name":"Engels","id":"107","full_name":"Engels, Gregor"},{"last_name":"Stein","full_name":"Stein, Benno","first_name":"Benno"}],"oa":"1","department":[{"_id":"66"}],"title":"Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017","_id":"6722","citation":{"mla":"Heindorf, Stefan, et al. “Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017.” <i>WSDM Cup 2017 Notebook Papers</i>, 2017.","ama":"Heindorf S, Potthast M, Engels G, Stein B. Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017. In: <i>WSDM Cup 2017 Notebook Papers</i>. ; 2017.","bibtex":"@inproceedings{Heindorf_Potthast_Engels_Stein_2017, title={Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017}, booktitle={WSDM Cup 2017 Notebook Papers}, author={Heindorf, Stefan and Potthast, Martin and Engels, Gregor and Stein, Benno}, year={2017} }","ieee":"S. Heindorf, M. Potthast, G. Engels, and B. Stein, “Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017,” 2017.","chicago":"Heindorf, Stefan, Martin Potthast, Gregor Engels, and Benno Stein. “Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017.” In <i>WSDM Cup 2017 Notebook Papers</i>, 2017.","short":"S. Heindorf, M. Potthast, G. Engels, B. Stein, in: WSDM Cup 2017 Notebook Papers, 2017.","apa":"Heindorf, S., Potthast, M., Engels, G., &#38; Stein, B. (2017). Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017. <i>WSDM Cup 2017 Notebook Papers</i>."},"user_id":"11871","date_created":"2019-01-15T08:57:40Z","language":[{"iso":"eng"}],"main_file_link":[{"open_access":"1","url":"https://arxiv.org/abs/1712.05956"}],"publication":"WSDM Cup 2017 Notebook Papers","date_updated":"2022-10-17T11:36:12Z","type":"conference"}