Wikipedia Text Reuse: Within and Without
M. Alshomary, M. Völske, T. Licht, H. Wachsmuth, B. Stein, M. Hagen, M. Potthast, in: L. Azzopardi, B. Stein, N. Fuhr, P. Mayr, C. Hauff, D. Hiemstra (Eds.), Advances in Information Retrieval, Springer International Publishing, Cham, 2019, pp. 747–754.
Download
No fulltext has been uploaded.
Conference Paper
| English
Author
Alshomary, MiladLibreCat;
Völske, Michael;
Licht, Tristan;
Wachsmuth, HenningLibreCat;
Stein, Benno;
Hagen, Matthias;
Potthast, Martin
Editor
Azzopardi, Leif;
Stein, Benno;
Fuhr, Norbert;
Mayr, Philipp;
Hauff, Claudia;
Hiemstra, Djoerd
Department
Abstract
We study text reuse related to Wikipedia at scale by compiling the first corpus of text reuse cases within Wikipedia as well as without (i.e., reuse of Wikipedia text in a sample of the Common Crawl). To discover reuse beyond verbatim copy and paste, we employ state-of-the-art text reuse detection technology, scaling it for the first time to process the entire Wikipedia as part of a distributed retrieval pipeline. We further report on a pilot analysis of the 100 million reuse cases inside, and the 1.6 million reuse cases outside Wikipedia that we discovered. Text reuse inside Wikipedia gives rise to new tasks such as article template induction, fixing quality flaws, or complementing Wikipedia's ontology. Text reuse outside Wikipedia yields a tangible metric for the emerging field of quantifying Wikipedia's influence on the web. To foster future research into these tasks, and for reproducibility's sake, the Wikipedia text reuse corpus and the retrieval pipeline are made freely available.
Publishing Year
Proceedings Title
Advances in Information Retrieval
Page
747-754
ISBN
LibreCat-ID
Cite this
Alshomary M, Völske M, Licht T, et al. Wikipedia Text Reuse: Within and Without. In: Azzopardi L, Stein B, Fuhr N, Mayr P, Hauff C, Hiemstra D, eds. Advances in Information Retrieval. Cham: Springer International Publishing; 2019:747-754.
Alshomary, M., Völske, M., Licht, T., Wachsmuth, H., Stein, B., Hagen, M., & Potthast, M. (2019). Wikipedia Text Reuse: Within and Without. In L. Azzopardi, B. Stein, N. Fuhr, P. Mayr, C. Hauff, & D. Hiemstra (Eds.), Advances in Information Retrieval (pp. 747–754). Cham: Springer International Publishing.
@inproceedings{Alshomary_Völske_Licht_Wachsmuth_Stein_Hagen_Potthast_2019, place={Cham}, title={Wikipedia Text Reuse: Within and Without}, booktitle={Advances in Information Retrieval}, publisher={Springer International Publishing}, author={Alshomary, Milad and Völske, Michael and Licht, Tristan and Wachsmuth, Henning and Stein, Benno and Hagen, Matthias and Potthast, Martin}, editor={Azzopardi, Leif and Stein, Benno and Fuhr, Norbert and Mayr, Philipp and Hauff, Claudia and Hiemstra, DjoerdEditors}, year={2019}, pages={747–754} }
Alshomary, Milad, Michael Völske, Tristan Licht, Henning Wachsmuth, Benno Stein, Matthias Hagen, and Martin Potthast. “Wikipedia Text Reuse: Within and Without.” In Advances in Information Retrieval, edited by Leif Azzopardi, Benno Stein, Norbert Fuhr, Philipp Mayr, Claudia Hauff, and Djoerd Hiemstra, 747–54. Cham: Springer International Publishing, 2019.
M. Alshomary et al., “Wikipedia Text Reuse: Within and Without,” in Advances in Information Retrieval, 2019, pp. 747–754.
Alshomary, Milad, et al. “Wikipedia Text Reuse: Within and Without.” Advances in Information Retrieval, edited by Leif Azzopardi et al., Springer International Publishing, 2019, pp. 747–54.
Link(s) to Main File(s)
Access Level
Closed Access
Google Scholar
ISBN Search