Credal Self-Supervised Learning

J. Lienen, E. Hüllermeier, ArXiv:2106.11853 (2021).

Preprint | English
Abstract
Self-training is an effective approach to semi-supervised learning. The key idea is to let the learner itself iteratively generate "pseudo-supervision" for unlabeled instances based on its current hypothesis. In combination with consistency regularization, pseudo-labeling has shown promising performance in various domains, for example in computer vision. To account for the hypothetical nature of the pseudo-labels, these are commonly provided in the form of probability distributions. Still, one may argue that even a probability distribution represents an excessive level of informedness, as it suggests that the learner precisely knows the ground-truth conditional probabilities. In our approach, we therefore allow the learner to label instances in the form of credal sets, that is, sets of (candidate) probability distributions. Thanks to this increased expressiveness, the learner is able to represent uncertainty and a lack of knowledge in a more flexible and more faithful manner. To learn from weakly labeled data of that kind, we leverage methods that have recently been proposed in the realm of so-called superset learning. In an exhaustive empirical evaluation, we compare our methodology to state-of-the-art self-supervision approaches, showing competitive to superior performance especially in low-label scenarios incorporating a high degree of uncertainty.
Publishing Year
Journal Title
arXiv:2106.11853
LibreCat-ID

Cite this

Lienen J, Hüllermeier E. Credal Self-Supervised Learning. arXiv:210611853. 2021.
Lienen, J., & Hüllermeier, E. (2021). Credal Self-Supervised Learning. ArXiv:2106.11853.
@article{Lienen_Hüllermeier_2021, title={Credal Self-Supervised Learning}, journal={arXiv:2106.11853}, author={Lienen, Julian and Hüllermeier, Eyke}, year={2021} }
Lienen, Julian, and Eyke Hüllermeier. “Credal Self-Supervised Learning.” ArXiv:2106.11853, 2021.
J. Lienen and E. Hüllermeier, “Credal Self-Supervised Learning,” arXiv:2106.11853. 2021.
Lienen, Julian, and Eyke Hüllermeier. “Credal Self-Supervised Learning.” ArXiv:2106.11853, 2021.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
Restricted Closed Access

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar