preprint draft Adil El Mesaoudi-Paul author Viktor Bengs author 76599 Eyke Hüllermeier author 48129 34 department 7 department 355 department Computing Resources Provided by the Paderborn Center for Parallel Computing project We consider an extension of the contextual multi-armed bandit problem, in which, instead of selecting a single alternative (arm), a learner is supposed to make a preselection in the form of a subset of alternatives. More specifically, in each iteration, the learner is presented a set of arms and a context, both described in terms of feature vectors. The task of the learner is to preselect $k$ of these arms, among which a final choice is made in a second step. In our setup, we assume that each arm has a latent (context-dependent) utility, and that feedback on a preselection is produced according to a Plackett-Luce model. We propose the CPPL algorithm, which is inspired by the well-known UCB algorithm, and evaluate this algorithm on synthetic and real data. In particular, we consider an online algorithm selection scenario, which served as a main motivation of our problem setting. Here, an instance (which defines the context) from a certain problem class (such as SAT) can be solved by different algorithms (the arms), but only $k$ of these algorithms can actually be run. 2020 eng A. El Mesaoudi-Paul, V. Bengs, and E. Hüllermeier, “Online Preselection with Context Information under the Plackett-Luce  Model,” <i>arXiv:2002.04275</i>. . El Mesaoudi-Paul, A., Bengs, V., &#38; Hüllermeier, E. (n.d.). Online Preselection with Context Information under the Plackett-Luce  Model. <i>ArXiv:2002.04275</i>. El Mesaoudi-Paul, Adil, et al. “Online Preselection with Context Information under the Plackett-Luce  Model.” <i>ArXiv:2002.04275</i>. @article{El Mesaoudi-Paul_Bengs_Hüllermeier, title={Online Preselection with Context Information under the Plackett-Luce  Model}, journal={arXiv:2002.04275}, author={El Mesaoudi-Paul, Adil and Bengs, Viktor and Hüllermeier, Eyke} } A. El Mesaoudi-Paul, V. Bengs, E. Hüllermeier, ArXiv:2002.04275 (n.d.). El Mesaoudi-Paul A, Bengs V, Hüllermeier E. Online Preselection with Context Information under the Plackett-Luce  Model. <i>arXiv:200204275</i>. El Mesaoudi-Paul, Adil, Viktor Bengs, and Eyke Hüllermeier. “Online Preselection with Context Information under the Plackett-Luce  Model.” <i>ArXiv:2002.04275</i>, n.d. 180172020-08-17T11:49:40Z2022-01-06T06:53:25Z