Preference-based reinforcement learning: A formal framework and a policy iteration algorithm
J. Fürnkranz, E. Hüllermeier, W. Cheng, S.H. Park, Machine Learning 89 (2012) 123–156.