Stability of stochastic approximations with ccontrolled markovd noise and temporal difference learning
A. Ramaswamy, S. Bhatnagar, IEEE Transactions on Automatic Control 64 (2018) 2614–2620.