A Concentration Bound for TD(0) with Function Approximation

We derive a concentration bound of the type `for all n \geq n_0 for some n_0' for TD(0) with linear function approximation. We work with online TD learning with samples from a single sample path of the underlying Markov chain. This makes our analysis significantly different from offline TD learning... Show more