Stochastic approximation
= Stochastic approximation
Estimating a solution of a deterministic equation through repeated noisy samples of its residual or update direction. Temporal-difference policy evaluation is an example. Convergence depends on stability, sampling, noise and step sizes, rather than merely on the existence of an unbiased sample.