Stochastic-approximation step-size conditions

ID: stochastic-approximation-step-size-conditions

A common condition along each repeatedly sampled component is and . The first permits continuing correction; the second limits accumulated noise under the relevant stochastic-approximation hypotheses. The example has a divergent harmonic sum and a convergent sum of squares. These conditions are not sufficient without suitable assumptions about the update dynamics and sampling.

New to topics? Read the docs here!