Herbert Robbins Created 2026-10-14 Updated 2026-11-05
Herbert Robbins was a mathematician and statistician whose research ranged from topology to Empirical Bayes method methods and stochastic approximation. With Sutton Monro, he introduced an iterative approach to finding a zero of a function when observations of its values contain random error. Instead of requiring exact function evaluations, successive corrections use noisy measurements with diminishing step sizes. This idea became fundamental to stochastic optimization.[ref] He also coauthored an influential mathematical exposition with Richard Courant, emphasizing explanations and examples that reveal why a proof works rather than a collection of calculation rules.
Figure 1.
Portrait of Herbert Robbins
. Photograph identified on the University of St Andrews portrait page.
Sutton Monro 2026-11-05
Sutton Monro coauthored the 1951 stochastic approximation paper with Herbert Robbins. The original title page verifies both full names and their joint contribution.[ref]
The problem is to find where an unknown mean response reaches a target when only noisy observations are available. An update moves according to the observed error. Positive step sizes with and , together with suitable response and noise hypotheses, balance continued movement against accumulated noise. The method replaces exact root evaluation by a convergent statistical procedure.[ref]