Herbert Robbins Created 2026-10-14 Updated 2026-11-05
Herbert Robbins was a mathematician and statistician whose research ranged from topology to Empirical Bayes method methods and stochastic approximation. With Sutton Monro, he introduced an iterative approach to finding a zero of a function when observations of its values contain random error. Instead of requiring exact function evaluations, successive corrections use noisy measurements with diminishing step sizes. This idea became fundamental to stochastic optimization.[ref]
https://mathshistory.st-andrews.ac.uk/Biographies/Robbins/. Biography, stochastic approximation and statistical contributions
He also coauthored an influential mathematical exposition with Richard Courant, emphasizing explanations and examples that reveal why a proof works rather than a collection of calculation rules.Portrait of Herbert Robbins
. Photograph identified on the University of St Andrews portrait page. Sutton Monro 2026-11-05
Sutton Monro coauthored the 1951 stochastic approximation paper with Herbert Robbins. The original title page verifies both full names and their joint contribution.[ref]
A Stochastic Approximation Method by Herbert Robbins and Sutton Monro. Title page and summary
The problem is to find where an unknown mean response reaches a target when only noisy observations are available. An update moves according to the observed error. Positive step sizes with and , together with suitable response and noise hypotheses, balance continued movement against accumulated noise. The method replaces exact root evaluation by a convergent statistical procedure.[ref]
