Minimax rate for isotonic sequence estimation Created 2026-09-28 Updated 2026-11-05
For a concrete isotonic regression model, observe with independent Gaussian distribution errors of expected value zero and fixed variance . Let for fixed , and use normalized squared-error loss . The minimax risk over has order
as with fixed. This states the model and loss behind the shorthand rate .
The isotonic least squares estimator satisfies an upper bound of order . Locally increasing sequences supply matching lower bounds for the first term. The primary analysis also shows why a worst-case rate does not describe every signal: when the true sequence has few constant blocks, the risk can be substantially smaller.[ref]
A heuristic for the exponent is to approximate a changing monotone signal by blocks: squared approximation error scales as , while estimating block levels costs approximately . Balancing these gives and risk . This balance motivates the rate; it does not replace the lower-bound argument. Uniformly constant signals or a variation bound shrinking with require their own regime analysis.