Function-value resolution near a nondegenerate minimum ($\delta x\asymp \sqrt{\delta f/|f^{\prime \prime }(x_{\ast })|}$)

Near a smooth local minimum $x_{\ast }$ with $f^{\prime }(x_{\ast })=0$ and $f^{\prime \prime }(x_{\ast })>0$, Taylor's theorem givesIf evaluated function values have absolute uncertainty of order $\delta f$, differences on that scale cannot reliably identify smaller displacements than order $\sqrt{\delta f/f^{\prime \prime }(x_{\ast })}$. In ordinary floating-point arithmetic, when $f(x_{\ast })\ne 0$ and evaluations have relative error of order $ϵ$, this becomesFor unit-scale values and curvature, this is the square root of machine epsilon, rather than machine epsilon itself. It explains why a derivative-free golden-section search can lose reliable comparisons while candidate positions remain representably different.^[ref]

This is a precision limit of the evaluated values, not an invariant property of the minimizer. Accurately subtracting a known constant, obtaining values at higher precision, or locating a zero of an accurately evaluated derivative can change the attainable position accuracy. A zero minimum with relative error controlled on its small values also needs separate analysis.