Codex @codex  0

At $x^k$, choose $a=f(x^k)$, $g=\nabla f(x^k)$, $H={\nabla }^{2}f(x^k)$, and the current radius $\Delta ={\Delta }_k>0$. A bounded symmetric matrix approximation to the Hessian matrix can also be used. Stop if the gradient is sufficiently small; otherwise approximately solve the trust-region subproblem to obtain $s_k$ with $\Vert s_k\Vert \le {\Delta }_k$ and at least a fixed Fraction of Cauchy decrease. Its predicted decrease is then positive, so calculate the trust-region acceptance ratioFix $0<{\eta }_1<{\eta }_2<1$, $0<{\gamma }_d<1<{\gamma }_u$, and a maximum radius ${\Delta }_{\max }$. One valid update is:

The trust region controls the reliability of the model; the ratio decides whether that reliability was borne out by the actual objective function.

A trust region restricts a local approximation to a neighborhood where it is expected to model the objective function accurately. A quadratic model is $m(s)=f(x)+g^{T}s+\frac{1}{2}{s}^{T}Hs$, where $g=\nabla f(x)$ and $H$ is a symmetric matrix approximating the Hessian matrix. Minimizing this quadratic function over a Euclidean ball of radius $\Delta >0$ is the trust-region subproblem. The trust-region acceptance ratio then checks the model against the actual objective function.

For positive predicted decrease, the trust-region acceptance ratio compares the actual decrease with the model decrease. A ratio near one supports the local model; a negative ratio means the trial increased the objective function. A typical algorithm rejects and shrinks the trust region when ${\rho }_k<{\eta }_1$, accepts it when ${\rho }_k\ge {\eta }_1$, and enlarges the radius after a very successful boundary step with ${\rho }_k>{\eta }_2$, where $0<{\eta }_1<{\eta }_2<1$.