The function is uniformly continuous on . Its derivative satisfies
so the mean value theorem gives
Thus the function is Lipschitz, which implies uniform continuity.
Expand about and use from the chain rule. The residual of the exact solution is
The coefficients through vanish, and the displayed fourth-order coefficient does not. Thus the multiderivative multistep method has order three.
At , its first characteristic polynomial is
Its roots are and , with the unit-modulus root simple, so it satisfies the root condition for a multistep method and is zero-stable. Combining this with the defect estimate proves convergence of order three, assuming sufficiently smooth , order-three starting values, and the nearby branch of each implicit update.
More explicitly, the right-hand side is , where has a uniform local Lipschitz continuity bound for small . A bounded zero-stable impulse response and the discrete Gronwall inequality therefore control the accumulated defects by over fixed time intervals. This is convergence of a zero-stable multiderivative method, rather than a direct application of the first-derivative-only Dahlquist equivalence theorem.
Let . Subtracting the exact one-step relation from the numerical method and applying the stated Lipschitz continuity gives
If , iteration yields the discrete Gronwall inequality
For ,
and
Consequently
Let
Differentiating and using the scale equation gives
Since is bounded, has global Lipschitz continuity. Thus
has a pathwise unique strong solution by the standard Lipschitz existence-and-uniqueness theorem for a stochastic differential equation. Applying the deterministic inverse gives a strong solution , and uniqueness of gives pathwise uniqueness of .
For the equation actually produced by the preceding construction, namely the Bessel process equation of dimension , the drift has Lipschitz continuity on every compact subset of . Starting at any positive time and position, pathwise uniqueness therefore makes the time-changed process agree until its first hit of zero with the maximal local solution of a stochastic differential equation. For , its dimension lies in , so it can hit zero; the time-change construction then supplies further excursions, whereas the maximal local solution on stops at that first hit.
For , is Reflected Brownian motion; away from zero it agrees with the maximal local solution of . For the dimension- equation printed in the paper, the preceding construction does not agree with the maximal local solution unless , for the coefficient mismatch established in part (d).
Because the Fejér kernel has normalized integral one,
For this implies
On , the inequalities and give
Splitting the integral at gives
For , both terms are . For , the second is . Uniformly in ,
where the constants absorb the Lipschitz continuity constant .
The Euclidean projection onto a convex set is nonexpansive, and because the optimum is feasible. Therefore the projected subgradient method satisfies
The subgradient inequality gives , while Lipschitz continuity of the finite convex function gives . Hence
Summing this telescoping inequality for , and then bounding the smallest term by the average, yields
Writing , the right-hand side is minimized by the constant step size
Substitution gives
If , the initial point is already optimal and the result is immediate.
Write for row of , and define affine functions
Then
The pointwise maximum of convex functions is convex, so is a convex function. Moreover,
so has Lipschitz continuity. The simpler bound is also valid.
Let be the active set. The subdifferential is
the convex hull of all active slopes. In particular, choosing any active index gives the subgradient
At a tie, every convex combination of the tied slopes is also valid.
Set
The gradient has Lipschitz continuity with constant
where the norm is the spectral norm. The proximal gradient method is therefore
For , part d makes the second step explicit:
where is the capped simplex; when , this proximal step is the identity.
A standard fixed choice is ; the wider interval also gives convergence under the usual forward-backward conditions. For a general convex objective, the function-value error is . If has full column rank, the quadratic term is strongly convex and an appropriate fixed step gives a linear convergence rate.
For and , define the characteristic curve by
The bounded derivative makes globally Lipschitz, uniformly in . On each finite time interval, , so Gronwall inequality prevents finite-time escape. The Picard-Lindelöf theorem therefore gives a unique trajectory for every finite . Differentiation in gives
so the characteristic flow map is a increasing diffeomorphism.
Along a characteristic, the chain rule changes the equation into
Tracing backward by the flow therefore gives
The regularity of the flow makes this a classical solution. Conversely, every classical solution obeys the same ordinary differential equation along every characteristic, so the formula also proves uniqueness.
The Lipschitz continuity of gives
Part (d) therefore implies
By the mean value theorem, for all real . Thus is a contraction mapping on the complete metric space . Starting from arbitrary , define . Induction gives . For , the triangle inequality and a geometric series yield
Hence is a Cauchy sequence and completeness of the real numbers supplies a limit . The Lipschitz continuity of implies . Thus the limit is a fixed point, independently of the initial value. If were another, would force . This proves the contraction mapping theorem in this setting, with error estimate
A weak solution belongs to and satisfies
with the nonlinear right-hand side defining a bounded functional on . Under the stated global Lipschitz hypothesis this requirement is automatic: and boundedness of give whenever . Continuity of alone, without growth control, would not guarantee this for an arbitrary Sobolev function.
For the semilinear Poisson contraction threshold, use the gradient norm on , and let satisfy the Poincaré inequality . For , Lax-Milgram gives the zero-Dirichlet Poisson solution . Testing with yields . Define , a self-map of the complete space . For ,
Therefore is a sufficient condition for Banach's theorem to give a unique fixed point and hence a unique weak solution. There is no need to assume or to restrict to a small ball: the Lipschitz bound makes the map defined on all of . The same estimates give
With the optimal Poincaré constant, the threshold is for the First Dirichlet eigenvalue; the stated sufficient condition does not depend on knowing that optimal constant.
One form of Schauder's theorem says that if is a nonempty closed bounded convex subset of a Banach space and is continuous with relatively compact image, then has a fixed point.
For a Schauder solution of a small Hammerstein integral equation, take with the supremum norm and . This set is nonempty, closed, bounded and convex. Put
Both maxima are finite by continuity on compact sets. Define . Continuity and uniform continuity of the kernel give , and for ,
so it is a self-map. This choice of also handles the case when either maximum is zero without division by zero.
If uniformly in , uniform continuity of on makes uniformly. The integral estimate then proves continuity of in the supremum norm. Moreover
which tends to zero with uniformly in . Thus the image is uniformly bounded and equicontinuous. Arzelà-Ascoli states that such a family on a compact interval has compact closure in the supremum norm. Hence is relatively compact, and Schauder gives a fixed point for each in the specified interval. Therefore a continuous solution with supremum norm at most exists. The argument imposes no Lipschitz hypothesis on and makes no uniqueness assertion.
For and every real ,
where was used. The mean value theorem therefore proves Lipschitz continuity in with constant .
Let . The explicit Euler method and the exact-solution identity from part (i) give
Using the requested local truncation error bound , including at , yields
Iteration and the finite geometric series give
Since and ,
Keeping the stronger bound from part (i) improves the same proof to . The requested inequality follows already from the weaker bound.
The descent lemma follows by integrating the gradient along the line and using its Lipschitz continuity:
This upper bound is at most the right side of the Armijo condition when . Since , it holds for
The zero step gives equality; every positive step in this interval satisfies the prescribed sufficient-decrease test.
The coefficients of this linear multistep method are , , and , . Substitution into the order of a numerical method conditions gives
The second equation gives ; substituting this into the third gives . Consequently there is exactly one second-order choice,
The resulting scheme is the BDF2 method,
For a exact solution, Taylor's theorem in the original normalization gives the exact leading order defect
In particular the coefficient is nonzero: the method has formal order exactly two, rather than three. Bounded third derivatives already suffice for the uniform estimate ; the stronger smoothness above only makes the displayed remainder immediate. Multiplying the recurrence by instead gives the common derivative normalization with leading defect .
The first of the characteristic polynomials of a linear multistep method is
Both roots are simple and lie in the closed unit disk, so the root condition for a multistep method proves zero-stability.
The Dahlquist equivalence theorem states that, for fixed-coefficient linear multistep methods on the usual class of initial value problems with a right-hand side continuous in and uniformly Lipschitz continuous in , convergence of a numerical method for every such problem and every convergent set of starting values is equivalent to consistency of a numerical method and zero-stability. The statement is on fixed finite intervals where the exact solution exists, with implicit updates well defined. Its order estimate says that a zero-stable method with and starting errors has global error under the corresponding solution smoothness and Lipschitz continuity assumptions; merely convergent starting values do not ensure the order- rate.
For this application, sufficient assumptions are a unique solution , a uniform Lipschitz continuity bound in on a neighborhood of its graph, and the nearby solution branch of each implicit update. For sufficiently small , the map
is a contraction mapping with factor at most on a suitable small closed neighborhood. The Banach fixed-point theorem supplies local solvability of the nearby update. With starting errors
the order estimate gives
Thus the BDF2 method is second-order convergent under these standard hypotheses. Exact together with one Euler method step for already gives the required starting error when is bounded, since only one starting step is taken.
The question's assumption of continuity of alone does not establish uniqueness, the needed solution smoothness, or this uniform convergence estimate. The added Lipschitz continuity condition is a sufficient hypothesis for the theorem used here; its failure does not imply that every particular initial value problem is nonunique or that its numerical approximations cannot converge.
Fix and put , the block coordinate gradient. For , define the one-variable function . By the chain rule,
The last equality holds because the coordinates of outside are zero. The fundamental theorem of calculus and the Cauchy-Schwarz inequality therefore give
For , the supplied condition (6), applied at the fixed starting point with parameter , bounds the integrand by . Integration yields
This argument needs only the given directional Lipschitz continuity and continuous differentiability; convexity is not needed for this part. If the block coordinate gradient is zero, the inequality is equality.
The subgradient inequality for the differentiable convex function gives
Thus is a global minimizer of with value zero. Subtracting an affine function preserves convexity.
We must also justify using part (a) for , since its partial derivative can differ from that of . First show that condition (6) for a singleton block implies the full coordinate Lipschitz continuity estimate
If , choose in (6). If it is zero but , apply the same argument starting at and reverse the displacement. If both partial derivatives are zero, the estimate is immediate. The availability of all real in (6) justifies these choices.
Now , so differences of this partial derivative along coordinate lines are unchanged. Hence has the same coordinate Lipschitz continuity constant and satisfies the singleton version of (6). Apply part (a) to with step size :
Combining with its already established nonnegativity proves
The coordinate estimate survives subtraction of the supporting affine function. This is the step that allows the arbitrary comparison point to be exploited in part (c).
For every , and . Consequently each of the three partial derivatives in the preceding gradient has absolute value below , so
The segment joining lies inside . The mean value theorem and Cauchy-Schwarz inequality therefore give
For both sides vanish. This proves the required Lipschitz continuity uniformly on the ball.