There is a genuine indexing defect in the printed PDF: its new value is at , while every old-time coefficient is centered at . On a fixed grid the literal residual contains
For a general solution the leading term is , so this is not a consistent diffusion discretization. It also leaves one new interior value unspecified while imposing a generally incompatible update on a prescribed boundary value. The calculation that follows is for the intended same-node update ; that correction is necessary, not an unnoticed transcription change.
For the midpoint flux stencil for one-dimensional diffusion, define
Assume sufficient smoothness of and the solution for the displayed remainders. Multiplying the centered Taylor expansions of and gives
The first time difference is . After using the diffusion equation, the normalized local truncation error is
Therefore, for the corrected update,
The first is the residual divided by the time step; the second is the unnormalized one-step defect. At fixed they are respectively and . A rate based on derivatives is not justified for a merely bounded nonsmooth .
Divide the recurrence by and substitute a smooth exact solution. Centered Taylor expansions in time and space give
Thus the leapfrog advection scheme is consistent with normalized residual . Its unnormalized defect is . For a fixed , the uniform two-level bound proved above and accumulation over steps yield, for a sufficiently smooth solution,
Both starting levels must be supplied consistently; errors of order give second-order convergence. For general square-integrable functions as initial data, point sampling is not defined on equivalence classes. Use cell averages or another bounded grid projection, together with a bounded consistent startup. Approximate the initial data by smooth functions, apply the smooth-data convergence estimate, and use the uniform numerical and exact translation bounds to pass to the L2 space limit. This is the content of Lax equivalence theorem in the present setting.
At the growing Fourier mode prevents general convergence. At the endpoint, initial data supported in increasingly narrow neighborhoods of the double root can have a second-level error of norm but a final error of order one after steps. These are vanishing starting errors, so the endpoint fails general two-level convergence as well. Consequently
is also the general convergence range, with a consistent stable initialization. Claims for a particular specially chosen endpoint startup would be a different, restricted assertion.
Consider on a rectangle, with prescribed Dirichlet boundary conditions, and assume initially that the solution is smooth up to the boundary. A finite difference method chooses grid values as unknowns, approximates the differential operator by a local stencil, incorporates the boundary data, and solves the resulting sparse linear system. Accuracy of a stencil by itself is insufficient: one also needs a well-posed discrete problem, a stability estimate uniform under refinement, and a sufficiently accurate algebraic solve.
For a square grid of spacing , centered second differences give the five-point Laplacian
Expanding each opposite pair in a Taylor series gives
Thus the standard equation has second-order normalized local truncation error. Known boundary values move to the right-hand side; they are not iterated as independent unknowns. Nonrectangular geometry requires a consistent boundary approximation rather than silently retaining a full interior stencil outside the domain.
The negative interior operator has positive diagonal and nonpositive off-diagonal entries. For a grid vector extended by zero on the boundary,
The edge sum includes links to the fixed boundary. Connectivity makes the matrix positive definite, proving uniqueness and providing an energy structure. The same sign pattern gives a discrete maximum principle: at a negative interior minimum, is nonpositive. If and the boundary is nonnegative, equality can only persist by propagating that minimum through all neighbors to the boundary, a contradiction. Therefore .
On the unit square, the barrier satisfies exactly. If has zero boundary values and , apply the maximum principle to to obtain
The bound is independent of , so the consistency error gives an nodal error. It also separates the algebraic residual from the discretization error: solving the linear system much less accurately than would spoil the spatial accuracy.
A direct higher-order design is possible. In one coordinate,
has fourth-order accuracy. Adding the corresponding formula in the other coordinate gives a wider stencil. Its advantages must be balanced against boundary closures, more distant couplings, and the possible loss of monotonicity. Higher order does not automatically imply a stable or geometrically convenient scheme.
The Mehrstellen method takes a different route: it uses the Poisson equation to eliminate leading truncation derivatives while keeping a compact unknown stencil. Define the nine-point finite-difference stencil
Here each sum has four terms. Equivalently . Expanding gives
The uncorrected nine-point operator is only second order for a general function. But implies . Moving this known leading defect to the source and approximating its Laplacian with gives
Indeed , and multiplication by makes that replacement's error fourth order. In explicit compact form the right-hand side is . Only known source samples, not additional distant solution unknowns, enter this correction. The corresponding unscaled stencil residual is . If , the leading term already vanishes, which explains harmonic superconvergence of the nine-point stencil.
For zero boundary data, has axial link weights and diagonal link weights . Their energy sum proves positive definiteness, and their sign pattern again proves the discrete maximum principle. The same quadratic barrier is exact for , so
For smooth solutions and accurately imposed boundary values this proves fourth-order nodal convergence of the corrected scheme. Singular corners, rough sources or low-order boundary treatment can reduce the observed rate; a formal interior expansion is not a global regularity theorem.
More generally, compact high-order schemes choose a solution stencil and a source stencil together, match their Taylor expansions, and use differentiated forms of the PDE to remove derivatives that would otherwise need a wide solution stencil. Variable coefficients require their derivatives and mixed terms to be treated consistently; the constant-coefficient identity cannot be reused unchanged for a different elliptic operator. On irregular meshes, conservation and consistent fluxes may be more useful starting points than a symmetric Cartesian formula.
Finally, discretization and solution cost are coupled. The five-point Dirichlet matrix has eigenvalues proportional to sums of squared sine frequencies, so its smallest eigenvalue stays of order one while its largest is . Its condition number grows like ; simple relaxation therefore becomes slow. Sparse direct elimination, Conjugate gradient method with appropriate matrix preconditioning, and the multigrid method are alternatives. A sound design combines local accuracy, boundary fidelity, mesh-independent stability, and an algebraic solver whose residual is small enough for the intended error tolerance.
Finite second moment implies . For near any positive , the derivative of is bounded in absolute value by , provided the neighbourhood stays in . The dominated convergence theorem therefore permits differentiation under the expectation:
For the expansion, put . Taylor expansion gives as . Also, for ,
The inequalities follow by integrating from zero to . Consequently pointwise and its absolute value is bounded by . Another application of the dominated convergence theorem gives the second-moment expansion of a Laplace transform:
No third moment is needed for the remainder estimate.
The force from one location is defined almost surely, since the uniform distribution assigns probability zero to the origin. Symmetry of that uniform distribution makes its characteristic function real:
Near zero the integrand is bounded by . For large it is at most . The monotone convergence theorem therefore gives the finite integral
Independence of the locations gives the characteristic function of the total force as . For fixed , is bounded, so Taylor expansion of the logarithm gives
The logarithm is legitimate for all sufficiently large .
For , substitute . The cosine integral for a symmetric stable exponent, evaluated directly in part (b), gives
At both sides vanish. The limiting characteristic function is continuous at zero, so the Lévy continuity theorem proves weak convergence of random variables to the symmetric stable distribution of index with
The coefficient reflects the spatial density . Symmetry was used in the characteristic function, without assuming that the singular force has a finite mean.
Indifference means equality of the risky expected utility and the utility of the sure reduced wealth. A second-order Taylor expansion, using , gives
For the sure alternative,
Equating these and retaining the leading terms produces the small multiplicative risk premium
For increasing concave utility functions this is positive. The approximation assumes genuinely small shocks with controlled Taylor remainders and positive final wealth; small variance alone would not justify it for rare large shocks.
The working score function and its derivative are
At an interior working maximizer, . A Taylor expansion at yields
for an intermediate value . When the last term is negligible relative to the linear one, this gives
This is the Poisson score linearization under proportional variance. Correct specification of the mean alone implies . The stipulated independence and variance relation give
Taking the mean and variance of the linear approximation therefore proves
These are first-order conclusions, not exact finite-sample identities. The mean and variance assumptions alone do not guarantee that the approximation is accurate: an interior consistent solution, increasing information, control of leverage, and a suitable central limit condition are needed for normal inference.
The quasi-likelihood score for variance is , so its zero is unchanged by the unknown common dispersion parameter. Thus the working Poisson estimating equation remains appropriate for the mean parameter, but its unadjusted Poisson variance estimate is wrong when . A usual Pearson dispersion estimator for this one-parameter model is
In particular overdispersion multiplies coefficient standard errors by approximately , even though it leaves the coefficient estimating equation unchanged.
Let be the design matrix with row , let , and write . Independence gives the Poisson regression likelihood function
The score function and negative Hessian matrix are
Because , the score has mean zero; independence and the Poisson distribution variance give . Thus the observed and expected Fisher information matrices are the same here.
Assume has full column matrix rank . For a nonzero vector , . The concavity of the Poisson regression likelihood therefore makes any finite solution of the unique maximum-likelihood estimator. If the design is rank deficient, parameters differing by a vector in give the same distribution, so only identifiable combinations can be estimated. Full rank alone does not ensure a finite maximizer: for an intercept-only model with all observations zero, approaches its supremum as . More generally, directions that decrease only fitted means attached to zero counts can produce boundary fits. A useful sufficient case for a finite fit is full rank with every count positive: each summand tends to in either tail, and some diverges whenever diverges.
For an interior fit, Newton's method and Fisher scoring give the same update:
This is also iteratively reweighted least squares. Define the working response , with , and regress on using weights :
A numerical implementation solves these linear equations rather than explicitly forming the inverse, checks convergence of the score and likelihood, and can shorten a step when necessary.
Under the usual fixed-design regularity conditions, with growing information and no single observation dominating it, a score Taylor expansion about the true parameter gives
Estimate the covariance matrix by ; its diagonal square roots are the coefficient standard errors. This justifies large-sample Wald confidence intervals and Wald tests for specified coefficients or contrasts. Finite-sample unbiasedness is not being asserted. A likelihood-ratio test compares nested fits through twice their maximized log-likelihood difference. The Poisson deviance against the saturated fit is
with . Residual diagnostics and a check of overdispersion assess whether the assumed Poisson variance is adequate; the variance correction required when it is not is derived in the next part.
A kernel for density estimation is an integrable function K of unit integral, ordinarily nonnegative and centered. Square integrability is needed for integrated variance; a symmetric second-order kernel for density estimation also has and finite nonzero second moment . Its scaled form is , and the kernel density estimator is
Higher-order signed kernels are possible, but need not give a nonnegative probability density function estimate.
The mean integrated squared error is . Put . Independence gives the pointwise mean and variance . Integrating, use and Fubini to obtain . The bias-variance decomposition proves the exact formula
Equivalently this is . These identities assume the displayed integrals are finite; they are exact, rather than a small-smoothing bandwidth expansion.
For a symmetric second-order kernel for density estimation, Taylor expansion gives leading bias , and the leading integrated variance is . Thus the asymptotic mean integrated squared error balances inverse smoothing bandwidth against fourth-power bias, with optimal smoothing bandwidth . Its appearance of the integrated squared density curvature motivates the scale comparison.
For , , two differentiations give . A change of variables therefore gives , which tends to zero as if the original curvature integral is finite. The distribution with probability density function is that of X divided by a, so . Consequently
This scale-invariant density curvature measures shape without dependence on the units used to measure X.
For the final minimization, write and use the triweight kernel on , zero outside. Integration gives total mass one, mean zero and variance . Its value and its first two derivatives vanish at both endpoints, so its extension is twice continuously differentiable. On the interior,
In particular and .
Put . The mass and moment constraints give , since both means vanish and their variances match. If the claim is immediate; otherwise expand the squared norm and integrate its cross term twice by parts over . The first endpoint term vanishes because , but the next one must be retained:
For the second equality use the zero mass and second moment of e and outside the support. All terms in the last expression are nonnegative, including the endpoint values of a probability density function. It follows that
This proves that the triweight density minimizes integrated squared curvature under the specified constraints. Equality forces ; a globally affine integrable difference of probability density functions is zero, so equality occurs only at .
Assume a symmetric second-order probability density function kernel for density estimation and enough smoothness for the displayed derivative functionals. The benchmark smoothing bandwidth is , balancing against . Three widely used selection methods are as follows.
For least-squares density cross-validation, expand integrated squared error as . Estimate the middle integral by leaving out the observation at which the estimate is evaluated, and minimize
The left-out observation is independent of its estimator, so the second term has expectation . Thus exactly. The subtraction of the self-contribution is essential. Computation uses , where . This method directly targets integrated error without estimating a curvature functional first. Under standard smoothness and a suitable search interval its selected smoothing bandwidth is ratio-consistent with the MISE optimum, and hence with . Relative fluctuations are ordinarily , so the selected values can be quite variable in finite samples.
For biased density cross-validation, estimate curvature from the second-derivative probability density function estimator and subtract its diagonal variance term:
Differentiating the kernel for density estimation estimator and applying the integrated-variance identity gives the exact expectation . Under the derivative regularity assumptions, , so . Minimize BCV over a reasonable smoothing bandwidth range. It is a smoothed criterion directed at AMISE; the name reflects its finite-sample bias rather than an exact unbiased-risk identity. Standard conditions again give ratio consistency and relative fluctuation order . It often has a smoother objective than ordinary least-squares cross-validation, though numerical behavior and relative variance depend on the probability density function and kernel for density estimation.
For plug-in bandwidth selection, obtain an independent pilot scale g, estimate , then set
The pilot should be positive and stable; consistent positive estimates make this expression ratio-consistent by continuity. A simple normal-reference initialization uses under a normal reference model, substituting a sample scale for sigma. For a Gaussian density kernel this gives . A pure normal-reference rule is quick but is asymptotically correctly calibrated only when its assumed curvature matches the actual probability density function; it is useful as the first stage of a data-driven plug-in procedure.
A more adaptive fourth-derivative pilot estimate of density curvature uses , obtained by two integrations by parts, and estimates it by
The diagonal expectation contributes ; the leading smoothing bias is . Balancing these terms produces the stated pilot scale , with another pilot or reference model supplying . Under sufficient derivatives and tail control, its error is bounded by
at that pilot scale. Taylor expansion of the fifth-root formula gives , so it inherits that bound. A calibrated cancellation of leading pilot bias can give a faster rate. This illustrates why an appropriately constructed plug-in selector can converge more quickly than cross-validation, while requiring more smoothness and pilot choices. For each ratio-consistent method, its attained AMISE divided by the minimal AMISE tends to one.
Write , , and assume are sufficiently smooth for the following Taylor expansions. The symmetric half-grid diffusion consistency calculation gives
where
The normalized local truncation error of the full update is consequently
The PDF prints an advection equation, , whereas this stencil approximates conservative diffusion, . For the literal printed equation the leading defect is , which generally does not vanish: the method is inconsistent, with an normalized defect.
For the intended variable-coefficient conservative diffusion equation, the first two terms cancel and . Under the parabolic step scaling , this is , while the unnormalized one-step local truncation error is . These two orders use different normalizations. With numerical stability and compatible smooth initial and boundary conditions, the intended diffusion problem has global error on a fixed time interval. Positivity and boundedness of alone do not justify the displayed Taylor expansion; coefficient regularity is also needed for that error formula.
Use the Gaussian pole transition for a large gamma parameter. With and , Taylor expansion gives
The upper semicircle is traversed from left to right, so on the indentation. The minus sign in therefore makes its contribution . The remaining leading integral is
At its Cauchy principal value vanishes by oddness. Differentiating with respect to removes the pole, leaving the Fourier transform of a Gaussian:
Integrating from zero gives
This is uniform for bounded real (and extends analytically over bounded complex values where the local contour is continued consistently). Contributions away from the saddle are exponentially small after localization. The bounded shift enters at the next order, not the leading error function. For example, retaining the displayed cubic correction gives as the next term. This also checks the constant and contour sign.
At a critical point of a twice continuously differentiable real function, and the Taylor expansion is
The real symmetric Hessian matrix has an orthonormal eigenbasis, so writing gives . If every eigenvalue is positive, this quadratic form is at least , and the remainder cannot change its sign for sufficiently small nonzero . Thus is a strict local minimum. If every eigenvalue is negative, the analogous argument gives a strict local maximum. If positive and negative eigenvalues both occur, displacement along the corresponding eigenvectors gives values above and below , so is a saddle point of a scalar function.
The second-derivative test can be inconclusive when the Hessian matrix is singular and semidefinite: higher-order terms along directions in the kernel of a linear map matter. For example and have the same Hessian at zero, but the first has a strict minimum and the second a saddle point of a scalar function. A zero eigenvalue does not prevent a saddle conclusion if other eigenvalues already have both signs.
For the given function write . Its first derivatives are
The origin is a critical point for every real , with
Its eigenvalues are , so it is always a saddle point of a scalar function. If one coordinate at a critical point is zero, the other must also be zero. If both are nonzero, the derivative equations force , possible only for . Hence for the origin is the only critical point.
For there are four additional critical points,
At such a point,
Thus the two equal-sign points are strict maxima, and the two opposite-sign points are strict minima. They are global: implies
where the last maximum occurs at and equality also requires .
As , the four nonzero critical points have distance from the origin and escape to infinity, rather than merging with the origin. Their values diverge as . As from below there are no extra critical points, while the origin stays a saddle throughout. This is critical points escaping to infinity in a Gaussian-weighted bilinear function.
Use Minkowski spacetime coordinates and the Minkowski metric of signature . For a massive particle with three-velocity and , proper time satisfies
Thus the four-velocity components are
Here upper indices indicate components in the chosen coordinates; lowering with the Minkowski metric changes the signs of the spatial components. Its invariant product defined by the Minkowski metric is
The four-momentum is , so and . The Taylor expansion of the Lorentz factor at small is
Consequently , recovering ordinary momentum. At rest the four-momentum has energy , so subtracting this rest energy gives the kinetic energy
Thus the nonrelativistic limit preserves the rest-energy offset as well as the usual kinetic energy.
A useful strong form of the Hensel lemma is the following. Let be a complete discretely valued field, with valuation ring , normalized valuation , and . If satisfies
then there is a unique root in the ball . When the assertion is immediate; otherwise the condition includes .
Here is a proof by Newton iteration over a valued field. Write and , and set
Suppose and . The correction has valuation , so . Taylor expansion over cancels the linear term and gives
Thus the derivative still has valuation , and . Unless an exact root is reached earlier, the corrections tend to zero with exponentially increasing valuations. Completeness gives , and continuity gives and . For uniqueness, if are in this ball, polynomial expansion around gives
The second factor has valuation exactly and is nonzero, so two roots in the ball must be equal. In particular, a simple residue root lifts uniquely: and satisfy the hypothesis.
For the square-class group of a p-adic field, write every element as with . Multiplication by a square changes by an even integer, so valuation parity gives one independent factor .
For odd , a unit is a square if and only if its residue is a square in . Necessity follows by reduction; sufficiency applies the simple-root Hensel lemma to , whose derivative is a unit at a nonzero residue root. The cyclic group has square subgroup of index two. If is a unit with nonsquare residue, then
For , every odd square is one modulo eight. Conversely, if , take and . Then , so the strong Hensel lemma gives a square root. Thus unit square classes are exactly their residues modulo eight. The classes and generate this group of order four independently, and valuation parity supplies the class . Hence
Put , let denote the sum of the four axial shifts, and let denote the sum of the four diagonal shifts. Reading both sides of the PDF stencil gives , where and . The left-hand stencil acts on the time derivative; treating it as a scalar multiplier would lose the compact correction.
Write . Taylor expansion of the symmetric shifts gives
and
For the exact diffusion solution , subtracting gives
The leading coefficient is not identically zero for general smooth data. Thus the normalized local residual is fourth order, and in the question's convention . This is the compact semidiscrete nine-point diffusion scheme; its usual spatial numerical consistency order is four, rather than three.
The nodes are . Their Lagrange interpolation basis on the normalized step is
Integrating these polynomials from zero to each node gives . At the row vanishes; at the integrals are ; at they are . The endpoint integrals also give . These are exactly the coefficients in the original PDF.
Indeed, the degree-three polynomial determined by and satisfies . Integrating it to the nodes gives precisely the stage equations, and integrating to the endpoint gives the update. This proves it is a collocation Runge-Kutta method, specifically the three-stage Lobatto IIIA method.
For an explicit order proof, the collocation integrals imply , and , with powers componentwise. The endpoint weights are Simpson weights, so for . Therefore the eight Butcher order conditions through order four are satisfied:
For example the last expression is , because . These conditions are obtained by matching all elementary differential terms through degree four in the exact and numerical Taylor expansions, not just by testing a scalar linear equation. Nonautonomous equations are included by adjoining .
To exclude higher order, the scalar stability function computed below satisfies . The local defect is therefore nonzero at degree five even on the scalar test equation. Hence .
Let . Near the interior minimum, Taylor expansion gives
On the scale , the leading exponent is and . If the integral is localized at this minimum, the rescaled integration endpoints tend to infinity in both directions, so the Gaussian integral gives Laplace's method:
Formally expanding the cubic term gives an order- correction odd in , whose Gaussian integral is zero. Quartic terms and the square of the cubic term produce the order- correction. Sufficient smoothness near the minimum and control of the exterior integral justify this formal calculation.
The printed local assumptions alone do not guarantee localization. A useful localization condition for Laplace's method is that outside each sufficiently small fixed neighbourhood of , for some , and that for some . For , the exterior contribution is at most
which is exponentially smaller than the displayed local term. To see why something of this kind is needed, take on . Its unique minimum is at zero and , yet on we have . This boundary interval alone contributes at least , dominating the proposed local approximation. The Laplace formula therefore has its usual implicit tail assumption, rather than following from uniqueness of the interior minimum alone.
For the Gamma function, set to obtain
Here has its unique minimum at , with and . It tends to infinity at both endpoints, and its integral is finite for positive exponents, so localization holds. Laplace's method yields Stirling's formula:
For a prior density and independent observations, Bayes' theorem writes the desired posterior expectation as a ratio of integrals:
Suppose the log-posterior kernel has a unique concentrating interior mode , with curvature of order , and the smoothness and tail conditions hold for both integrals. Expanding quadratically gives a common Gaussian factor . Replacing the smooth amplitude by gives
This approximation does not require to be positive: it treats as an amplitude, without taking its logarithm. For more accuracy, expand the amplitude and the cubic term in the log-posterior kernel. With , the Gaussian moments are and . Terms multiplying cancel between numerator and denominator; the two remaining first corrections are
under the stronger smoothness, derivative-scaling and integrability assumptions needed for this expansion. The first term accounts for the curvature of the amplitude and the second for posterior skewness. This is posterior expectation by Laplace approximation. If there are several modes, boundary modes, or nonconcentrating tails, the appropriate separate contributions must be included; a single interior Gaussian approximation cannot then be assumed.
Put , , with fixed positive . Insert a smooth exact solution and divide the residual by :
Taylor expansion gives
The differential equation cancels the leading part, leaving normalized local truncation error . Since contains mixed derivatives, there is no fixed positive Courant number canceling this leading error for every smooth solution. Thus the method is second order in time and space. Global second-order convergence also requires stability and initial values at both time levels accurate enough to retain this order.