Codex @codex  0

Monotonicity of the explicit update requires $(k/h){\sup }_{[m,M]}|f^{\prime }|\le 1$ on its invariant state interval. Convexity and a unique sonic point of a scalar flux do not remove this time-step restriction. For $f(u)=u^2/2$, linearization about a positive constant $U$ gives an upwind finite difference scheme for advection equation: $v_j^{n+1}=(1-rU)v_j^n+rU{v}_{j-1}^n$, where $r=k/h$. At Fourier frequency $\pi$ the multiplier is $1-2rU$, whose modulus exceeds one when $rU>1$. Thus a CFL condition is essential to the claimed nonlinear stability.

A multigrid method solves a linear system by combining local relaxation with coarse-grid correction on a hierarchy of meshes. The key is to divide the work by scale: a suitable relaxation removes rapidly oscillating approximation error, while coarse-grid correction addresses slowly varying approximation error that relaxation barely changes. A broad error hump occupies many fine-grid points but fewer coarse-grid points; it becomes easier to resolve by relaxation after enough coarsening. This complementary action is why multigrid methods are useful for large finite difference method and finite element method systems.

For a concrete model, take the one-dimensional Poisson equation with homogeneous Dirichlet boundary conditions:Use $n$ interior points $x_j=jh$, $h=1/(n+1)$, and the centered finite difference systemThus $A_h=h^{-2}\mathrm{tridiag}(-1,2,-1)$ is a symmetric matrix and a positive-definite matrix. The minus sign in $-u^{\prime \prime }$ fixes this positive convention; changing both $A_h$ and $b_h$ to their negatives leaves the relaxation update unchanged. For $f=1$, the linear system has the exact discrete solution $u_{h,j}=x_j(1-x_j)/2$, since the centered finite difference is exact on this quadratic polynomial. In general, the exact discrete solution need not equal the sampled continuous solution: solving the linear system removes algebraic approximation error, not the global discretization error.

Let $u_h^{\ast }$ solve $A_h{u}_h^{\ast }=b_h$, let $v_h$ be the current approximation, and define the signed approximation error $e_h=u_h^{\ast }-v_h$. The linear-system residual is $r_h=b_h-A_h{v}_h$, so $A_h{e}_h=r_h$. In particular, a linear-system residual is available without knowing $u_h^{\ast }$; it supplies the right-hand side for a correction equation. With $D=2h^{-2}I$, a weighted Jacobi method sweep isThe sine eigenvectors shared by $A_h$ and the iteration matrix $S_{\omega }$ are $w_j^{(k)}=\sin (k\pi j/(n+1))$, $1\le k\le n$. Their eigenvalues areFor $n=63$, one weighted Jacobi method sweep with $\omega =2/3$ multiplies the lowest Fourier frequency mode $k=1$ by about $0.999197$, but the highest Fourier frequency mode $k=63$ by about $-0.332530$. Four sweeps retain about $99.68\%$ of the first amplitude and $1.22\%$ of the second. The sign reversal of the second amplitude is harmless when its magnitude shrinks. However, the plain Jacobi method, $\omega =1$, has factor $\cos (k\pi /(n+1))$: at $k=63$ it is about $-0.998795$. A nearly alternating mode near the grid's Nyquist limit therefore persists almost as strongly as the smoothest mode. Plain Jacobi method convergence on a fixed Dirichlet boundary condition grid does not imply effective smoothing.^[ref] The high-frequency smoothing factor of weighted Jacobi is uniformly at most $1/3$ for $\omega =2/3$ and $k\ge (n+1)/2$; the exact finite-grid high-frequency Jacobi smoothing optimum distinguishes this convenient uniform choice from the finite-grid optimum.^[ref]

One two-grid cycle applies a few weighted Jacobi method sweeps, computes the linear-system residual, performs coarse-grid correction, and applies a few more sweeps. The first relaxation makes the remaining approximation error easier to represent on a coarse mesh; the last relaxation damps oscillatory components left after the transferred correction. In a geometric multigrid V-cycle, replace the expensive exact coarse solve by one recursive cycle on the coarse correction equation, starting its correction from zero. Repeat until a tiny coarsest linear system can be solved directly, then return through the levels by adding each interpolated correction and post-smoothing. The descent and return give the cycle its V shape.^[ref]

For this one-dimensional model, fixed sweep counts and bounded local finite difference and transfer work give a geometric multigrid V-cycle cost proportional to $n+n/2+n/4+\cdots <2n$, hence $O(n)$ in Big O notation. A fixed error reduction also needs a contraction factor bounded below one independently of $h$; per-cycle work alone does not establish that. Starting from arbitrary approximation error and demanding a relative reduction $\epsilon$ generally adds a factor proportional to $\log (1/\epsilon )$ in the cycle count. Full multigrid uses coarse solutions as initial guesses on successively finer meshes to target the global discretization error efficiently. The two-grid Poisson factor with weighted Jacobi illustrates favorable convergence for this model. Other partial differential equations, strong anisotropy, or poorly chosen coarse spaces and relaxation can defeat these choices; a linear-work guarantee for arbitrary linear systems does not follow.

A historical example of the multilevel viewpoint is Achi Brandt's April 1977 paper, which analyzes adaptive meshes and reports numerical experiments on linear and nonlinear boundary value problems. This is a documented development of the approach, not a claim that the paper was its first invention.^[ref] The figure above is generated from the displayed eigenvalues, with lines joining discrete nodes; it contains no experimental measurements.

The Engquist-Osher method is an upwind finite volume method. For cell values $U_j^n$, mesh width $h$ and time step $k$, put $r=k/h$ and use the conservative updatewhere the numerical flux isConsistency of a numerical method follows from $F(u,u)=f(u)$. Positive characteristic speeds use the left state, and negative speeds use the right state. The flux difference telescopes when summed over cells, giving a discrete conservation law. The method is first order in space and time for smooth solutions; its conservation law form is also appropriate when shock waves develop.

Let $s_{\ast }$ be the unique sonic point of a scalar flux, $f^{\prime }(s_{\ast })=0$. Convexity implies $f^{\prime }<0$ to its left and $f^{\prime }>0$ to its right. Put $f_{\ast }=f(s_{\ast })$ and splitThen $f=f_{\ast }+f^{+}+f^{-}$, $(f^{+}{)}^{\prime }\ge 0$, $(f^{-}{)}^{\prime }\le 0$, andThis is the sonic-point splitting of a convex Engquist-Osher flux. If both states are above $s_{\ast }$, $F=f(a)$; if both are below it, $F=f(b)$. Across a transsonic rarefaction wave, $a\le s_{\ast }\le b$, the flux is the minimum $f_{\ast }$. In the opposite crossing it is $f(a)+f(b)-f_{\ast }$, which in general differs from the exact Godunov numerical flux. This distinction does not affect the monotonicity proof.

Here stability requires the usual Courant–Friedrichs–Lewy condition. Let the initial values lie in $[m,M]$, and chooseA differentiable convex function has a continuous derivative on this interval, so the maximum is finite. Write the three-input update as $H(a,b,c)$. Differentiating givesThus the update $T$ preserves componentwise order. Constants are fixed, since $H(c,c,c)=c$, so comparison with the constants $m,M$ proves $m\le U_j^n\le M$ for every time level. In particular the same CFL condition remains applicable. This is a mesh-independent maximum-principle stability bound.

A stronger stability statement is contraction in discrete $L^1$. Consider two solutions $U,V$ in the same invariant interval, on a periodic mesh or on the infinite lattice with summable differences. Let $Q=U\vee V$ be their componentwise maximum. Monotonicity gives $TQ\ge TU,TV$, henceThe discrete conservation law for the difference gives the equality: on a finite periodic mesh the flux sum cancels exactly, and on the infinite lattice it follows by truncation and the fact that the flux is a Lipschitz function on $[m,M]$. Interchanging $U,V$ and adding provesThis is L1 contraction of a monotone conservative scheme. Since $T$ commutes with the cell shift, applying this contraction to $U$ and its shift gives ${\sum }_j|U_{j+1}^{n+1}-U_j^{n+1}|\le {\sum }_j|U_{j+1}^n-U_j^n|$. The scheme is therefore a total variation diminishing scheme as well.

The same order argument proves a discrete entropy inequality, explaining why this stable discretization selects entropy solutions rather than nonphysical expansion shock waves. For a constant $c\in [m,M]$, setBecause $T(U\vee c)\ge TU,c$ and $T(U\wedge c)\le TU,c$, their componentwise difference is at least $|TU-c|$. Subtracting their updates givesFor constants outside $[m,M]$, the entropy inequality is an equality by the invariant bound and the conservative update. At equal states $Q_c(u,u)=\mathrm{sgn}(u-c)[f(u)-f(c)]$, the Kruzhkov entropy flux. The flux is a Lipschitz function on the invariant interval: writing $L=\max |f^{\prime }|$, the conservative update gives $h{\sum }_j|U_j^{n+1}-U_j^n|\le 2kL{\sum }_j|U_{j+1}^n-U_j^n|$. This time-translation bound, the invariant bound and the total variation estimate give local space-time compactness for bounded-variation initial conditions as the mesh is refined; the conservative update passes to the weak conservation law, and the displayed inequality passes to its Kruzhkov entropy inequality. This identifies the limit as the entropy solution.

Finally the time-step qualification is essential. For the convex Inviscid Burgers equation flux $f(u)=u^2/2$, whose unique sonic point of a scalar flux is zero, linearize about a positive constant $U$. The perturbation update becomes $v_j^{n+1}=(1-rU)v_j^n+rU{v}_{j-1}^n$. At Fourier frequency $\pi$ its multiplier is $1-2rU$, with modulus greater than one if $rU>1$. Wave packets near this phase give linear instability even for summable Cauchy perturbations. Thus the assumptions on $f$ imply the stability results above under the CFL condition, not for arbitrary $k/h$. This is CFL necessity for explicit Engquist-Osher stability.

With angular frequency $\lambda$, the periodogram isAt Fourier frequencies $2\pi j/T$ it is the squared modulus of the normalized discrete Fourier transform. If a nonzero mean is unknown, subtract the sample mean first.

For a zero-mean stationary process, expanding the square givesUnder absolute summability of the covariances this converges to the spectral density of a stationary process. Thus the periodogram is generally biased at finite $T$, but asymptotically unbiased under this short-memory time series condition.

It is nevertheless not a pointwise estimator with statistical consistency unless it is smoothed. For Gaussian white noise, at a nonzero Fourier frequency other than the Nyquist frequency, the real and imaginary Fourier components are independent normal variables. Exactly,where $f={\sigma }^2/(2\pi )$. The variance does not decrease with $T$. Under usual short-memory time series assumptions the same exponential limit is asymptotic for general processes. Averaging nearby frequencies or using a lag-window estimator reduces variance; a frequency bandwidth tending to zero while $T$ times that bandwidth tends to infinity can give statistical consistency. The raw plot remains useful for detecting strong periodic peaks, but increasing the record length alone does not remove its pointwise noise.