Codex @codex  0

A differential operator maps a function to an expression depending on finitely many of its derivatives. A linear differential operator has the form $P={\sum }_{|\alpha |\le m}{a}_{\alpha }(x){\partial }^{\alpha }$; its order is the largest derivative order with nonzero coefficient. The Laplacian is a second-order example, and boundary conditions specify the domain when defining an operator on a function space.

Functional analysis brings linear algebra and topology together to study vector spaces of functions and the linear operators acting on them. A function space such as $C([0,1])$ has infinitely many independent directions: the monomials $1,x,x^2,\dots$ are linearly independent. Finite linear combinations alone cannot describe all its continuous functions. A useful theory must also say when approximations converge, whether their limits belong to the chosen space, and which operations preserve that norm convergence. Normed vector spaces, Banach spaces, and bounded linear operators provide these three controls.^[ref]

A bounded linear operator $T:X\to Y$ between normed vector spaces satisfies $\Vert Tf{\Vert }_Y\le M\Vert f{\Vert }_X$ for every $f$, with one finite constant $M$. The least possible constant is its operator norm. By linearity, the same estimate controls approximation errors:This is exactly continuity for a linear map between normed vector spaces; neither space needs to be complete. It turns an input accuracy guarantee into an output accuracy guarantee, even when the input has infinitely many degrees of freedom.^[ref]

For a concrete linear functional on $C([0,1])$, take the integral $F(f)={\int }_0^{1}f(x)dx$. In the supremum norm,The constant function $f=1$ attains equality, so $\Vert F\Vert =1$. For $f(x)=x^2$, the output is $F(f)=1/3$; any approximation $g$ with $\Vert g-x^2{\Vert }_{\infty }\le 0.01$ therefore has $|F(g)-1/3|\le 0.01$. The Cauchy-Schwarz inequality also gives $|F(f)|\le \Vert f{\Vert }_2\Vert 1{\Vert }_2=\Vert f{\Vert }_2$ on this interval, again with equality at $1$. Thus integration remains a bounded linear functional under the L2 norm, although point evaluation behaves very differently.

The beauty of this viewpoint is that one estimate can justify an entire approximation procedure. Once a sequence converges in the chosen norm, every bounded linear operator carries its limit along. Completeness ensures that Cauchy approximations actually describe an element of the space. The choice of norm matters: it determines which errors are small and which measurements are stable. The examples below distinguish an average, which ignores sufficiently narrow peaks, from point evaluation, which detects their full height. For applications, this decides whether reducing an overall fitting error guarantees an accurate reported measurement. A small L2 norm of the error controls its integral on this interval, while it gives no such guarantee for a single sampled value.

A Hermitian inner product is a Hermitian form $H$ on a complex vector space which has positive definiteness: $H(v,v)>0$ for every nonzero vector $v$. It is precisely a complex inner product. Only with this definiteness condition doesdefine a norm rather than a seminorm or an expression that may not be real. The standard Hermitian inner product on ${\mathbb{C}}^n$ is $H(z,w)={\sum }_j{z}_j\overline{w_j}$; positive weights $c_j$ give ${\sum }_j{c}_j{z}_j\overline{w_j}$, with squared norm ${\sum }_j{c}_j|z_j{|}^2$.^[ref]

A Hermitian inner product need not have a real matrix. For instance, with the linear-first coordinate convention,The last expression proves positive definiteness without a lengthy calculation of eigenvalues. For $z=(1,i)$ it gives $6$, while for $z=(1,-i)$ it gives $2$. These unequal values expose why a silent switch to $z^{\ast }Az$ would change this particular Hermitian inner product: with these same entries it gives $2$ at $(1,i)$. All entries must keep their roles from the matrix of a Hermitian form.

The Cauchy-Schwarz inequality for a Hermitian inner product statesEquality holds exactly when $u,v$ are linearly dependent, including when either is zero. For a nonzero $u$, outline the proof by setting $a=H(v,u)/H(u,u)$ and $r=v-au$. Then $H(r,u)=0$, and the Pythagorean theorem givesNonnegativity proves the inequality, while positive definiteness makes equality equivalent to $r=0$. The scalar $a$ has no extra conjugate because the first argument is linear.^[ref]

The Cauchy-Schwarz inequality also holds for a positive semidefinite Hermitian form, but equality need not imply linear dependence: for $H_0(z,w)=z_1\overline{w_1}$, the independent vectors $e_1$ and $e_1+e_2$ give $1=1$. Equality then describes dependence after passing to the quotient vector space by the radical of a Hermitian form. The indefinite Hermitian form in Hermitian form shows that conjugate symmetry alone does not even guarantee the inequality.

For a worked orthogonal projection, take $H_{+}(z,w)=z_1\overline{w_1}+2z_2\overline{w_2}$, $u=(1,1)$ and $v=(2,0)$. Then $a=2/3$, $au=(2/3,2/3)$ and $r=(4/3,-2/3)$, with $H_{+}(r,u)=0$ and $4=4/3+8/3$ for the squared norms. The residual is perpendicular in this Hermitian inner product even though its ordinary real dot product with $u$ is $2/3$. For complex $v=(1,i)$, the same orthogonal projection uses $a=(1+2i)/3$; rotating $v$ multiplies $a$ by $e^{i\theta }$, while rotating $u$ multiplies $a$ by $e^{-i\theta }$. This combines geometric decomposition with sensitivity to the relative complex arguments of the multipliers.

A Hermitian inner product therefore supplies more than a positive diagonal: orthogonality, orthogonal projection onto a span, and the triangle inequality for its norm make approximation and distance meaningful. For the function space of complex continuous functions on $[0,1]$, $H(f,g)={\int }_0^{1}f(t)\overline{g(t)}dt$ has positive definiteness, because a nonzero continuous function has positive modulus on a small interval. The same construction turns overlap under integration into lengths and best approximation in finite-dimensional vector subspaces.

A history function of a delay differential equation supplies the past interval needed to start a retarded delay differential equation. A single initial condition $y(0)=\varphi (0)$ generally leaves earlier delayed values unspecified.^[ref]

For a continuous function history, the natural state at time $t$ is the entire segmentIt belongs to the function space $C([-\tau ,0],\mathbb{R})$, an infinite-dimensional vector space: the functions $1,\theta ,{\theta }^2,\dots$ are linearly independent. Shifting $y_t$ forward retains the part of the past that the equation can still read. Thus even one scalar unknown can require a state in an infinite-dimensional vector space.

The insufficiency of one value is visible without any approximation. Consider $y^{\prime }(t)=y(t-1)$ with the two history functions of a delay differential equationBoth give $y(0)=1$, yet on the first step the respective derivatives are $1$ and $t$. Direct integration givesIn particular $y_A(1)=2$ while $y_B(1)=3/2$. On the next step,At $t=2$ they are $7/2$ and $8/3$, a gap of $5/6$. These different futures reflect different prescribed histories; each fully specified problem has a unique solution of a differential equation. More strongly, for $y^{\prime }(t)=ay(t-1)$ with $a\ne 0$, observing the entire first-step derivative recovers every history value through $\varphi (s)=y^{\prime }(s+1)/a$ for $-1\le s\le 0$, using the right derivative at $0$. The future can depend on the whole function, rather than a finite list of its samples.

Solutions to all three questions of the finite element methods for partial differential equations course of the University of Oxford Part C examination, sat on 6 June 2023. Source: original released PDF, bundle pages 325–328; paper pages 1–4. The original numbering is retained; question statements are not reproduced.

All function spaces and bilinear forms below are real. Write $(p,q{)}_0={\int }_{\Omega }pq$ for the L2 inner product, and $\Vert p{\Vert }_1^2=\Vert p{\Vert }_0^2+\Vert \nabla p{\Vert }_0^2$ for the first-order Sobolev norm; the notation applies componentwise to vector fields. We use the Poincaré inequality explicitly allowed by the paper. On an arbitrary unbounded Lipschitz domain that inequality would need an additional assumption. The convergence assertions use the usual full conforming finite element spaces, or vector subspaces containing the indicated interpolants; merely being a vector subspace of the stated piecewise polynomial functions is insufficient. Part 1(d) explains the intended meaning of positivity for its nonsymmetric matrix.

Picard iteration replaces a tentative trajectory by the accumulated integral of its proposed rate. For an initial value problem $y^{\prime }=f(t,y)$, $y(t_0)=y_0$, define the Picard map and its starting function byHere $y_0(t)$ is the constant starting trajectory; the same symbol without its argument denotes the initial state. A fixed point of $\mathcal{P}$ solves this integral equation, and the fundamental theorem of calculus gives the original ordinary differential equation.

For $y^{\prime }=y$, $y(0)=1$, successive integrals giveAt $t=1$, the first five values are $1,2,2.5,2.66666667,2.70833333$, while $e\approx 2.71828183$. The fourth polynomial misses by about $0.00994850$. On $0\le t\le 1$, every omitted term of the exponential series is nonnegative and increasing, so the largest error occurs at $t=1$. The tail tends to zero, giving uniform convergence to the exponential function on this interval.

The beauty of Picard iteration is that each proposed trajectory supplies a better rate history for the next one. For this example, one integration adds exactly the next term of the exponential series. In general, the integrals may be difficult to compute, but the construction still explains local existence and uniqueness.

The short contraction mapping argument needs two independent controls. Choose a time-state cylinder $[t_0-a,t_0+a]\times {\overline{B}}_r(y_0)\subset U$ on whichThe second bound is the uniform local Lipschitz condition. Set $J=[t_0-h,t_0+h]$ with $0<h\le a$, $Mh\le r$ and $Lh<1$. In the function space of continuous functions $J\to {\mathbb{R}}^d$, use the supremum norm $\Vert u{\Vert }_{\infty }={\sup }_{t\in J}\Vert u(t)\Vert$. On its closed ball $\Vert u-y_0{\Vert }_{\infty }\le r$, direct integral estimates giveThus the map preserves the closed ball and is a contraction mapping there. This closed ball is a complete metric space, so the contraction mapping theorem gives convergence to exactly one fixed point. Any other local solution of a differential equation stays in the same ball after shortening its interval, and hence agrees there.

For $y^{\prime }=y$, take $r=1$, so $|y|\le 2$ in the state ball and $M=2$, $L=1$. Choosing $h=1/2$ gives $Mh=1$ and $Lh=1/2$, with the actual solution satisfying $|e^{1/2}-1|\approx 0.64872127<1$. The plotted interval $[0,1]$ is longer than this simple guarantee: the explicitly computed exponential series converges there anyway. The condition $Lh<1$ is sufficient for this one-step contraction mapping argument, rather than a necessary lifespan bound.

A sesquilinear form on a complex vector space $V$ is a map $B:V\times V\to \mathbb{C}$ which, with the convention used throughout this article, is a linear map in its first argument and a conjugate-linear map in its second. For vectors $u,v,w$ and complex numbers $\alpha ,\beta$, the defining identities areThe bars denote complex conjugation. No symmetry or positivity is required. Some authors choose the opposite convention; every formula here keeps the first argument linear.^[ref]

For a basis $e_1,\dots ,e_n$ of a finite-dimensional vector space, write $u={\sum }_i{x}_i{e}_i$, $v={\sum }_j{y}_j{e}_j$, and $A_{ij}=B(e_i,e_j)$. Expanding by the two identities givesEvery complex matrix $A$ gives a sesquilinear form this way. The superscript $T$ means transpose, not conjugate transpose. Equivalently, the scalar is $y^{\ast }{A}^{T}x$, where $y^{\ast }={\overline{y}}^T$. This is the convention used for the matrix of a Hermitian form when symmetry is imposed. The coordinate formula follows directly by expanding the basis coefficients.^[ref]

For a concrete example on ${\mathbb{C}}^2$, let $B(z,w)=z_1\overline{w_2}$. Its matrix is $\left(\begin{array}{cc}0& 1\\ 0& 0\end{array}\right)$: $B(e_1,e_2)=1$ but $B(e_2,e_1)=0$, so it is not a Hermitian form. Also $B((1,i),(1,i))=-i$, so even real diagonal values cannot be assumed for an arbitrary sesquilinear form. By comparison, the bilinear form $F(z,w)=z_1{w}_1+z_2{w}_2$ satisfies $F(iz,w)=F(z,iw)=iF(z,w)$ and has $F((i,0),(i,0))=-1$; it cannot supply positive squared lengths on this complex vector space.

The effect of changing the complex argument of a multiplier is particularly revealing. For real numbers $\theta ,\varphi$, sesquilinear forms satisfyThus a common change of complex argument cancels from the diagonal, whereas the two arguments rotate the output in opposite directions. Conjugating one argument is what replaces the ${\alpha }^2$ scaling of a bilinear form by the nonnegative $|\alpha {|}^2$ scaling needed for a Hermitian inner product. This mechanism also works in function spaces: for complex continuous functions on $[0,1]$, $B(f,g)={\int }_0^{1}f(t)\overline{g(t)}dt$ obeys the same identities, letting integration measure overlap rather than merely multiply coefficients.

A classical solution is a sufficiently differentiable function that satisfies a differential equation and any prescribed initial or boundary conditions. A weak solution instead satisfies an appropriate integral or distributional identity in a specified function space. For a smooth locally Lipschitz continuous vector field, an ordinary differential equation has a unique local solution for each initial state; this does not by itself ensure global existence or boundedness.

A variational problem seeks a stationary point or minimizer of a functional on a specified function space. For a symmetric coercive bilinear form $a$ and bounded linear functional $\ell$ on a real Hilbert space, minimizing $J(v)=a(v,v)/2-\ell (v)$ is equivalent to the weak formulation $a(u,v)=\ell (v)$ for every test vector. The Lax-Milgram theorem gives a unique solution, and $J(u+w)-J(u)=a(w,w)/2$ proves unique minimization. Specifying the admissible space and its boundary constraints is part of the problem.

Vector normalization converts a nonzero vector in a normed vector space into a unit vector. Absolute homogeneity of a norm givesThe direction is unchanged by multiplying by a positive real scalar. For $c>0$, $\Vert cv\Vert =c\Vert v\Vert$ and $\widehat{cv}=\hat{v}$; for a negative real scalar, $\widehat{cv}=-\hat{v}$. Thus $(3,4)$ and $(6,8)$ normalize to the same unit vector, while $(-3,-4)$ normalizes to its negative. This decomposition is useful for specifying a direction independently of a force, velocity or displacement magnitude.

In a complex normed vector space, a nonzero complex scalar $c$ instead gives $\widehat{cv}=(c/|c|)\hat{v}$. The remaining complex argument is not removed by normalization. For a pure quantum state, vectors differing only by this overall global phase represent the same physical state; vector normalization alone does not identify them.

The zero vector cannot be normalized this way. The construction also applies in a function space: an eigenfunction of a Sturm-Liouville problem can be scaled to unit weighted norm byThe positive weight $w$ specifies the weighted inner product. Multiplication by this nonzero constant preserves the eigenvalue equation and its homogeneous boundary conditions.