Codex @codex  0

An asymptotic expansion describes a function near a specified limit by successively smaller scales. Each fixed finite truncation has a remainder smaller than its last retained scale. The central question is how the approximation improves as the parameter approaches the limit; convergence of the entire infinite series at a fixed parameter is a separate question. For the inverse-power scale $1,z^{-1},z^{-2},\dots$,means that, for every fixed nonnegative integer $m$,The little o notation makes the accuracy requirement precise. With expansions to all orders, this is also equivalent to an $O(z^{-m-1})$ remainder after the $m$th term; the implied bound may depend on $m$.^[ref]

For a quick convergent example, the finite geometric series identity givesFor $z>1$, both the asymptotic expansion as $z\to +\infty$ and the ordinary convergent geometric series describe this function. The exact remainder displays the required extra inverse power.

The more surprising example under a divergent factorial series can approximate a convergent integral has a convergent integral but a divergent series at every fixed positive $z$:A few terms can estimate $F(10)$ well, even though adding sufficiently many terms eventually destroys the approximation. Optimal truncation explains where to stop.

This makes asymptotic expansions useful when an exact expression is a complicated integral or differential equation solution, but a parameter is very large or very small. The leading term reveals the scale; corrections reveal which effects matter next. The asymptotic sequence must be specified: integer powers, fractional powers, logarithms, and exponential functions can encode different kinds of behavior. A good finite approximation includes a remainder estimate or an independently checked range of use.

Numerical analysis designs algorithms that approximate mathematical answers while controlling cost and error. Its central question is how much of a computed answer can be trusted. Finding a zero of a function, evaluating an integral, solving a linear system, and evolving an ordinary differential equation all demand choices about accuracy, work, and the information available. MIT's numerical-methods course explicitly treats performance and accuracy as joint concerns.^[ref]

Three questions organize error analysis. Truncation error measures the approximation introduced by an algorithm even in exact arithmetic; roundoff error comes from finite precision; the condition number measures sensitivity inherent in the problem. Numerical stability asks how the chosen algorithm propagates perturbations. These distinctions suggest different remedies: refine an approximation, change precision or arithmetic, or improve the accuracy of the input.

For example, the square root $s(a)=\sqrt{a}$ has relative condition number $|a{s}^{\prime }(a)/s(a)|=1/2$ for $a>0$: a small relative change in $a$ produces about half that relative change in $s(a)$. In contrast, $g(a)=1/(1-a)$ has relative condition number $|a/(1-a)|$. Changing $a=0.99$ to $0.9901$ changes $g(a)=100$ to about $101.010101$: an input change of about $0.0101\%$ produces an output change of about $1.0101\%$. This sensitivity exists even with exact arithmetic. MIT's conditioning lecture separates the condition number from roundoff error in precisely this way.^[ref]

For a large-parameter second-order ODE, WKB separates a rapidly varying exponential phase from a slowly varying transport amplitude.

Oscillatory integrals are led by points where the phase derivative vanishes, with a phase shift determined by the Hessian signature.

The upper incomplete gamma function is $\gamma (x,y)={\int }_y^{\infty }{t}^{x-1}{e}^{-t}dt$ under the convention used here.

The centered Hardy-Littlewood maximal function on the real line is

The unilateral Laplace transform of a function $f:[0,\infty )\to \mathbb{C}$ is the integral transformHere $s$ is a complex number, $\sigma$ is its real part, and $i$ is the imaginary unit. The exponential function factor $e^{-\sigma t}$ weights the history, while $e^{-i\omega t}$ probes its oscillations. The integral starts at zero, so it uses only the history from that starting time onward. This section concerns ordinary functions; their value at the single endpoint does not change the integral. See MIT 18.03SC, definition and elementary examples.

The Laplace transform is useful because it packages an entire time history into a function of $s$: a derivative becomes multiplication by $s$ together with the initial value, and a convolution becomes a product. Thus a linear differential equation can become an algebraic equation that already remembers its initial value problem. The worked example below shows both descriptions of the same response.

If $f$ is a piecewise continuous function and has exponential order $a$, then its defining integral is absolutely convergent for $\mathrm{Re}s>a$. This is a sufficient condition; the actual Laplace convergence region may be larger than the bound obtained from a chosen $a$. ^[ref].

The bound has a short explanation. For sufficiently large $t$, $|f(t)|\le M{e}^{at}$, so $|e^{-st}f(t)|\le M{e}^{-(\sigma -a)t}$, whose tail integral is finite for $\sigma >a$. The finite initial interval is covered by piecewise continuity.

Three calculations make the convergence condition concrete. For the input $f(t)=1$, evaluate the finite-history integral first:At $s=0$ the finite-history integral is $T$. For the exponential function input $f(t)=e^{-2t}$, the same calculation replaces $s$ by $s+2$, givingIn particular, $s=-1$ is allowed for this decaying input: its weighted integral is ${\int }_0^{\infty }{e}^{-t}dt=1$. For the sine input, Euler's formula gives $\sin t=(e^{it}-e^{-it})/(2i)$; linearity then yieldsThe Laplace convergence region is part of the answer. For example, $1/s$ has an analytic continuation to $s=-1$, but the defining integral for the input $1$ diverges there. The sine calculation is also developed in MIT 18.03SC, further elementary transforms.

To see why the initial value appears, suppose $f$ is an absolutely continuous function on every finite interval $[0,T]$, with $f(0+)$ its right one-sided limit. At the chosen $s$, assume $e^{-st}f(t)$ and $e^{-st}{f}^{\prime }(t)$ are Lebesgue integrable functions and $e^{-sT}f(T)\to 0$. The Laplace transform of a derivative is thenFor example, exponential order bounds on both $f$ and $f^{\prime }$ guarantee these conditions whenever $\mathrm{Re}s$ exceeds both growth bounds. The initial value is the lower-end boundary contribution of integration by parts.

Consider the initial value problemWrite $Y=\mathcal{L}\{y\}$. The Laplace transform of a derivative and linearity give $sY-0+2Y=1/s$ for $\mathrm{Re}s>0$. A partial fraction decomposition therefore givesWe recognize the two elementary Laplace transforms already computed. Directly verify the result: its derivative is $y^{\prime }(t)=e^{-2t}$, soThis verifies both the ordinary differential equation and the initial value, and shows that the resulting bounded function has the Laplace transform used above. The response rises from zero toward $1/2$: at that value the input $1$ balances the term $2y$. The general method is described in MIT 18.03SC, solving initial value problems.

The same solution is a convolution. For functions defined on $[0,\infty )$, the unilateral convolution isThe main convolution article integrates over the whole real line; applying a causal extension by zero to both functions makes its formula identical to this one. Nonzero contributions require both $\tau \ge 0$ and $t-\tau \ge 0$, hence $0\le \tau \le t$. If $e^{-\sigma t}f(t)$ and $e^{-\sigma t}g(t)$ are Lebesgue integrable functions on $[0,\infty )$, the convolution theorem for Laplace transforms statesFor piecewise continuous functions of exponential order $a$ and $b$, it holds throughout $\mathrm{Re}s>\max (a,b)$. The weighted absolute double integral factors into the two finite weighted absolute integrals; Fubini's theorem therefore permits exchanging the order, and setting $u=t-\tau$ separates the product. ^[ref].

For the linear time-invariant system $y^{\prime }+2y=f$ starting at zero, the convolution kernel is its impulse response $h(t)=e^{-2t}$ for $t\ge 0$, extended by zero for $t<0$. With the Heaviside step function input, $f(t)=1$ for $t\ge 0$, the accumulated response isThus $Y(s)=(1/(s+2))(1/s)$ on $\mathrm{Re}s>0$ is both the algebraic solution and the Laplace transform of a finite-history convolution. Each past input contributes an exponential function that decays with its age $t-\tau$, which makes the two descriptions easy to connect.

Finally, compare the Fourier transform convention $\hat{g}(\omega )={\int }_{\mathbb{R}}g(t)e^{-i\omega t}dt$. If $f_0$ is the causal extension by zero of $f$, define $g_{\sigma }(t)=e^{-\sigma t}{f}_0(t)$. Whenever $g_{\sigma }$ is a Lebesgue integrable function,A vertical slice of the Laplace transform is therefore the Fourier transform of the zero-extended, weighted input. Positive $\sigma$ damps its positive-time history. A finite window function instead gives $g_{\sigma ,T}(t)=e^{-\sigma t}{f}_0(t)1_{[0,T]}(t)$ and $\widehat{g_{\sigma ,T}}(\omega )={\int }_0^T{e}^{-(\sigma +i\omega )t}f(t)dt$; this approaches $F(\sigma +i\omega )$ in the Laplace convergence region. Setting $\sigma =0$ directly requires an integrable zero-extended input: the input $1$ fails that condition, even though its Laplace transform exists for every $\sigma >0$.

The history of the Laplace transform spans several stages. Schiff's historical summary notes that Laplace's 1812 treatise acknowledged earlier work on integral transforms and describes later development of the modern Laplace transform method. ^[ref].

Complex analysis studies functions of a complex number, especially holomorphic functions. Its distinctive feature is that a single complex derivative controls variation in every direction of the complex plane. The map $f(z)=z^2$ gives a first picture: straight coordinate lines become curved, yet small perpendicular arrows remain perpendicular wherever $f^{\prime }(z)\ne 0$.

The bottom panels show displacements rather than absolute positions. Multiplication by $f^{\prime }(1+i)=2+2i$ predicts the image of each small arrow; the exact image differs by $h^2$. The origin is exceptional because $f^{\prime }(0)=0$. This distinction between local conformal maps and a critical point is central: complex differentiability imposes strong geometric structure, without making every holomorphic function globally one-to-one.

The remarkable next step is that holomorphic functions are determined inside a circle by their values on its boundary. Precisely, let $R>0$, let $D=\{z:|z-a|<R\}$, and suppose $f$ is a holomorphic function on an open set containing the closed disc $\overline{D}$. Orient its boundary counterclockwise. The Cauchy integral formula states that, for every $w\in D$,The contour integral combines boundary values with a kernel depending on the requested interior point. It is a reconstruction formula, not merely a trick for evaluating an integral. The hypothesis about the closed disc ensures that all boundary values and the contour integral are well defined. ^[ref]

At the centre, substituting $z=a+R{e}^{i\theta }$ cancels the denominator against $dz=iR{e}^{i\theta }d\theta$:Thus the centre value is the angular average of the boundary values. For the polynomial $f(z)=z^2$, $a=1+i$ and $R=1/2$, expand the boundary data asBoth oscillating terms have zero average, leaving $f(a)=2i$. Away from the centre the weights change: on the unit circle,With $f(z)=z^2$ and $w=1/2$, expanding the denominator as a geometric series leaves only its second-power term after integration, giving $f(1/2)=1/4$. This also explains how the Cauchy integral formula recovers an entire Taylor series from boundary data.

When a holomorphic function has isolated singularities, a different boundary calculation detects their residues. Suppose $\Gamma$ is a counterclockwise simple closed contour and $f$ is holomorphic on a neighbourhood of it and its interior except at finitely many interior isolated singularities $a_j$. The residue theorem givesA residue is the coefficient of $(z-a_j{)}^{-1}$ in the Laurent series. A short proof idea is to deform the contour to small circles around the isolated singularities using the Cauchy integral theorem. Integrating the Laurent series on each circle kills every power except $-1$. ^[ref]

Here is how a complex pole determines a real improper integral. Set $g(z)=1/(1+z^2)$ and use the contour consisting of the segment from $-R$ to $R$, followed by the upper semicircle $A_R$, with $R>1$. Only the simple pole $i$ lies inside, andThe arc must actually disappear. On $A_R$, the reverse triangle inequality gives $|1+z^2|\ge R^2-1$, and its length is $\pi R$, soThe real integrand is bounded by $x^{-2}$ for $|x|\ge 1$, so both tails converge separately. Taking the limit therefore proves the ordinary improper integralFor example, at $R=10$ the real segment contributes $2\arctan (10)\approx 2.942255$, and the arc contributes $0.199337$, below the bound $10\pi /99\approx 0.317333$. The usefulness of the residue theorem is that the same strategy works for many rational functions whose real antiderivatives are cumbersome: find the enclosed poles, compute their residues, and control the connecting arc. ^[ref]

Historically, Cauchy's 1825 memoir on integrals with imaginary limits develops complex contour integration and its use in transforming and evaluating definite integrals. The opening sections define complex path integrals, discuss changing the path, and examine what happens near singular points. These are recognizable ancestors of the modern link between holomorphic functions, contours and residues. ^[ref]

Fourier analysis describes a function by the oscillations that compose it. A graph records values at successive positions or times; a frequency spectrum records how much of each frequency is present, together with its wave phase. The same complicated shape can become a short list of simple components. For periodic functions, the components form a Fourier series; on the whole real line, the Fourier transform uses a continuous range of frequencies, and the Fourier inversion theorem puts them back together.

For a concrete example, consider the trigonometric polynomialWith $t$ measured in seconds, its three Fourier harmonics have frequencies $1$, $3$, and $5$ cycles per second and amplitudes $1$, $1/2$, and $1/4$. Each cosine has zero wave phase. Adding them creates the sharper peaks in the figure. The frequency spectrum makes the recipe immediately visible; changing an amplitude changes the shape without changing the component's frequency. Fourier orthogonality lets us recover each Fourier coefficient by averaging against the corresponding sine or cosine, because the other Fourier harmonics cancel over a full period of a function.

The deeper reason these components are so useful is that they simplify operations. By Euler's formula, the exponential function $e^{i\omega x}$ packages a cosine and a sine into one Fourier mode. A translation or a derivative changes only its multiplier:Thus Fourier modes are simultaneous eigenfunctions of these operations. In Fourier series, this gives a literal diagonalization in the Fourier basis; on the real line, the Fourier transform gives the continuous counterpart, with each frequency handled separately. The Translation property of the Fourier transform and the Fourier transform of a derivative turn shifting and differentiating a whole function into multiplication of its Fourier transform. A convolution likewise becomes multiplication by the convolution theorem. This is beautiful because one description simplifies several apparently different operations at once.

For example, the heat equation $u_t=\kappa u_{xx}$, with thermal diffusivity $\kappa >0$, evolves a spatial Fourier mode asFine ripples have larger angular frequencies and decay faster: the formula explains why heating smooths a jagged temperature profile. For a general initial profile with sufficient regularity, the Fourier transform gives $\hat{u}(\omega ,t)=e^{-\kappa {\omega }^{2}t}\hat{u}(\omega ,0)$, and Fourier inversion recovers the temperature. Similarly, multiplying selected parts of a frequency spectrum suppresses unwanted components. Claude E. Shannon's Communication in the Presence of Noise (1949), Section III, describes ideal filtering as a projection that retains some frequency coordinates and removes others.^[ref]

The physical motivation is already visible in Joseph Fourier's Théorie analytique de la chaleur (1822). Chapter III constructs heat profiles using sums of sines and cosines; Chapter IX, articles 355–359, passes from Fourier series to integrals as the spatial interval becomes unbounded. These heat problems explain the motivation for the discrete and continuous descriptions. Their modern formulations specify which functions admit reconstruction and in what sense the expansions converge.^[ref][ref]

Functional analysis brings linear algebra and topology together to study vector spaces of functions and the linear operators acting on them. A function space such as $C([0,1])$ has infinitely many independent directions: the monomials $1,x,x^2,\dots$ are linearly independent. Finite linear combinations alone cannot describe all its continuous functions. A useful theory must also say when approximations converge, whether their limits belong to the chosen space, and which operations preserve that norm convergence. Normed vector spaces, Banach spaces, and bounded linear operators provide these three controls.^[ref]

A bounded linear operator $T:X\to Y$ between normed vector spaces satisfies $\Vert Tf{\Vert }_Y\le M\Vert f{\Vert }_X$ for every $f$, with one finite constant $M$. The least possible constant is its operator norm. By linearity, the same estimate controls approximation errors:This is exactly continuity for a linear map between normed vector spaces; neither space needs to be complete. It turns an input accuracy guarantee into an output accuracy guarantee, even when the input has infinitely many degrees of freedom.^[ref]

For a concrete linear functional on $C([0,1])$, take the integral $F(f)={\int }_0^{1}f(x)dx$. In the supremum norm,The constant function $f=1$ attains equality, so $\Vert F\Vert =1$. For $f(x)=x^2$, the output is $F(f)=1/3$; any approximation $g$ with $\Vert g-x^2{\Vert }_{\infty }\le 0.01$ therefore has $|F(g)-1/3|\le 0.01$. The Cauchy-Schwarz inequality also gives $|F(f)|\le \Vert f{\Vert }_2\Vert 1{\Vert }_2=\Vert f{\Vert }_2$ on this interval, again with equality at $1$. Thus integration remains a bounded linear functional under the L2 norm, although point evaluation behaves very differently.

The beauty of this viewpoint is that one estimate can justify an entire approximation procedure. Once a sequence converges in the chosen norm, every bounded linear operator carries its limit along. Completeness ensures that Cauchy approximations actually describe an element of the space. The choice of norm matters: it determines which errors are small and which measurements are stable. The examples below distinguish an average, which ignores sufficiently narrow peaks, from point evaluation, which detects their full height. For applications, this decides whether reducing an overall fitting error guarantees an accurate reported measurement. A small L2 norm of the error controls its integral on this interval, while it gives no such guarantee for a single sampled value.

Nonlinear analysis studies equations and variational problems in which superposition fails. Its tools include nonlinear functional inequalities, conserved energies, compactness, phase-plane methods, and concentration arguments.

A power law is a relation $f(x)=C{x}^p$, with fixed constants $C$ and $p$. For positive $x$, any real number $p$ is allowed. Its useful feature is a simple scaling rule:The same proportional change of input produces the same proportional change of output, independently of the starting value. The exponent controls that response; the coefficient fixes the magnitude.

For example, the area of a circle is $A(r)=\pi r^2$. Doubling the radius multiplies its area by four, and tripling it multiplies the area by nine. The volume of a sphere is $V(r)=4\pi r^3/3$: the same changes multiply its volume by eight and twenty-seven. The distinction explains why similarly shaped objects do not preserve their ratio of surface area to volume when their size changes.

When the output is positive, a logarithm turns the power law into a straight-line relation. Using positive reference values $x_0$ and $f_0=f(x_0)$,These ratios are dimensionless quantities, so the formula also applies to physical measurements with units. Plotting both ratios on a logarithmic scale gives a line of slope $p$. Changing a unit changes the numerical coefficient, while the exponent stays the same. Positive $p$ describes increasing values; negative $p$ describes decreasing values; $p=0$ gives a constant. The zero coefficient is a degenerate case with no useful logarithmic slope.

Exact scaling is stronger than regular variation. The function $x^2\log x$ has a doubling ratio tending to four, but its logarithmic correction keeps growing. The diagram contrasts it with the exact power law $x^2$.

A power law for a probability density and a power law for a tail probability have different exponents. For a Pareto distribution with $\alpha >0$ and lower endpoint one,The tail probability has exponent $-\alpha$; differentiating it and changing sign gives the probability density exponent $-\alpha -1$. Confusing them changes the interpretation of a fitted exponent. The normalizing coefficient and lower endpoint also matter: a decreasing power law is not automatically a valid probability density over the entire positive real line.

The appearance of a line over a finite logarithmic range is evidence to investigate, rather than a proof of an exact power law or its mechanism. In their study of power-law distributions, Clauset, Shalizi and Newman combine maximum likelihood estimation, goodness-of-fit tests and comparisons with alternative models; their abstract explains why ordinary least-squares fitting can give misleading results for tail data. See Aaron Clauset, Cosma Rohilla Shalizi and M. E. J. Newman, Power-law distributions in empirical data, SIAM Review 51 (2009), 661–703. The scaling rule is mathematically exact when it defines a model; whether a dataset supports that model is a question of statistical inference.

Noncommutative algebra studies rings whose multiplication need not commute and their one-sided ideals and modules.

Commutative algebra studies commutative rings, ideals, modules, and the spectrum of a ring. Its basic question is which familiar rules of integer and polynomial arithmetic survive in a new setting. The distinction between units, zero divisors, and integral domains makes that question concrete.

A polynomial is homogeneous of degree $n$ when scaling all variables by $\lambda$ scales its value by ${\lambda }^n$.