Exponential generating function Created 2026-10-07 Updated 2026-10-20
An exponential generating function encodes a sequence using . For labelled counting, is the number of structures on a fixed set of distinct labels. Labels distinguish otherwise similar objects: changing which person belongs to a group can change the structure. Recover the count by coefficient extraction as . The raw coefficient is , not .
The factorial makes multiplication account automatically for distributing labels. To combine an -structure on labels and a -structure on the remaining , choose the first label subset in ways, then choose the two structures. The binomial coefficient counts how the two groups of labels interleave within the full label set. Thus
The normalization works because . This explains the usefulness of exponential generating functions for labelled counting: an ordinary Cauchy product would omit the choices of labels. See Peter Magyar, Math 482, notes for 2/7, labelled product principle.
For a concrete example, there is one undecorated set on any given collection of labels. Its exponential generating function is the exponential function . Combine a red set and a blue set, allowing either to be empty:
Every label independently receives one of two colours, giving assignments by the rule of product. With three labels, the counts by number of red labels are , totalling eight. Choosing only the two group sizes would give the four possibilities ; it would forget which labels are red.
Indeed, the ordinary generating function for the constant sequence is the geometric series . Its square has coefficient , counting pairs of nonnegative sizes. Both encodings are correct for their respective questions. The decision is whether identity matters when objects are combined.
For unordered sets of labelled components of positive size, an exponential generating function becomes : the term forgets the ordering of components. The existing rooted-tree generating function develops the richer example . A labelled rooted tree consists of its root of a tree and an unordered set of smaller labelled rooted trees, connecting the same label-distribution mechanism to recursive counting.
Exponential limit 2026-10-31
For fixed real , the base is positive for sufficiently large . Applying Taylor's theorem to the natural logarithm at one gives . Continuity of the exponential function then proves the displayed limit. In particular for fixed , a basic source of exponential distribution limits in probability theory.
Exponential Markov bound Created 2026-09-24 Updated 2026-10-14
Applying Markov's inequality to the positive random variable gives
Here is the moment-generating function, and the useful bound requires it to be finite at the chosen . Optimizing over gives the Chernoff bound method: an exponential function weights large values more strongly before applying the same average-budget argument.
For example, let have the Poisson distribution with parameter one. Its expected value and variance are both one, and its moment-generating function is . At threshold four, choosing gives
This minimizes the exponent because its derivative is , with positive second derivative. The direct Markov's inequality bound is , and the two-sided Chebyshev's inequality bound, applied to a deviation of at least three from the mean one, is . The exact Poisson distribution tail probability is . These compare three valid bounds obtained from progressively different information; none is an exact tail probability formula for general random variables.
From and one cannot generally deduce . For , and , the two premises hold, but the ratio of the compositions is , which is unbounded. A constant scaling of an inner argument can change the growth order after an exponential function is applied.
Finite-dimensional continuation criterion Created 2026-09-24 Updated 2026-10-14
Under the Picard-Lindelöf theorem's hypotheses on , extend a solution of a differential equation as far as possible, to a maximal interval . If , the time-state trajectory must eventually leave every compact subset of . Equivalently, confinement near to one compact subset of permits continuation past . See Teschl, Section 2.6, Lemma 2.14 and Corollaries 2.15–2.16, pp. 52–53.
The domain restriction matters even for a bounded trajectory. Restrict , , to . Then exists in this domain only for ; at its values are . As , it approaches the excluded boundary point while remaining bounded. Its trajectory cannot fit into any compact subset of near that endpoint. This is escape from a finite domain, without finite-time blowup in norm. Enlarging the domain to gives the same formula for every real .
Conversely, , , stays in the compact set for every fixed . Its growing exponential function is unbounded over the entire future, but has no finite-time blowup. At , its largest value on is only . The relevant question is boundedness before each finite endpoint, rather than one bound valid forever. The tangent function in the diagram under the Picard-Lindelöf theorem illustrates the other possibility: its norm escapes every bound before .
This criterion is useful because an estimate can secure continuation without an explicit formula. In a finite-dimensional vector space, a bounded closed ball is compact; a bounded state trajectory therefore supplies the needed compact set when its time-state closure is inside the domain. That final proviso prevents mistaking a domain boundary for finite-time blowup.
A common sufficient estimate comes from global Lipschitz continuity in the state. Assume for an open time interval , with continuous and a Lipschitz constant valid for all states on each compact time interval under consideration. For , let , finite by continuity. Then , and the Gronwall inequality gives, for wherever the solution already exists,
For instance, , , has and the exact solution , attaining this estimate; at the value is . Finite bounds of this kind give continuation throughout , with the analogous estimate backwards in time. When , this gives existence for all real times. If has a finite endpoint, it gives no continuation beyond that prescribed domain. The underlying linear-growth criterion is [ref].
A brief explanation of the continuation mechanism suffices: within the protecting compact set, the continuous function is bounded, say by . The integral equation yields near the finite endpoint, so has a limit . The protecting compact set puts inside . Restarting the initial value problem there and using local uniqueness joins the trajectories.
Finite rectangular barrier matching Created 2026-10-14 Updated 2026-10-20
Take a nonrelativistic particle of constant mass with energy , and choose the same zero of potential energy on both sides of a rectangular potential barrier:
The equality of the exterior potential energies matters: it gives the same exterior wavenumber and makes . Here is the reduced Planck constant. This model has a finite jump in potential energy, no delta potential, and no absorbing term.
For , the time-independent Schrödinger equation gives the spatial wavefunction
The full stationary state is . We set the incident probability amplitude to one and impose no incoming wave from the right; this scattering wavefunction is not a normalizable wavefunction. The tunnelling decay constant describes exponential decay, rather than an oscillatory wavenumber in the barrier. Both exponential functions are needed on the finite interval: the growing term is not excluded by a condition at infinity.
The wavefunction and its derivative are continuous at each face, giving four linear matching conditions:
Their solution supplies the transmission amplitude
A short derivation is to use the two right-face equations to express and in terms of , then substitute into the left-face equations. Taking the squared modulus gives the rectangular barrier transmission probability.
Finite-valued infimal convolution Created 2026-10-07 Updated 2026-10-14
If two nonnegative finite-valued convex functions are defined on all of a finite-dimensional space, their infimal convolution is finite, convex and continuous everywhere. Convex perturbation duality then gives strong duality and dual attainment at every argument. It does not require or imply attainment of the primal decomposition infimum.
More precisely, let be finite everywhere and write . Nonnegativity supplies a lower bound, while the two trial splits and give
Mixing nearly optimal splits proves convexity, and continuity of a convex function applies because the effective domain is the entire finite-dimensional vector space. These statements concern the optimized value, rather than existence of an optimal split. For the continuity theorem and dual attainment under the equality constraint , see Bertsekas, Convex Optimization Theory: A Summary, Propositions 1.3.11 and 5.3.3(a). The equality has a feasible point in the whole space for every , and the displayed bound makes its optimal value finite.
A finite value without any optimal split. On , take the convex functions and . Both are nonnegative and finite everywhere, but
for every . The splits have costs , yet the exponential function is strictly positive at every finite . No split attains the infimum. The value function is even constant and differentiable; regularity of the value function does not prevent optimizing splits from escaping to infinity. For example, gives costs approximately , and .
A sufficient extra condition for attainment at a fixed is that be a coercive function, meaning it tends to as . Under the finite-valued assumptions it is a continuous function, so a sufficiently large closed ball contains a global minimum by the extreme value theorem. If this cost is also a strictly convex function, the optimal split is unique. The quadratic example above satisfies both conditions; the exponential function example does not satisfy coercivity.
Nonnegativity is sufficient, not necessary: finite lower bounds , would give by the same argument. Removing all lower-bound control can lose finiteness even for finite convex functions: and give , hence . Nor does finiteness alone guarantee differentiability: choosing gives by the triangle inequality and the split .
An observation interval of finite duration is not an infinitely sharp frequency selector. Combine the lock-in quadratures into
For unwanted electric potential difference , where is an angular frequency offset and , expansion into complex exponentials gives the exact response
The sinc function formula follows by integrating the exponential function and factoring ; its value at zero follows from a limit. The first term changes slowly after multiplication; the second oscillates at the sum frequency. It vanishes at exact matching when is an integer number of reference cycles, each lasting one period of a function, but cannot generally be discarded in a short-window calculation.
For and many reference cycles, the first term usually dominates: its modulus is and its complex argument includes . Thus gives almost no rejection. A longer observation separates closer frequencies, with the first zeros of this term at . Those zeros are not a brick-wall cutoff: the sinc function has nonzero lobes beyond them. At a synchronized contribution remains however large becomes.
Figure 1.
Lock-in quadratures preserve phase difference; a finite interval limits rejection
. Original calculated geometry and responses, not measurements. Left: , , , ; the dotted vector shows an added synchronized contribution. Right: exact for and equal to four reference cycles, against dimensionless detuning . The dashed curve keeps only the difference-frequency term. Their difference shows why the sum-frequency term matters for a short observation. Details.
For a numerical check, use , , and an unwanted frequency . Then and the exact expression gives
whereas the difference-frequency term alone gives . An interference amplitude therefore contributes to in this constructed example. A nearby frequency can survive strongly even though the three-times-frequency component in lock-in harmonic rejection cancels exactly.
A practical lock-in amplifier's low-pass filter weights past products differently from this rectangular observation interval. Its time constant and roll-off determine near-reference rejection and settling time; narrowing detection slows the response.[ref]
Floating-point overflow 2026-10-25
Floating-point overflow occurs when the magnitude of a computed result exceeds the largest finite representable floating-point number. Large values of an exponential function are a common source. In a normalized weighted sum, replacing exponentials by before division prevents this particular overflow while leaving the normalized weights unchanged; this is an application of the log-sum-exp construction.
Fourier analysis Created 2026-09-24 Updated 2026-10-14
Fourier analysis describes a function by the oscillations that compose it. A graph records values at successive positions or times; a frequency spectrum records how much of each frequency is present, together with its wave phase. The same complicated shape can become a short list of simple components. For periodic functions, the components form a Fourier series; on the whole real line, the Fourier transform uses a continuous range of frequencies, and the Fourier inversion theorem puts them back together.
For a concrete example, consider the trigonometric polynomial
With measured in seconds, its three Fourier harmonics have frequencies , , and cycles per second and amplitudes , , and . Each cosine has zero wave phase. Adding them creates the sharper peaks in the figure. The frequency spectrum makes the recipe immediately visible; changing an amplitude changes the shape without changing the component's frequency. Fourier orthogonality lets us recover each Fourier coefficient by averaging against the corresponding sine or cosine, because the other Fourier harmonics cancel over a full period of a function.
The deeper reason these components are so useful is that they simplify operations. By Euler's formula, the exponential function packages a cosine and a sine into one Fourier mode. A translation or a derivative changes only its multiplier:
Thus Fourier modes are simultaneous eigenfunctions of these operations. In Fourier series, this gives a literal diagonalization in the Fourier basis; on the real line, the Fourier transform gives the continuous counterpart, with each frequency handled separately. The Translation property of the Fourier transform and the Fourier transform of a derivative turn shifting and differentiating a whole function into multiplication of its Fourier transform. A convolution likewise becomes multiplication by the convolution theorem. This is beautiful because one description simplifies several apparently different operations at once.
For example, the heat equation , with thermal diffusivity , evolves a spatial Fourier mode as
Fine ripples have larger angular frequencies and decay faster: the formula explains why heating smooths a jagged temperature profile. For a general initial profile with sufficient regularity, the Fourier transform gives , and Fourier inversion recovers the temperature. Similarly, multiplying selected parts of a frequency spectrum suppresses unwanted components. Claude E. Shannon's Communication in the Presence of Noise (1949), Section III, describes ideal filtering as a projection that retains some frequency coordinates and removes others.[ref]
The physical motivation is already visible in Joseph Fourier's Théorie analytique de la chaleur (1822). Chapter III constructs heat profiles using sums of sines and cosines; Chapter IX, articles 355–359, passes from Fourier series to integrals as the spatial interval becomes unbounded. These heat problems explain the motivation for the discrete and continuous descriptions. Their modern formulations specify which functions admit reconstruction and in what sense the expansions converge.[ref][ref]
For , use the Fourier transform convention . Splitting the integral at zero gives . By the Fourier inversion theorem, the dual identity is
This pair connects an exponential function with the kernel of a Cauchy distribution and produces the Poisson kernel for the upper half-plane by inversion of .
Gamma integral Created 2026-09-28 Updated 2026-10-20
For real and , the change of variables in the defining improper integral for the Gamma function gives
The improper integral converges absolutely: near zero its absolute integrand behaves like , and at infinity the exponential function overcomes every fixed power.[ref]
For real and , the integrands are , , and , with total areas , , and . The third integrand is taller and has six times the area of the first, although the exponential function makes each tail decay.
Figure 1.
Gamma integral kernels for shapes 1, 2, and 4 have total areas 1, 1, and 6 before probability normalization
. Details.
For real , the kernel becomes the probability density function of a Gamma distribution with shape and unit rate only after division by its normalizing constant . In particular, the shape-four probability density function is . More generally, the Gamma integral verifies that integrates to one for shape and rate .
For the half-integer evaluation, the change of variables reduces the Gamma integral to the Gaussian integral:
Consequently, for real ,
For and a nonnegative integer , define the symmetric partial sum and its positive remainder by
Successive omitted terms have ratio for . Bounding them by a geometric series gives
Consequently the physical approximation to has error at most , while the dual approximation has error at most . The prefactor must be included when setting an absolute error tolerance.
For a truncation error below , at the physical side first passes this bound with : lattice points give , whereas gives . The dual side needs only . At the physical side needs only , whereas the dual side first passes the bound with : lattice points give . These counts measure symmetric lattice terms; using the even function symmetry reduces the distinct exponential function evaluations to . Truncation bounds do not include rounding error in a numerical implementation.
Figure 1.
Positive Gaussian tails and rigorous bounds versus retained lattice points, showing the efficient side at reciprocal scales
. Details.
The generating function holds for and fixed . From Rodrigues' formula, . Sum first over , using , and then over to obtain the exponential function. The absolute-value double series is finite for , justifying the rearrangement. Alternatively, the weighted inner product and the Laplace transform of a Laguerre polynomial extract the coefficient .
Geometric mean Created 2026-10-07 Updated 2026-10-13
The geometric mean replaces a list of nonnegative real numbers by one repeated value that preserves their product of numbers. For inputs,
For two positive inputs, is their positive square root. The geometric mean of and is three: replacing by retains the same product. In contrast, their arithmetic mean five retains the sum . The geometric mean is zero if any input is zero; the logarithm formula below requires every input to be positive. [ref].
Its usefulness becomes immediate for successive growth factors. Suppose a hypothetical positive quantity starts at , is multiplied by , then by . It goes , so the geometric mean factor is : a constant factor of one for both steps gives the same endpoint. The arithmetic mean factor is ; repeating it would give , a different endpoint. A mean of factors summarizes multiplicative change; subtracting one afterwards gives the equivalent change per step. Equal-duration steps are necessary to interpret this as change per common time interval.
For positive inputs, logarithms turn multiplication into addition, so
Thus the geometric mean is an arithmetic mean in logarithmic coordinates, followed by the exponential function. For positive measurements with a common unit, one can use dimensionless ratios to a fixed reference : . Changing the common unit rescales by the same factor as the inputs. As a check, doubling one input and halving another retains while usually changing the arithmetic mean.
Figure 1.
The geometric mean preserves multiplicative endpoints and sits between the harmonic mean and arithmetic mean
. Left: the original toy factors and return a quantity to its starting value; repeating their arithmetic mean would produce a larger endpoint. Right: the dimensionless inputs and keep product one while , , and separate as the inputs become less equal. Lines joining time steps are guides, not a continuous growth model. Details.
The arithmetic-geometric mean inequality gives . Apply that same inequality to the multiplicative inverses to obtain , where is the harmonic mean. Consequently
for positive inputs, with equality throughout exactly when all inputs agree. For and , the three values are , , and . They preserve, respectively, the sum of inverses, the product, and the sum. No one of these summaries preserves all three for unequal inputs.
Gibbs--Bogoliubov--Feynman inequality Created 2026-09-28 Updated 2026-10-05
For an exact dimensionless Hamiltonian and trial Hamiltonian , the free energies obey
where and the expectation uses the trial Gibbs distribution .
The identity and the Jensen inequality for the convex exponential function give . Taking minus the logarithm proves the bound.
Heun's method 2026-10-14
Here Heun's method means the explicit endpoint-averaging Runge-Kutta method: take an Euler predictor , sample there, and average it with for the output. The second Runge-Kutta stage is evaluated at the predictor, not at the corrected endpoint. In particular it requires no implicit solve as the ODE trapezoidal rule does. Naming conventions vary between books; the formulas specify the method unambiguously.[ref]
For smooth , a Taylor expansion about gives , where is the state Jacobian matrix. Consequently the output is , matching the exact solution through degree two by the chain rule. This gives local truncation error and, with the usual bounded smoothness and Lipschitz continuity hypotheses on a fixed finite interval, global error . The Euler-Heun embedded pair compares this output with its Euler predictor.
Figure 1.
Euler-Heun stage geometry for y prime equals y: sample at the Euler predictor, then average slopes for the corrected endpoint
. Details.
For , and , the sampled slopes are and . Transporting the second slope to the starting point would end at ; the average slope instead ends at . The exact exponential function reaches . The magnified endpoint comparison separates the pair difference from the actual Heun local defect .
Here is an explicitly synthetic mathematical model of a warming disturbance and its compensatory cooling. It is a teaching analogy for thermoregulation, not a measured human heat budget. Write , where is a lumped internal temperature, is a fixed reference and is a chosen temperature scale. Let be an additional heating rate and an additional cooling rate, both scaled to the same reference rate. All three are dimensionless variables, while is a time constant in the chosen time units. The ordinary differential equation is
The term idealizes increased passive heat transfer with increased internal temperature, around the baseline. The term opposes warming through proportional control with feedback gain . This local signed model does not treat a negative as negative sweating: it would represent decreased cooling relative to baseline. Changes of the environment and multiple body compartments are omitted.
For a constant disturbance and initial condition , the exponential function solution is
Substitution checks the ordinary differential equation directly. Increasing reduces the lasting offset and, in this instantaneous model, shortens the response time constant to . It does not make zero for a nonzero disturbance and finite : a persistent cooling command requires a persistent displacement under proportional control. At the equilibrium point, the extra heating is balanced by passive loss plus active cooling . Zero change of temperature means balanced rates, rather than zero rates, consistent with conservation of energy.
The first diagram uses , , and a pulse from to , comparing with . The latter approaches during the pulse, compared with without active feedback control. After the pulse ends, each displacement decays as . These are computed curves, not physiological measurements. The curve still has passive loss; it is not a claim that an unregulated body warms without limit.
Real physiological effectors take time to respond. To isolate that issue, set and replace the instantaneous command by another ordinary differential equation:
Here the disturbance remains from onward and the effector time constant is also . The equilibrium point is still , but the characteristic polynomial is . Its eigenvalues give decaying oscillations and asymptotic stability. The exact response is
In particular, , so the first maximum occurs at , with . The response exceeds its eventual displacement while remaining above its baseline. The return has the same negative sign as before; the extra state changes the timing. A finite effector time constant is distinct from the fixed time lag in the delayed negative feedback model.
Figure 1.
Synthetic homeostasis responses: offset, lag and limited effector capacity
. Original computed plots from the homeostatic temperature model, all in arbitrary units and explicitly labelled synthetic. Upper panel: displacement under the same sustained disturbance. Lower panel: corresponding cooling command. Instantaneous proportional control, a finite effector time constant, and effector saturation give different responses despite opposing the same disturbance. No experimental data or clinical limits are shown. Details.
Homogeneous linear differential equation Created 2026-09-29 Updated 2026-10-14
A homogeneous linear differential equation is a linear differential equation with identically zero forcing term, . On a common interval, its solutions of a differential equation form the vector space , the kernel of a linear map. They include the zero function and are closed under addition and scalar multiplication. For any two solutions of a differential equation and constant scalars , linearity gives : this is the superposition principle. The scalars must be constant; variable multipliers introduce extra derivatives.
For example, has general solution , where is any constant real number. A short verification uses the product rule: , so is constant. For and , the sum is and also solves the same homogeneous linear differential equation. At , their values are approximately , and . Every curve is a multiple of one exponential function; the solution space of a homogeneous linear differential equation has dimension one. Both and in this example and the following diagram are dimensionless mathematical variables.
Now keep the same differential operator but prescribe the forcing term . The inhomogeneous linear differential equation has particular solution and general solution . The initial conditions select, respectively,
At , their values are approximately , and . The midpoint solves the same inhomogeneous linear differential equation, because . The sum instead satisfies , so it fails the equation with forcing term . More generally, a linear combination of solutions of a differential equation for the same fixed nonzero forcing term retains that forcing term precisely when its scalar weights add to one. This is the affine space structure, rather than unrestricted superposition within that fixed family.
On the left, all three curves solve the same homogeneous linear differential equation. On the right, share the particular solution , and the shaded difference is the homogeneous solution . The dashed sum has twice the forcing term, even though its starting value coincides with that of . Adding the two initial conditions also adds their inputs; taking their midpoint averages both. This distinction makes the superposition principle useful for assembling responses to different inputs without mistaking that assembly for a solution of a differential equation with the original input. See MIT's superposition notes, including the particular solution one half.
Hyperbolic function Created 2026-10-05 Updated 2026-10-14
Hyperbolic functions combine the exponential function to describe a hyperbola much as trigonometric functions describe a circle. Their two basic members are the hyperbolic cosine and hyperbolic sine, defined for every real number by
Their derivatives exchange the two functions:
These formulas follow by applying differentiation to the exponential function definitions. [ref]
Adding and subtracting gives and . Multiplying these equalities proves the hyperbolic Pythagorean identity:
Consequently the parametric equation traverses the entire right branch of the unit hyperbola , where . For example, gives , while gives approximately . Compare on the unit circle, where the squared coordinates add to one. The minus sign changes the geometry from a closed circle to an unbounded hyperbola.
Figure 1.
Hyperbolic cosine and sine become the coordinates of the right branch of a unit hyperbola
. The same inputs are marked on both function graphs and the unit hyperbola. The shaded region has area and corresponds to hyperbolic angle . Details.
The other members are ratios and reciprocals: hyperbolic tangent is , hyperbolic cotangent is , and hyperbolic secant is ; denominators must be nonzero. The hyperbolic sine and hyperbolic cosine both solve the second-order linear differential equation . In fact has and , making this basis convenient for an initial value problem. Their geometry also makes hyperbolic substitution useful for integrals containing , and the hyperbolic cosine gives the physical catenary of a hanging chain.