The contraction principle for large deviations says that if has a large deviation principle in with good rate function , and is a continuous map between Hausdorff spaces, then has the same large-deviation speed and good rate function
For an open set , its inverse image is open, so the input lower bound gives
For a closed set , its inverse image is closed, giving the corresponding upper bound with .
It remains to prove goodness, including the endpoint issue in the infimum. Each fibre is closed. If , compact sublevel sets and lower semicontinuity make attain its infimum on that fibre: intersect it with the compact set and use the closed nested sublevels tending down to . Hence for each finite ,
The right-hand side is compact, being a continuous image of a compact set, and is closed because the target is Hausdorff. Thus is lower semicontinuous and good, completing the proof.
Write for work arriving in slot and for the service rate of a queue. For a work-conserving single-server queue, the Lindley recursion is . For stable independent and identically distributed random variables with mean , its stationary workload supremum has the form
Different scaling limits of a queue concern different quantities growing large; they need not share either a probability speed or a likely path to overflow.
For large-buffer queue scaling, fix the input law and and let the buffer size of a queue . Assume finite exponential moments around a positive root of . An overflow accumulated in slots requires an average input about , so Cramér's theorem assigns logarithmic cost . Optimizing the duration gives the Cramér-Lundberg workload exponent
For an interior root with , Fenchel–Young inequality verifies the minimization: the lower bound is because , and equality occurs at . The exponential workload bound from cumulative arrival moments gives the upper exponent for every ; an exponentially tilted positive-drift path or the duration calculation gives the matching lower exponent. In effective bandwidth notation, . This regime measures long accumulation into a large buffer with a fixed positive stability margin.
For many-source queue scaling, superpose independent copies of an input process, give the server capacity , and give it buffer size . For each lookback horizon , the average of the source cumulative arrivals has a large deviation principle with rate function . Overflow at that horizon costs . Optimizing the lookback horizon suggests
For independent slots, , giving . The integer horizon is important in a slotted system. For temporally dependent sources, use the cumulative-input cumulant-generating function, rather than multiplying a one-slot formula by . The heuristic needs uniform control of the tail of the stationary supremum to justify optimizing an unbounded set of horizons; stability and suitable exponential-moment estimates provide this in the usual models. The growing quantity here is the number of independent sources, while per-source capacity and buffer remain fixed.
For moderate-deviation queue scaling, consider a bufferless queue with aggregate Poisson input of mean and capacity , . The spare capacity is much larger than the ordinary central limit theorem scale but much smaller than . The Poisson sample-mean rate function near its minimum has expansion
With , the cost is asymptotic to . Hence Poisson moderate deviations give . The quadratic cost comes from a shrinking neighborhood of the mean, rather than from a fixed macroscopic overload. The regime is useful for a large aggregate whose service margin lies between its typical fluctuation scale and its mean scale.
For a heavy-traffic limit of a queue, instead hold the input law fixed with mean and positive finite variance , and let with and . In slots the net input has mean about and random fluctuation of size . Thus the functional central limit theorem, followed by the Skorokhod reflection map on the half-line, suggests
where is reflected Brownian motion with negative drift and variance parameter . The stationary law of negatively drifted reflected Brownian motion has tail . When passing the stationary distribution through the limit is justified, this predicts
For dependent input satisfying a suitable invariance principle, replace by its long-run variance of a stationary process. This regime is appropriate near critical load and on long time scales; a functional transient limit alone does not automatically justify the stationary-limit interchange.
A different large-service regime holds the input law fixed. With Poisson distribution of mean and bufferless capacity , let . The single-point lower bound and the optimized Chernoff bound for , using Stirling's formula, give the Poisson large-service overflow asymptotic
Here the service rate grows while the input mean does not. A quadratic moderate-deviation approximation would describe the wrong part of the Poisson tail.
To choose a regime, compare the spare capacity, typical fluctuations, number of sources and buffer size before selecting a formula. Use the large-buffer exponent for a fixed stable input and a long overload episode; use the many-source variational cost when independent flows and resources grow together; use moderate deviations for an intermediate safety margin; use the heavy-traffic diffusion when the stability margin tends to zero; and use the fixed-input Poisson tail when service alone becomes very large. Check temporal dependence and exponential-moment assumptions. For heavy-tailed subexponential distributions, a single exceptionally large arrival can dominate overflow, so a finite exponential workload root and a Brownian approximation to the far tail need not apply. These comparisons explain why the same nominal queueing theory system can have different useful asymptotic descriptions.
A large molecular Schmidt number separates the velocity's smallest smooth length scale from the scalar's smaller diffusive length scale. Follow a Lagrangian trajectory and measure displacement from it. Within a sufficiently small scalar packet, Taylor expansion of the smooth velocity field gives
The moving frame removes uniform sweeping, leaving a linear random velocity gradient tensor. Thus the local scalar equation is the advection-diffusion equation with velocity , and averaging over realizations of gives the corresponding ensemble average. The approximation requires the packet to lie within the velocity's locally smooth region. Its thin, diffusive direction can satisfy this condition even when its long direction eventually becomes too large for one global linearization; applications to a spatially varying flow then use local packet descriptions. The statistical conclusions below refer to the linear-flow model and the usual mixing assumptions, not to every conceivable trace-free random matrix process.
Write and assume sufficiently rapid decay to discard boundary terms. Integration by parts gives
For , integrate the advective term once and the diffusive term twice. Since and , one obtains
These are mass conservation and the evolution of the unnormalized second moment tensor. The first moment obeys , so a centered packet stays centered.
For a positive Gaussian scalar packet in a linear incompressible flow, must be a positive-definite matrix. Diagonalizing its symmetric matrix and applying the Gaussian integral gives
The factor in the last identity matters because has not been divided by the scalar mass. Substitution into the advection-diffusion equation also gives
These identities agree with the second moment equation and prove that the Gaussian family is preserved. For an initially negative packet the same analysis applies after replacing by and taking its positive mass.
To see the roles of stretching and diffusion explicitly, let the deformation gradient solve , . Incompressibility gives . Differentiating integrates the moment equation:
Without diffusion, and is constant. In a statistically stationary, mixing flow with positive Lyapunov exponent , the two stretching exponents are and . Writing the ordered eigenvalues of as , their typical initially nondiffusive evolution is
The fluctuation scale presumes the usual central limit theorem for accumulated strain; it is not implied by incompressibility alone. During this stage the packet becomes long and thin but keeps its area and peak concentration.
In the instantaneous principal-axis basis, write for the rotated velocity gradient tensor. Differentiation of an eigenvalue gives
The formulas hold through a repeated eigenvalue by continuity of their sum. The compressed physical variance is . Its contraction is arrested when it is of order , the square of the Batchelor scalar microscale . If its initial length is , the crossover occurs at
Thereafter has stationary fluctuations associated with the strain and the diffusive floor, while continues to grow typically at rate . Under sufficiently fast mixing, the central part of the distribution of is approximately Gaussian with mean and variance for a strain-dependent coefficient . This central approximation does not determine far tails, which control high concentration moments; those require a full large deviation principle. The two logarithmic widths need not be independent. The area now increases and decreases typically as . This is diffusion arrest of Gaussian packet compression.
For example, a constant principal strain gives the exact physical variances
The thin variance approaches its diffusive floor, the long variance grows exponentially, and the mass-to-area relation gives the quoted typical amplitude decay. A random strain additionally makes rare histories important for concentration moments.
For a precise statistical formulation define the logarithmic area increase
The Gaussian identities give the exact relation ; hence
Assume the long-time strain statistics give a large deviation principle for on , with convex good rate function , . At exponential accuracy the probability of near is . Combining that cost with the amplitude factor and applying the Laplace principle for probability measures gives the large-deviation decay rates of a Gaussian scalar packet
The initial amplitude only changes a time-independent prefactor. One can see the minimization directly by dividing the possible area-growth rates into small intervals: each contributes its probability cost times , and the interval with least total exponential cost dominates. An interval around a minimizing gives the matching lower bound. The nonnegative area increase bounds the exponential weight by one, so unusually large positive growth cannot produce a divergent weighted tail. Using the area rather than only also avoids discarding possibly important fluctuations of the compressed direction.
Suppose is strictly convex and differentiable, with its minimum at and finite negative right derivative at zero. Define
For the minimizing rate is positive and uniquely solves
For , convexity puts the minimum at the endpoint , giving
High moments are dominated by rare histories with little net area growth, in which a packet keeps a substantial concentration. Their probability cost is , independent of the moment order. A finite threshold is conditional: if , the minimizer can approach zero without reaching it at any finite .
Below the threshold, differentiation of the minimizing expression cancels the terms involving because . Thus , and
Strict negativity uses a nondegenerate rate function with a unique zero at : for positive , and . For deterministic strain the ratio can instead be constant. Near the typical rate, if with , then for small . If this quadratic expression holds all the way to zero, it gives the illustrative full result
The quadratic form is an example, not a universal law of turbulent strain.
A thin scalar packet is stretched until molecular diffusion broadens its compressed direction; conservation of its scalar mass then converts area growth into dilution. Ensemble averages sample different stretching histories, producing different decay rates for different moments and saturation when weakly stretched histories dominate. The present moment calculation is specifically for the centered Gaussian packet and averaging over the flow; signed random initial fields with overlapping packets can also have cancellations and require their initial-field statistics.
Finally, positive exponential decay is a statistical conclusion requiring the strain assumptions above, not a consequence of the local differential equation by itself. For and initially isotropic physical variance , the exact solution has and . Its moments decay algebraically as . Thus the general equations for the exponential rates are the rate-function minimization above; numerical rates and a finite saturation threshold require the long-time statistics of the flow.
Use the positive-integer geometric distribution, for , initially with . Put . The precise good rate function on is
The large-deviation speed is . We prove both bounds of the large deviation principle for .
For , the geometric tail gives the exact expression
Let be a closed set. If it does not meet its probability is zero. If it contains zero, . Otherwise, if it meets the nonnegative half-line, its least possible nonnegative value is positive: a sequence in approaching zero would force zero into the closed set. Its event is contained in , giving
For an open set containing , choose positive integers with . Eventually , and
If , the event alone gives lower exponential rate zero; alternatively the probability of a neighborhood of zero tends to one. Optimizing over proves the open-set lower bound. Sets containing no nonnegative point require only the trivial lower bound .
The rate function is lower semicontinuous at zero as well as elsewhere, and for finite is compact. Hence the large deviation principle has a good rate function. This establishes the large deviations of a scaled geometric random variable. For , deterministically and the rate instead is zero at and infinite elsewhere; the displayed logarithmic coefficient must not be treated as an ordinary finite number in that case.
The contraction principle for large deviations states that if random elements in a space satisfy a large deviation principle with speed and good rate function , and is continuous, then satisfies a large deviation principle at the same speed with
For example, take to be Polish spaces. The rate function is good: its finite sublevel sets are the continuous images of compact sublevel sets. Compactness and lower semicontinuity ensure that a finite fibre infimum relevant to such a sublevel set is attained. The probability bounds follow by taking preimages of open and closed sets.
With fixed, the asymptotic family is the scaled sum
An unscaled fixed random variable alone has no diverging parameter for a large deviation principle; this scaling is the continuation of part (a). Suppose first and put . Independence and the product large-deviation principle give the vector rate
Addition is continuous, so the contraction principle for large deviations gives
For every feasible vector has cost at least , where . Equality holds by assigning all scaled excess to an index attaining . For the constraint set is empty. Thus
Equivalently, the coefficient is with . On the exponential scale the rare large sum is carried by a variable having the slowest geometric tail. Several equal slowest tails can change polynomial prefactors, but not this rate function. This is the large deviations of a fixed sum of geometric random variables.
As a direct check of the tail exponent, for each the moment-generating function of the sum is finite, so the Chernoff bound gives an upper rate at most for . Letting gives . For a lower neighborhood bound, keep all other variables at fixed finite values and let a slowest-tail variable take an integer near ; its probability has rate . If some , their deterministic contributions disappear after division by , so minimize over the nondeterministic variables. If all , the rate is zero only at zero and infinite elsewhere.
A standard form of Varadhan's integral theorem is as follows. Let be probability measures on a Polish space satisfying a large deviation principle with speed and good rate function . If is continuous and bounded above, then
The usual bounded-continuous version follows immediately. If is unbounded above, the same conclusion holds under the additional exponential tail condition
This is the exponential tail extension of Varadhan's lemma. A convenient sufficient hypothesis is
An integrability hypothesis is essential for general unbounded functions; the ordinary large deviation principle alone does not control arbitrarily large exponential weights.
For example, let with probability and otherwise. It satisfies the large deviation principle at speed with rate zero at zero and infinite elsewhere. But for , , whose logarithmic rate diverges, while . This shows why the tail hypothesis cannot simply be omitted.
For the lower bound, fix with and . By continuity choose an open set containing on which . Then
Apply the open-set lower bound of the large deviation principle:
Let and take the supremum over to obtain the required lower bound. This argument also applies when is not bounded above.
For the upper bound, suppose and set , which is finite. Choose a large and partition into finitely many closed intervals of length at most . The preimages
are closed sets. The overlapping endpoints do not matter for an upper estimate. Split off the lower tail and bound each remaining exponential weight:
For a finite sum of nonnegative terms the upper logarithmic rate is at most the largest of their upper logarithmic rates. Applying the closed-set upper bound gives
For , , hence every inner term is at most . Empty preimages contribute no term. Let and then to get the upper bound . Together with the lower bound this proves the bounded-above theorem.
For the unbounded extension, put . This is continuous and bounded above, so the proved result applies, with
The full integral is at most the integral with plus the integral on . The upper logarithmic rate is therefore at most the larger of and the tail rate. The tail hypothesis and then give the upper bound ; the earlier local argument gives the lower bound. If , that lower argument already yields the asserted infinite limit.
Finally, the sufficient exponential-moment condition really implies the required tail estimate: on ,
After integration the upper logarithmic rate is bounded by a finite constant minus , which tends to . This completes the statement and proof of Varadhan's lemma, including the hypotheses needed for the unbounded version.
At large-deviation speed , the exponential distribution gives the large deviation principle on with good rate function
In particular, for . Its finite sublevel sets are the compact sets .
Write and . The cumulant-generating function of one normal random variable is
Cramér's theorem states that empirical means of independent and identically distributed random variables whose moment-generating function is finite on a neighborhood of zero satisfy a large deviation principle at the sample-size large-deviation speed, with good rate function equal to the Legendre-Fenchel transform of their cumulant-generating function. Here that gives
For , differentiation gives the maximizing parameter , and hence
This rate function tends to infinity as , so its finite sublevel sets are compact. Equivalently, the Gärtner–Ellis theorem applies because the limiting scaled cumulant-generating function is finite and differentiable everywhere; it is lower semicontinuous and essentially smooth, with no finite domain boundary at which to check steepness. If is permitted, deterministically and the rate function is zero at and infinity elsewhere.
The product large-deviation principle states that independent families satisfying large deviation principles at the same speed with good rate functions and have joint good rate function . The contraction principle for large deviations states that a continuous map sends such a principle to one with good rate function . Apply these results to and addition. The resulting infimal convolution is
For , the unconstrained stationary point is . Convexity gives the constrained minimum at , so
The two branches agree in value and first derivative at their junction. Both tails tend to infinity, giving a good rate function. This is the fixed exponential perturbation of a Gaussian empirical mean.
There is a reason to use the product large-deviation principle rather than invoke the supplied Gärtner–Ellis theorem without checking its hypotheses. The limiting scaled cumulant-generating function here is
At it is neither lower semicontinuous nor steep from the left: its left derivative tends to the finite value . Its Legendre-Fenchel transform still equals , but the stated Gärtner–Ellis theorem does not establish the full lower bound on the linear branch. The product large-deviation principle and contraction principle for large deviations do establish it. In the degenerate case , the answer is for , and infinity otherwise.
The sum still has a normal distribution, now with
Its scaled cumulant-generating function is
The limit is the same everywhere-finite function as in part (b), so the Gärtner–Ellis theorem gives
at large-deviation speed , when .
One can also see exactly why has no effect through exponential equivalence. For every , the Chernoff bound for the two Gaussian tail bounds gives, when and ,
Its logarithm divided by tends to . If , this probability is eventually zero. The transfer result for exponential equivalence says that coupled families whose distance exceeds each fixed positive tolerance with superexponentially small probability share a large deviation principle with the same good rate function. Apply it to and . This also covers , with the point-mass rate function from part (b).
Work in a Hausdorff space , for example a metric space. A rate function is a lower semicontinuous map . A good rate function additionally has compact finite sublevel sets .
A large deviation principle at large-deviation speed requires, for every open set and closed set ,
The conventions are and . A weak large deviation principle imposes the same lower bound but only the upper bound for compact sets. Exponential tightness supplies compact sets with for every . The strict inequality can equivalently be obtained from the common non-strict definition by choosing a larger containment level.
The indexing defect also affects the downstream claim. For the two inputs in part (b), now choose . The constant input has zero downstream queue workload, while the input with has
Their printed distance is zero, so the literal post-slot downstream continuity assertion is false as well.
In the corrected weighted cumulative-input topology for a slotted queue, apply the finite-window proof of part (b) separately with services and . Both have strictly negative long-window drift because . There are a neighborhood of and finite constants such that
This proves continuity, and indeed local Lipschitz continuity, for the intended downstream function.
Suppose a family of random arrival paths has a large deviation principle in this corrected input space, at speed with good rate function . The contraction principle for large deviations then gives the downstream good rate function
It is infinity for . The path large deviation principle, its topology, and its subcritical domain must actually be established for the chosen stochastic model: a collection of finite-dimensional large deviation principles alone does not control infinitely long workload windows. Nor should upstream departures be assumed independent; the path contraction avoids that unjustified assumption.