The profile likelihood for the parameter of interest replaces the nuisance parameter by its constrained best fit: , with . It is not in general a normalized sampling density. A conditional likelihood instead uses the sampling law conditional on a statistic carrying the nuisance dependence. In the canonical exponential family here, conditioning on removes because the factor involving is constant over the conditioning fibre.
Let and let the observed equal . For the cumulant-generating function of at fixed ,
The saddlepoint solves , equivalently with . This is also the constrained likelihood equation, since . Assume an interior saddle, , and the usual smooth nonlattice conditions under which has a density. Exponential tilting to makes the tilted mean. A local normal approximation gives tilted density at that mean; undoing the tilt gives the saddlepoint density approximation
The factor is for the sample mean, rather than the sum. A transform-based derivation gives the same expression by expanding to second order at its stationary point.
The joint log-likelihood is . Subtracting cancels every appearance of the original , leaving
Any change from the ambient density to a conditional density on contributes only a data-dependent Jacobian determinant. Thus, up to a constant independent of , the saddlepoint conditional likelihood adjustment is
Equivalently up to the constant , where is the nuisance observed information. The adjustment has a positive sign. The printed exponential-family form alone does not guarantee a density for : for example a continuous can have . In a lattice case one must approximate the probability mass of the sum instead; the displayed density calculation uses the regular continuous interpretation.
Write for the cumulant-generating function in the question's parametrization. Multiplying the density by replaces in the decaying part of its exponent by . For , the remaining integral is the normalizing integral for an Inverse Gaussian distribution with parameters . Comparing the two normalizing constants gives
In particular , so the mean parameter used in the more usual Inverse Gaussian distribution notation is ; it must not be confused with the present parameter .
First compute the cumulant-generating function of the sample average, as requested. Independence gives
This is exactly the cumulant-generating function of an Inverse Gaussian distribution with parameters . The uniqueness theorem for moment-generating functions therefore identifies that law. Scaling and including the density Jacobian gives
Equivalently, the inverse Gaussian sum closure is in the parametrization of this question. Its mean is and its variance is , in agreement with addition of independent means and variances.
For a general continuous iid sample with cumulant-generating function , finite near zero, set and choose a real saddle in the interior of the finite moment domain satisfying . With , the saddlepoint density approximation for the sum is
Under the usual smooth nonlattice conditions, at a fixed interior the true density has this leading expression times . This is a relative density approximation; the leading expression is not automatically an exactly normalized probability density in every model.
One way to understand the statistical saddlepoint approximation is through exponential tilting. The tilted one-observation density is , with mean and variance . Undoing this tilt for the sum multiplies its tilted density at by . At , is exactly the tilted mean of the sum. A local version of the central limit theorem gives tilted density there approximately . Multiplying these two factors gives the displayed saddlepoint density approximation. Higher local expansion terms produce the stated relative error order.
For the Inverse Gaussian distribution, differentiation gives
Thus for every the saddle exists, with
At this saddle,
Substitution into the saddlepoint density approximation gives precisely the exact density already found for . Therefore
This exact saddlepoint density of an inverse Gaussian sum is stronger than a relative claim: the leading formula is exact and needs no renormalization.
For the final distribution, both tails decay polynomially. Any positive exponential tilt makes the positive tail nonintegrable, and any negative tilt makes the negative tail nonintegrable. Its moment-generating function is therefore infinite away from zero, leaving no open interval on which to form the cumulant-generating function and solve a saddle equation. Here polynomial tails prevent exponential tilting, so the conventional saddlepoint density approximation is unavailable. A finite mean and variance, and even an ordinary central limit theorem, do not supply the missing exponential moments.
For every , the pointwise inequality holds: on the event the exponential is at least one, and off it the indicator is zero. Taking expected values and then the infimum proves the Chernoff bound
An infinite exponential moment merely gives a vacuous bound at that ; no existence assumption on moments is needed for this extended-value inequality.
For a positive at which the relevant moment-generating functions are finite, apply the Chernoff bound to . Independence of the sources gives
Thus
Classes with make no contribution, so no moment assumption on those inactive classes is necessary. The effective bandwidth is the exponential-moment capacity demand of one class- source over this observation interval. Independent sources have additive effective bandwidths; reserving the margin below capacity certifies the desired overflow bound. If describes traffic during one unit of time, this is a bandwidth in traffic per unit time; for a window of length , divide by instead.
To establish monotonicity and bounds of effective bandwidth, write for a representative source. The Holder inequality gives, for in its moment domain,
Equivalently, the cumulant-generating function is convex with , so its secant slope from zero is nondecreasing. Hence is nondecreasing, rather than necessarily strictly increasing: if is deterministic its effective bandwidth is constant.
Assuming the mean is defined and finite, the Jensen inequality gives , hence . Let
For finite , almost surely, so and . Combining these proves
The upper bound is vacuous if the essential supremum is infinite. For nonnegative traffic these comparisons also make sense with extended values; for an arbitrary real-valued source with undefined mean, the printed mean comparison itself requires an integrability qualification. The positive parameter domain is essential: is defined only by a limit when the appropriate moment assumptions hold, and the stated monotonicity comparisons concern .
Write and . The derivatives of the cumulant-generating function are
Since and , the first three cumulants are
The last equality follows by expanding the cube and taking expectations. We use the paper's unstandardized third central moment throughout. The usual skewness coefficient divides this quantity by ; its sign is the same whenever the variance is positive.
There is a minor domain qualification: finite ordinary moments do not guarantee a finite moment-generating function for positive arguments. The differentiations are valid in a neighborhood of zero when a positive exponential moment exists. For positive variables with the stated finite moments, all formulas also follow from left derivatives at zero, because for and dominated convergence applies. Thus no extra exponential-moment assumption is needed for the moment identities themselves.
For the random sum of independent claims, condition on . Independence of the claims and independence from the count give
Taking expectations and then logarithms yields the random-sum transform identity and the cumulant composition for a random sum:
Here is the probability generating function. These identities hold wherever the transforms are finite, in particular for with positive claims.
For reuse in the three cases, write and . Applying the chain rule three times gives
or equivalently
This expresses the requested third central moment in raw claim moments, while keeping the contribution of claim-count variability explicit.
Put and define the finite geometric series
Starting the autoregressive process of order one at time gives . Consequently
The future innovations are independent and identically distributed random variables, independent of . Factorizing their exponential conditional expectation and using the cumulant-generating function yields
Thus the exponential-affine bond pricing coefficients are
They vanish at maturity, giving . Everywhere finiteness of ensures that each zero-coupon bond price is positive and finite, including when is zero, negative, or one.
An effective bandwidth converts a traffic distribution and a quality-of-service requirement into a capacity requirement, penalizing bursts as well as mean load. Let be the traffic generated in one observation interval and assume its moment-generating function is finite for some positive parameters. Write . The Chernoff bound follows immediately from Markov's inequality applied to :
Optimizing gives , where the supremum is restricted to finite exponential moments. This exhibits the effective bandwidth as the load appropriate to exponential tail control, not an extra physical stream of traffic.
For the mean and peak limits of effective bandwidth, if exponential moments exist near zero, the cumulant-generating function expansion is
For small , , with the variance giving the first burstiness correction. convexity of and show that its secant slope is nondecreasing; Jensen's inequality also gives .
If is bounded with essential supremum , then . For any , the probability is positive and
Let and then . For large , , so very stringent exponential tail control approaches peak provisioning. If traffic is unbounded and every positive exponential moment is finite, the same lower-bound argument gives . If exponential moments cease to exist beyond a finite parameter, is infinite there; one cannot assign a finite large- peak interpretation to that traffic.
For example, deterministic traffic has . A burst of size with Bernoulli distribution probability gives
which moves from to . For Poisson packet count of mean and packet size , , showing a mean limit but no finite peak limit.
For independent traffic sources, logarithmic generating functions add, so effective bandwidths add. For arrivals in a window of length , use the rate-valued definition . A resource with rate capacity then satisfies
Thus a sufficient admission condition for a target probability is for some . Independence is needed for this additive form; correlated sources require the joint exponential moment.
A queue involves a supremum over time windows, not merely one fixed window. For independent identically distributed discrete-time traffic increments , constant service , and stationary workload
the workload Chernoff bound for independent increments follows from a union bound:, whenever ,
The requirement is precisely . This explains why effective bandwidth is useful for buffer and delay design: the relevant time scale and tail parameter depend on the service rule and target overflow risk. A single-window bound cannot be silently substituted for an infinite-horizon workload bound.
Let and let the cumulant-generating function and its Legendre transform be
Under the permitted assumption that is finite everywhere, the right-tail form of the Cramér theorem is, for ,
Use . The restriction to nonnegative parameters is valid on this side of the mean: convexity gives , so negative parameters cannot improve the value zero available at . For , the right-tail probability tends to one by the strong law of large numbers, so its logarithmic rate is zero; it is not generally .
The full large deviation principle bounds probabilities of closed sets from above and open sets from below with rate . For the displayed tail equality, a possible finite upper endpoint also needs attention. If , then at the event requires every summand to equal ; its probability is , and . The identity follows by taking in . Above , both sides have infinite rate. The theorem describes exponential decay, including endpoints and impossible events.
Write . The hypothesis implies and rules out a constant random variable. In particular . The cumulant-generating function is strictly convex, since its second derivative is the positive variance under exponential tilting, and , as .
If , there is a unique with , and the Legendre transform gives . Thus
If , use differentiability at zero: , so for some sufficiently small ,
In either case choose a parameter with , and choose . The Cramér theorem gives, for all sufficiently large ,
The Chernoff bound at the chosen parameter gives . The conditioning event has positive probability for every , since all summands can simultaneously exceed . Therefore
Taking the complement within the conditioning event proves the conditional concentration at a large-deviation threshold:
The farther tail has a strictly larger exponential cost. The argument also works when reaches or exceeds the upper support endpoint, without requiring an interior maximizer there.
An effective bandwidth measures how much capacity a random traffic source requires when unusually large demands matter. A mean-rate description loses burstiness; a peak-rate description can waste capacity when peaks are rare. The parameter in an effective bandwidth controls the emphasis placed on such bursts through the moment-generating function:
Here is the traffic in a chosen time unit. If instead measures traffic over length , the corresponding rate is . With independent stationary increments, this is independent of whenever the moment-generating function exists. More generally both the time scale and dependence structure matter.
The Chernoff bound follows directly from the Markov inequality, since is nonnegative and implies :
Optimize over the admissible positive values of to obtain
For independent sources , moment-generating functions multiply and their effective bandwidths add. Thus a total capacity has the one-time overflow bound . In particular, for independent and identically distributed random variables,
This is the positive-parameter part of the Legendre transform of a cumulant-generating function. The size of its exponent describes how a service margin reduces the chance of a large aggregate demand. A buffer-overflow event involves traffic over many intervals; a one-time Chernoff bound alone is not automatically a bound on that event. A time-dependent model and, for example, bounds on the union of relevant interval events are then needed.
Assume a finite moment-generating function in a neighborhood of zero. Differentiating the cumulant-generating function gives , and . Therefore the small-parameter limit is the mean traffic rate:
The variance term shows how an effective bandwidth charges extra capacity for burstiness. Also is a convex function with , so is nondecreasing for in its domain.
For the other limit, let , the essential supremum. If , almost surely gives . For every , , and
Taking a lower limit and then proves the large-parameter limit is peak traffic:
If has no finite upper bound and all positive exponential moments exist, the same lower bound for arbitrarily large makes the limit infinite. If positive exponential moments cease to exist at a finite parameter, the effective bandwidth is infinite beyond that domain, and the infinite limit is understood in this extended sense. For example, a normal distribution with mean and variance has : its unbounded upper tail has no finite peak. Thus effective bandwidth interpolates between mean and peak demand while permitting independent sources to be aggregated by addition.
Let and . To prove the Hoeffding lemma, take a centered random variable and its cumulant-generating function . Under exponential tilting, is the variance of . The Popoviciu inequality on variances gives
since under any such tilt the support remains , and . Because , integrating twice gives for ; applying the same argument to handles the opposite tail.
The independence of the gives . The Markov inequality, in the Chernoff bound argument, yields
where the minimum is at when . Apply the same argument to and add the bounds to obtain the Hoeffding inequality:
If , every centered is identically zero and the tail probability is zero; the displayed exponential is interpreted by its zero-variance limit.
For the Bennett inequality, write , and first assume and . For , boundedness and centering give
For , expanding the moment-generating function and using the permitted interchange of sum and expected value,
Negative odd moments cause no difficulty because the estimate is an upper bound term by term. The independence of the and the Chernoff bound then give
The derivative vanishes at , and substitution gives with the Bennett rate function . The same absolute bounds apply to , so
If , all centered are zero almost surely; if , the same is immediate. Handle those cases directly rather than divide by zero. Both derived concentration inequalities also hold with , by the same Markov inequality argument or by letting a smaller positive threshold increase to .
For the binomial distribution, write with independent and identically distributed random variables having the Bernoulli distribution with parameter . Then has range , width one, and variance . For large , , so and . Set .
The Hoeffding inequality gives
After truncation at one, this is asymptotically the trivial probability bound. The Bennett inequality instead gives
Since and by a Taylor expansion,
Thus the Bennett bounds for sparse binomial fluctuations yield
The Bennett inequality supplies the smaller raw exponential bound for every fixed and all sufficiently large . If , clipping probability upper bounds at one makes both eventually trivial; for , the Bennett inequality retains a nontrivial limiting bound. This distinction avoids claiming a probability improvement after clipping when both raw bounds exceed one.
Because the moment-generating function is finite in a neighborhood to the right of zero and , its cumulant-generating function satisfies
Divide the defining Sub-Gamma random variable in the right tail inequality by and let . The right side converges to , proving .
For an integrable real random variable , its cumulant-generating function is the extended-real convex function
where if the exponential moment diverges. Its Legendre transform of a cumulant-generating function is
For independent Poisson arrival counts of mean per slot, with one unit of work per arrival, the cumulant-generating function is . Its effective bandwidth is the displayed expression. If , the equation has a unique positive root: strict convexity, negative initial derivative after subtracting , and divergence to infinity prove existence and uniqueness. Independent Poisson streams combine by replacing with the sum of their intensities.
For a Poisson random variable of mean and , the scaled cumulant-generating function is . Its Taylor expansion tends to for every real . The Gärtner–Ellis theorem applies because the limit is finite and differentiable everywhere. Its Legendre-Fenchel transform is the displayed quadratic good rate function.
For sample means of Poisson random variables of mean , the cumulant-generating function is . Its Legendre-Fenchel transform is the displayed good rate function, with , and is infinite for . Near its zero, . This local quadratic explains the Poisson moderate deviation principle.
For independent and identically distributed exponential random variables of rate , the sample mean has large-deviation speed and the displayed good rate function, infinite for . The cumulant-generating function is for . Its Legendre-Fenchel transform has maximizing parameter . For , sending gives infinite cost. The cost has its unique zero at and diverges at both ends of its positive domain.