A natural exponential family uses its observation vector itself as the canonical sufficient statistic. Its cumulant function is and its natural parameter space consists of parameters for which this integral is finite. On the interior, differentiating gives mean parameter of an exponential family and covariance matrix .
Write and for the individual and total score functions. Under the usual regularity assumptions, and , the nonsingular per-observation Fisher information matrix. The central limit theorem and weak law of large numbers give
Rearranging the stipulated score expansion, including its remainder, gives
Slutsky theorem therefore proves the asymptotic normality of a maximum likelihood estimator:
A consistent plug-in Fisher information matrix yields the Wald statistic . Under the null hypothesis, , so a test of asymptotic size rejects when exceeds the quantile of that chi-squared distribution. A consistent observed Fisher information matrix gives the same limiting test.
With an -dimensional parameter of interest and nuisance parameter , partition accordingly. The marginal asymptotic covariance matrix of is the block of , whose inverse is the efficient information
Thus the nuisance-adjusted Wald statistic is , with limiting null distribution . Using alone is generally incorrect when the nuisance parameter is estimated; it is valid when the cross-information vanishes.
For the Inverse Gaussian distribution in this problem, expand the exponent to obtain the log likelihood, up to terms independent of both parameters,
Its score functions are
For each positive , the first score changes sign from positive to negative at , so this is the global maximizing mean parameter of an exponential family. Substituting it in the second score gives
The reciprocal function is strictly convex, so the denominator is positive for a nonconstant sample. The profile log likelihood is strictly concave in and tends to minus infinity at both endpoints, proving this is a maximum. Under continuous model sampling, a sample of size at least two is nonconstant almost surely. For a constant sample, including a one-observation sample, no finite joint maximum-likelihood estimator exists: the likelihood increases without bound as at .
For one observation, differentiating again and using gives
This parameter orthogonality proves that estimating does not reduce the efficient information for . The Wald statistic has the same algebraic form in the two cases:
Using information evaluated at instead is another first-order equivalent convention.
The printed claim of coincidence needs a first-order interpretation. Known and unknown need not give numerically identical Wald statistics, because their maximum-likelihood estimators differ. With known, direct maximization gives
For example, observations and known give and . At , the displayed Wald convention gives and , respectively. Thus exact equality is false. Under the null hypothesis, however, , hence . Their centered, standardized estimates differ by , so their Wald statistics differ by . This is the valid asymptotic coincidence supplied by inverse Gaussian shape estimation and nuisance orthogonality.
Use an ideal carrier-sense multiple access scheme on the interference graph. An active station finishes its transmission after an independent unit-rate exponential distribution waiting time. An inactive station has an independent attempt clock with an exponential distribution of rate ; an attempt succeeds only when all its neighbors are inactive. Attempts that are blocked do not change the state. Thus, on the independent sets represented by , the continuous-time Markov chain has transition rates
The empty independent set can be reached by successive deactivations, and any other independent set can be reached from it by successive activations. Hence this finite chain is an irreducible Markov chain. The weight satisfies
By detailed balance for a continuous-time Markov chain, its unique stationary law is
This is a finite exponential family. Its natural parameter of an exponential family is and its mean parameter of an exponential family is the vector of active fractions.
The throughput region of an interference graph is exactly . To see the possibly less immediate inclusion, suppose a random feasible schedule has mean . Retain each of its active vertices independently with probability , interpreting zero coordinates as always deleted. A subset of an independent set remains an independent set; the thinned schedule has mean exactly . Thus lies in the convex hull of . The opposite inclusion follows from the definition using equality. Moreover , so this convex hull has full dimension.
Now choose such that remains in the interior of . Use interior moment matching in a finite exponential family. Consider the convex function
There is a ball of radius around contained in . Maximizing a linear functional over the convex hull is the same as maximizing over its generating set, so, for every ,
The last inequality uses the point when . Hence is a coercive function and has a finite minimizer . Differentiating the finite normalizing sum gives
This covariance matrix is a positive-definite matrix: a linear functional constant on all states of positive weight must be constant on , so its coefficients vanish. Thus is a strictly convex function; its minimizer is unique. At that minimizer the desired strict service margins are
For a backlogged station that transmits at unit speed whenever active, the long-run throughput is , by the ergodic theorem for a finite continuous-time Markov chain. Therefore the ideal carrier-sense multiple access scheme can supply a strict service margin for every arrival vector in the interior of the throughput region of an interference graph. The local attempt rates can realize the whole interior capacity region in this sense. Boundary points may require parameters tending to infinity, and the argument gives no uniform delay or mixing-time bound near the boundary.
A one-parameter exponential family with natural statistic has density or probability mass function
where is the natural parameter of an exponential family and is the cumulant function of an exponential family. Its mean parameter is
The exponential-family deviance from to is twice the Kullback-Leibler divergence:
The carrier cancels from the likelihood ratio, so, with ,
For the Poisson distribution with mean ,
Therefore
Writing and applying the Taylor series of gives
so the second-order approximation is