For independent random variables, and . Factor their probabilities to obtain the distribution functions of independent minima and maxima:
These formulas also allow atoms; no probability density function assumption is needed.
For independent unit-rate exponential distributions, for , so . To establish the independent minimum and gap of two exponential variables, set . On either ordering branch, the change of variables is or with unit absolute Jacobian determinant. Both contribute ; ties have probability zero. Thus the joint probability density is
It factors into normalized exponential probability density functions, proving , and their independence.
The maximum is . A half-scaled unit-rate exponential has rate two, so the independent pair has the same joint law as . Consequently
Using the expected values, variances and independence of the summands,
The spacing factorization explains why an order statistic can be represented as a sum of independent waiting times.
Finiteness of the moment-generating function on an open neighborhood of zero gives its differentiability there. Using the permitted interchange of differentiation and expectation,
Hence , and . The second-order Taylor expansion with its Peano remainder gives
Here is the raw second moment, not the variance: . This distinction matters before specializing to a centered variable.
Put . For a real eigenvalue ,
The spectral theorem for real symmetric matrices therefore gives and , since is a sum of with nonnegative coefficients given by squared eigenvector coordinates of . This is the positive imaginary part of a Stieltjes matrix resolvent. Hence
Apply the triangle inequality to the identity above, and add and subtract the minor trace:
The allowed principal minor resolvent trace bound, with the printed normalization, bounds the second average by . Thus the explicit conclusion is
In particular, the final term is with a constant independent of . The upper-half-plane restriction gives the displayed positive denominators; in the lower half-plane the analogous bound uses .
The chosen centering also has a probabilistic meaning. The column vector is independent of the minor, has mean zero and coordinate variance , so its conditional expectation satisfies
This explains why the bound isolates fluctuations of a quadratic form around the minor trace. Mean centering alone is not a concentration estimate; no unrequested limiting assertion is being assumed.
An effective bandwidth converts a traffic distribution and a quality-of-service requirement into a capacity requirement, penalizing bursts as well as mean load. Let be the traffic generated in one observation interval and assume its moment-generating function is finite for some positive parameters. Write . The Chernoff bound follows immediately from Markov's inequality applied to :
Optimizing gives , where the supremum is restricted to finite exponential moments. This exhibits the effective bandwidth as the load appropriate to exponential tail control, not an extra physical stream of traffic.
For the mean and peak limits of effective bandwidth, if exponential moments exist near zero, the cumulant-generating function expansion is
For small , , with the variance giving the first burstiness correction. convexity of and show that its secant slope is nondecreasing; Jensen's inequality also gives .
If is bounded with essential supremum , then . For any , the probability is positive and
Let and then . For large , , so very stringent exponential tail control approaches peak provisioning. If traffic is unbounded and every positive exponential moment is finite, the same lower-bound argument gives . If exponential moments cease to exist beyond a finite parameter, is infinite there; one cannot assign a finite large- peak interpretation to that traffic.
For example, deterministic traffic has . A burst of size with Bernoulli distribution probability gives
which moves from to . For Poisson packet count of mean and packet size , , showing a mean limit but no finite peak limit.
For independent traffic sources, logarithmic generating functions add, so effective bandwidths add. For arrivals in a window of length , use the rate-valued definition . A resource with rate capacity then satisfies
Thus a sufficient admission condition for a target probability is for some . Independence is needed for this additive form; correlated sources require the joint exponential moment.
A queue involves a supremum over time windows, not merely one fixed window. For independent identically distributed discrete-time traffic increments , constant service , and stationary workload
the workload Chernoff bound for independent increments follows from a union bound:, whenever ,
The requirement is precisely . This explains why effective bandwidth is useful for buffer and delay design: the relevant time scale and tail parameter depend on the service rule and target overflow risk. A single-window bound cannot be silently substituted for an infinite-horizon workload bound.
Let be independent and identically distributed random variables with mean and variance , and put , . Define the polygonal interpolation
with the endpoint . The Donsker invariance principle states
where is standard one-dimensional Brownian motion and the arrow denotes weak convergence of probability measures on this path space. Equivalently, the step interpolation converges in the Skorokhod space with its topology. The continuous interpolation version is sufficient for the maximum in part (c).
For the simple symmetric random walk, the increments have mean and variance . Use the polygonal interpolation from (b). The maximum functional is Lipschitz in the supremum norm, since
Each interpolating segment is linear, so its maximum occurs at a grid endpoint. The continuous mapping theorem applied to the Donsker invariance principle gives
The limiting maximum has no atom at by the Brownian reflection principle, so the closed-tail probabilities converge at this threshold. Including does not change the event because . Therefore the random-walk maximum limit from Donsker invariance is
Here is the standard normal distribution function. The normalization and the positive-threshold condition are those in the PDF; the TeX aid's is not the printed expression.
For a pathwise differentiable statistical functional, an influence-function representer is a mean-zero function such that every admissible score function satisfies . The efficient influence function, also called the canonical gradient, is the unique such representer in the statistical tangent space. Equivalently, it is the orthogonal projection of any representer onto that statistical tangent space. The Pythagorean theorem in an inner-product space shows that it has the smallest squared L2 norm among all representers.
Here the statistical tangent space is all of . To verify the closure explicitly, take , truncate it to , and set . Then is bounded and centered, and in , by dominated convergence and the Cauchy-Schwarz inequality. Part (c) supplies a representer already in this space. Hence
Its variance is .
The closure must be taken in the density-weighted space . An unweighted reading of in the printed hint is false. For example, when , the function has and , so bounded centered truncations converge to it in ; nevertheless . This illustrates density of bounded centered scores and fixes the measure in the closure statement.
Use the normal linear model , with fixed full-column-rank design matrix , independent errors , and . Its log-likelihood is
For fixed , differentiating with respect to gives . Since is positive-definite, the unique least-squares estimate is
Let . The variance score equation is , giving
This is the maximum-likelihood estimator, whereas the residual standard error reported by linear-regression software is . The latter uses the unbiased residual estimate of Gaussian noise variance. These formulas assume and positive RSS; exact interpolation gives a variance-boundary degeneracy rather than an interior maximum.
A Poisson model assumes independent counts between rats conditional on time, a common mean at a given time, and conditional variance equal to that mean. Comparable observation units and consistent counting are needed; unexplained rat-to-rat heterogeneity is excluded by this simple specification. The quadratic Poisson regression is
The printed nested analysis of deviance tests against . Its likelihood-ratio statistic is , approximately under the null hypothesis and regular Poisson asymptotics. The reported gives borderline rejection of the log-linear time effect at 5%, conditional on the Poisson assumptions. This is curvature of the log mean, rather than an ordinary quadratic model for the count itself.
There are only three distinct time values, so the intercept, linear term, and quadratic term span every possible set of three log means. This is Poisson mean saturation at three distinct times: the quadratic fit is saturated for the time-group means, which are , , and . A grouped deviance comparison against unrestricted time-group means has zero statistical degrees of freedom: the quadratic functional form cannot be tested at these three times. The individual-observation deviance 24.515 still describes within-group departure from the Poisson distribution, but small means and zeros make the naive goodness-of-fit calibration doubtful. Poisson variation itself can be checked using the replicates, preferably by a parametric bootstrap; it is not rendered untestable by the saturated mean specification.
Overdispersion means conditional variance exceeding the variance assumed by the Poisson mean model. For example, rats may have different latent susceptibility, so if , the law of total variance gives . A quasi-Poisson model instead uses . The Pearson-residual dispersion estimate is , using .
For the conventional quasi-likelihood comparison with estimated dispersion, use
Its upper-tail probability is about 0.096, so the evidence for curvature no longer reaches 5%. The F-distribution is an approximate calibration, not an exact small-sample result for arbitrary overdispersed counts; quasi-likelihood does not supply a full Poisson likelihood. With known dispersion one would instead compare approximately with . The displayed dispersion code uses the undefined name acf.glm2; its fitted values must be those of aom.glm2 for the stated calculation.
The moment-based approach specifies marginal means, variances, and within-student covariances, without supplying a joint probability distribution for each count profile. It is a quasi-likelihood or generalized estimating equation strategy. The parameter interpreted as a structural-zero fraction is not automatically an actual probability of a structural-zero component merely because it appears in the moment formulas. A valid positive-definite working covariance and parameter identifiability must also be checked.
The printed covariance specification is not admissible for all the stated parameter values. For example, take , , and all three component means equal to 10. It gives diagonal variance 80 and off-diagonal covariance 100, so . A covariance matrix cannot have a negative variance in any direction. Thus the moment approach requires additional admissibility restrictions or a valid working covariance; the parameter ranges alone do not define a valid model. This does not alter the hierarchical model, whose covariance derived below is positive semidefinite.
The alternative gives a full hierarchical mixture distribution, specifically a shared zero-inflated Gamma-Poisson count model: a common student random effect is zero with probability , and otherwise has a Gamma distribution with mean 1 and variance . Conditional on this effect, the three counts are independent Poisson random variables. Integrating it out induces both excess zeros and positive within-student dependence. Zero inflation is shared for the whole student, rather than independently reselected in each term. This full distribution supports likelihood-based inference but is more sensitive to the distributional assumptions.
The marginal mean in the hierarchical model has the same form as the proposed moment mean. Its marginal covariance does not, in general, equal the printed working covariance; the law of total covariance calculation below makes the distinction explicit. At the Gamma component is interpreted as its point-mass-at-one limit. At all counts are zero, and the log-mean parameterization and regression effects are not identifiable.