Under fit.2, observations in each period are independent Poisson random variables with a common mean, so each sample variance should fluctuate around its sample mean. The plot instead has variances roughly 130–300 for means roughly 80–120, well above the line variance equals mean. This is overdispersion.
Day-to-day traffic variation can produce a Poisson mixture: a random daily intensity increases the marginal variance and can correlate observations from the same day. A useful replacement is a negative binomial regression, with variance , or a Poisson generalized linear mixed model with a day random intercept. A day-factor effect can also be included if inference is restricted to the observed days. A Quasi-Poisson regression estimates a dispersion multiplier for uncertainty, but does not itself explain the shared-day dependence and has no ordinary likelihood-based AIC. The means can retain the period-factor or selected jump structure.
Statement and definitions. For disjoint nonempty sets of vertices, their edge density of a bipartite graph is . They form a regular pair of vertex sets, or an -uniform pair, if
whenever , , and .
The Szemerédi regularity lemma states that for every and positive integer , there are integers such that every graph of order has a set partition
with , , equal nonzero sizes , and at most unordered pairs , , that fail to be -uniform. It is enough to prove this for , since decreasing the parameter strengthens the conclusion.
Energy increment. For the proof, regard each exceptional vertex as a singleton part and use the equitable regularity energy
The sum is over ordered pairs, including diagonal pairs; for those pairs define as the mean adjacency indicator on . Thus . Under a refinement, the subrectangle densities have the original density as their weighted mean. The Cauchy-Schwarz inequality, equivalently the nonnegativity of their weighted variance, gives .
Suppose there are more than irregular pairs, with main cell size . For each such pair choose witnesses , of sizes at least and with . Refine every main cell by all its witness subsets. Each splits into at most atoms, and we may use the larger bound .
For an ordered irregular rectangle, write its refined densities as and relative areas as . The energy gain on that rectangle is
The witness rectangle has relative area at least . Applying the Cauchy-Schwarz inequality to the subrectangles it contains shows that this expression is greater than . There are two orientations of each irregular pair. Since , the total gain is greater than
Restoring equal sizes without losing energy. Put , assuming . Split every refined atom into sets of size , putting its leftover fewer than vertices into the exceptional set as singleton parts. This is a further refinement, so the energy cannot decrease. The number of new exceptional vertices is at most
The number of new main cells satisfies
For the first inequality, in each old cell the leftovers have total size less than , so at least one full chunk survives. All previous exceptional singleton parts are kept. Treating leftovers as singleton parts is what makes the energy increment survive equitabilization exactly.
Take and choose so large that . Start with equal main cells, with fewer than exceptional vertices. Define a finite bound by iterating a total of times, starting from . Choose sufficiently large that and whenever .
At each of the first refinements, the exceptional set has size at most
the cell count is between and , and , so all the chunk sizes above are valid. But unsuccessful refinements would raise by more than , which is impossible. Thus the procedure terminates at a partition satisfying the Szemerédi regularity lemma.
Three linearly large uniform sets. Apply the Szemerédi regularity lemma with
For , delete all edges touching , all internal main-cell edges, all edges of irregular pairs, and all edges of regular pairs whose edge density of a bipartite graph is less than . The respective losses are bounded by
Thus the total loss is at most , and the remaining graph has at least
edges. Form the reduced graph of a regularity partition , joining two main cells precisely when they are -uniform and have edge density of a bipartite graph at least . If their common size is , the remaining edge count is at most . Since , we obtain . The Mantel theorem gives a triangle in a graph in . Its three cells have the required pairwise density and are -uniform: an -uniform pair is uniform for any larger parameter.
Each selected cell has size . Choose
For , the Mantel theorem gives a triangle in a graph in the original graph, since its edge count exceeds ; take its three singleton vertices. Their pairs have density one and are uniform for every positive parameter, and . Therefore in all cases
The constant is absolute; the energy proof gives a very large bound for , which does not affect its positivity.
A standard one-dimensional Brownian motion is a real-valued stochastic process satisfying almost surely, having continuous paths almost surely, and having independent increments with
Here is the normal distribution with zero expected value and variance . Thus the increments are also stationary increments.
If Brownian motion is defined relative to a specified filtration , additionally require that it is an adapted process and that is independent of . For its natural filtration, this follows from independent increments. These are the defining properties of standard Brownian motion.
Put . By independence of the two Brownian motions, is a standard Brownian motion: its independent increments have the normal distribution with variance equal to elapsed time. The stopping time is the first time hits or .
To justify finiteness without presupposing the desired hitting probability, each unit-time increment of has the normal distribution . An increment of absolute value greater than forces exit from if the path was inside at its start. These independent increments give , where . Hence almost surely.
The stopped martingale lies in . The optional stopping theorem at gives , and the bounded convergence theorem gives . Writing , path continuity gives . Therefore, as in Brownian exit from an interval,
Multiplication by the integrating factor and the Itô product rule give the Ornstein-Uhlenbeck process
The two summands are independent centered normal random variables, because is independent of the Brownian motion and the integrand is deterministic. By the Itô isometry, their variances sum to . Thus
For , split the Itô integral at to obtain , where the latter term is centered and independent of . Consequently
In particular this initialization makes the Gaussian process a stationary process.
The expression is a Test-function pairing with a Gaussian free field, rather than the pointwise integral of an ordinary random function. For a real test function , take the Dirichlet solution
using the Green-kernel identity allowed in the original PDF. In particular, . Integration by parts gives, initially for smooth compactly supported and then by continuity in the Dirichlet energy space,
The integral functional is continuous in the energy norm: pull back to the unit disc, where the transformed test function has compact support, and use the Poincare inequality. Hence is its energy-space representer. Define
By the isonormal Gaussian process definition, it has mean zero and variance
The logarithmic singularity is locally integrable, so this variance is finite for smooth compactly supported test functions. Thus
The local TeX corrupted the double integral and the bracketed Green-kernel identity; the PDF supplies the identity above and does not assert an infinite variance.
Put and assume . For fixed and a fixed nonzero difference , the approximate statistical power of the Wald test increases as its noncentrality increases, where
Differentiating with respect to the continuous allocation gives
Hence the unique minimum and its associated minimum variance are
This is Neyman allocation. Integer allocations use a feasible adjacent integer to the continuous optimum, comparing the resulting variances; must still hold. It is a large-sample normal approximation argument, not an exact finite-sample power theorem for arbitrary response-adaptive randomization. Under the null , the approximate power is the significance level for any allocation, although the same allocation still minimizes the stated variance.
The difference of the Bernoulli distribution variances factors as
The first factor is positive, whereas makes the second negative. Thus and . Therefore Neyman allocation assigns more patients to treatment 1, the inferior treatment. Minimizing the variance of a treatment comparison and maximizing the number of desirable responses are different objectives.
For the electronic-record observational study, three strengths are:
Three weaknesses are:
For two-sample Mendelian randomization, three strengths are:
Three weaknesses are:
Thus the agreement supports the hypothesis, but does not establish the effect of a dietary intervention.
Put and , where is a nonnegative integer and is the smoothing bandwidth. The local polynomial estimator is the intercept of the weighted least squares fit
When the local polynomial Gram matrix is invertible, the normal equations give
A singular local polynomial Gram matrix requires a selection convention and may leave the intercept unidentified; an arbitrary nonnegative regression kernel alone does not guarantee uniqueness. At , provided , the Nadaraya–Watson estimator is
Multiplying every weight by changes neither fit.
For the uniform kernel, let and . Then . For and , the interval is inside , and the regular design has
The same lower bound holds when the interval starts at zero, despite the absence of the design point zero. In particular the Nadaraya–Watson estimator is defined throughout the integration interval.
For every Lipschitz continuous mean function in , the bias of an estimator and variance satisfy
Here the variance uses the independence of the errors in the fixed-design nonparametric regression model. The bias-variance decomposition of mean squared error and Tonelli theorem give a slightly stronger integrated mean squared error bound than required:
Thus
The printed integration interval represents a nonnegative risk function for . For , the written integral has reversed limits and is nonpositive, making the displayed upper bound trivial; it should not be interpreted as an integrated mean squared error in that range. For , evaluation outside would additionally require a specified extension of the mean function. The subsequent optimization restricts to .
Minimizing the stated right side gives
For sufficiently large , and . For example take . Therefore the upper bound holds with
For the lower bound, the PDF has the mean squared error ; the TeX erroneously moves the square outside the expected value. The PDF's suggested smooth bump function is , with value zero at the endpoints, rather than the corrupted TeX formula. A triangular alternative suffices because only Lipschitz continuity is needed.
The Le Cam two-point lemma says that for two data laws with parameter separation , every estimator satisfies
Indeed, classify according to the nearer parameter value. Misclassification incurs squared-error loss at least , and the sum of the two error probabilities is at least one minus the total variation distance. Averaging the two risk functions proves the stated form.
Let , , and use the two-point lower bound with a triangular bump
Both functions are in , and . Assume first that and . At most design points meet the bump's support. The Kullback-Leibler divergence between normal distributions and chain rule for relative entropy give
The Pinsker's inequality therefore gives . The Le Cam two-point lemma yields the pointwise minimax rate for Lipschitz regression
This universal constant is valid for .
If the printed lower bound is read as applying to all positive integers , it also holds with a smaller constant depending on the fixed . For , use the constant mean functions and . They have Kullback-Leibler divergence , so Pinsker's inequality and the Le Cam two-point lemma give minimax risk at least . Combining the two ranges gives the explicit all- choice
The universal asymptotic constant and this parameter-dependent all- constant are distinct conventions; the latter supplies the assertion without inserting an unstated large- restriction.
Let and . To prove the Hoeffding lemma, take a centered random variable and its cumulant-generating function . Under exponential tilting, is the variance of . The Popoviciu inequality on variances gives
since under any such tilt the support remains , and . Because , integrating twice gives for ; applying the same argument to handles the opposite tail.
The independence of the gives . The Markov inequality, in the Chernoff bound argument, yields
where the minimum is at when . Apply the same argument to and add the bounds to obtain the Hoeffding inequality:
If , every centered is identically zero and the tail probability is zero; the displayed exponential is interpreted by its zero-variance limit.
For the Bennett inequality, write , and first assume and . For , boundedness and centering give
For , expanding the moment-generating function and using the permitted interchange of sum and expected value,
Negative odd moments cause no difficulty because the estimate is an upper bound term by term. The independence of the and the Chernoff bound then give
The derivative vanishes at , and substitution gives with the Bennett rate function . The same absolute bounds apply to , so
If , all centered are zero almost surely; if , the same is immediate. Handle those cases directly rather than divide by zero. Both derived concentration inequalities also hold with , by the same Markov inequality argument or by letting a smaller positive threshold increase to .
For the binomial distribution, write with independent and identically distributed random variables having the Bernoulli distribution with parameter . Then has range , width one, and variance . For large , , so and . Set .
The Hoeffding inequality gives
After truncation at one, this is asymptotically the trivial probability bound. The Bennett inequality instead gives
Since and by a Taylor expansion,
Thus the Bennett bounds for sparse binomial fluctuations yield
The Bennett inequality supplies the smaller raw exponential bound for every fixed and all sufficiently large . If , clipping probability upper bounds at one makes both eventually trivial; for , the Bennett inequality retains a nontrivial limiting bound. This distinction avoids claiming a probability improvement after clipping when both raw bounds exceed one.
Taking expectations in the single-step discrete Tanaka formula, the martingale transform term vanishes because is bounded and -measurable. Hence
At a state with , the tower property of conditional expectation gives , so the conditional second moment of the increment is . Part (a) gives . Combining these identities yields the discrete Dupire equation
The conditional variance needs a positive-probability conditioning state. The bound does not guarantee . If , both the call-price curvature and the time increment above are zero; the equation can be extended by assigning an arbitrary finite value to at such a state, but its conditional variance is not determined there.
Let and . Given , the next value is one of . The martingale property makes its upward and downward conditional probabilities equal; their sum is the conditional variance of the increment, . Thus
The discrete Dupire equation therefore recovers all positive-probability one-step conditional transitions from the European call option price surface. No Markov property is required: these are conditional probabilities given the current value, not necessarily given the whole past.
Recovery is impossible at a zero-probability state. For example, satisfies every stated assumption, but at a different integer can satisfy while . Its conditional transitions can be specified arbitrarily without altering . Thus the literal all-states claim needs the positive-probability qualification.