Let have the uniform distribution on , and set
The variables have the same law. They are not independent random variables, since
Let be independent Rademacher signs, also independent of the i.i.d. sample . With the normalization, the Rademacher complexity is
The Rademacher symmetrization inequality is
The Bounded differences inequality states that if for independent random variables , and replacing only can change by at most , then for every ,
The same estimate holds for the lower tail .
The Kolmogorov zero-one law says that for independent random variables , every event in the tail sigma-algebra
has probability zero or one.
In the canonical model of an independent and identically distributed sequence, the sample space is a sequence space with the product law, is the th coordinate, and the left Bernoulli shift satisfies . If is shift-invariant, then for every ,
so . The zero-one law therefore says that the canonical one-sided i.i.d. shift is ergodic.
A cipher has perfect secrecy when the conditional probability of every plaintext given a ciphertext equals its prior probability: whenever . Equivalently, the plaintext and ciphertext are independent random variables.
Fix a ciphertext that can occur. Perfect secrecy requires every possible plaintext to remain possible after observing . For a deterministic decryption rule, two different plaintexts producing require two different keys, so the key space has cardinality at least that of the message space.
In a one-time pad, the message and key belong to the same finite additive group, the key is uniform and independent of the message, and encryption is . For every there is exactly one key , so
independent of . Bayes theorem then gives , proving perfect secrecy.
Perform every addition in the finite field . From the two transmitted strings and one obtains
Choosing one candidate value of recursively determines , and hence determines the candidate plaintext . There are only two candidates: changing complements every recovered key bit and every plaintext bit. The information that the message makes sense normally selects the intended candidate.
Once this ambiguity is resolved, any other ciphertext positions encrypted with the recovered segment can be decrypted. Key bits outside that segment remain independent and uniformly distributed, so this mistake gives no information about messages using only those bits. This is the two-time pad attack: reusing related one-time-pad key material destroys perfect secrecy.
The estimator is unbiased for because the independent random variables satisfy . Given , all placements of the successes are equally likely, so
Thus the Rao-Blackwellized estimator is
It is unbiased by the tower property. Since and , the event has positive probability, and conditionally on it takes both zero and one with positive probability. Hence , so the new estimator has strictly smaller variance.
Let
be the hat matrix. Then
depends only on the orthogonal projection , while
depends only on the orthogonal residual projection .
The random vectors and are jointly multivariate normal, and their cross-covariance is
Uncorrelated jointly Gaussian vectors are independent. Therefore
For the simple random walk on the integer line, a return to the origin is possible only at an even time. At time , exactly of the increments must be , so the return probability is
The supplied factorial bounds, equivalently the order estimate in the Stirling formula, give
Consequently diverges. By the recurrence criterion by return probabilities, the origin is a recurrent state; translation invariance then makes the whole walk recurrent.
For three independent walks, the probability that all three are at the origin at time is
This P-series is convergent, so the first of the Borel-Cantelli lemmas says that simultaneous returns occur only finitely often with probability one. Therefore the requested probability is
The upper envelope for implies
Writing , taking expectations, and using gives
Independent random variables then yield
Applying the lower envelope to similarly gives
If the variables are independent random variables, apply the defining product rule first to indicator functions, then to simple functions, and finally use bounded measurable approximation to obtain the displayed identity. Conversely, choosing gives
which is independence.
Let . Independence and zero means imply orthogonality in , so
If the variance series converges, is Cauchy in the complete space and hence converges there. Conversely, convergence makes Cauchy, so every tail of the nonnegative variance series tends to zero; therefore .
The self-loop at zero makes the irreducible chain aperiodic. The convergence theorem for irreducible, aperiodic, positive recurrent countable-state chains gives
Because and are independent,
Therefore
Conditioning on and using independent random variables gives
where the notation in the paper uses for the survival function.
Write the Cepheid measurement as , where , and define the calibrated absolute magnitude data
Thus has a multivariate normal distribution with mean and covariance matrix
The Hubble law and the definition of distance modulus give
Consequently, with
the Hubble-flow observations are independent random variables satisfying . Apart from a factor independent of the parameters, the joint likelihood function is
The expression extends by continuity to a singular limiting covariance such as .
Let be independent random variables and let
be their tail sigma-algebra. The Kolmogorov zero-one law states that every has probability zero or one.
Indeed, is independent of for every . The union of these finite-coordinate sigma-algebras generates , and independence extended from generating pi-systems shows that is independent of that entire sigma-algebra. Since itself belongs to it,
so .
A function has the bounded-differences property with constants
when replacing only coordinate changes its value by at most . The Bounded differences inequality states that, for independent inputs,
and the analogous lower-tail bound also holds.
For an open subdomain , identify with the closed subspace of obtained by zero extension. Its orthogonal complement is
If , then testing against and integrating by parts gives in in the distributional derivative sense. The Weyl lemma therefore gives a representative harmonic on .
The orthogonal decomposition by a closed subspace gives
Project the isonormal process defining onto these two orthogonal subspaces. The projections are jointly Gaussian and uncorrelated, hence independent. The first projection is a zero-boundary Gaussian free field on ; the second is a random distribution that is harmonic on . Thus
with independent summands. This proves the Domain Markov property of the Gaussian free field.
Because the variables are independent, the moment-generating function of the sum factors. Whenever ,
Therefore is sub-exponential with parameters
Let be independent random variables, let , and let each depend on every coordinate except . The modified logarithmic Sobolev inequality states that, for every real for which the expectations exist,
To prove it, first apply tensorization of entropy:
Condition on all coordinates except and use the stated variational formula with the admissible constant . The th conditional entropy is at most
Summing and taking the remaining expectations proves the inequality.
Model 1's residuals have a systematic curved pattern and a spread that grows strongly with fitted time. This indicates an incorrect linear mean on the original scale and heteroscedasticity; several observations are also influential or outlying. The constant-variance assumption is therefore implausible.
Logging time greatly stabilizes the spread and removes most of the mean pattern, so model 2 is much more compatible with constant conditional variance and linearity. A few conspicuous residuals remain. A residual-versus-fitted plot alone does not check independence or fully establish normality.