Let
where is the golden ratio. If the union-closed family consists of one nonempty set, any element of that set has frequency one, so assume its cardinality exceeds one. Choose independent uniform members and let be their characteristic vectors of sets. Then .
Suppose for a contradiction that every element has frequency . Put , and let , the characteristic vector of a set of . The chain rule for information entropy and conditioning reduces entropy give
because is a function of .
Fix the two prefixes and set
The two conditioned bits are independent random variables, and exactly when both are zero. The supplied binary entropy product inequality therefore gives
Averaging over the independent prefixes yields
whenever either conditional entropy is positive. Summing and using gives .
But set union keeps inside the union-closed family, so is supported on . The maximum entropy distribution on a finite set gives , a contradiction. Some element must therefore occur in at least members, proving the entropy bound for a union-closed family.
Write , , , and . Distances depend only on distributions, so all variables used in any one application may be realized as independent random variables.
First, the entropy submodularity for three independent sums implies
and analogously for . The Entropic Ruzsa triangle inequality gives and . Consequently the relevance of independent self-sums gives
Apply the Conditioned entropic Ruzsa distance of a summand first to and then to :
Three applications of the Entropic Ruzsa triangle inequality give
Adding all these bounds yields
Thus the required absolute constants may be taken as and .
The relevant invariance principle for a low-degree multilinear polynomial is the following. Let and be sequences of independent random variables satisfying
If is multilinear of degree at most and , then
For the proof, use the Lindeberg replacement method. Replace by one coordinate at a time and write , where and depend only on the other coordinates. A third-order Taylor expansion of has identical expected terms through order three for and , because the first three moments match. Each fourth-order remainder is bounded by , so the th replacement costs at most
Part (i), applied in the hybrid product space, bounds each of the two fourth-moment terms by . Thus the cost is at most . The triangle inequality and summation over prove the result.
For every , the exponential Markov bound and independence give
Taking the infimum over yields
For , convexity makes this supremum equal to , proving the upper bound in the stated tail form of Cramér theorem.
A Lévy process starts at zero, has independent and stationary increments, is stochastically continuous, and is taken with càdlàg sample paths. Thus for , the increments are independent, and the law of depends only on .
Write and . The variables and need not be independent random variables. Part (d) and the Cauchy-Schwarz inequality imply, for every integer ,
Also by Cauchy-Schwarz, because and . Thus , and, for ,
Part (c) shows that is sub-Gamma in the right tail with variance parameter and scale parameter .
If , then . Consequently
while . Another application of part (c) gives the improved variance parameter and scale parameter .
A linear estimator in nonparametric regression at has the form , where the weights may depend on the design, , , , and , but not on the responses. Put
and define the local polynomial Gram matrix
When , the weighted least squares normal equations have the unique solution
Therefore , where the effective kernel weight is
The identity
shows that these weights exactly reproduce at every multivariate polynomial of total degree at most . This is the required polynomial reproduction property of local polynomial regression.
Only grid points with have nonzero weight. There are at most such points because . On this support,
so the operator norm bound gives
Because the errors are independent random variables with the stated variance bounds,
Thus .
Let be the Multivariate Taylor polynomial of at through total degree . The assumed Hölder continuity of the derivatives and
give the Taylor remainder bound
Polynomial reproduction cancels in the bias. The same support count and weight bound give
Consequently
so .
The products and share , so they are not independent. Using the definition of covariance and the independence of ,
By contrast, and depend on disjoint sets of independent random variables, so they are independent and have zero covariance. Hence
Write , so . Each product has mean one, and its variance is
Adjacent products share one factor, giving covariance one by part (a)(iii). Products whose indices differ by at least two involve disjoint independent random variables, so their covariance is zero. There are adjacent pairs. By the variance of a sum,
For an outcome , the two random variables are the coordinate maps
Their marginal probability mass functions are on , and their joint probability mass function satisfies
Off that support, the same factorization holds with zeros. Hence and are independent random variables, by the joint probability mass function criterion for independence.
On the product support , the joint probability density function factors as
The equality also holds outside the support with both sides zero. The probability density function factorization criterion proves that and are independent random variables.
Use the intended model of independent Bernoulli trials, with the same scoring probability for every shot. Equal marginal scoring probabilities alone would not establish the stated formula without independence. Let count misses in the two groups of five. They are independent random variables with binomial distribution . A tie occurs precisely when for one of the mutually exclusive possibilities . Therefore the tie probability for independent binomial counts is
At , Vandermonde's identity gives , so
Exchanging the two teams preserves the distribution and interchanges the two winning events. Their total probability is , so the first team wins at the end of the initial period with probability . In this model the shooting order gives no advantage.
The exponential series proves normalization of a probability distribution:
Let and count the two labels. Conditional on , independent labeling gives a binomial distribution, so the joint probability mass function is
Each bracket is a normalized Poisson distribution. Summing over therefore gives
The factorization also proves that and are independent random variables. This is Poisson thinning; the phrase about ignoring the other count refers to taking a marginal distribution, rather than fixing that count.
The intended season calculation needs the additional assumption that scores in different games are independent random variables. The printed statement gives their common one-game distribution but does not explicitly state independence; identical marginals alone do not determine season probabilities.
Under independence, each game has probability of at least one goal, so
Without independence this product is not determined by the supplied marginal distribution.
Assume the three standard dice are fair and independent. For one die , a discrete uniform distribution on gives
The variance is . For the sum , linearity of expectation and addition of variances for independent random variables give
Let be the finish-time offset from the start of its displayed minute. The elapsed time is , so . To obtain the stated density, use the intended model that and are independent random variables, both with the uniform distribution on .
Their joint probability density function is one on the unit square. Equivalently, the convolution of probability densities gives
The integrand is one exactly where and . The overlap has length for , length for , and zero otherwise. Therefore
This is a symmetric triangular distribution. The independence and finish-time uniformity are additional modelling assumptions: the two truncated clock readings alone do not imply them. For example, if then the elapsed time is exactly twenty-five minutes and , even though each endpoint offset is individually uniform.
The apparent conflict largely disappears when metacognitive calibration is distinguished from metacognitive resolution. Calibration asks whether, for example, answers assigned confidence are correct about of the time. Resolution asks whether a person's more confident answers tend to be more accurate than that same person's less confident answers. A consistently overconfident person can still discriminate relatively well between stronger and weaker answers.
Justin Kruger and David Dunning found that low-scoring groups in humour, grammar and logic tasks overestimated their relative performance, and argued that limited task knowledge can also impair error recognition.[ref] Such global, often comparative judgments are not the same measurement as trialwise confidence in a repeated perceptual task. A participant may recognize which of their own answers are weak while lacking an accurate model of the comparison group's performance. Conversely, a person who knows their overall success rate can still fail to identify their particular mistakes.
A simple illustration is a task with four equally common classes of answers, whose success probabilities are . Reporting these probabilities is calibrated. Reporting instead creates an average overestimate of , but preserves every ordering and tie between confidence values. Consequently the type 2 receiver operating characteristic and its area under the receiver operating characteristic curve remain unchanged. This is the general result that a strictly increasing confidence transformation preserves metacognitive resolution.
There is also a statistical selection issue. Let standardized observed performance be and self-estimated performance be , where latent ability and the two errors are centred normal random variables and are independent random variables. Then selection on noisy performance can produce apparent overconfidence:
For a low observed score and , the expected self-estimate exceeds despite being unbiased before selection. The highest observed scores show the reverse pattern. This toy model demonstrates why a quartile plot alone cannot identify a monitoring deficit. It does not prove that all observed miscalibration is a statistical artifact or that the original skill-training results are uninformative.
Perceptual findings also require qualification. Good resolution can reflect variation in stimulus difficulty; it need not establish optimal monitoring at fixed difficulty. Metacognitive sensitivity depends partly on first-order discrimination, and raw confidence–accuracy correlations can differ because task accuracy or confidence criteria differ. Meta-d-prime estimates the signal-detection sensitivity compatible with observed confidence ratings under its model assumptions. The original method found visual metacognitive sensitivity close to, but below, its optimal benchmark.[ref]
A decisive comparison would measure global and trialwise estimates in the same people, match task performance where possible, estimate test reliability, distinguish raw scores from percentile beliefs, and examine the uncertainty of sensitivity estimates. Transfer of feedback or training should be tested rather than presumed. Overconfidence, useful trialwise discrimination and genuine limits in domain knowledge can coexist; their relative contributions require separable measurements.
Assume , and work on the support . In rejection sampling, choose a normalized proposal probability mass function and a known finite constant satisfying everywhere. Draw independent random variables and , accepting when . The joint probability of proposing and accepting is , so the overall acceptance probability is and the accepted value has probability mass function . Fresh trials therefore produce independent and identically distributed random variables with the desired probability distribution. For a fixed positive number of accepted values, the sample average is an unbiased estimator of the expectation when that expectation is finite. Its variance is if the second moment is finite. Finding a valid envelope can be difficult, and a small acceptance probability makes the method expensive.
For the Metropolis–Hastings algorithm, choose a proposal transition matrix and, at the current state , propose . Accept with the Metropolis–Hastings acceptance probability
A proposal outside is rejected; an impossible proposal need not be assigned a ratio. Otherwise remain at . This constructs a Markov chain satisfying detailed balance with , without computing or a global envelope. Estimate the expectation by averaging over iterations, including repeated states after rejections. Keeping only accepted jumps generally changes the stationary distribution of the recorded process.
The Metropolis–Hastings algorithm produces dependent samples, so the variance of its average includes autocovariances; starting outside stationarity can also cause finite-run bias. With Markov chain irreducibility, suitable recurrence and an integrable , the countable-state Markov chain ergodic theorem gives consistency. Aperiodicity is additionally needed for the usual convergence of one-time probability distributions. In contrast, accepted rejection sampling values need no initial transient. Neither method is universally faster: envelope rejection competes with the proposal quality and mixing time of the Markov chain. Nonnegativity of alone does not guarantee a finite expectation or variance.
For , the event says that each of the independent random variables is at most . Hence, for all sufficiently large ,
Since and as , taking logarithms gives the limit . For the probability is zero. Therefore
This is the Fréchet limit for a reciprocal integer tail, with a Fréchet distribution of shape one. Its cumulative distribution function is continuous even at zero, so the pointwise calculation establishes convergence in distribution.
The Poisson interarrival times of a homogeneous Poisson process are independent and identically distributed with the exponential distribution of rate . Consequently are independent random variables and their joint probability density is
Here is the second interarrival duration, rather than the time of the second arrival.