Write for all coordinates except , let be an independent random variable with the same distribution as , and let . Three equivalent forms of the Efron–Stein inequality are
for arbitrary square-integrable measurable with respect to , and
The first is the sharp choice within the second because conditional expectation is the least-squares projection. The first and third right sides are equal because two conditionally independent copies have expected squared difference twice their conditional variance.
The vector is Jointly Gaussian. Assuming , Gaussian conditional independence gives
Thus the required condition is . Under it, conditioning on supplies no further information after , and the Gaussian process regression posterior is
Both the conditional expectation and conditional variance depend only on ; neither contains or .
Variance tensorization Created 2026-10-03 Updated 2026-10-18
Write for all inputs except . Under the Efron–Stein inequality hypotheses, variance tensorization is the equivalent conditional variance form
Conditioning freezes the other inputs. Then are independent with the same conditional probability distribution, giving
Taking expected values explains the factor .[ref]
For Bernoulli input with parameter , let be the value of with coordinate set to one minus its value with that coordinate set to zero, keeping fixed. The two-point conditional variance is
For the maximum example, and . The two averaged conditional variances are and , precisely half the respective resampling terms. In the dependent example , each other coordinate already determines , so both conditional variances vanish; variance tensorization also fails without independence.
For a short induction proof, separate the last input using the law of total variance. Apply the smaller-dimensional statement to the conditional expectation; Jensen's inequality for the square bounds its coordinate contributions by the original ones. One input gives equality, starting the induction.[ref]
Volatility clustering 2026-10-06
Volatility clustering means that large absolute observations tend to be followed by further large absolute observations, and small ones by small ones. In an ARCH process, persistence is in the conditional variance rather than necessarily in the signed observations.