Covariance induced by a shared latent variable Created 2026-10-06 Updated 2026-10-14
Covariance of draws without replacement 2026-10-31
Draw two distinct positions uniformly from a fixed population with . Let and . Each draw has expected value , whileSubtracting the product of the expected values proves the covariance formula and explains the finite population correction. If the sampled values are coin biases and the actual tosses are conditionally independent given those biases, the law of total covariance gives the same covariance for their head indicator random variables.
Covariance of two components of a compound Poisson sum Created 2026-10-14 Updated 2026-11-05
Let be independent of independent and identically distributed random variables with finite second moments. Conditioning on gives covariance and conditional expectations . Law of total covariance and yield the formula. For per-claim excess of loss reinsurance payouts and , it becomes . The insurer and reinsurer aggregates share their claim count and are generally dependent.
The negative covariance of empty and positive detector-interval counts arises because a fixed number of measurement intervals is divided into mutually exclusive categories. Let indicate that interval is respectively physically empty or strictly positive. The same interval cannot satisfy both, so andFor independent repetitions with common probabilities, the counts and therefore haveThe joint probability of empty and strictly positive detector-width intervals gives the underlying multinomial model. The sign describes category-count dependence, not physical antagonism between two detectors.
For an original boundary example, take and . Each count has variance , while their covariance is . The total tail-category count has variance . Treating the two counts as independent would give instead. The covariance is needed even though the individual measurement repetitions are independent.
Conditioning on the total is important. If the number of repetitions is random and independent of the category assignments, the law of total covariance givesAn independent total with a Poisson distribution has equal mean and variance, making this covariance zero; a more variable total can make it positive. This is a different sampling protocol, not a contradiction of the fixed-total formula.
Shared calibration drift is another change of model. Repetitions may then have dependent category indicators, and cross-repetition covariance terms must be added. Overdispersion of detector-interval counts under shared drift can make a simple multinomial analysis inadequate.
NIST's measurement guidance retains common influences in uncertainty propagation and requires assumptions for confidence-level interpretation.[ref]
Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Results by Barry N. Taylor and Chris E. Kuyatt. Appendix A, equation A-3; §§6.2–6.3, Expanded Uncertainty
State whether the repetition total is fixed, how the categories are defined and which calibration influences are shared before interpreting their empirical count covariance. Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 11 2 Solution Created 2026-10-03 Updated 2026-10-14
On an independent Bernoulli product measure, the Harris-Kleitman inequality states that increasing events obeyThe same holds for two decreasing events; an increasing and a decreasing event have the reversed inequality.
Prove the stronger function version by induction on the number of coordinates. For increasing bounded functions , condition on the last coordinate , with . The law of total covariance givesThe first term is nonnegative by induction, and the other factors are nonnegative by monotonicity. The one-coordinate case is the same formula without the first term. Event indicators prove the assertion. Two decreasing functions follow by replacing both by their negatives; replacing only one gives negative correlation of increasing and decreasing events.
Here is a precise Janson inequality and its lower-tail concentration form. Let indicate containment of a specified set of independent Bernoulli coordinates, set , , and letThis Janson dependency sum is ordered and excludes the diagonal. ThenA zero denominator means the trivial case almost surely.
To prove the avoidance bound, expose the avoidance events in order. For a fixed , separate earlier indices into those whose supports are disjoint from and those overlapping it. Write for avoidance of the first group and for avoidance of the second. The event is independent of , while is decreasing and is increasing. The correlation inequality therefore givesThe first inequality divides a nonnegative numerator by ; the second uses a union bound and negative correlation with . Conditioning events of zero probability already make full avoidance impossible. Multiply the resulting conditional avoidance bounds to obtain the Janson sequential product lemma. Taking logarithms and using gives , since each unordered dependency pair is counted once in the sequential sum.
For the Janson lower-tail bound by independent thinning, attach independent selectors of probability to the events. Their total expectation and dependency sum are , so avoidance of the selected events givesSet and apply the exponential Markov bound to . Using yieldsChoosing proves the concentration assertion. For avoidance alone, optimizing also gives when , and the original bound gives when .
To outline the sharp chromatic application, view an independent set of as a clique of its complement, whose edge probability is . Fix , let and . For a particular -vertex set, let count independent -sets. Then , and the overlap calculation givesOverlap of only one vertex shares no edge, hence is independent. For completeness, the summand is at most . Since eventually, large overlaps are bounded by ; finitely many smaller overlaps are dominated by . Also , so the diagonal contribution is negligible. The concentration bound consequently givesA union bound over at most vertex sets still tends to zero. Thus independent sets in every large subset of a dense random graph are available uniformly, including adaptively obtained remainders. Repeatedly remove an independent -set and give it a new colour, then colour the fewer than leftover vertices individually. This uses at most colours. Combining with the first-moment lower bound and letting fixed be arbitrarily small gives the accurate leading asymptoticThe uniform subset estimate, rather than merely the existence of one large independent set, is what makes the sharp upper bound possible.
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 27 3 Solution 2026-10-14
A credibility factor is the weight assigned to a particular risk's observed experience when blending it with a population or manual premium. In the Bühlmann model, the blend is the best affine mean-square predictor, rather than automatically the full posterior mean.
Let , the expected process variance, and assume the displayed second moments are finite. The law of total expectation gives . The law of total variance and law of total covariance giveFor the second formula, the conditional covariance is zero by conditional independence, while the covariance of the conditional means is , the variance of hypothetical means. Likewisebecause .
To derive the Bühlmann credibility premium, minimize . Differentiating in sets the predictor's mean to . The remaining normal equations areFor , subtracting any two rows forces all to be equal, then gives . Thus the premium and factor areThe same affine premium predicts : conditional independence makes , so minimizers agree. If , every year's amount equals almost surely, and gives the exact risk mean even though the coefficient vector need not be unique.
For fixed , . Thus more within-risk variation decreases credibility: individual experience becomes less informative, as , and the premium tends to . Increasing the number of observed years has the opposite effect.
For numerical estimation from a balanced panel, assume the risks are independent draws from the same risk population, with comparable exposures, and . SetConditionally, each within-risk sample variance has mean ; hence . The risk sample means have variance , so . Therefore is an unbiased method of moments estimate of . For a usable nonnegative variance estimate take , noting that this truncation sacrifices exact unbiasedness.
The balanced-panel method-of-moments credibility estimate for risk is consequentlyIf and , use zero credibility. If both estimates are zero, the within and between sums of squares are zero and all the observed amounts coincide; any blend gives that same premium. With only one year per risk or only one risk, these within/between estimators are unavailable, so external structural estimates or additional assumptions are necessary.
Past exam of the mathematics course of the University of Cambridge 2002 iii Paper 36 4 i Solution Created 2026-10-03 Updated 2026-10-14
The first approach specifies marginal means, variances and an exchangeable correlation for each student's repeated counts. It is a moment model suitable for a generalized estimating equation; equality of the mean and variance alone does not specify a full Poisson joint distribution. Different students supply independent sampling clusters, while the three counts within a student are dependent.
The second approach is a Poisson generalized linear mixed model with a positive shared random multiplier . Conditional on it, the three counts are independent Poisson variables; integrating over it gives a fully specified dependent joint law. The gamma random-intercept Poisson model uses Gamma shape and rate , so and . Treat the covariates as fixed, with the same multiplier distribution across covariate/treatment groups, as required by this model.
Let and . The law of total expectation, law of total variance and law of total covariance giveThus each marginal is a negative binomial distribution by the Poisson-gamma mixture, rather than generally a Poisson variable. Put . Its variance is , and the marginal correlation isIt is positive but usually depends on the two marginal means, so it need not be the common exchangeable correlation proposed in the first approach. The first method focuses on population mean effects with a chosen working correlation matrix; the second models latent student heterogeneity and separates conditional Poisson variation from additional marginal variation. Correctly specified likelihood inference for the second uses more distributional assumptions, while the first can retain valid mean inference despite a wrong working covariance by using a cluster-level sandwich variance.
Past exam of the mathematics course of the University of Cambridge 2006 iii Paper 43 4 Solution Created 2026-10-03 Updated 2026-10-14
Let be the total exposure, and define the prior distribution expected value, prior variance and average binomial noise bySince the prior distribution has a probability density function on , and . All relevant moments exist because the parameter and observations are bounded. The binomial distribution givesThe law of total expectation, law of total variance and law of total covariance consequently yieldIn particular, conditional independence of the annual observations does not imply unconditional independence: they share the uncertain parameter.
To derive the optimal credibility estimate among affine functions of the observations, put and write . The conditional errors have zero conditional expectation, conditional variance , and zero pairwise conditional covariances. They are also uncorrelated with every integrable function of . Therefore the joint mean squared error isFor fixed slopes, the first term is uniquely minimized by . For fixed sum , the Cauchy-Schwarz inequality giveswith equality exactly when . Thus the remaining optimization is the strictly convex quadraticIts derivative vanishes at . Consequently the Bühlmann–Straub credibility estimate isThe individual coefficients are and . The strict quadratic minimizations establish global optimality and uniqueness, not just necessary equations. Here is the variance of hypothetical means, is the expected process variance, and is the Bühlmann–Straub credibility factor. More exposure gives more weight to the observed claim fraction. Since , the estimate remains between the observed pooled fraction and the prior expected value. If one separately permits a degenerate prior, leads to the constant estimate , interpreted as .
For the uniform distribution prior on ,With two years, put and . Then andTo compare with the Bayes estimator under squared error loss, use conditional independence to multiply the two binomial likelihood functions. Terms independent of cancel on normalization, and the uniform prior makes the posterior density proportional to . Hence Beta-binomial conjugacy givesFinally, for an arbitrary reported value , conditional quadratic loss decomposes asThe unique minimum is the posterior mean. Therefore the affine credibility estimate and the exact Bayesian estimate coincide in this case. The agreement illustrates exact beta-binomial credibility with unequal exposures; for a general prior distribution, minimizing over affine functions of the observations need not recover the unrestricted posterior mean.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 38 4 Solution 2026-10-14
The PDF gives an inverse-gamma distribution with shape and scale , and a gamma distribution prior with shape and rate . Write . The supplied conditional moments, together with and , give the three structural quantities of the Bühlmann model:Here is the variance of hypothetical means and the expected process variance. The law of total covariance and conditional independence of different years implyAll these quantities are finite because .
For any coefficients , minimizing the mean squared error over the intercept first gives . Let and . Expanding the remaining mean squared error givesIts normal equations are for every . Since , subtracting any two equations shows that all agree. The quadratic part is strictly positive for every nonzero coefficient change, so the solution is the unique global minimizer. Solving givesA credibility estimate combines individual experience with the collective expected value, using an experience weight . In this equal-exposure setting, the Bühlmann credibility premium isThus the computed coefficients give exactly a credibility estimate, with a fixed credibility factor determined by known parameters and the number of observed years. This is Bühlmann credibility for inverse-gamma observations.
For the final Bayesian calculation, the likelihood function in is proportional to . Multiplication by the gamma distribution prior gives the Gamma prior for an inverse-gamma scale updateUnder quadratic loss, the conditional risk of an estimate is . Its minimizer is therefore the posterior mean:This is not a fixed-weight arithmetic-mean credibility estimate. For , the observations and have the same sample mean, but reciprocal sums and , hence different posterior means. For any , append the same positive observations to these two samples. For , the estimate is , with ; its second derivative is , so it is not affine either. Symmetry in the observations would force equal slopes in any affine representation, so these examples also exclude a general fixed-coefficient linear representation.
One can express the posterior mean as a broader data-dependent blend. With and harmonic mean , it isThis weights a harmonic-mean-based experience estimate, and the weight itself depends on the observations. It is not the credibility estimate based on and the fixed Bühlmann credibility factor derived above.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 37 6 a Solution Created 2026-10-03 Updated 2026-10-07
The moment-based approach specifies marginal means, variances, and within-student covariances, without supplying a joint probability distribution for each count profile. It is a quasi-likelihood or generalized estimating equation strategy. The parameter interpreted as a structural-zero fraction is not automatically an actual probability of a structural-zero component merely because it appears in the moment formulas. A valid positive-definite working covariance and parameter identifiability must also be checked.
The printed covariance specification is not admissible for all the stated parameter values. For example, take , , and all three component means equal to 10. It gives diagonal variance 80 and off-diagonal covariance 100, so . A covariance matrix cannot have a negative variance in any direction. Thus the moment approach requires additional admissibility restrictions or a valid working covariance; the parameter ranges alone do not define a valid model. This does not alter the hierarchical model, whose covariance derived below is positive semidefinite.
The alternative gives a full hierarchical mixture distribution, specifically a shared zero-inflated Gamma-Poisson count model: a common student random effect is zero with probability , and otherwise has a Gamma distribution with mean 1 and variance . Conditional on this effect, the three counts are independent Poisson random variables. Integrating it out induces both excess zeros and positive within-student dependence. Zero inflation is shared for the whole student, rather than independently reselected in each term. This full distribution supports likelihood-based inference but is more sensitive to the distributional assumptions.
The marginal mean in the hierarchical model has the same form as the proposed moment mean. Its marginal covariance does not, in general, equal the printed working covariance; the law of total covariance calculation below makes the distinction explicit. At the Gamma component is interpreted as its point-mass-at-one limit. At all counts are zero, and the log-mean parameterization and regression effects are not identifiable.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 37 6 d Solution Created 2026-10-03 Updated 2026-10-07
Keep baseline covariates fixed and put , , and for . Integration of a Poisson count over the Gamma component givesThis negative binomial distribution has mean and variance . Therefore the unconditional one-term distribution is the zero-inflated negative binomial distributionIn particular its zero probability is , not simply . As this becomes a Zero-inflated Poisson distribution.
The mixing effect has , and . The law of total variance and law of total covariance now giveEquivalently, for , and . This also supplies raw second moments by adding . Dependence arises from both shared heterogeneity and shared structural zeros, even when the positive random effect is constant.
The printed moment variance matches the hierarchical variance at the same parameter values, but its printed off-diagonal covariance is . Equality would require , or . It is therefore false to claim that the two approaches consistently estimate all the same parameters in general.
The precise distinction is between consistency of mean ratios and identification of structural parameters. In the hierarchical model, with , both the quadratic variance coefficient and the covariance coefficient in terms of the marginal mean areFor the moment parameterization, writing its parameters as , these coefficients are and . Its intercept is identifiable from the mean only as . Matching the true first two moments demands . One solution always isFor there is also a solution , , , with the corresponding shifted intercept. Indeed eliminating gives . This is moment aliasing in a shared zero-inflated count model: matching the moments does not identify the actual structural-zero probability.
For a concrete counterexample take . Then and . The only admissible moment-matching choice is , with an intercept shifted by ; it cannot recover the true structural-zero proportion 0.2. Correct marginal means can give consistent term and baseline-covariate slopes with sandwich standard errors; they do not justify consistent estimation of the intended , or latent intercept. Nor does a mean-only estimating equation identify at all. Full-distribution inference provides information beyond these first two moments.
Past exam of the mathematics course of the University of Cambridge 2013 iii Paper 28 4 a Solution Created 2026-10-03 Updated 2026-10-07
Write and . The Bühlmann model uses the finite structural parametersHere is the expected process variance and is the variance of hypothetical means. The target is the latent conditional mean , rather than the realized next count. The Bühlmann credibility estimate is the best affine predictor of that target under mean squared error.
The law of total expectation and law of total variance give and . Conditional independence gives for , and the law of total covariance therefore yieldsTo derive the optimal predictor, consider . Minimizing with respect to the intercept gives . Thus . The linear least-squares projection normal equations areFor , subtraction of any two equations forces all equal. Substituting a common coefficient then gives . Equivalently, the mean squared error of the centered predictor is , a convex quadratic with precisely these normal equations. HenceThe ratio notation assumes ; the credibility factor formula also handles . If , the target is the constant almost surely. If , one observation already equals almost surely, and the average gives it exactly. If both vanish, the target and observations are constant.
The result optimizes over affine functions of the observations. It need not equal the unrestricted posterior mean; exact Bayesian inference generally depends on the whole prior and likelihood, whereas the Bühlmann credibility estimate uses these second-moment structural parameters.
Put . Given , its conditional expected value is and its conditional variance is , since is then fixed. The law of total expectation and law of total variance giveThe two scores are dependent: the law of total covariance gives . Adding their two variances without that covariance term would give an incorrect total.
Positive covariance 2026-11-05
Two random variables have positive covariance when their centered product has positive expected value:Assume throughout that their second moments are finite. Outcomes where the centered values have the same sign contribute positively; opposite signs contribute negatively. The sign describes their average balance, rather than requiring every outcome to have matching signs.[ref]
Covariance and Correlation by Jeremy Orloff and Jonathan Bloom. §§2–2.1, definition and properties of covariance
A shared group effect can produce positive covariance even when the relation inside each group runs in the opposite direction. For an exact original example, let and be independent random variables with the Rademacher distribution: each takes the values with equal probability. Define and . Both expected values vanish, and independence givesTheir Pearson correlation coefficient is consequently . The four equiprobable outcomes are , , and .
For either fixed value , however, . Thus the conditional covariance is , and the conditional Pearson correlation coefficient is : the two points inside each group lie on a descending line. The law of total covariance identifies exactly where the positive pooled value comes from:The first term averages the conditional covariances; the second measures how the two conditional expectations move together across groups. Here the between-group contribution outweighs the negative within-group contribution. This is a covariance form of Simpson's paradox.
The dashed linear regression line has slope , but that slope does not give the direction of the relation at fixed . Nor does positive covariance by itself establish a causal effect: in the specified model the common variable supplies the positive component. Choosing which variables to condition on is a question about the model and the intended comparison, beyond computing one number.
Positive covariance is also weaker than requiring one variable to be an increasing function of the other. Under appropriate integrability assumptions, strict positive covariance with an increasing payoff supplies a useful sufficient condition; the grouping example shows a different route to the same sign.
