Kalman prediction step 2026-10-14
The Kalman prediction step advances the previous posterior mean and posterior covariance matrix through the state transition:
The minus superscript marks information before observing . The transpose and matrix multiplication propagate the old uncertainty; adds the uncertainty of the new process noise. A known control input changes the mean but contributes no additional variance. If the control input itself is uncertain, that uncertainty needs its own model.
For independent normal observations conditional on , with mean and variances , and normal prior mean and variance , write . Multiplying likelihood and prior adds precisions . Completing the square gives the displayed posterior distribution. Its posterior mean is , where and . Thus the Bayes estimator under squared error loss is exactly the Bühlmann–Straub credibility estimate, not merely an approximation to it. Its posterior variance is .
Normal-normal credibility 2026-10-14
Conditionally independent normal distribution observations of mean and known variance , with normal prior mean and variance , give normal-normal conjugacy with known observation variance. Their posterior mean has the displayed exact credibility estimate form. It minimizes posterior squared-error loss and predicts the conditional mean of the next observation.
For conditionally independent annual averages and prior , the posterior mean is , with . Completing the quadratic likelihood gives posterior precision . This is an exact Bayesian credibility version of the Bühlmann–Straub credibility estimate. Increasing the between-risk prior variance increases the experience weight; increasing process variance decreases it. The next total pure premium is times the estimated per-life mean.
A credibility factor is the weight assigned to a particular risk's observed experience when blending it with a population or manual premium. In the Bühlmann model, the blend is the best affine mean-square predictor, rather than automatically the full posterior mean.
Let , the expected process variance, and assume the displayed second moments are finite. The law of total expectation gives . The law of total variance and law of total covariance give
For the second formula, the conditional covariance is zero by conditional independence, while the covariance of the conditional means is , the variance of hypothetical means. Likewise
because .
To derive the Bühlmann credibility premium, minimize . Differentiating in sets the predictor's mean to . The remaining normal equations are
For , subtracting any two rows forces all to be equal, then gives . Thus the premium and factor are
The same affine premium predicts : conditional independence makes , so minimizers agree. If , every year's amount equals almost surely, and gives the exact risk mean even though the coefficient vector need not be unique.
For fixed , . Thus more within-risk variation decreases credibility: individual experience becomes less informative, as , and the premium tends to . Increasing the number of observed years has the opposite effect.
For numerical estimation from a balanced panel, assume the risks are independent draws from the same risk population, with comparable exposures, and . Set
Conditionally, each within-risk sample variance has mean ; hence . The risk sample means have variance , so . Therefore is an unbiased method of moments estimate of . For a usable nonnegative variance estimate take , noting that this truncation sacrifices exact unbiasedness.
The balanced-panel method-of-moments credibility estimate for risk is consequently
If and , use zero credibility. If both estimates are zero, the within and between sums of squares are zero and all the observed amounts coincide; any blend gives that same premium. With only one year per risk or only one risk, these within/between estimators are unavailable, so external structural estimates or additional assumptions are necessary.
For any prior density , the Bayes estimate under squared-error loss is the posterior mean:
For the matched beta distribution, the integrals are beta integrals and their ratio is
The posterior mean minimizes posterior expected squared error because . The phrase Bayes point estimate depends on the loss: under absolute-error loss it would be a posterior median, while the posterior mode is a different summary and here equals .
The posterior mean is a weighted average of the sample proportion and prior mean:
Thus it is pulled from 10% toward the prior's 5%, giving about 7.17%. This is an affine shrinkage estimator for a binomial proportion. The prior carries substantial concentration relative to the 90 observations, so the posterior is also more precise under this model: its standard deviation is about , compared with the binomial plug-in standard error . The posterior 95% credible interval is narrower and shifted down compared with the simple Wald interval based on alone.
The point estimate shrinks toward the historical mean, and the interval is narrower under the informative prior. A credible interval and a frequentist confidence interval have different probability interpretations; the comparison does not make the prior's relevance automatic.
A beta distribution is a convenient prior for a probability and is conjugate to the binomial distribution of the death count. Match its mean and variance . For ,
The moment matching for a beta prior formula gives
Conditional on , use and the observed count . Multiplying its likelihood by the prior density gives the Bayesian posterior through Beta-binomial conjugacy:
Under squared-error loss, take its posterior mean as the point estimate. A 95% equal-tail credible interval is given by its 0.025 and 0.975 quantiles. Numerically,
Matching two moments does not uniquely determine a prior distribution; the beta family is a justified convenient choice, not a conclusion forced by those moments. Its transfer to this hospital presumes that the historical between-hospital distribution is relevant to the present risk and case mix.
Assume the known variances are positive and write . The likelihood times the normal prior distribution is proportional to
Collecting the quadratic and linear terms in completes the square with precision and mean . Thus normal-normal conjugacy gives
For quadratic loss, the posterior risk of reporting is , uniquely minimized at . For absolute-error loss, differentiating the posterior risk gives , so its minimizer is a posterior median. The normal posterior is symmetric about and has a strictly increasing distribution function, hence that median is uniquely . Therefore both optimal point estimates equal , the posterior mean.
A credibility premium estimates a risk's expected future claims by combining its own observed experience with a collective or prior mean. In its basic form , the credibility factor is the weight assigned to individual experience. Larger credibility places less weight on pooling with the population. The amounts below are pure expected-claim premiums; no additional expense or profit loading is specified.
Under squared-error loss, the posterior risk for estimating the unknown conditional mean by is
Hence the Bayes estimator under squared error loss is the posterior mean. In the equal-year model, conditional independence makes the likelihood proportional to . Combining it with the normal prior and completing the square gives
Because , the required estimator is ; it also equals the predictive mean . The normal-normal credibility expression is
This is exact Bayesian credibility, not merely the best linear approximation to a possibly nonlinear posterior mean.
For unequal life counts use the usual exposure model: individual-life losses are conditionally independent with variance , and the annual totals are conditionally independent given the same . Then
The dot denotes the stipulated normal approximation. The positive exposures are known. Define total past exposure and its experience mean by
The normal log-likelihood has quadratic term . With the prior , normal-normal conjugacy with unequal exposures gives posterior variance and mean
Therefore the estimated pure premium per life for year has the normal-normal credibility with unequal exposures form
It is also an exact normal-model Bühlmann–Straub credibility estimate. The individual experience is exposure-weighted: the unweighted mean of the yearly per-life observations would generally discard the different precisions.
For positive , differentiation gives
Thus increasing the prior variance increases credibility, because greater between-risk heterogeneity makes the collective mean less representative of this risk. Increasing the individual process variance decreases credibility, because a fixed amount of observed experience becomes noisier. The future exposure supplies no new observation, so it does not enter . It only scales the total premium:
The independent-life variance scaling is part of the usual exposure interpretation. Without it, a known variance for one life does not determine the variance of a total: a common pairwise conditional covariance would add to . Similarly, cross-year conditional dependence would change the joint likelihood. Those assumptions are implicit in applying the standard credibility model to the final paragraph.
Given , the sum of the independent yearly counts is : their probability generating functions multiply to . Averaging this conditional law over the prior gives the mixed Poisson distribution
The likelihood for the full vector depends on only through , so is a sufficient statistic; conditioning on the total or on the full observed vector gives the same posterior for .
For an event of positive probability , the posterior density is proportional to . Put . Its mean is . The future count has conditional mean , so
This is the posterior mean from adjacent mixed Poisson probabilities. Both probabilities refer to the same -year exposure; the numerator is not a probability for . For a proper prior and , the integrals defining this posterior mean are finite because is bounded on .
For the independent normal distribution observations, the log likelihood is
Its derivative is and its second derivative is , so the unique maximum-likelihood estimate is
For the prior with , multiplying prior density by likelihood and completing the square gives
Thus normal-normal conjugacy gives the posterior distribution
For quadratic loss, the conditional expected loss of action is the posterior variance plus . Its unique minimizer is the posterior mean, so the Bayes estimator is
This weights the sample and prior means by their respective precisions.
Let be the total exposure, and define the prior distribution expected value, prior variance and average binomial noise by
Since the prior distribution has a probability density function on , and . All relevant moments exist because the parameter and observations are bounded. The binomial distribution gives
The law of total expectation, law of total variance and law of total covariance consequently yield
In particular, conditional independence of the annual observations does not imply unconditional independence: they share the uncertain parameter.
To derive the optimal credibility estimate among affine functions of the observations, put and write . The conditional errors have zero conditional expectation, conditional variance , and zero pairwise conditional covariances. They are also uncorrelated with every integrable function of . Therefore the joint mean squared error is
For fixed slopes, the first term is uniquely minimized by . For fixed sum , the Cauchy-Schwarz inequality gives
with equality exactly when . Thus the remaining optimization is the strictly convex quadratic
Its derivative vanishes at . Consequently the Bühlmann–Straub credibility estimate is
The individual coefficients are and . The strict quadratic minimizations establish global optimality and uniqueness, not just necessary equations. Here is the variance of hypothetical means, is the expected process variance, and is the Bühlmann–Straub credibility factor. More exposure gives more weight to the observed claim fraction. Since , the estimate remains between the observed pooled fraction and the prior expected value. If one separately permits a degenerate prior, leads to the constant estimate , interpreted as .
For the uniform distribution prior on ,
With two years, put and . Then and
To compare with the Bayes estimator under squared error loss, use conditional independence to multiply the two binomial likelihood functions. Terms independent of cancel on normalization, and the uniform prior makes the posterior density proportional to . Hence Beta-binomial conjugacy gives
Finally, for an arbitrary reported value , conditional quadratic loss decomposes as
The unique minimum is the posterior mean. Therefore the affine credibility estimate and the exact Bayesian estimate coincide in this case. The agreement illustrates exact beta-binomial credibility with unequal exposures; for a general prior distribution, minimizing over affine functions of the observations need not recover the unrestricted posterior mean.
For a prior and loss , the Bayes risk of a rule is . A Bayes decision rule minimizes this integrated risk. An Extended Bayes rule is a rule whose excess over the optimal Bayes risk can be made arbitrarily small by a suitable proper prior: for every some has , with finite risks.
Condition on the observation and use iterated expectation. A rule is Bayes precisely when it chooses a minimizer of the posterior expected loss almost surely, up to the usual measurability requirement. Under squared Euclidean loss, with a finite posterior second moment, write . The identity
shows that the Bayes rule is the posterior mean.
By normal-normal conjugacy, the posterior distribution is
The posterior mean is a precision-weighted average of the population mean and the observed personal measurement.
A constant improper prior would give the formal posterior density kernel . However,
There is no normalized posterior distribution under this prior. The failure is not simply that the prior is improper: some improper priors give proper posteriors. Here posterior propriety itself fails after this single observation, so probabilities, quantiles and a posterior mean cannot be assigned to that kernel.
Write , with . The truncated uniform prior gives the posterior distribution
Its posterior mean is
Each term in the numerator of the expectation is , which explains the exact count .
Keep fixed. Integral bounds for the decreasing function give , so . Consequently
The posterior mean thus grows like instead of approaching a data-determined limit. Even the posterior distribution mass below a fixed endpoint is . Hence increasing the supposedly innocuous prior cutoff moves the inference to larger and larger endpoints. In an integral approximation its median is of order , also depending strongly on the cutoff. This explains the sensitivity of the entire inference, not just of its posterior mean.