Bayesian credibility 2026-10-14
Bayesian credibility estimates a risk's conditional mean by its Bayesian posterior expected value under squared-error loss. When that posterior mean is an affine combination of exposure-weighted individual experience and a prior mean, the coefficient of the experience is its credibility factor. Exact Bayesian credibility is distinct from merely selecting the best affine estimator when the true posterior mean is nonlinear.
Bayesian deviance 2026-10-06
A Bayesian deviance is minus twice the log-likelihood, with any chosen additive data-only constant held consistent across the models being compared. Its Bayesian posterior expectation measures average fit. In the deviance information criterion, evaluating it at a parameter's posterior mean also enters the effective complexity penalty. This likelihood-based convention differs by a data-only constant from a saturated-model exponential-family deviance when a common saturated model exists.
Bayesian model evidence Created 2026-09-24 Updated 2026-10-18
The Bayesian model evidence is the prior predictive distribution evaluated at the data . For a statistical model with a normalized prior density , its marginal likelihood isThis is an expected value of the likelihood function under the prior distribution; for discrete statistical parameters, replace the integral by a sum. For continuous observations, is a probability density function value with respect to a specified data reference measure, rather than a probability of one exact observation. Comparisons must use the same data and reference measure. The same normalizes the within-model Bayesian posterior and supplies the between-model comparison in a Bayes factor.[ref]
Bayes Factors by Robert E. Kass and Adrian E. Raftery. Kass and Raftery, Bayes Factors (1995), section 3.1, p. 776, equations (1)–(2): integrating over parameter priors
A normalized prior distribution makes the Bayesian model evidence an average, so it cannot exceed the largest likelihood function value on its support. A broad prior distribution can assign little mass to values that predict the data well, even when one value gives an excellent fit. The worked uniform-alternative binomial Bayes factor below makes the difference between averaging and maximum likelihood estimation explicit.
Bayesian posterior Created 2026-09-24 Updated 2026-10-14
The Bayesian posterior is the conditional probability distribution of an unknown statistical parameter after observing data. Suppose a continuous prior distribution has prior density relative to Lebesgue measure , and is the sampling probability mass function or probability density function of the observed data in the statistical model. Bayes' theorem givesThe Bayesian model evidence is the normalization constant making the posterior density integrate to one. The strict positive, finite condition is essential: a zero or infinite normalizer does not define this posterior distribution, even if the unnormalized expression can be written down. Other reference measures give the corresponding density formula; discrete parameter values replace the integral by a sum. The posterior propriety article gives examples where normalization fails.
With fixed, is a likelihood function of . Its normalization as a sampling distribution is over possible data, not over parameter values. In particular, a likelihood function is not a probability density function for and need not integrate to one over . The prior density supplies the probability weighting, and the Bayesian model evidence normalizes their product. This distinction prevents a tempting mistake: reversing the conditioning merely by exchanging the words “data” and “parameter”.
For eight heads among ten conditionally independent Bernoulli trials, take the observed data to be the heads count . Its binomial distribution likelihood function and the prior density giveUsing the Euler beta function , the Bayesian model evidence and normalized posterior density areThus the posterior distribution is . If the data are instead one particular ordered sequence with eight heads and two tails, its likelihood function omits the factor 45 and its Bayesian model evidence becomes . The factor cancels in Bayes' theorem, leaving the same posterior distribution; these two data descriptions have different sampling probabilities but identical information about here.
Beta(2,2) prior, peak-normalized Bernoulli likelihood, and Beta(10,4) posterior after eight heads and two tails
. Details. The prior density and posterior density use the left axis and each integrate to one. The dashed likelihood function uses the right axis and is divided by its maximum solely to compare its shape; it is not a parameter probability density function. The likelihood function peaks at , while the posterior mode is and the posterior mean is . Multiplying by the prior density shifts the preferred values toward one half while preserving a range of possibilities.
The resulting posterior variance is , compared with prior variance . In this example the update reduces uncertainty. The posterior predictive probability of heads on the next conditionally independent toss is , and the credible interval above reports a 95% range. These are summaries of the same posterior distribution, rather than competing estimates of one density peak.
Bayesian statistics Created 2026-09-24 Updated 2026-10-14
Bayesian statistics expresses uncertainty about an unknown statistical parameter through a probability distribution, then uses Bayes' theorem to update it after observing data. The prior distribution describes uncertainty before the current observations; the likelihood function describes how the statistical model generates those observations at each parameter value; the posterior distribution describes uncertainty conditional on the observations and that model. A physical parameter can have one fixed value while its value remains uncertain to us. Assigning it a probability distribution represents that uncertainty under the chosen model, rather than requiring the physical parameter to change randomly between measurements.
For example, suppose ten Bernoulli trials are independent conditional on an unknown heads probability , with a beta distribution prior . Eight heads and two tails give the posterior distribution by Beta-binomial conjugacy. Its posterior mean is , between the prior mean and observed binomial proportion . The Bayesian posterior below computes the whole update, and the credible interval below summarizes its remaining uncertainty. The conjugate update is explained in MIT 18.05, Reading 15: beta and normal conjugate priors.
The useful feature is that one posterior distribution supports several questions: a posterior mean estimates a value, a credible interval reports a range, and a posterior predictive distribution predicts a future observation while averaging over parameter uncertainty. With conditionally independent new data, today's posterior distribution can become tomorrow's prior distribution. These conclusions remain conditional on the statistical model and prior distribution; a precise update does not establish that either assumption fits the experiment.
A historical starting point is Thomas Bayes's essay in the 1763 volume of the Royal Society's Philosophical Transactions, communicated after his death by Richard Price. Its opening problem asks for uncertainty about an unknown event probability given observed successes and failures: the same direction of reasoning illustrated by the coin example. See Bayes and Price, An Essay towards solving a Problem in the Doctrine of Chances, opening letter and problem.
BUGS Created 2026-10-06 Updated 2026-10-14
BUGS specifies a probabilistic model through stochastic nodes, deterministic nodes and observed data, then uses Markov chain Monte Carlo to simulate its Bayesian posterior. Its normal sampling notation uses a precision parameter rather than a variance, and its gamma notation uses shape and rate.
Credibility estimate Created 2026-10-07 Updated 2026-10-13
A credibility estimate combines a risk's individual experience with population information. In the basic equal-exposure form, the credibility factor weights the observed sample mean, while weights a prior or collective expected value. The Bühlmann credibility premium is the best affine estimate under mean squared error; an exact Bayesian posterior mean can also have this form, as in the natural conjugate credibility identity.
Flat-prior elimination of a Gaussian common mean Created 2026-10-05 Updated 2026-10-06
For independent observations , put , , , and . Integrating the likelihood function against a flat improper prior on gives, up to the arbitrary prior constant,Indeed , and the remaining one-dimensional Gaussian integral is . The conditional Bayesian posterior of is .
Gamma prior for an inverse-gamma scale 2026-10-14
For inverse-gamma distribution observations of known shape and scale , their likelihood function in is proportional to . A shape-, rate- gamma distribution conjugate prior therefore gives the displayed Bayesian posterior. The Bayes estimator under squared error loss of the conditional claim expected value is . It depends on reciprocals, rather than the sample mean of the claims.
Gaussian posterior in the zero-noise limit 2026-10-05
For , with independent and , the multivariate normal distribution of the Bayesian posterior has posterior mean and covariance matrix . The singular value decomposition shows that the variance on a right singular vector of nonzero singular value is , while the variance along the null space is one. Thus, for fixed data, the mean tends to the minimum-norm least-squares solution and the covariance tends to the orthogonal projection onto the null space. Unobserved components retain their prior distribution even as the noise vanishes.
If is a measurable function into a separable Banach space and has finite second moments under probability measures , then their Bochner integral expected values satisfyHere the Hellinger distance includes the factor in its square. For a proof, use , , and . Apply the norm bound for a Bochner integral and the Cauchy-Schwarz inequality to , then use . This explains why stability of a Bayesian posterior in Hellinger distance controls posterior expected values when the relevant second moments remain bounded.
Likelihood function Created 2026-09-24 Updated 2026-10-14
For a fixed observed sample , a likelihood function iswhere is the probability mass function or probability density function of the observations under the statistical parameter . All densities must be defined relative to the same parameter-independent dominating measure. The sample is fixed; the parameter is the function's argument. With independent and identically distributed random variables, the joint mass or density factors as . This definition and the distinction between sampling probability and parameter uncertainty are explained in MIT 18.05, Reading 10b, sections 3 and 3.2.
For an observed ordered sequence of ten independent Bernoulli trials containing eight successes and two failures, each success contributes and each failure contributes , givingIf the observation is instead only the total count , its binomial distribution probability mass function sums over the possible ordered sequences:The raw heights differ: at they are approximately and . Their maximum-likelihood estimates are identical. More generally, multiplication by any finite positive constant independent of leaves the maximizing parameter values and all likelihood ratios unchanged. Multiplication by a parameter-dependent factor can change the MLE; dropping such a factor is not justified. Relative likelihood height sets the peak to one, without making the area under the curve one.
Normalization of is over possible data values for each fixed parameter. It imposes no requirement that . For example, the ordered Bernoulli trials likelihood above hasIts integral is not one, and its values are not posterior probabilities for . When the Bayesian posterior is defined, Bayes' theorem multiplies the likelihood by a prior density and normalizes that product. Choosing to normalize a likelihood function alone is an additional choice, such as using a uniform prior in those parameter coordinates, rather than part of the definition of likelihood.
For observations with a probability density function, the probability of an exact sample point is zero. If a scalar density is continuous at the observed value , thenThus the density compares probabilities of small, equal observation intervals at different parameter values; it is not itself the probability of that exact real number. The equal-width factor is independent of the parameter. This gives visual intuition for density likelihoods, as in MIT 18.05, Reading 10b, section 4. The normal distribution example in maximum-likelihood estimator makes the comparison explicit. If only rounded intervals are recorded, their integrated probabilities give the exact observation likelihood; using midpoint densities is an approximation.
Partial pooling Created 2026-10-06 Updated 2026-10-14
Partial pooling estimates related local parameters jointly through shared hyperparameters. Each local Bayesian posterior balances its own likelihood function against a group prior distribution, with stronger shrinkage when its data are weak or the group variation is small. It lies between forcing all local parameters to be equal and estimating them independently. Random-effects meta-analysis is an important application.
Put and . In the computational basis, input has outcome probabilities , while has . The marginal outcomes are equally likely; the Bayesian posterior probabilities areGuess after zero and after one. Each guess is correct with probability and wrong with probability . Neither outcome is certain evidence for one input.
For a real state , the Born rule in the Hadamard basis gives . Both angles and have . Thus both preparations give and . By Bayes' theorem, either outcome leaves the two input hypotheses equally likely. The biased outcome frequencies carry no information about which state was prepared; the best success probability with this measurement is .
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 29 4 i Solution Created 2026-10-03 Updated 2026-10-14
A beta distribution is a convenient prior for a probability and is conjugate to the binomial distribution of the death count. Match its mean and variance . For ,The moment matching for a beta prior formula givesConditional on , use and the observed count . Multiplying its likelihood by the prior density gives the Bayesian posterior through Beta-binomial conjugacy:Under squared-error loss, take its posterior mean as the point estimate. A 95% equal-tail credible interval is given by its 0.025 and 0.975 quantiles. Numerically,Matching two moments does not uniquely determine a prior distribution; the beta family is a justified convenient choice, not a conclusion forced by those moments. Its transfer to this hospital presumes that the historical between-hospital distribution is relevant to the present risk and case mix.
Past exam of the mathematics course of the University of Cambridge 2002 iii Paper 35 3 Solution Created 2026-10-03 Updated 2026-10-14
In the Bühlmann model, one policy has a random risk parameter . Conditional on , its annual observations are independent and identically distributed random variables, with mean and variance . Put , let be the expected process variance, and let be the variance of hypothetical means. Assume the required second moments are finite.
The Bühlmann credibility premium is the best affine estimate of under mean squared error. After choosing the intercept to make the estimate unbiased, write it as . If , the law of total variance and conditional independence give its errorFor fixed , the Cauchy-Schwarz inequality minimizes the last sum at . Differentiating gives . Thus the credibility factor and credibility premium areThe ratio form assumes ; when and , the conditional mean is constant and . Predicting rather than its conditional mean adds the constant to the error and leaves the optimal affine estimate unchanged.
Here the latent intensity has a Pareto distribution with shape three and lower bound one. For , its moments are . ConsequentlyThe equality for uses the Poisson distribution conditional variance . There are two years of experience, so and the observed sample mean is . The Poisson credibility with a shape-three Pareto intensity is thereforeIn particular it equals when .
For the exact Bayesian credibility estimate, the total count conditional on has Poisson distribution of mean . Multiplication of its likelihood by the prior distribution density gives a Bayesian posterior density proportional to on . At , its normalizing integral and first-moment integral areHence the next-year predictive expected value isThe Bühlmann credibility premium optimizes over affine estimates, whereas the Bayesian posterior mean optimizes over all square-integrable estimates. This explains why the two credibility estimates need not agree for this nonconjugate prior.
Past exam of the mathematics course of the University of Cambridge 2008 iii Paper 43 4 Solution 2026-10-14
A credibility estimate combines a risk's own observed experience with a collective or prior mean, in the form . The credibility factor is the weight given to that risk's experience. Bayesian credibility starts with a prior distribution for a latent risk parameter, updates it using observations, and estimates the conditional risk mean by its Bayesian posterior expected value under squared-error loss. In conjugate models this posterior mean can have exactly the displayed credibility form.
For the unequal policy exposures, defineConditional independence of the binomial distribution observations gives the likelihood, up to a factor not depending on ,Multiplication by the beta distribution prior therefore gives Beta-binomial conjugacy:Both posterior parameters are positive, since and the prior parameters are positive.
The conditional target is . To verify the quadratic-loss rule directly, for any proposed estimate and observed data ,The variance term does not depend on , so the unique Bayes estimator under squared error loss is the posterior mean. Applying the beta mean formula givesIt is also the posterior expected future claim count, by the tower property of conditional expectation.
Let be the collective prior claim probability and the observed claims per policy. ThenTherefore the exact beta-binomial credibility with unequal exposures isThe individual experience must be weighted by exposure: is the policy-weighted frequency, not the unweighted average of when the differ. The factor multiplies next-year expected counts after scaling both component probabilities by .
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 39 4 ii Solution Created 2026-10-03 Updated 2026-10-14
Use the primitive , as in Question 3, and the usual positive spot volatility convention . An additive utility function constant shifts both agents' value functions equally and does not affect their policies or the comparison. SetThe Itô formula applied to the stock price and the binary Brownian drift filter givesLet denote the dollar stock holding. The separated state equations areBoth states use the same observed Brownian motion. In particular, their quadratic covariation is .
Let be the Bayesian value function. Its Hamilton-Jacobi-Bellman equation isThe cross derivative is necessary: learning and portfolio wealth are correlated through the same observation shock. At a smooth, finite, strictly concave value, the optimal consumption and stock holding areThe number of shares is , and the wealth fraction is .
More explicitly, homogeneity gives , where . ThenThe additional term is the learning hedge in a binary-drift investment model, a form of intertemporal hedging demand. Merely putting the Bayesian posterior mean drift into a constant-coefficient investment formula would omit it. Eliminating the controls gives the coefficient equationThe economic solution is selected by admissibility and the infinite-horizon value condition, rather than by an arbitrary solution of this ordinary differential equation.
For the comparison, now suppose and . Write , , andWhen , the informed agent's Merton consumption-investment problem has valueThese are the policies available to an agent who knows the true drift is .
For any admissible Bayesian policy, not only its optimum, defineThe integration variable is throughout the accumulated utility function. Applying the Itô formula in the Bayesian observation filtration giveswhereThe informed-agent Hamilton-Jacobi-Bellman equation says . Maximizing the stock term at any excess drift givesSince , this maximum increases with . The binary Brownian drift filter satisfies , and thereforeIt follows that . Thus is a local supermartingale. Because , both accumulated utility function and are nonnegative. A nonnegative local supermartingale is a genuine supermartingale, by localization and the conditional Fatou lemma. This proves the requested assertion under the Bayesian probability law, without conditioning that law on the favorable drift.
ConsequentlyThe monotone convergence theorem lets tend to infinity. Taking the supremum over Bayesian policies proves the maximal squared Sharpe ratio value boundIn particular this holds at the equal-prior state . No vanishing-terminal-value assumption is needed for this upper bound, because the terminal term is nonnegative and can simply be dropped.
The finite-value assumption is missing from the printed comparison. Without it, and the value inequality is trivial, but is not a finite supermartingale. For a concrete allowed example, take , , , and . Then and . For the informed agent, the constant stock fraction and consumption giveThe time integral diverges, so his value is infinite. This is why the nontrivial finite-supermartingale proof above needs the stated qualification.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 39 4 i Solution Created 2026-10-03 Updated 2026-10-14
Treat the two-point prior for as independent of the driving Brownian motion. On a partition , conditionally on , the increments of are independent normal distributions with means and variances . Their likelihood ratio isThus every partition containing gives the same Bayesian posterior, depending only on the endpoint. Refine partitions through a dense set of observation times. Continuity makes their increasing observation fields generate the full path field , and convergence of bounded conditional expectations preserves that Bayesian posterior. Equal prior probabilities and the Bayes' theorem consequently giveIts conditional mean drift isThis is the binary Brownian drift filter.
Define the observed innovation processIt is continuous and adapted to . For , independence of future Brownian motion increments from the past and the latent drift givesFor every , the tower property of conditional expectation givesSince , conditional integration is justified. Subtracting the integrated identities shows . Thus is a square-integrable martingale. Subtracting a continuous finite variation process does not change quadratic variation, so . The Lévy characterization of Brownian motion now proves that is a Brownian motion in the observation filtration. Therefore
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 40 4 Solution Created 2026-10-03 Updated 2026-10-07
A credibility estimate blends the risk's own sample mean with a population or prior expected value. In the basic equal-exposure form it is , where the credibility factor is the weight attached to the individual experience. More data ordinarily increase that weight; greater within-risk variation relative to between-risk variation reduces it.
Write for the conditional claim expected value, keeping for the prior-level parameter. Normalization of the probability density function givesAt interior points of its finite domain, differentiation under the integral sign yieldsThis is an instance of the exponential-family derivative identities for natural parameter . The minus sign is present in the PDF and is lost in the converted TeX. The conditional variance is likewise .
Differentiate the log of the natural conjugate prior:Integrate on a compact subinterval and then let its endpoints approach those of the parameter interval. The prescribed vanishing of the prior density eliminates the boundary term. Since , monotone convergence theorem justifies the limit of its expectation, and the identity givesIn particular the assumed proper prior and boundary conditions themselves establish this first-moment integrability.
For and , conditional independence makes the likelihood function proportional to . Multiplication by the prior distribution gives the Bayesian posteriorThus this is a conjugate prior family, with updated parameters
The integration-by-parts calculation for the posterior mean also needs vanishing posterior boundary values. Here that property can be checked, rather than assumed. Let be the essential lower and upper endpoints of the claim support. Every nondegenerate tilted claim law has , so the established prior mean satisfies . Supported observations have ; hence . At a finite parameter endpoint the prior's vanishing forces , because its exponential factor has a finite positive limit; the increased power makes the posterior vanish there too. At , choose with positive base-measure mass below . Then and the unnormalized posterior is at most . At , choose with positive mass above to obtain the corresponding bound . These bounds also ensure posterior propriety at infinite endpoints. This is the endpoint control for a Laplace-family conjugate posterior.
Apply the previous score integration to the Bayesian posterior. The natural conjugate credibility identity isThus is the credibility factor. This is an exact posterior mean, rather than an affine approximation to one.
For the specific shape-two gamma distribution, takeThen and . The gamma rate gamma conjugacy prior isthat is, . Its normalizing constant in the notation of the question is . The gamma distribution density vanishes at both zero and infinity for . The posterior has shape and rate , so its conditional-mean posterior mean is again .
For the last calculation, gamma distribution integration givesThe second identity requires the printed . Therefore the expected process variance and variance of hypothetical means, denoted by in this question, areConsequently , and the Bühlmann credibility factor agrees with the exact Bayesian weight:This is the exact Bühlmann credibility for gamma claims, expressed using the reciprocal rate as the random scale. The symbols here are the process and between-risk variances, respectively; their roles should not be interchanged when comparing with other notation for the Bühlmann model.
