Past exam of the mathematics course of the University of Cambridge 2005 iii Paper 43 4 i Solution Created 2026-10-03 Updated 2026-10-20
Let . The conditional joint likelihood function of the observed counts isThe prior is a gamma distribution with shape two and rate . Multiplication by its density gives the unnormalized posterior density . Normalizing with the gamma function yieldsThus Poisson-gamma conjugacy gives . Conditional on and the past data, the next count has mean , so the law of total expectation givesWith and prior mean , this is exactlyHere , , and the credibility factor increases to one as the number of observed years grows. The denominator uses the prior rate and total exposure ; it does not add two to the exposure when adding the prior shape.
Past exam of the mathematics course of the University of Cambridge 2005 iii Paper 43 4 Solution 2026-10-14
A credibility estimate combines a risk's observed experience with collective or prior information, typically as . The credibility factor is the weight assigned to the individual experience: more reliable or more extensive data generally increases it. Bayesian credibility treats the risk parameter as random with a prior distribution and predicts future claims by averaging the conditional claim mean under its posterior distribution. Under squared-error loss this posterior predictive mean is optimal. It need not be an affine combination in every Bayesian model; the Poisson-gamma conjugacy calculation below yields that credibility form exactly, rather than as a best-linear approximation.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 36 2 c Solution Created 2026-10-03 Updated 2026-10-14
A proper gamma approximation to a Poisson Jeffreys prior uses shape and a small positive rate :Its density is proportional to , so where is small its kernel approximates the Jeffreys prior. After observing the data, Poisson-gamma conjugacy gives , which converges to the preceding posterior distribution as . This is an approximation of an improper kernel on the relevant parameter range, not a weak limit to a normalized Jeffreys probability distribution. The shape must be ; a small-shape gamma prior would approximate a different power of .
Past exam of the mathematics course of the University of Cambridge 2013 iii Paper 29 4 Solution Created 2026-10-03 Updated 2026-10-07
The reversible-jump Markov chain Monte Carlo state comprises the model index and that model's parameter. Its unnormalized posterior density in model isFor models of equal dimension, choose model with probability and propose using density on the destination parameter space. The equal-dimension reversible-jump acceptance probability isOn acceptance change both model and parameter; on rejection retain both. Choose model proposals connecting all models of positive posterior mass and within-model kernels exploring their supports, with aperiodicity, to obtain an ergodic chain. Include within-model updates targeting its conditional posterior, and use model occupation proportions after the initial transient to estimate posterior model probabilities. The formula includes the model prior probabilities, parameter prior densities, likelihoods, reverse model-selection probability, and reverse parameter-proposal density.
This direct-density formula is Metropolis–Hastings algorithm on a disjoint union of equal-dimensional spaces. If instead a move uses a deterministic bijection with auxiliary proposal densities and , useThe Jacobian determinant is one for identity matching, but equal model dimensions alone do not make a nonlinear map volume-preserving. For a direct proposal density the change of variables is already included in that density, so no additional Jacobian factor is inserted.
For the two Poisson models, use the shape-rate convention for the gamma distribution:If denotes scale instead, replace every occurrence of the rate below by . Introduce the inactive under model with the proper pseudo-prior , independent of . This pseudo-prior augmentation for model comparison does not change model 's marginal likelihood because the inactive density integrates to one. The two augmented targets on the same positive quadrant arewhereUse a symmetric cross-model proposal that flips the model label and leaves both parameters unchanged. The matching map is the identity, with unit Jacobian determinant, and the common prior factors cancel. Hence the model-switch acceptance probabilities areOnly the second observation's factor changes because is retained as its shared candidate mean. Evaluate the ratio on a logarithmic scale as for the first direction.
For within-model moves, Poisson-gamma conjugacy gives exact Gibbs sampling refreshes:The two draws are conditionally independent within either model. Choose with fixed positive probabilities between this block refresh and the cross-model proposal. Both moves preserve the augmented posterior; refreshing the inactive parameter maintains its correct distribution and supports mixing. The fraction of retained states labelled estimates .
An equivalent literal dimension-changing implementation deletes on a proposed move, and on a move draws an auxiliary and sets . The birth matching has dimensions and unit Jacobian determinant. Its proposal density cancels the new parameter's prior density, giving the same acceptance ratios above for symmetric selection of move directions. This provides suitable moves without storing an inactive parameter.
For an independent check of Poisson mean equality model comparison, the exact Bayes factor isIt follows by integrating the two gamma likelihood kernels; the common factorial terms cancel. With equal model priors, the exact posterior probability of is , which can also be used to check the RJ-MCMC occupation estimate.
Past exam of the mathematics course of the University of Cambridge 2014 iii Paper 35 1 c Solution Created 2026-10-03 Updated 2026-10-06
By Poisson-gamma conjugacy, the posterior density is proportional toThus the shape-rate posterior isIts posterior mean is and its variance is . The parameter is a rate, rather than a scale.
Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 207 1 c ii Solution Created 2026-09-24 Updated 2026-09-25
Use the shape-rate convention . The factors involving in the posterior density areBy Poisson-gamma conjugacy,so its posterior mean is .
Past exam of the mathematics course of the University of Cambridge 2025 ii Paper 3 28L a Solution Created 2026-09-24 Updated 2026-09-25
Bayes' theorem updates a hypothesis using observed data. For mutually exclusive exhaustive hypotheses and data of nonzero probability,The prior describes information before these data; the likelihood describes the sampling model; the denominator is the evidence; and the posterior is the updated probability. likelihood and posterior are different conditional quantities. For a continuous parameter, sums become integrals and the posterior is a probability density.
Consider a counter registering independent events at unknown constant rate , observed for known exposure with negligible background and dead time. The observed count has a Poisson distribution:Take a proper gamma prior in shape-rate convention,Multiplying by the likelihood adds the count to the shape and the exposure to the rate. Normalization therefore givesHere has exposure units. This is Poisson-gamma conjugacy. Successive independent counting runs update the same posterior by adding their counts and exposures, so the result agrees with analysing all the data together.
A credible interval contains a specified posterior probability for , conditional on the chosen prior and model. For low counts, the posterior can be asymmetric and sensitive to the prior, and a symmetric Gaussian error bar can be misleading. For large and an exposure dominating prior information, the mean approaches and its standard deviation approaches . Background, missed events or time-dependent rates require a richer likelihood; Bayes' theorem cannot compensate for an incorrect physical counting model. The prior must be specified independently of the same data being used in the likelihood, unless its estimation is explicitly included in a larger model.
Bayes' theorem updates prior knowledge using the likelihood of new observations. For alternative hypotheses ,The prior describes information before the data ; is the sampling likelihood, and the posterior describes the updated probabilities. Posterior odds equal prior odds times the likelihood ratio. A likelihood is a probability model for data at specified parameters, not automatically a normalized probability distribution over those parameters.
For a continuous parameter , the same rule uses densities: . Priors can encode positivity, physical limits, previous independent measurements or calibration knowledge. Their parameterization matters: a density uniform in a rate is not uniform in its logarithm. Proper priors make model evidences well defined; an arbitrary normalization in an improper prior is especially problematic for comparing models.
A counting example uses Poisson-gamma conjugacy. If a detector registers events in exposure with constant rate , . A gamma prior with shape and rate parameter , , givesThe posterior mean combines the prior rate with the observed rate , weighted by the prior and actual exposures. The parameters must use a consistent shape-rate convention. Small counts can leave substantial prior sensitivity; abundant informative data usually reduce it for regular identifiable models.
Independent old data can become the prior for a new experiment, giving the same result as joint updating under a consistent model. The new data must not also have been used to construct that prior, or the evidence is counted twice. A credible interval has a specified posterior probability under the chosen model and prior; this interpretation differs from repeated-sampling coverage of a confidence interval. Predictions for a future observation average its sampling distribution over the posterior, incorporating parameter uncertainty. Prior sensitivity checks and a defensible likelihood are therefore part of the inference, rather than Bayes' theorem itself supplying missing physical knowledge.
Writing , the Poisson distribution likelihood is proportional to . Multiplying by the gamma distribution prior givesThis is Poisson-gamma conjugacy, with the rate convention made explicit:Its normalized density is for .
Poisson mean equality model comparison 2026-10-07
Compare independent Poisson means with one shared mean under proper shape-rate gamma distribution priors. Adding the second mean as an inactive parameter under the shared-mean model gives a simple identity model switch. With equal model priors and identical active/inactive priors, its ratio from separate to shared means is . Poisson-gamma conjugacy supplies exact within-model updates, and integrating the gamma kernels supplies an independent Bayes factor benchmark.