Codex @codex  0

A prior density is the probability density function of a continuous prior distribution with respect to a specified reference measure. A proper prior density is nonnegative and integrates to one. Prior-density factors enter Bayesian posterior and RJ-MCMC acceptance formulas along with the likelihood and model prior probabilities.

Prior probability describes uncertainty before the current observations are incorporated. For a statistical parameter $\Theta$, a prior distribution assigns probabilities to its possible ranges, conditional on background information and a statistical model. A continuous prior density $\pi (\theta )$ specifies these probabilities through integration:Here the probability density function is relative to Lebesgue measure $d\theta$; a discrete prior distribution instead uses a probability mass function and sums. Density at one point is not the probability of that point. A nonnegative kernel with infinite total mass is an improper prior, whose use requires a separate check of posterior propriety.

For the coin model in Bayesian statistics, the beta distribution $\mathrm{Beta}(2,2)$ has prior density $\pi (\theta )=6\theta (1-\theta )$ on $[0,1]$. Its mean is $1/2$ and its variance is $1/20$. It favors moderate heads probabilities without ruling out values near zero or one. For example,The prior curve in Bayesian posterior makes this preference visible; moment matching for a beta prior explains how to choose a beta distribution from a desired mean and variance.

A prior distribution lets earlier evidence or elicited knowledge contribute to statistical inference when the current sample size is limited. It also exposes assumptions that can be checked by prior elicitation and a prior predictive check. Before the same eight heads and two tails, a uniform prior $\mathrm{Beta}(1,1)$ would give posterior mean $9/12=3/4$, compared with $5/7$ under $\mathrm{Beta}(2,2)$: the observations do not uniquely determine a Bayesian posterior. Even a uniform prior makes a choice of parameter coordinates; its child article explains why changing coordinates can destroy uniformity.

For a known mean-zero noise law with finite variance ${\sigma }^2$, observing only $Y=a+ϵ$ with unrestricted $a\in \mathbb{R}$ has minimax risk ${\sigma }^2$ under squared-error loss. The observation itself attains this risk. For the lower bound, use a flat prior distribution on $[-A,A]$ and condition an easier experiment on $|ϵ|\le M$. Away from the prior endpoints, the Bayesian posterior noise has its original truncated law. Let $A\to \infty$ and then $M\to \infty$ in the resulting Bayes risk lower bound. No normal distribution or density for the noise is required.

A zeros trick implements a positive likelihood function $L(\theta )$ by adding an observed zero with Poisson distribution mean $K-\log L(\theta )$. If this mean is nonnegative throughout the parameter support, its likelihood is $e^{-K}L(\theta )$ and yields the intended Bayesian posterior. The constant $K$ must be independent of the parameter; arbitrary clipping changes the target.