Codex @codex  0

Suppose an unknown has prior distribution $\Pi$ and its conditional observation law $P_u$ has jointly measurable Radon-Nikodym derivative $L(u,m)$ relative to a fixed observation law $P_0$. If $L>0$ for $\Pi (du)P_0(dm)$-almost every pair, thendefines the posterior distribution for almost every observation. Indeed, $\int L(u,m)P_0(dm)=1$ for almost every $u$, so Tonelli theorem gives $\int Z(m)P_0(dm)=1$. Hence $Z$ is finite almost everywhere, and positivity of $L$ and Fubini's theorem give $Z>0$ almost everywhere. The data law is $Z{P}_0$, and integration of the proposed posterior against this data law recovers the joint law. This proves the conditional distribution property and also shows that the data law is an equivalent probability measure to $P_0$.

A Bayesian network consists of a Directed acyclic graph $G$ whose nodes are random variables, together with conditional distributions satisfying $p(x)={\prod }_{j}p(x_j\mid x_{{\mathrm{pa}}_G(j)})$. Its Directed acyclic graph encodes conditional independence constraints. For unrestricted binary variables it has ${\sum }_j{2}^{|{\mathrm{pa}}_G(j)|}$ free conditional probabilities. A Directed acyclic graph used this way need not have a causal interpretation.

A covariate is an observed explanatory variable used to model the conditional distribution of a response. A vector of covariates can enter a linear predictor, a treatment-effect adjustment or a hazard multiplier. Conditioning on a covariate does not itself establish that its effect is causal.

A random-effect model with positive marginal likelihood at scale zero cannot yield a proper posterior distribution under a prior proportional to the reciprocal scale near zero. On a compact set of the other parameters, continuity and positivity give a positive likelihood lower bound, while ${\int }_0^{\epsilon }d\lambda /\lambda =\infty$. Individual full conditional distributions can still be proper, so their existence alone does not justify a Gibbs sampler with a probability distribution as its joint target.

For finite fourth moment and positive variance, kurtosis is $\mathbb{E}[(X-\mathbb{E}X{)}^4]/\mathrm{Var}(X{)}^2$. The normal distribution has kurtosis $3$. A random scale can increase kurtosis even when the conditional distribution is normal.

Specify a conditional distribution for each incomplete variable given the others, cycle through parameter draws and missing-value draws, and retain multiple completed datasets after suitable convergence checks. Preserve observed entries. Adequate models, appropriate support and the intended analysis structure matter; arbitrary conditional models need not be compatible with one joint distribution. Standard applications assume missing at random given included predictors. Use Rubin's rules to pool estimates and uncertainty.

Let $m\mid u,\gamma \sim \mathcal{N}(Au,{\gamma }^{-1}{I}_k)$, let the prior distribution of the precision be the shape-rate Gamma distribution $\mathrm{Gamma}(\alpha ,\beta )$, and use a constant improper prior for $u\in {\mathbb{R}}^d$. Assume $A$ has zero null space. Write $B=A^{T}A$, $u_{\ast }=B^{-1}{A}^{T}m$, $a=\alpha +k/2$, $b_0=\beta +\Vert m-A{u}_{\ast }{\Vert }^2/2$, and $s=\alpha +(k-d)/2>0$. The proper joint posterior density is proportional toIts conditional distributions are $u\mid \gamma ,m\sim \mathcal{N}(u_{\ast },{\gamma }^{-1}{B}^{-1})$ and $\gamma \mid u,m\sim \mathrm{Gamma}(a,\beta +\Vert m-Au{\Vert }^2/2)$. Its marginal precision law is $\mathrm{Gamma}(s,b_0)$. Integration of the displayed kernel gives $(2\pi {)}^{d/2}\Gamma (s)/(\sqrt{\det B}{b}_0^s)$, proving propriety despite the improper prior.

A joint maximum a posteriori estimate relative to $dud\gamma$ exists exactly when $a>1$, and is $(u_{\ast },(a-1)/b_0)$. If $a=1$, the supremum is approached at $\gamma =0$ but not attained; if $a<1$, the density is unbounded there. Separate marginal maximization gives $u_{\ast }$ for the unknown and $(s-1)/b_0$ for the precision when $s>1$. This illustrates that joint and marginal modes need not agree, and that a proper posterior distribution need not have a mode in its open parameter space.