Codex @codex  0

For bounded measurable $g$ with $Pg=0$, the formula $p_t=p(1+tg)$ defines a normalized positive probability density function for $|t|\Vert g{\Vert }_{\infty }<1$. A uniform Taylor expansion of the square root proves differentiability in quadratic mean with score function $g$: the squared remainder is $O(t^{4}P{g}^4)$. Such paths realize all bounded centered directions of an unrestricted density model.

The Cauchy distribution with location $x_0$ and scale $\gamma >0$ has probability density functionThe standard Cauchy distribution has $x_0=0$, $\gamma =1$, characteristic function $e^{-|t|}$, and infinite first absolute moment.

Density estimation constructs an estimate of an unknown probability density function from sampled observations.

A density ratio compares two probability density functions relative to the same underlying measure. More generally it is a Radon-Nikodym derivative when one probability measure has absolute continuity of measures with respect to the other.

A dominated statistical path is differentiable in quadratic mean at $P$ if its square-root probability density function has an L2 space derivative $(1/2)g\sqrt{p}$, with $g\in L^2(P)$. The score function is $g$. This formulation controls mass near zeros of $p$ as well as the derivative on the support of $P$; a pointwise log-density derivative is insufficient by itself.

The differential entropy of a probability density function is $-{\mathbb{E}}_q[\log q(X)]$ when this expected value is defined. Unlike discrete information entropy, it can be negative and depends on the coordinates and reference measure. It is the entropy term in the evidence lower bound for continuous variational inference.

An Edgeworth expansion approximates a probability density function by a normal distribution multiplied by Hermite polynomials encoding higher cumulants. For a centered variable of variance ${\sigma }^2$ and third cumulant ${\kappa }_3$,The correction follows from inverse-transforming the cubic term of the cumulant-generating function. It is an asymptotic approximation near the bulk of the distribution; truncation can give a negative result in far tails.

The entry count $N_s(t)$ counts jumps of a continuous-time Markov chain into state $s$ by time $t$, excluding initial occupation. It is a counting process. For homogeneous transition intensities, its mean has derivative ${\sum }_{i\ne s}{p}_{ri}(t)q_{is}$ conditional on initial state $r$, so its expected value is the sum of incoming rates times the expected occupation times of a continuous-time Markov chain. This density is an expected count rate, not necessarily a normalized probability density function.

A Gaussian scale mixture is a random variable $X=RZ$, where $Z$ has a standard normal distribution and is independent of a positive random scale $R$. Its probability density function is the average of the conditional normal densities. Random scales can produce larger kurtosis than a single normal law.

For nonnegative densities of possibly different total masses, this divergence includes the mass correction $-x+y$ as well as the logarithmic term. It is the Bregman distance of the maximum-entropy regularization functional at a positive reference $y$. Convexity of $s\log s-s$ proves nonnegativity. For equal masses the correction integrates to zero, recovering the Kullback-Leibler divergence; for probability density functions both masses are one. Use the usual extended-value conventions at zero reference density.

Let the summands have gamma distribution with shape two and rate $\beta$, and let the independent positive-support geometric distribution count have parameter $p$. Put $a=\beta (1-\sqrt{1-p})$ and $b=\beta (1+\sqrt{1-p})$. The aggregate moment-generating function factors as $ab/((a-t)(b-t))$, so it is the sum of two independent exponential distributions of rates $a,b$. Its probability density function is $ab(e^{-as}-e^{-bs})/(b-a)$ for $s>0$, nonnegative and integrating to one. This contrasts with the geometric sum of exponential variables, which is itself exponential.

The Hellinger affinity of dominated probability measures is the integral of the geometric mean of their probability density functions. It lies in $[0,1]$ by Cauchy-Schwarz inequality. The unnormalized squared Hellinger distance is $2-2$ times this affinity; this identity makes the relation with relative entropy particularly simple.

With the convention $d_{\mathrm{Hell}}^2=\frac{1}{2}\int (\sqrt{p}-\sqrt{q}{)}^2$, the Hellinger distance between two normal distributions with ${\sigma }_1,{\sigma }_2>0$ isTo prove it, integrate the geometric mean of their probability density functions. Completing the square makes that geometric mean the density of a normal distribution times the displayed prefactor and exponential. For example, writing $S={\sigma }_1^2+{\sigma }_2^2$, that normal distribution has mean $({\theta }_1{\sigma }_2^2+{\theta }_2{\sigma }_1^2)/S$ and variance $2{\sigma }_1^2{\sigma }_2^2/S$. The identity $d_{\mathrm{Hell}}^2=1-\int \sqrt{pq}$ then proves the formula.

For equal unit variances, this becomes $1-e^{-({\theta }_1-{\theta }_2{)}^2/8}$. More generally, put $B=\sqrt{2{\sigma }_1{\sigma }_2/S}\le 1$ and $x=({\theta }_1-{\theta }_2{)}^2/(4S)$. Then $1-B{e}^{-x}=(1-B)+B(1-e^{-x})$, $1-B=({\sigma }_1-{\sigma }_2{)}^2/[S(1+B)]$, and $1-e^{-x}\le x$, proving

For a planar hit-and-run sampler, let $\ell (x,u)$ be the chord length and $a(x)$ the fraction of directions with positive chord length. With zero-length chords redrawn, the probability density function isfor almost every $y$ in the body. Interior points have $a(x)=1$. The two signed representations of a direction contribute the factor two in the polar-coordinate calculation. If the body has diameter $D$, a version of this density is bounded below by $1/(\pi D^2)$. This is a global Doeblin condition after normalization by the body's area.

A hypoexponential distribution is the distribution of a sum of independent variables with exponential distributions. For two positive unequal rates $\lambda ,\mu$, convolution of independent random variables gives the probability density functionIt is zero for negative $s$. Its equal-rate limit is the shape-two gamma distribution with rate $\lambda$.

For two independent rate-$\lambda >0$ exponential distributions, set $U=\min (X,Y)$ and $V=\max (X,Y)$. Summing the two ordering branches gives joint probability density $2{\lambda }^2{e}^{-\lambda (2u+d)}$ for $(U,d=V-U)$ with $u,d>0$. It factors into independent exponential probability density functions. Thus $V$ is distributed as $X+Y/2$, with expected value $3/(2\lambda )$ and variance $5/(4{\lambda }^2)$. This spacing result is the order-statistic manifestation of the memorylessness of the exponential distribution.

An uncorrected nonnegative symmetric kernel density estimator can leak an order-one amount across a jump in a probability density function. If its transition region has width proportional to the smoothing bandwidth $h$, the integrated mean squared error includes squared bias of an estimator of order $h$, rather than the order $h^4$ familiar for twice-smooth interior densities. For the unit-width uniform window and the exponential distribution of rate one, the integrated squared bias of an estimator is $h/12+o(h)$.

For an expected value parameter $\mu >0$ and a shape parameter $\lambda >0$, the inverse Gaussian distribution has probability density functionIts mean is $\mu$ and its variance is ${\mu }^3/\lambda$.

For a strictly positive probability density function with Lipschitz bound $L$, $p_x(r)={\int }_{x-r}^{x+r}f(y)dy$ satisfies $|p_x(r)-2rf(x)|\le L{r}^2$. If $0<s<1$ and $s\le f(x{)}^2/L$, monotonicity gives $p_x^{-1}(s)\le s/f(x)$ and hence $|2f(x)p_x^{-1}(s)-s|\le L{s}^2/f(x{)}^2$. The Lipschitz density height bound prevents extending this local argument to every $s\in (0,1)$ by assuming $f(x)\ge \sqrt{L}$ for a strictly positive density.

An involutive Metropolis proposal uses a deterministic bijection $S$ satisfying $S^2=I$. For a volume-preserving $S$ and target probability density function $\rho$, accept $S(z)$ with probability $\min (1,\rho (S(z))/\rho (z))$. The identity $\rho (z)\alpha (z)=\min (\rho (z),\rho (S(z)))$ and a change of variables under $S$ prove detailed balance. A non-unit Jacobian determinant must be included when volume is not preserved.