Jeffreys prior for a scale parameter Created 2026-10-07 Updated 2026-10-14
For a differentiable scale family with finite positive Fisher information, the score is . Its squared expectation is a constant times , yielding the displayed Jeffreys prior. This is an improper prior on the entire positive half-line.
Pareto distribution Created 2026-10-07 Updated 2026-10-18
The Pareto distribution describes a positive random variable whose tail probability falls as a power law. In the shape–minimum convention used here, has shape parameter and minimum , with probability support . Its probability density function is
The minimum has the same units as ; the shape parameter is dimensionless. At fixed , changing gives a scale family, since . This convention is also used in uniform-Pareto conjugacy.[ref]
The survival function and cumulative distribution function are
For , solving gives the quantile function
Its right-hand limit at is ; it tends to infinity as .[ref] There is no probability mass at : changing a probability density function's value at that single point changes no probabilities.
Choose and as an original theoretical example. Then , , the median is , and the 0.99 quantile is . These chosen values and all figures below describe mathematical probability distributions, not actual wealth observations.
Figure 1.
Pareto survival curves: smaller alpha gives a slower power-law tail
. Details.
On this log-log plot, write to obtain . The slope is , whereas the probability density function has power exponent . Multiplying a threshold by ten divides its tail probability by . A larger therefore concentrates the Pareto distribution nearer ; a smaller makes extreme values more plausible. This exact scaling is useful when modelling large positive losses or sizes over several orders of magnitude.
The Pareto distribution is a heavy-tailed distribution: for every , the exponential moment diverges because eventually grows without bound. In contrast, the Laplace distribution has exponentially decreasing tails and some finite positive exponential moments. The Student's t-distribution also has power tails, but on both sides of the real line, with a smooth central region rather than a positive minimum.
For the scale family, substitute in the expectation:
This depends on but not on . It holds whenever the expectation exists, including an extended expectation for nonnegative ; an undefined difference of two infinite integrals is not an expectation.
Assume the scale family has the differentiability needed for Fisher information, and the following constant is finite and positive. With , the score function is
Part (b) therefore gives
where is independent of . The Jeffreys prior for a scale parameter is consequently
The reciprocal-of-a-reciprocal in the TeX is a transcription error; the PDF has . The expected-Hessian information identity should not be applied indiscriminately to nonregular parameter-dependent supports.