The probability density function is nonnegative for . Its integral over the support is
so it is normalized for every . This is the unit-threshold Pareto distribution.
Let have the Pareto distribution with probability density function for , and zero otherwise. Its normalization of a probability distribution and first two moments follow from
Set . Then
The probability distribution of is not a symmetric distribution: almost surely, whereas and . For we have , so
Thus has every property required.
Let and . For the observed positive data, the uniform distribution likelihood function is
Multiplying by the Pareto distribution prior density gives the posterior density kernel . Since
the normalized posterior distribution is
This is uniform-Pareto conjugacy. The posterior density is strictly decreasing over its support, so the highest posterior density interval starts at , where the admissible density is largest in the limiting sense. Its upper endpoint satisfies
Hence a 95% highest posterior density interval is
Inclusion of endpoints does not change its posterior probability. Every point inside has higher posterior density than every admissible point to its right, and points below have density zero. This is the Pareto highest density interval; equal endpoint densities are unnecessary because one endpoint is the support boundary.
Let . The continuous uniform distribution likelihood contributes , while the Pareto distribution prior contributes . Their product proves Uniform-Pareto conjugacy:
Thus the posterior distribution is Pareto with shape and lower bound . Its density is strictly decreasing on its support, so the highest posterior density interval begins at . Since the upper-tail probability is , the required upper endpoint satisfies . The Pareto highest density interval is therefore
For , the cumulative distribution function is zero. For , integrate the normalized probability density function:
It is continuous at , increases to one, and is the cumulative distribution function of the stated Pareto distribution.
Call the normalization constant to distinguish it from the moment index used later. A probability density function must have total integral one, so
Therefore , the value denoted in the density. This is the Pareto distribution with scale and shape .
For , the event equals . Integrating the Pareto distribution's density gives
The mass formula follows by subtracting consecutive tail probabilities, or by integrating over . With the paper's convention , include the separate endpoint values and , since almost surely. Substituting into the power expression would be invalid.
Power law Created 2026-09-24 Updated 2026-10-13
A power law is a relation , with fixed constants and . For positive , any real number is allowed. Its useful feature is a simple scaling rule:
The same proportional change of input produces the same proportional change of output, independently of the starting value. The exponent controls that response; the coefficient fixes the magnitude.
For example, the area of a circle is . Doubling the radius multiplies its area by four, and tripling it multiplies the area by nine. The volume of a sphere is : the same changes multiply its volume by eight and twenty-seven. The distinction explains why similarly shaped objects do not preserve their ratio of surface area to volume when their size changes.
When the output is positive, a logarithm turns the power law into a straight-line relation. Using positive reference values and ,
These ratios are dimensionless quantities, so the formula also applies to physical measurements with units. Plotting both ratios on a logarithmic scale gives a line of slope . Changing a unit changes the numerical coefficient, while the exponent stays the same. Positive describes increasing values; negative describes decreasing values; gives a constant. The zero coefficient is a degenerate case with no useful logarithmic slope.
Exact scaling is stronger than regular variation. The function has a doubling ratio tending to four, but its logarithmic correction keeps growing. The diagram contrasts it with the exact power law .
Figure 1.
Exact quadratic scaling and a logarithmic correction have different finite doubling ratios, even though the correction leaves the limiting exponent unchanged
. Details.
A power law for a probability density and a power law for a tail probability have different exponents. For a Pareto distribution with and lower endpoint one,
The tail probability has exponent ; differentiating it and changing sign gives the probability density exponent . Confusing them changes the interpretation of a fitted exponent. The normalizing coefficient and lower endpoint also matter: a decreasing power law is not automatically a valid probability density over the entire positive real line.
The appearance of a line over a finite logarithmic range is evidence to investigate, rather than a proof of an exact power law or its mechanism. In their study of power-law distributions, Clauset, Shalizi and Newman combine maximum likelihood estimation, goodness-of-fit tests and comparisons with alternative models; their abstract explains why ordinary least-squares fitting can give misleading results for tail data. See Aaron Clauset, Cosma Rohilla Shalizi and M. E. J. Newman, Power-law distributions in empirical data, SIAM Review 51 (2009), 661–703. The scaling rule is mathematically exact when it defines a model; whether a dataset supports that model is a question of statistical inference.
Power-law distribution 2026-10-14
A power-law distribution uses a power law for a probability mass function or a probability density on a specified range. For a continuous model with on and zero below it, the total integral is finite exactly when . Normalization then requires , giving a Pareto distribution with shape parameter . Discrete models instead normalize a sum. The support and normalizing coefficient are part of the model, and a power law for its tail probability uses a different exponent from its probability density.
By Mark Newman, credited as M. E. J. Newman. Published in Contemporary Physics 46, 323–351 (2005). The inspected arXiv version 3 was revised 29 May 2006; version 1 was submitted 1 December 2004. These preprint dates are distinct from the journal publication year.
Cited passages: §II, pp. 4–5, equations (3)–(5), density and survival exponents and fitting caveat; §III.D, pp. 10–11, equations (24)–(28), fraction of a total held by an upper population fraction. Its density exponent is one greater than the positive survival exponent used for the Pareto distribution.
Regular variation Created 2026-10-05 Updated 2026-10-14
A power law responds to every fixed rescaling by the same factor . Regular variation keeps this scaling behaviour in the limit , while allowing departures from an exact power law. It is useful when the scaling exponent is stable but a smaller correction continues changing. The correction can even grow without bound.
An eventually positive measurable function has regular variation at infinity with index if
The argument is in the domain of a function for sufficiently large . Each is held fixed as the limit is taken; allowing to change with is a different assertion. This is the scalar definition recalled by [ref]. The index is unique: taking determines .
For example, on the function has
Thus has regular variation of index two. Yet : regular variation does not require asymptotic equivalence to a constant times a power law. Doubling gives . At this is approximately , respectively. The ratio approaches four slowly, even though the exponent is exactly two in the limiting scaling law.
Figure 1.
An exact power law has a fixed doubling ratio; a logarithmic correction approaches the same ratio without approaching a constant multiple of that power
. Details.
The slowly varying function isolates this correction. Set . Then
Conversely, multiplying a slowly varying function by gives regular variation of index . Hence the decomposition is exact on its eventual domain of a function; it is the scaling relation, rather than the decomposition itself, that is asymptotic.
A Pareto distribution gives a decreasing example with a direct interpretation. For , take the tail probability . Its regular variation index is . Doubling a threshold divides its tail probability by four, and
For a tail probability with regular variation of index , the same conditional probability tends to . An exponential distribution behaves differently: its corresponding conditional probability is . This comparison explains why scaling limits are useful in extreme value theory; it does not establish that an observed dataset follows a particular tail model. The role of regular variation in heavy-tailed distributions is discussed in Lindskog, Resnick and Roy, introduction, p. 1.
An exponential function is not regularly varying with any finite index: at , , rather than . Boundedness alone is also insufficient, as the oscillating counterexample in slowly varying function shows. Checking a few rescaling ratios at finite arguments can illustrate a proposed law, but cannot prove its limiting definition.
Jovan Karamata developed this theory in his 1930 paper and returned to its fundamental results in 1933. The opening of his 1933 paper identifies the earlier work; pp. 57–58 connect the rescaling limit with a power law and a slowly varying factor. See J. Karamata, Sur un mode de croissance régulière. Théorèmes fondamentaux, Bulletin de la Société Mathématique de France 61 (1933), 55–62. This gives a precise language for “almost a power” without discarding corrections that remain large.
Tail probability Created 2026-10-03 Updated 2026-10-14
For a real random variable , an upper-tail probability has the form and a lower-tail probability has the form . Each is the probability of an event lying beyond a chosen threshold in one direction. A tail probability need not be small: the threshold determines how much of the probability distribution it includes. A concentration inequality bounds such probabilities, often for deviations from an expected value.
Endpoint conventions matter. Write for the cumulative distribution function and . The complement rule of probability gives four distinct formulas:
The strict upper-tail convention is the survival function . Its value differs from the inclusive upper tail probability by exactly the probability mass at the threshold:
A singleton with positive probability mass is an atom of a measure. Thus excludes an atom of a measure at , whereas includes it. These endpoint identities follow directly from the cumulative distribution function properties in Kyle Siegrist, Distribution and Quantile Functions: endpoint probabilities and right tails.
As the threshold increases, both upper tail probabilities are nonincreasing functions. The strict survival function is a right-continuous function; the inclusive upper tail probability takes the upper endpoint value at a downward jump, equal to the left limit of the survival function. Both tend to zero as for a real random variable, but the speed of that decay differs across probability distributions. The cumulative distribution function properties and their proof from continuity of probability measures are given in MIT 6.436J, Lecture 4: random variables and cumulative distribution function properties.
For a fair six-sided die , the discrete uniform distribution assigns probability mass to each of . At threshold four,
Between four and five, both upper tail probabilities equal . At the largest possible outcome the distinction is especially visible: , but . The diagram shows exact probabilities for this mathematical model; its dots specify which endpoints belong to each step function.
Figure 1.
Exact fair-die probabilities: including or excluding a threshold changes the tail by one atom
. Details.
If a probability distribution has a probability density function , then every singleton has zero probability mass and
For an exponential distribution of rate two, for and zero otherwise, so for and for . Hence . This tail probability is an integral of the probability density function, not its height . A mixed probability distribution retains endpoint jumps even with a smooth component: give zero probability mass and choose this exponential distribution with probability . Then , , and for .
A two-sided tail probability can measure the absolute value of displacement from a specified center . For , the two extreme events are disjoint events, so
For strict displacement , replace the last expression by . The condition prevents overlap; at adding inclusive tails double-counts any probability mass at . For a uniform distribution on , take and : the two tail probabilities are each and their sum is . Equal tails follow from this symmetric probability distribution, not from the phrase two-sided alone; for a uniform distribution on with , the two tail probabilities are zero and .
The tail-sum formula for expectation turns a whole curve of tail probabilities into an expected value. For any nonnegative random variable , without assuming a probability density function or a finite expected value,
For a proof outline, write pointwise and exchange the expected value and Lebesgue integral using Tonelli theorem; is an indicator function. The inclusive version has the same Lebesgue integral: positive probability masses occur at only a countable set of thresholds, which has Lebesgue measure zero. For a nonnegative integer-valued random variable , the tail-sum formula instead gives . The integer hypothesis is essential for these sums. The integral identity, its indicator function proof, and the integer version appear in Kyle Siegrist, Additional Properties of Expected Value: integration and summation of right tails.
For the fair die, this tail-sum formula yields , equal to the direct weighted arithmetic mean . For the rate-two exponential distribution, the area under the survival function is , its expected value. The first panel below shades an integral of the probability density function for a single threshold; the second shades an integral of the survival function across all nonnegative thresholds. These are analytical illustrations, with the displayed curves truncated at three; their exact total areas use an infinite integration range.
Figure 2.
Exponential model: one tail probability is density area, while expectation is total survival area
. Details.
Nonnegativity is essential to interpreting the upper tail probability area as : for a general real random variable that area equals the expected value of its positive part. An integrable random variable satisfies , subtracting the expected value of its negative part; infinite terms cannot be canceled. Even when is finite almost surely, its expected value can be infinite. For the shape-one Pareto distribution on , on and for , so the area is . The finite versus infinite expected value distinction is illustrated in Kyle Siegrist, Definitions and Basic Properties: exponential and Pareto expected values.
Why are tail probabilities useful? They answer threshold questions directly, and a concentration inequality can bound them without knowing the full probability distribution. For nonnegative with finite expected value, Markov inequality gives for : a large threshold relative to the expected value forces rarity. The quantile function reverses the question by choosing a threshold for a prescribed cumulative level. If with , then ; an atom of a measure may prevent equality. For the die, , with strict upper tail probability zero and inclusive upper tail probability .
A tail probability describes rarity under a specified probability distribution; it is not automatically a conditional probability after extra information. For with ,
because the threshold events are nested. Thus the die has but . Conditioning changes the sample space and renormalizes its probability measure; the same extreme outcomes can become common in that restricted population.
For target density proportional to on , use the Pareto distribution proposal with . Its density ratio is proportional to , maximized at if that point exceeds . The tight envelope yields the highest acceptance probability for this fixed proposal. An inverse draw is with uniformly distributed on .
Uniform-Pareto conjugacy 2026-10-07
A Pareto distribution prior for the upper limit of independent uniform distributions remains Pareto after observing data. The likelihood adds the sample size to the shape and replaces the lower bound by the larger of the prior bound and sample maximum.
For positive observations and , the Bayesian model evidence follows by integrating the uniform distribution likelihood against a Pareto distribution prior. For independent groups with shared fixed hyperparameters, these evidences multiply. The resulting hyperparameter log likelihood is up to a constant.
For a Pareto distribution of shape three and minimum with count rate , the sum of insurer and reinsurer aggregate variances is for , and for . The first branch has its unique minimum at ; the second is increasing. The branches agree in value and slope at , giving the displayed global minimum. This criterion minimizes the sum of party variances; the total portfolio variance includes their covariance and remains .