Truncated distribution Created 2026-09-24 Updated 2026-11-05
A truncated distribution is the conditional probability distribution obtained by restricting a random variable to a specified event with positive probability. If its original law is , the truncated law isThe denominator renormalizes the retained probability mass to one. If has a probability density function , the truncated density is ; the same restriction and normalization apply to a probability mass function.
For example, truncate a uniform distribution on to values at least six. The retained event has probability , so the new density is on , and its mean is eight. This is the law obtained by repeatedly sampling from the original law and rejecting values outside the retained set; rejection sampling becomes inefficient when the retained event is rare.
A zero-probability restriction cannot be normalized by the displayed formula. Conditioning a continuous random variable to equal a specified value requires an additional conditional-law construction or limiting convention, rather than division by zero.
Type (information theory) Created 2026-09-24 Updated 2026-10-14
A type summarizes a string by how often each symbol occurs. Fix a finite alphabet of cardinality and a positive length . For a string , its empirical distribution is the probability mass functionThe empirical distribution forgets order. The strings and both assign probability to each binary symbol; assigns to zero and to one. Thus a long string can have a short summary even though that summary does not reconstruct the original order.
For independent and identically distributed symbols, this loss of order has a useful consequence: all strings with the same empirical distribution have the same probability. The method of types uses this symmetry to turn questions about exponentially many strings into counting questions about relatively few frequency profiles.[ref]
The Method of Types by Imre Csiszár. §I, printed p. 2505: partition by empirical distribution and equiprobability under a memoryless model
Unimodal distribution 2026-11-05
A unimodal distribution, under the density or mass-function convention, has probabilities that rise toward one central region and then fall away. For an absolutely continuous probability distribution, this means it has a probability density function that is nondecreasing up to a mode and nonincreasing afterward. This is the single-maximum meaning of unimodality; the chosen density is a one-dimensional quasiconcave function. A plateau of maximizing points is allowed.
For a discrete original example on outcomes0,1,2and3, choose probabilities0.1,0.4,0.4and0.1. The probability mass function rises, has two adjacent maximizing values, then falls. It is unimodal under the weak monotonicity definition despite not having a unique mode. In contrast, separated high-probability regions with a genuine dip between them are not one mode plateau.
Unimodality does not imply symmetry or equality of arithmetic mean, median and mode. For the exponential distribution with density on , , the mode is0, the mean is and the median is . The density decreases from its boundary maximum. The NIST handbook gives the family and these summary characteristics, using a scale parameter reciprocal to this rate parameter.[ref]
Exponential Distribution in the NIST e-Handbook. §1.3.6.6.7, Probability Density Function and summary statistics
Nor is unimodality generally preserved by a mixture distribution. Equal mixing of uniform distributions on and gives density1/2 on those two intervals and zero in between. Each component has a flat unimodal density, while the mixture has separated peaks.
A density is defined only up to changes on sets of measure zero. Thus the distributional statement concerns existence of a representative with the required shape, rather than artificial isolated spikes added to one displayed formula. In higher dimensions, several notions of unimodality are used; one convex-level-set formulation requires convex superlevel sets, as in the quasiconcave function definition.[ref] The shape convention should be specified before extending a one-dimensional conclusion to another setting.
Weakly typical sequence Created 2026-10-05 Updated 2026-10-14
For an IID random variable source with probability mass function , a word is weakly typical when . It has probability on the scale . The weak law of large numbers makes the typical set probable, but does not make every word in it representative: for a uniform source every possible word is weakly typical.
Zero-truncated Poisson distribution 2026-10-05