Positive difference of independent exponential waiting times Created 2026-10-18 Updated 2026-11-05
Let be independent random variables with exponential distributions of respective positive rates . Condition on and use the survival function of :At this is . Dividing by that probability proves that the positive difference conditional on again has an exponential distribution with rate . The memorylessness of the exponential distribution persists after an independent competing event has already occurred. Replacing the difference by a negative sentinel when adds an atom of a measure of mass at that sentinel without changing the positive tail.
Rayleigh radial thresholds and quantiles 2026-10-18
For , integration gives the survival function and cumulative distribution functionSolving gives the quantile function[ref]
The Rayleigh Distribution. Random: Probability, Mathematical Statistics, Stochastic Processes by Kyle Siegrist; The General Rayleigh Distribution, Distribution Functions: CDF, quantile and survival functions
For the chosen positioning model ,The disk of radius one component standard deviation therefore contains about 39.35% of outcomes; the familiar one-dimensional normal interval percentage does not apply to a two-dimensional disk. The 95% and 99% radial thresholds areA circle defined by itself still has probability zero; its enclosed disk carries the stated probability.
The closed-form quantile function also gives inverse transform sampling: if has uniform distribution on , then has Rayleigh distribution. Using instead gives the same law. Endpoints are excluded so that the logarithm stays finite.
Reliability theory 2026-11-05
Reliability theory uses probability theory and statistical inference to describe whether a component or system continues to perform its specified function. For a nonnegative failure time , its reliability at time is the survival function . If has probability density function , the hazard function describes the instantaneous failure rate conditional on survival, where .
System structure matters. For independent components with reliabilities , a series reliability system fails at the first component failure, so . A parallel reliability system works while at least one component works, so . Two independent components each having reliability therefore give in series and in parallel. These product formulas depend on independence; a common cause of failure can invalidate them.[ref]
Residual lifetime process Created 2026-09-24 Updated 2026-11-05
The residual lifetime process of a renewal process is the time remaining until the next renewal:The time since the last renewal is , and is the length of the renewal interval containing a fixed time. Between renewal epochs, decreases at speed one. On reaching zero it resets to a freshly drawn interarrival time. For strictly positive iid interarrivals, this deterministic motion and independent resetting make a Markov process, even when the count alone is not Markov.
Its initial and equilibrium laws can differ. An ordinary process started at a renewal has . A stationary observation instead has the equilibrium residual-life distribution, whose survival function is the integrated interarrival tail divided by its mean. For deterministic interarrivals of length , the initial residual is , but the equilibrium residual is uniform on . For exponential interarrivals the two laws agree, reflecting the memoryless property.
Right censoring Created 2026-09-24 Updated 2026-10-14
An unobserved survival time is right-censored when it is known to exceed the last event-free follow-up time. For a potential survival time and potential observation-ending time , recordWhen , the occurrence was observed at ; when , only is known. An intact machine at the study's closing date and an event-free subject who stops attending follow-up can both yield right censoring, but the reasons for stopping matter for independent censoring. A subject right-censored at year two has contributed two years to person-time at risk and belongs to earlier risk sets. Neither recording a failure at year two nor discarding that subject preserves this information.
Under independent censoring and separate parameters for the observation mechanism, the part of the survival likelihood involving an absolutely continuous probability distribution for is . Thus a right-censored observation contributes the survival function , rather than the event probability density function . See Lu Tian's Stanford notes, Section 2.1, equations (2.1)–(2.2). The Kaplan–Meier six-subject cohort shows exactly how this distinction changes the calculation.
Right endpoint of a distribution Created 2026-10-05 Updated 2026-10-06
The right endpoint of a distribution with distribution function is , possibly infinite. The survival function is positive below .
Semi-log plot 2026-10-18
A semi-log plot uses a logarithmic scale on one axis and a linear scale on the other. Which axis is logarithmic matters. Plotting against makes positive exponential functions appear as straight lines; plotting against instead makes an affine function of a logarithm appear straight. The plotting operations change positions while retaining the original tick values.[ref]
Log scale. Matplotlib 3.10.7 documentation; Matplotlib 3.10.7, Log scale: Convenience functions semilogx, semilogy, and loglog; distinction between horizontal and vertical logarithmic axes
Take the original dimensionless mathematical model for . It has exponential growth, with , , and . Taking a base-ten logarithm givesThe slope in these transformed positions is , although the original relative growth rate is . Equal steps of two in multiply by . The corresponding ordinary gains increase, so the left plot bends while the right plot is straight.
The same exponential growth model bends on a linear scale and is straight on a semi-log plot with a logarithmic vertical axis
. Original exact mathematical model , not measurements. Both panels show identical values at the same . Right-hand tick labels retain the original values, with equal gaps for each doubling. The stated slope is for , not the original derivative . Details.One practical use is checking a proposed exponential distribution for failure times. For rate and , its cumulative distribution function is , so the reciprocal survival function satisfies . Estimated probabilities can therefore be placed on a logarithmic vertical axis and compared with a straight line. Agreement supports compatibility with the chosen statistical model; a roughly straight finite sample does not establish a unique physical mechanism.[ref]
8.2.2.1. Probability plotting. NIST and SEMATECH e-Handbook of Statistical Methods, §8.2.2.1 Probability plotting: Exponential Model, logarithmic vertical-axis transformation and interpretation of approximate straightness
Survival analysis Created 2026-09-24 Updated 2026-10-13
Survival analysis studies the probability distribution of a survival time: how long from a specified starting point until a specified occurrence. The occurrence need not be death. It might be a machine's first breakdown, a customer's first renewal, or a person's recovery. The meaning of "survival" is simply that the chosen occurrence has not happened yet. Both the starting point and the outcome must be defined before interpreting a survival function.
The distinctive difficulty is incomplete observation. A machine still working when observation stops supplies a lower bound on its survival time, rather than an observed breakdown time. Right censoring lets us retain that information. The Kaplan–Meier estimator estimates a survival function using the changing risk sets, without choosing an exponential distribution or another particular survival distribution. A hazard function instead describes the current event rate among those still event-free; its cumulative hazard connects those local rates to the whole survival function.
This framework turns different follow-up lengths into usable evidence about waiting times. It supports questions such as the chance of remaining event-free for another year, or the restricted mean survival time within an observed horizon. Lu Tian's Stanford teaching materials introduce these interpretations in Survival Distributions, Hazard Functions, Cumulative Hazards, Section 1.1.
Survival function Created 2026-09-24 Updated 2026-10-14
For a nonnegative survival time , the survival function iswhere is the cumulative distribution function. Thus is the probability that the chosen occurrence is still in the future at time . We consistently use the strict inequality : a probability mass at has already left the survival function at itself. With this convention is a right-continuous function and a nonincreasing function taking values in . If , then ; if is finite with probability one, then as .
For and , conditional probability givesFor example, and mean that of those still event-free at year two remain event-free through year five. Their intervening event probability is , whereas the original population's probability of an occurrence in is . Conditioning changes the denominator.
The area under the survival function up to a horizon gives the restricted mean survival time. A positive terminal plateau in a plotted Kaplan–Meier estimator does not establish that the occurrence will never happen: terminal censoring and survival-mean identifiability explains why the unobserved tail remains undetermined.
Survival likelihood Created 2026-09-24 Updated 2026-11-05
For a continuous event time with probability density function , survival function and hazard function , right censoring records and . Suppose and are conditionally independent given the observed covariates, suppressed here. Write and for the censoring-time probability density function and survival function. The joint observed-data likelihood contribution isAn event contributes its event-time probability density function times the probability of remaining uncensored until then. A censored observation contributes its censoring-time probability density function times the probability of remaining event-free until then.
If the censoring model has separate parameters with no constraints linking them to , its factor can be omitted when maximizing over . The event-model part for independent subjects is thenwhere is the cumulative hazard function. Independent censoring alone does not permit dropping a censoring term that itself contains the event-model parameters. The familiar event-versus-censoring formula is thus a factorization under an ignorable observation mechanism, rather than an unconditional rule for every missing event time.[ref]
Survival time Created 2026-10-06 Updated 2026-10-07
A survival time is the elapsed time to an event of interest, which may be death, failure, recovery or completion of a task. Its survival function and hazard function describe the event-time law. Right censoring records only that the event time exceeds the observed follow-up time.
A switching-current distribution of a Josephson junction records the bias electric current at the first detected transition to a sustained nonzero electric potential difference. Interpret it using a stipulated monotone ramp , a reproducible initial trapped state, and an instantaneous escape hazard function . Neglect retrapping and readout delay. The survival function obeys , so changing variable from time to electric current givesHere is a probability density function per unit electric current, not a rate per unit time. Division by the surviving population is essential: only trials still trapped can escape. A typical switching current is consequently not identical to the noiseless superconducting critical current.
For an independent illustrative check, choose constant and . ThenHalf the trials have switched after , corresponding to of ramp. Doubling doubles the mean increment without changing the underlying escape rate. Real junction rates vary sharply with bias; this example isolates the statistical conversion.
Repeating the preparation, measuring the ramp, resolving the voltage onset, and allowing cooling after each dissipative event are prerequisites for this interpretation. Missed events, finite detection delay, changing temperature and retrapping alter the measured distribution. Even a correctly reconstructed rate needs the independent thermal and spectral checks before identifying its escape mechanism.
Tail probability Created 2026-10-03 Updated 2026-10-14
For a real random variable , an upper-tail probability has the form and a lower-tail probability has the form . Each is the probability of an event lying beyond a chosen threshold in one direction. A tail probability need not be small: the threshold determines how much of the probability distribution it includes. A concentration inequality bounds such probabilities, often for deviations from an expected value.
Endpoint conventions matter. Write for the cumulative distribution function and . The complement rule of probability gives four distinct formulas:The strict upper-tail convention is the survival function . Its value differs from the inclusive upper tail probability by exactly the probability mass at the threshold:A singleton with positive probability mass is an atom of a measure. Thus excludes an atom of a measure at , whereas includes it. These endpoint identities follow directly from the cumulative distribution function properties in Kyle Siegrist, Distribution and Quantile Functions: endpoint probabilities and right tails.
As the threshold increases, both upper tail probabilities are nonincreasing functions. The strict survival function is a right-continuous function; the inclusive upper tail probability takes the upper endpoint value at a downward jump, equal to the left limit of the survival function. Both tend to zero as for a real random variable, but the speed of that decay differs across probability distributions. The cumulative distribution function properties and their proof from continuity of probability measures are given in MIT 6.436J, Lecture 4: random variables and cumulative distribution function properties.
For a fair six-sided die , the discrete uniform distribution assigns probability mass to each of . At threshold four,Between four and five, both upper tail probabilities equal . At the largest possible outcome the distinction is especially visible: , but . The diagram shows exact probabilities for this mathematical model; its dots specify which endpoints belong to each step function.
If a probability distribution has a probability density function , then every singleton has zero probability mass andFor an exponential distribution of rate two, for and zero otherwise, so for and for . Hence . This tail probability is an integral of the probability density function, not its height . A mixed probability distribution retains endpoint jumps even with a smooth component: give zero probability mass and choose this exponential distribution with probability . Then , , and for .
A two-sided tail probability can measure the absolute value of displacement from a specified center . For , the two extreme events are disjoint events, soFor strict displacement , replace the last expression by . The condition prevents overlap; at adding inclusive tails double-counts any probability mass at . For a uniform distribution on , take and : the two tail probabilities are each and their sum is . Equal tails follow from this symmetric probability distribution, not from the phrase two-sided alone; for a uniform distribution on with , the two tail probabilities are zero and .
The tail-sum formula for expectation turns a whole curve of tail probabilities into an expected value. For any nonnegative random variable , without assuming a probability density function or a finite expected value,For a proof outline, write pointwise and exchange the expected value and Lebesgue integral using Tonelli theorem; is an indicator function. The inclusive version has the same Lebesgue integral: positive probability masses occur at only a countable set of thresholds, which has Lebesgue measure zero. For a nonnegative integer-valued random variable , the tail-sum formula instead gives . The integer hypothesis is essential for these sums. The integral identity, its indicator function proof, and the integer version appear in Kyle Siegrist, Additional Properties of Expected Value: integration and summation of right tails.
For the fair die, this tail-sum formula yields , equal to the direct weighted arithmetic mean . For the rate-two exponential distribution, the area under the survival function is , its expected value. The first panel below shades an integral of the probability density function for a single threshold; the second shades an integral of the survival function across all nonnegative thresholds. These are analytical illustrations, with the displayed curves truncated at three; their exact total areas use an infinite integration range.
Nonnegativity is essential to interpreting the upper tail probability area as : for a general real random variable that area equals the expected value of its positive part. An integrable random variable satisfies , subtracting the expected value of its negative part; infinite terms cannot be canceled. Even when is finite almost surely, its expected value can be infinite. For the shape-one Pareto distribution on , on and for , so the area is . The finite versus infinite expected value distinction is illustrated in Kyle Siegrist, Definitions and Basic Properties: exponential and Pareto expected values.
Why are tail probabilities useful? They answer threshold questions directly, and a concentration inequality can bound them without knowing the full probability distribution. For nonnegative with finite expected value, Markov inequality gives for : a large threshold relative to the expected value forces rarity. The quantile function reverses the question by choosing a threshold for a prescribed cumulative level. If with , then ; an atom of a measure may prevent equality. For the die, , with strict upper tail probability zero and inclusive upper tail probability .
A tail probability describes rarity under a specified probability distribution; it is not automatically a conditional probability after extra information. For with ,because the threshold events are nested. Thus the die has but . Conditioning changes the sample space and renormalizes its probability measure; the same extreme outcomes can become common in that restricted population.
Tail-sum formula Created 2026-09-24 Updated 2026-10-18
The tail-sum formula expresses an expected value as the area under a survival function. For every nonnegative random variable ,This Lebesgue integral and the expected value may both be ; a probability density function is unnecessary. For a random variable taking values in the nonnegative integers, the corresponding sum isThe events and coincide because takes integer values. Thus the strict sum starts at zero, while the inclusive sum starts at one.[ref]
Random: Probability, Mathematical Statistics, Stochastic Processes by Kyle Siegrist. Expected Value, §2 Additional Properties, Right Distribution Function: nonnegative tail integral and integer-valued tail sums
For an original example, let the probability mass function of beIts expected value computed directly is . The strict tail probabilities at thresholds are : their sum is again . There is no probability mass at two, yet the event still has probability . The survival function has heights on the successive intervals ; each interval has length one, so its integral is the same sum.
The same expected value from probability masses and survival columns
. The exact constructed probability mass function assigns to . The contribution appears in one survival column, while the contribution appears in three. Filled endpoints give the strict survival function at its jumps; open endpoints show the preceding height. The shaded area is . Details.The indexing matters numerically. Starting the inclusive sum at zero adds , giving for this example. Starting the strict sum at one omits , giving . For a general nonnegative random variable, replacing with inside the integral is harmless: the difference is , nonzero at only a countable set of thresholds. For each positive integer , at most thresholds can have probability mass at least ; their countable union contains all thresholds with positive probability mass and has Lebesgue measure zero. This reasoning concerns an integral, not equality of the two survival function conventions at every point.
For a continuous original example, take the uniform distribution on the interval . Its survival function is for and zero for . The area is a triangle of base four and height one:Directly integrating against the probability density function gives the same expected value, . The integral of the probability density function alone is one; it is the survival function whose area is the expected value.
The proof counts layers of each outcome. For a realized value , the indicator function equals one over an interval of length , soTonelli theorem permits the interchange because the indicator function is nonnegative; no finite expected value is assumed. Similarly, an outcome contributes one indicator random variable for each of the events that occur:Again Tonelli theorem applies to the nonnegative sum, or equivalently the monotone convergence theorem applies to its partial sums. This exchanges counting layers within each outcome with averaging across outcomes. The existing integer-valued hypothesis in the tail-sum formula explains what changes when the values are not integers; the tail integral formula for moments weights the layers to obtain higher moments.
For an integrable random variable that can have either sign, apply the nonnegative formula separately to its positive part and negative part :Integrability makes both integrals finite. More generally the difference defines an extended expected value when at least one is finite; if both are infinite, subtraction does not define an expected value.[ref]
Random: Probability, Mathematical Statistics, Stochastic Processes by Kyle Siegrist. Expected Value, §2 Additional Properties, A General Definition: positive and negative parts and the condition on their expectations
Tail probabilities are often easier to measure or bound than a whole probability density function. For a device's survival time, the survival function records the probability of still operating at each threshold; its integral gives the mean operating time. A finite observation window naturally gives the expected value of a capped nonnegative random variable. For a mathematical bound, for all implies . The tail-sum formula turns control of a whole family of events into control of an average.
Two-stage Euler-Lotka equation 2026-10-25
For serial stages with survival functions , set . If completion of stage two produces new stage-one individuals, a common exponential mode requires . Indeed its age profiles are , while the incoming fluxes give and . Cancelling nonzero amplitudes proves the equation. Under ordinary positive residence-time assumptions a positive root exists exactly when . The normalized profiles are .
Von Mises conditions for extreme values Created 2026-10-05 Updated 2026-10-14
For an absolutely continuous distribution function with positive probability density function near its right endpoint of a distribution, write for its hazard function. The limits at an infinite endpoint or at a finite endpoint imply attraction to the Fréchet distribution or negative Weibull distribution, respectively. A continuously differentiable reciprocal hazard function with implies attraction to the Gumbel distribution, provided the survival function tends to zero at the endpoint.
Waiting-time distribution Created 2026-10-25 Updated 2026-11-05
A waiting-time distribution is the probability distribution of a nonnegative random duration until a specified event. It can be discrete, absolutely continuous, or mixed. Its survival function is and its cumulative distribution function is .
If the finite-time law is absolutely continuous, the probability density function is almost everywhere. Mere continuity of the cumulative distribution function is insufficient for this density representation. At times with positive survival, the hazard function is ; it measures the instantaneous event rate conditional on having waited that long.
Constant hazard with gives , the exponential distribution. Waiting a discrete number of independent Bernoulli trials instead gives a geometric distribution. A fixed deterministic wait has a point mass at its prescribed duration rather than an ordinary density.
Sequential independent waiting stages add, so their probability distributions combine by convolution. The two-step catalytic waiting time gives a concrete chemical-kinetics example. Waiting-time distributions also describe first-passage times and time-to-event observations in survival analysis.
Weibull distribution Created 2026-09-24 Updated 2026-11-05
The two-parameter Weibull distribution is a positive lifetime model with shape and scale . Its Probability density function and Survival function areIts Cumulative distribution function is . The Hazard function is : it decreases for , is constant for , and increases for . This permits decreasing or increasing failure rates within one family.[ref]
The mean is and the variance is . The substitution reduces the power-moment integrals to gamma integrals. At the law is exponential with rate ; at its survival is .
Inverse transform sampling is explicit: for uniform on , take . Conditional survival after an already attained age is , which depends on unless . This is why an Unknown entry age in a Weibull survival segment affects the likelihood. The scale parameter here is ; inverse-scale parameterizations instead use its reciprocal.
Zeta bounds from rounded Pareto variables Created 2026-10-25 Updated 2026-11-05
Let have survival function for , with . Its expected value is . The tail-sum formula for expectation givesThe absolutely continuous probability distribution gives zero mass to the integers, so almost surely and . Taking expectations of gives , which rearranges to the displayed bounds on the Riemann zeta function. Finiteness is justified by and .






