Let , , and let be the cumulative distribution function of . Since the prime omega function is integer-valued, is constant on every half-open interval between consecutive points of the lattice .
Choose and put , . Then , and has the same value throughout . The standard normal distribution function is continuous, so the definition of the Kolmogorov distance gives
where the second inequality follows by taking a limit from below at . The triangle inequality therefore yields
Thus the integer lattice forces the lower bound:
This lattice obstruction to normal approximation does not require a quantitative Erdős-Kac theorem; it follows directly from discreteness and the positive standard normal density near zero.
Fix the normalization
The Lasso penalty uses the L1 norm. All arguments below apply to every minimizer; uniqueness of the coefficient vector is not assumed.
The Karush-Kuhn-Tucker conditions are the subgradient optimality condition
These conditions are necessary and sufficient because the objective is a convex function. They use the subgradient of the absolute value, coordinate by coordinate.
Put . Centered columns imply , so the subtraction of in the model contributes nothing to the score. The Karush-Kuhn-Tucker conditions become
Multiply by . Since and , this gives the prediction inequality from Lasso stationarity:
This is the desired version of the Basic inequality for the Lasso. Using stationarity directly preserves the coefficient on the squared prediction norm.
For the Gaussian score event for the Lasso, write for column . The assumed Euclidean norm and the multivariate normal distribution of give
The may be correlated, which does not affect the union bound. Use the following sharp two-sided Gaussian tail bound, valid for with the standard normal distribution and every :
For completeness, the difference satisfies , , and as . It first increases and then decreases to zero, so it is nonnegative. This bound avoids introducing an unnecessary factor two.
Here is the standard normal distribution function. With , the union bound yields
Consequently
The score event uses the supremum norm of ; the centering term still vanishes because .
We next work deterministically on . Let
By Holder inequality, . Since , the triangle inequality gives
Substituting both inequalities into the Basic inequality for the Lasso produces
Because , this also proves the relevant Lasso cone condition, . The assumed Compatibility condition for the Lasso therefore applies to :
Set . Combining these inequalities gives
If , discarding the nonnegative term shows . If , compatibility gives , and the preceding inequality then gives . In either case , so
This is a fast prediction bound and an inactive-coordinate error bound on the same event. It is the fast-rate Lasso prediction bound under compatibility.
Finally, the same argument bounds the active-coordinate L1 norm by
If , then , and . When this implies ; when it implies . Thus the sign function obeys
This is Lasso sign recovery under compatibility. It concerns the sufficiently large nonzero coefficients; it does not assert that every estimated inactive coefficient is zero.
Couple the Wald test statistics as , where the joint centered bivariate normal distribution of is fixed. Increasing either enlarges, pointwise in this coupling, the event . Its probability is consequently nondecreasing in each treatment effect.
If both null hypotheses hold, then , so this probability is maximal at the joint boundary . To check the familywise error rate across all configurations, suppose only hypothesis is true. A type I error then occurs only if , with probability at most , where is the standard normal distribution function. This is no larger than the any-rejection probability at , since that joint event contains . If neither null hypothesis is true, the familywise error rate is zero. Hence the least-favourable null configuration for type I error is
where is the centered bivariate normal distribution function with correlation coefficient .
For , the Brownian reflection principle gives, for ,
where is the standard normal distribution function. Hence almost surely; for , .
For , use the Exponential martingale for Brownian motion . At , it is bounded by because before the first hit and by continuity. The bounded optional stopping theorem gives . Its limit is , and the dominated convergence theorem yields . Equivalently, the Brownian first-passage Laplace transform is
Taking proves the displayed exponential identity. The cases and are included. The restriction is what gives the upper bound on the stopped exponential.
Put , the uniform bound on the supremum norm of the gradient. The fundamental theorem of calculus on a line segment, together with the inner product inequality , gives
Thus is Lipschitz continuous with respect to the L1 norm. The Gaussian random variables comprising and have finite exponential moments of their absolute values. More explicitly, for , Hölder's inequality gives . Consequently and every exponential expression below are finite, including when the covariance matrix is singular.
Use the convex function . Since is an independent copy of , Jensen inequality for the conditional expectation gives
For , define the Gaussian rotation of independent copies
Writing , both rotated covariance matrices are and their cross-covariance is zero. The pair has a centered multivariate normal distribution, so its components are independent and has the same probability law as . This calculation uses no inverse of and therefore also proves the assertion for degenerate multivariate normal distributions.
The path runs from to . The chain rule and the fundamental theorem of calculus give the pathwise identity
Apply Jensen inequality to the uniform probability measure on . Then use Tonelli theorem and the Gaussian rotation of independent copies to obtain
This proves the Gaussian rotation interpolation inequality in the required form:
The stated almost-sure domination now gives an exponential moment of an absolute standard normal variable bound. If , completing the square in the standard normal density yields
where is the standard normal distribution function. Hence Markov inequality gives, for every ,
The exponent is minimized at . Therefore the resulting Gaussian tail bound is
No independence of from or is needed: only the given almost-sure domination is used.
Let , with three independent standard Brownian motions, and set and . The radial stochastic process is a three-dimensional Bessel process, which never hits zero by the Hitting-zero classification for a Bessel process. In three dimensions is a harmonic function away from zero: direct differentiation gives .
For the stopping times , , the Itô formula gives
The coefficients are bounded by , so each stopped Itô integral is a true martingale on every finite horizon. The stopping times form a localizing sequence; as permitted, its divergence need not be proved here. Thus is a nonnegative continuous local martingale.
To see that is not a true martingale, integrate the three-dimensional multivariate normal density of in spherical coordinates. The angular integral yields
where is the standard normal distribution function. Therefore the reciprocal of a three-dimensional Bessel process is a strict local martingale.
Put
The call payoff is , and it is positive when
Writing for the standard normal density, the given risk-neutral pricing formula becomes
Completing the square gives
so the two tail integrals are and , where is the standard normal distribution function. Therefore the Black-Scholes formula is
The payoff identity
replicates the call-minus-put position by one stock and borrowing the present value of . Hence put-call parity gives
and therefore
Let and . Split the crossing event according to its endpoint:
Under the Cameron-Martin theorem for a linear drift, the law of relative to standard Wiener measure has endpoint density
On paths that cross and end at , the Brownian reflection principle reflects the path after its first hit of and changes the endpoint to . Under this reflection the density becomes
The remaining exponential is the Cameron--Martin density for drift . Therefore
where the last equality uses the symmetry of the normal distribution. Subtracting the crossing probability from one gives
Equivalently, in terms of the standard normal distribution function,
This is the finite-horizon maximum of Brownian motion with negative drift formula.
The central limit theorem states that if are independent and identically distributed random variables with finite mean and finite positive variance , then
Here the arrow means convergence in distribution: for every real , the probability that the expression on the left is at most tends to , the standard normal distribution function. If , the variables equal almost surely and their sample mean is exactly .
Write for the standard normal distribution function. Integrating out the twenty independent past durations gives the threshold-censored normal likelihood
The frequencies are those in part (a). For a future day, the conditional late-arrival probability is . Conditional independence of the five future durations gives .
Exactly three primitive random coordinates suffice. Draw from the same priors and one independent . Reject if ; otherwise return whether . Conditional on acceptance and the parameters, is uniform on an interval of length ; the true-answer subinterval has length . Reusing this same uniform value is therefore intentional, not an independence mistake.
Indeed the two output contributions at each parameter value are
These are exactly the contributions obtained by integrating the original twenty-five duration noises. Multiplication by the common prior density and normalization therefore give the same joint posterior distribution of . The revised program preserves the query and parameter posterior, but does not retain individual latent durations. This is uniform-interval encoding of conditioning and a binary query.
Here is an executable version, reusing the definitions from part (a). Logarithms avoid multiplying many small probabilities.
def normal_logcdf(z):
    value = 0.5 * math.erfc(-z / math.sqrt(2.0))
    return math.log(value) if value > 0.0 else -math.inf

def journey_loglik(mu, sigma):
    return (sum(n * normal_logcdf((mu - c) / sigma)
                for c, n in LATE.items())
            + sum(n * normal_logcdf((c - mu) / sigma)
                  for c, n in EARLY.items()))

def collapsed_trace(rng):
    mu = rng.uniform(0.0, 60.0)
    sigma = rng.uniform(1.0, 20.0)
    log_likelihood = journey_loglik(mu, sigma)
    # This uniform lies in (0, 1], avoiding log(0).
    log_u = math.log(1.0 - rng.random())
    if log_u >= log_likelihood:
        return None
    log_h = 5.0 * normal_logcdf((mu - 30.0) / sigma)
    return log_u < log_likelihood + log_h
accepted_average(collapsed_trace, n, rng) consequently has the same target as the original program. The ideal three-dimensional sample space is with product uniform probability measure, conditioned on the displayed acceptance event. Finite-precision normal tails can underflow to zero in this simple implementation; the mathematical equivalence concerns exact probabilities, and the numerical check in part (d) independently integrates the likelihood in the region carrying appreciable posterior mass.
Let be real independent and identically distributed random variables with finite expected value and variance . The central limit theorem states
Equivalently, the cumulative distribution functions of these normalized sums converge at every real point to the standard normal distribution function. The theorem itself does not require a finite moment-generating function.
Select units with first reading , keep that membership fixed, and measure the same units again. The first reading now has a truncated normal distribution. For a general finite threshold , write for the standard normal density and for the standard normal distribution function. Since ,
The tower property of conditional expectation lets us average the line over the selected group.[ref] At this gives
The average second reading is below the selection threshold even though every selected first reading exceeded it. This is a group expectation; any finite generated group's sample mean fluctuates around it. Selecting again on would define a different group and answer a different question.
The latent variable decomposition makes the apparent drop especially clear. Gaussian conditioning gives and . Thus
The first measurement error has zero unconditional mean, but positive selected mean. The second measurement error stays centered because it is independent of selection on . The persistent signal never changed.
Figure 1.
Selection captures an extreme first error while the persistent signal stays fixed
. Original synthetic repeated measurements, not actual measurements. Left: 40 generated units selected by ; orange trajectories move farther from zero. Right: analytic selected-group expectations decompose the first and second readings into persistent latent variable and measurement error. Black dots give generated group sample means after selecting from 60,000 synthetic units; their small departures from the bar totals reflect sampling variation. All selections use the first reading only. Details.
Standard normal distribution Created 2026-09-24 Updated 2026-10-14
The standard normal distribution is : the normal distribution with mean zero, variance one and standard deviation one. Its standard normal density integrates to one; its standard normal distribution function records the area accumulated from to a threshold. The distinction matters: , , and for a standard normal random variable .
For a toy measurement , leave the measurement unit unspecified. The standardization of a normal random variable converts into standard scores . Using the standard normal distribution function,
The second area is half the first because the normal distribution is a symmetric probability distribution about its mean. The numerical heights differ: , yet the corresponding shaded areas are equal because in the change of variables.
Figure 1.
Standardization changes density heights and coordinates but preserves probabilities
. The same toy normal distribution is shown before and after standardization of a normal random variable. The blue and orange areas together have probability approximately ; the orange area alone has probability approximately . The threshold becomes standard score . Each probability density function has total area one over the whole real line; a single outcome has zero probability. Details.
Standard normal distribution function Created 2026-09-24 Updated 2026-10-14
The standard normal distribution function is the cumulative distribution function of a standard normal random variable :
Here is the standard normal density and is the error function. The symmetric probability distribution gives and , while differentiation gives . For with , standardization of a normal random variable gives ; subtracting two values calculates an interval probability.
Suppose conditionally independent latent values have normal distribution , with , but the observation only says which side of a known threshold contains each value. With for a value above the threshold and for a value below, the likelihood is the displayed product, where is the standard normal distribution function. Repeated thresholds give corresponding powers. These factors are tail probabilities, not probability densities evaluated at the thresholds. Multiplying normal densities at would describe a different observation process. The thresholds must be treated as fixed or otherwise modelled appropriately; informative selection of thresholds can change the likelihood.
Truncated lognormal moment Created 2026-10-06 Updated 2026-10-25
If with , and having the standard normal distribution, then for every real ,
Here is the standard normal distribution function. Multiplying the normal distribution density by and completing the square shifts its mean by and supplies the factor ; this is a Gaussian exponential tilt. Integrating above or below the shifted threshold proves both formulas. They apply to noninteger and negative powers, including the inverse-price moment . The lower-tail formula gives the European power put formula after a binomial theorem expansion.
Up-and-out power claim 2026-10-14
An up-and-out power claim pays a power of the terminal stock price provided an upper barrier has never been reached. In the Black-Scholes model, set and , where , and . The risk-neutral pricing value is
Here is the standard normal distribution function. Weighting the Brownian motion endpoint by changes the logarithmic drift to ; the finite-horizon maximum of Brownian motion with drift then supplies the survival factor.