A map is Hadamard differentiable at if there is a continuous linear functional such that, whenever with , in , and ,
For tangential Hadamard differentiability, the limit directions are restricted to a specified tangent subspace and the derivative is continuous linear on that subspace. The domain condition is indispensable.
Assume almost surely and use the usual measurable, separably supported setting for norm-valued convergence in distribution, with the limit in the tangent space. The functional delta method gives
To justify this by Skorokhod representation theorem, a sufficient precise version is: for weakly convergent random elements in a separable complete metric space, one can construct copies of the whole sequence and its limit on one probability space which converge almost surely in the metric. More generally the separable-limit-support version of the representation theorem can be used. Apply it to , obtaining almost surely. The variables have the same laws as and lie in on a common probability-one event. The definition of Hadamard differentiability, with , gives convergence almost surely of the transformed quotients to , and hence the claimed convergence in distribution. If is a Gaussian measure, the limit is Gaussian because the derivative is linear. Without membership of in , the expression in the question is not defined.
The final function space is with supremum norm; it is not separable as a whole. This does not affect the deterministic differentiability proof below. Any statistical application of the preceding representation argument must use its separability or tightness hypotheses, rather than assuming that every normed space automatically satisfies them.
Fix admissible and set . The candidate derivative, defined even for continuous directions without derivatives, is
This follows formally from the product rule and integration by parts. We now establish the uniform-direction limit required by Hadamard differentiability.
Let and belong to the stated domain, with , in supremum norm. The domain gives and , while uniformly. We first claim that, for every continuous on ,
For a continuously differentiable test function , integration by parts gives convergence directly from uniform convergence of : both boundary terms and converge. By the Weierstrass approximation theorem, approximate uniformly on by a polynomial . The difference between the two integrals introduced by this approximation is at most , by the uniform bounded variation bounds. Letting the approximation error decrease proves the claim. This is weak convergence of bounded-variation integrators.
Now decompose the quotient in the order that retains the bounded-variation bound:
The first term differs from by at most , so it tends to . For the second term, integration by parts yields
which tends to the corresponding expression with . Hence the quotient tends to for every admissible perturbation sequence. Finally,
This proves that the derivative is a continuous linear functional on the product space. Therefore is Hadamard differentiable at every point of the stated domain. The bounded-variation restriction is what controls the apparently dangerous interaction between uniformly small perturbations and possibly large perturbation derivatives; no convergence of or has been assumed.
A non-degenerate probability distribution is not concentrated at a single point. In extreme value theory, a non-degenerate distribution function is max-stable if, for each integer , constants satisfy for every . This says that a normalized sample maximum has the same law as one observation. A distribution function belongs to the maximum domain of attraction of a non-degenerate if there are such that
at every continuity point of . Equivalently, has convergence in distribution to .
The extremal types theorem says that any such non-degenerate limit is max-stable and, up to a positive affine change of variable, is exactly one of the following:
These are respectively the Gumbel distribution, Fréchet distribution, and negative Weibull distribution. The theorem is also known as the Fisher–Tippett–Gnedenko theorem.
Useful sufficient conditions can be expressed using the survival function and the right endpoint of a distribution . An infinite endpoint with for every gives the Fréchet distribution domain. A finite endpoint with as gives the negative Weibull distribution domain. For the Gumbel distribution, it suffices that a positive Gumbel auxiliary function gives for every real as . These are regular variation and exponential tail-ratio conditions; they need no proof here.
In case (i), on , so the finite-endpoint ratio is exactly . Therefore the domain is negative Weibull with shape . With and ,
and the limit is one for .
In case (ii), has exponential tail ratio with the constant Gumbel auxiliary function . Therefore the domain is Gumbel. Choosing and gives
In case (iii), has regular variation of index , so the domain is Fréchet with shape . The convenient choices and give
with limit zero for .
Finally, define the empirical distribution function . On a sample with positive threshold and exactly observations strictly above , its survival function has . Using the Tonelli theorem to integrate the finite nonnegative sum gives
This is the Hill estimator as an empirical plug-in version of the tail-integral limit. It does not prove consistency for fixed ; that is a separate issue.
There is a finite-sample qualification because the question permits ties and does not assume positive observations. The formula requires and . If because the threshold is tied, direct substitution gives
where terms equal to the threshold contribute zero. This is generally times the displayed Hill estimator, rather than the same estimator. If , the empirical plug-in denominator is zero. For a continuous probability distribution the no-tie condition holds almost surely; for a Fréchet distribution domain and fixed , the threshold is positive with probability tending to one. Thus the stated plug-in identity holds at a positive untied threshold, and the literal claim for all samples from an arbitrary distribution function needs this qualification.
First, convergence in probability at gives almost surely, since every . For any finite set of times, the corresponding vectors converge in probability: the union bound controls the probability that any coordinate differs by more than a fixed tolerance. The same holds for their increment vectors, hence also for their convergence in distribution.
For , set and . The characteristic function of a random vector factors for the independent increments of each :
Pass to the limit using convergence in distribution and bounded continuous functions. The resulting factorization of the characteristic function of a random vector, with the uniqueness theorem for characteristic functions, proves independence of the . Similarly passes to the limit, proving stationary increments for .
It remains to prove stochastic continuity. For , the triangle inequality and the union bound imply, for every fixed ,
The second term vanishes by stochastic continuity of . Now let and use the additional near-zero approximation hypothesis. We obtain in probability as . The stationary increments transfer this to every time: both and have the law of for when defined. Thus has all the intrinsic Lévy process properties, proving closure of Lévy processes under locally controlled convergence in probability.
If one requires the supplied process itself to be càdlàg, the hypotheses justify a càdlàg modification, rather than that stronger pathwise assertion. To see the distinction, take , let have uniform distribution on , and put . At each fixed time , almost surely, so both approximation hypotheses hold with zero error probability. Nevertheless every path has an isolated spike at and is not right-continuous there. Its identically zero modification of a stochastic process is a Lévy process with càdlàg paths. The conclusion is exact under the intrinsic definition, and exact up to modification under the convention requiring càdlàg paths.
One general form of the Erdős-Kac theorem is the following. Let be a real strongly additive arithmetic function, with for all primes, and define
If , then under the discrete uniform distribution on ,
Here the arrow denotes convergence in distribution and is the standard normal distribution. Equivalently, the probability of being at most tends to the standard normal distribution function for every real . Replacing by is equivalent, because the difference is bounded by .
This is a general bounded-prime-weight form, not just the special case . In that case the Mertens theorem for reciprocal primes gives and , so the classical prime-factor central limit theorem is
A useful method of moments in probability states that if real random variables have all moments, for every integer , and is the moment sequence of a moment-determinate probability distribution, then converges to that distribution in the sense of convergence in distribution. In particular, convergence to the standard normal distribution follows from limiting odd moments zero and limiting even moments . The moment-generating function of a standard normal variable, finite in a neighbourhood of zero, ensures moment determinacy.
For the classical Erdős-Kac theorem, put and choose, for example, , with a harmless modification for small . Truncate the prime omega function to primes . The omitted number of distinct prime factors of any is at most , since a product of omitted primes exceeds . Thus this truncation changes the normalized variable by uniformly. Also, the Mertens theorem for reciprocal primes gives
Part (b) transfers every fixed normalized central moment of the truncated prime omega function to the independent Bernoulli random variables model. Indeed, its unnormalized error is at most , using , and this tends to zero for each fixed . In the independent expansion, any singleton index has zero expectation; the leading contributions are pairings, giving exactly the standard normal distribution moments, while blocks of size at least three are negligible after normalization. The method of moments in probability, followed by the uniformly negligible truncation and centering errors, proves the Erdős-Kac theorem.
The same strategy proves the bounded-prime-weight form in part (a). Choose slowly enough that . The omitted weighted contribution is ; its mean is likewise , and its independent variance is by the Mertens theorem for reciprocal primes. Hence the truncated model has the same normalization, and part (b) again transfers each fixed central moment.
Fix . Put and form the centered real vectors
They are bounded independent and identically distributed random variables, so the multivariate central limit theorem applies to .
To identify its limiting covariance matrix, put . Its complex covariance and pseudo-covariance are respectively
For , and . Thus
The two conditions on identify exactly this real covariance matrix: the second is , with a conjugate in its second argument. A centered multivariate normal distribution is determined by its covariance matrix, including when that matrix is singular. Therefore
This proves convergence in distribution at each fixed ; it does not assert convergence of the entire empirical characteristic process.
Let and use the floor function to choose
Interpret an empty integer interval as an empty sum. These bounds give exactly the event , where has the binomial distribution of parameters . Since , the central limit theorem for a sum of independent Bernoulli distribution variables gives convergence in distribution of that standardized count to the standard normal distribution. Its cumulative distribution function is continuous at both endpoints, so
The TeX's additional malformed inequality involving and is absent from the PDF and is not a condition on the requested integers.
The symmetric group has elements, not the printed order . For the identity and the adjacent transpositions have probabilities , so the specified transition matrix is normalized. Its stationary distribution is uniform and it satisfies detailed balance, since each transposition is its own inverse. Adjacent transpositions generate the symmetric group, making this an irreducible Markov chain; the positive holding probability makes it an aperiodic Markov chain.
For a fixed label , right multiplication swaps positions, so is the label's position. Under the uniform distribution on a finite set it is uniform on . Therefore
For each generator , the squared change is one if the label occupies either of the two positions, and zero otherwise. Its stationary expected value is , giving
Thus the tagged-label Rayleigh quotient for adjacent transpositions gives the corrected bound
The printed factor six cannot be obtained: the hint's variance of a uniform distribution is wrong. Directly, . Bounded convergence in distribution of does imply convergence of its first two moments, hence convergence of its variance, but the limit is .
More strongly, the claimed asymptotic bound itself is false for this kernel. The Aldous spectral gap theorem states that the interchange process on a finite connected weighted graph has the same spectral gap as the single-label random walk with identical edge rates; see Theorem 1.1 and its proof. Here is that interchange process generator on a path graph with edge rates . For the tagged-label generator, direct substitution of gives eigenvalues , , including the reflecting endpoint equations. These distinct eigenvalues exhaust the tagged-label function space. Consequently the theorem yields
which exceeds asymptotically. This use of a substantial external theorem is only to certify the printed claim's failure; the corrected factor-twelve upper bound above follows directly from the requested test function and the variational formula.
The Lévy continuity theorem states that if characteristic functions of probability distributions converge pointwise on to , and is continuous at zero, then is the characteristic function of a unique probability distribution and
Here the arrow denotes weak convergence of probability measures, equivalently convergence in distribution of associated random variables. Conversely, weak convergence of probability measures implies pointwise convergence of their characteristic functions to the characteristic function of the limit. The continuity-at-zero condition is essential to ensure that the pointwise limit is a characteristic function.
Suppose with convergence in probability. For real and , the elementary inequality gives
First let , then let . The characteristic functions converge pointwise to that of , which is continuous at zero. The Lévy continuity theorem gives convergence in probability implies convergence in distribution.
For the converse, let have the fair Bernoulli distribution, put , and set for every . All have the same probability distribution as , so . But always, hence
There is no convergence in probability to . In this example does have convergence in probability to : the counterexample concerns the converse with the specified limit , as usual. If one interprets the question as denying convergence in probability to any limit, take for even and for odd . Its probability distribution is still constant, while the two subsequences have distinct limits from almost sure convergence, ruling out any common limit in probability by uniqueness of a limit in probability.
Let be the distribution function of . The limiting constant zero has distribution function for and for . For every , both and are continuity points of . Thus convergence in distribution implies and . Therefore
This proves
The same proof after subtracting a fixed real proves convergence in distribution to a constant implies convergence in probability. A deterministic limit fixes the coupling automatically; the counterexample in (c) exploits a nonconstant limit whose probability distribution alone does not fix that coupling.
For independent and identically distributed random variables with distribution function , let be the sample maximum. In extreme value theory, belongs to the maximum domain of attraction of a nondegenerate distribution function when there exist and such that
at every continuity point of . Thus the normalized sample maxima have convergence in distribution to .
A positive measurable function has regular variation at infinity with index , written , if
The case defines a slowly varying function; equivalently a regularly varying function is with a slowly varying function.
Write for the survival function and for the right endpoint of a distribution. For , use the following standard extreme value theory normalization conventions:
They are respectively the Fréchet distribution, the negative Weibull distribution, and the Gumbel distribution for maxima. The negative Weibull distribution is supported to the left of its finite endpoint; it is not the usual positive Weibull distribution.
The necessary and sufficient maximum domain of attraction criteria are:
  • For the Fréchet distribution,
    Equivalently for every .
  • For the negative Weibull distribution,
    Equivalently as , for every .
  • For the Gumbel distribution,
    Here is a Gumbel auxiliary function, and can be finite or infinite. For each fixed , the shifted argument lies below eventually. This exponential tail-ratio condition, rather than regular variation with a fixed finite index, characterizes this case.
For the corresponding sufficient hazard function conditions, assume is absolutely continuous near , its survival function tends to zero there, and its probability density function is positive there. Write . The Von Mises conditions for extreme values give
The last condition additionally assumes that the reciprocal hazard function is continuously differentiable near the endpoint. It concerns the derivative of the reciprocal hazard function, not the derivative of the hazard function itself. Equivalently, when is differentiable, it is .
To see the connection, taking an integral of the hazard function gives
The first two limits make the logarithmic tail ratios over multiplicative or endpoint-distance intervals tend to or , giving the required regular variation. For the Gumbel distribution, set . The derivative condition makes uniformly on bounded -intervals, so
The endpoint assumptions ensure these shifts are admissible: at an infinite endpoint , and at a finite endpoint . These are sufficient smooth-tail conditions; the tail-ratio characterizations above are necessary and sufficient without differentiability assumptions. For a source using the same reciprocal-hazard convention, see Smith and Weissman's university lecture notes, equations (2.18)–(2.24).
For the Gamma distribution with integer shape and rate one, let . The base case is , and integration by parts gives
Induction proves
This survival function has the asymptotic form ; for the relation is exact. Put . For every fixed real , and . The proposed centering satisfies
so
Only the highest-degree term contributes to the limit, with the same reasoning covering . The Taylor expansion now gives
because . Therefore the Gumbel limit for gamma maxima is
Equivalently, has convergence in distribution to the standard Gumbel distribution, with scale .
Suppose first that
This is convergence in L2, hence convergence in probability, which implies convergence in distribution. By part (i), the respective laws are and , so converges weakly to . Part (a)(i) also gives
Conversely, suppose that converges weakly to and the displayed second moments converge. By the stated quantile coupling for convergence in distribution,
Part (i) identifies their second moments with those of the measures, so part (a)(ii) applies and gives convergence in . Therefore
This is the one-dimensional second-Wasserstein convergence criterion realized by the common-quantile coupling.
Since and a standard normal variable has second and fourth moments and ,
Thus has the chi-squared distribution with degrees of freedom and
Convergence in distribution means that the cumulative distribution functions satisfy at every continuity point of . The Lévy continuity theorem states that this is equivalent to pointwise convergence of characteristic functions to the characteristic function of , provided the limiting function is continuous at zero.
For fixed , independence and a Gaussian integral give
Using ,
Therefore , the characteristic function of the standard normal distribution. Lévy's theorem now gives
This derives the limit directly, without assuming the central limit theorem.
For , independence and give
Thus is a Cauchy sequence in the complete L2 space and converges in to some random variable . The Cauchy-Schwarz inequality gives on a probability space, so the convergence also holds in . Finally, convergence in implies convergence in probability, which implies convergence in distribution.
Write
Expanding gives the leading term and terms of the forms treated in parts b and c, together with their versions obtained by interchanging and . For example, the pure error terms are , , and , and each cross term is controlled by Cauchy-Schwarz from these. Hence
Assuming this limit is positive, the continuous mapping theorem yields . Combining this with the assumed convergence in distribution of and applying the Slutsky theorem gives
This is the studentization of the generalized covariance measure statistic.
Let
Here has the binomial distribution with parameters . Part a, now with independent coordinates, gives
By Pinsker's inequality, the probability mass functions therefore converge in total variation, and in particular converges in distribution to .
The joint probability of the observed row depends only on :
Taking logarithms in any fixed base and choosing gives
where
The convergence lemma supplied in the question now yields
This sparse triangular array therefore has a random limiting normalized self-information rather than the constant limit in the usual asymptotic equipartition property.
Let be independent and identically distributed random variables with the standard Cauchy distribution, whose probability density function is
Its first absolute moment diverges since
On the other hand, its characteristic function is . The characteristic function of a sum of independent variables therefore gives
Thus the stability of the Cauchy distribution implies that has the standard Cauchy distribution for every . In particular,
where is standard Cauchy and denotes convergence in distribution.