At an interior statistical parameter , local asymptotic normality means that there are random vectors and a symmetric nonnegative Fisher information matrix such that, for each fixed ,
A common stronger definition requires this expansion also for . The fixed- version suffices here. A regular identifiable model usually has positive definite Fisher information; nonsingularity is unnecessary for the contiguity conclusion.
Here are sufficient differentiability conditions for a proof by Taylor's theorem. Suppose the local probability density functions have common support, is twice continuously differentiable near , differentiation can pass through the normalization integral twice, the score function has finite second moment, and the local Hessian matrix is bounded in operator norm by an integrable envelope of a function class. These hypotheses imply
The first identity differentiates once; the second uses and differentiates twice. The central limit theorem gives . Taylor's integral remainder gives
The weak law of large numbers and the continuity and integrable-envelope hypotheses make the bracket converge in probability to . Indeed, the expectation of the supremum of the Hessian matrix difference over a shrinking neighborhood tends to zero by dominated convergence, and Markov inequality controls its empirical average. This proves local asymptotic normality and explains the role of both derivatives.
Write for contiguity of probability measures: for every measurable sequence , implies . Mutual contiguity requires this in both directions. A useful form of Le Cam's first lemma is the following: if the Radon-Nikodym derivative of the absolutely continuous part of relative to converges in distribution under to , with almost surely and , then the two sequences are mutually contiguous. This includes the usual case . The mean-one condition ensures uniform integrability of and vanishing mass of any singular part; positivity ensures the reverse implication.
Take and . Their likelihood ratio on the support of satisfies, by local asymptotic normality and the continuous mapping theorem,
This limit is positive and , including . The conditions of Le Cam's first lemma therefore hold, giving mutual contiguity of the product sampling laws. The products, rather than the one-observation laws, are the relevant sequences.
For any , let . Consistency under makes , and contiguity gives . Thus the estimator remains consistent for under each fixed local alternative. Since , it is also consistent for the moving parameter in the sense that in probability under .
For , a Poisson distribution has mass for ; at it is concentrated at zero. Its moment-generating function is
For independent , the moment-generating function of their sum is the product, . Uniqueness of the moment-generating function near zero therefore gives . Repeating the argument gives when every parameter is one.
The displayed sequence is . The classical central limit theorem states that independent identically distributed variables with finite mean and nonzero finite variance have standardized sum converging in distribution to the standard normal distribution. Here , so
Convergence of the distribution functions at the continuity point zero justifies the last step. This is the Poisson cumulative probability at its growing mean.
First derive the survival renewal equation for a classical risk model. Before the first claim, capital rises deterministically. The first interarrival time has exponential distribution of rate , independently of the claim size. Conditioning on its time and size, and using the Markov property after that claim, gives
A claim larger than the capital available then causes immediate ruin and contributes zero. There is almost surely a first claim because .
Put . Changing variables yields
Since , this representation makes locally absolutely continuous, and differentiation gives, at least almost everywhere,
Integrate from to . The integrands are nonnegative, so Tonelli theorem permits interchange in the double integral. In particular
Subtracting this from , changing variables once more, and using the permitted boundary value gives
The constant is the zero-capital survival probability. Positive relative safety loading means , so it is positive. The convolution kernel is a multiple of the integrated tail distribution density and has total mass , making this a defective renewal equation.
For the individual portfolios define . Under the positive-loading convention of the question, . At zero capital, portfolio survives with probability . The independence of random variables of the entire portfolio processes makes their ultimate survival events independent. Consequently
The exponential form is not needed for this zero-capital probability under positive loading; only the claim mean enters. For completeness, the company description does not separately repeat positive loading for every portfolio. If nonpositive loadings are allowed, certain ruin with nonpositive loading and finite claim variance instead gives
Here the positive part sets a nonpositive factor to zero. To justify the additional case, observe capital at claim times: its independent increments are , with mean . A negative mean sends their partial sums to by the strong law of large numbers. At zero mean, these increments have finite nonzero variance. The central limit theorem gives for each fixed , so the probability of unboundedness below is at least . That event is unchanged by altering finitely many increments and hence is a tail event; the Kolmogorov zero-one law makes its probability one. Ruin therefore occurs almost surely also at zero loading.
For the merged claims, Poisson superposition of insurance portfolios gives total arrival rate . Each arrival is from portfolio with probability , independently of other arrival labels. Thus its claim-size mixture distribution has density
The weights sum to one, so this density integrates to one. An independent transform verification uses the aggregate for one accounting period. If , then its moment-generating function is
This is precisely a compound Poisson distribution with parameter and the displayed claim-size law. The transform identity can safely be read at ; positive arguments must be below the relevant poles.
Premium incomes and initial capitals add. Therefore the merged premium rate is , the merged initial capital is zero, and its mean claim size is
Its zero-capital survival probability is consequently
Under the question's positive-loading context this is a premium-weighted average of the individual survival probabilities, rather than their product. If arbitrary individual loadings are admitted, recompute the loading of the merged portfolio; its finite-variance mixture law gives the complete formula
An individually nonpositive loading does not force merged ruin when aggregate premiums still exceed aggregate expected claims. The survival probability under risk pooling is at least their product because a product of numbers in is at most each factor. Pooling allows one portfolio's surplus to cover another's deficit, so merged survival does not require every original portfolio to remain solvent separately.
Let where , and set it to zero on the g-null set where . The domination assumption makes there and gives . Integrating it also gives . For iid proposals , the importance sampling estimator is
Cauchy-Schwarz inequality under gives . Direct integration proves unbiasedness, . Moreover
Thus
The iid central limit theorem applies to these finite-variance weighted observations:
If the variance is zero, this denotes the point mass at zero. This is the bounded-weight importance-sampling moment bound.
Write and . The Bernoulli central limit theorem gives
If , all proposals are accepted and this limit is degenerate.
Conditional on , the accepted sample is iid from . Since , its size tends to infinity, and the ordinary target-sample CLT therefore gives
Assign any fixed value to the estimator on ; the probability of that event tends to zero, so it does not change this limit. This is the random-count central limit theorem for accepted rejection samples.
For comparison at the same budget of proposals, Slutsky's theorem rescales this as
The distinction between accepted-sample size and proposal count is essential for the final efficiency comparison.
A convenient general-state-space ergodic theorem is the following. For a positive Harris recurrent Markov chain with invariant probability measure , and a measurable function with ,
Here is the stationary expected value. Harris recurrence means that every set of positive irreducibility measure is visited almost surely from every state; positive recurrence supplies an invariant probability rather than only an infinite invariant measure. The ergodic theorem for a positive Harris recurrent Markov chain holds from any starting state under these Harris hypotheses. aperiodicity is not necessary just for averages.
A useful sufficient form of the central limit theorem for a geometrically ergodic Markov chain adds aperiodicity, geometric ergodicity, and for some . It gives
These are sufficient hypotheses, not a claim that irreducibility alone ensures a central limit theorem. The Markov chain Monte Carlo asymptotic variance uses stationary covariances , with . The series is absolutely convergent under the stated sufficient assumptions. If , write and , where the integrated autocorrelation time is . When , the effective sample size of a Markov chain is approximately . Negative correlations can reduce the asymptotic variance; a zero asymptotic variance gives a degenerate normal limit. For constant , variance is zero and the autocorrelation normalization is undefined.
Apply the Monte Carlo estimator to the observable :
The theoretical justification is the ergodic theorem for a positive Harris recurrent Markov chain, not an independent-sample law of large numbers. The Markov chain has finite state space, is irreducible, and has the strictly positive posterior distribution as invariant law, so it is positive recurrent and Harris recurrent with counting measure. The observable is bounded: . Thus the estimator converges almost surely to the posterior expected value from any initial configuration.
Each state also has positive self-transition probability, so the chain is an aperiodic Markov chain. Finiteness then gives geometric convergence and the relevant central limit theorem; serial dependence determines the Markov chain Monte Carlo asymptotic variance if error bars are required. A fixed finite burn-in can be discarded without changing consistency, but independence of the retained states should not be assumed.
Weak convergence means that for every bounded continuous real function on ; it is a statement about their distributions, not their coupling.
The central limit theorem says that for independent identically distributed real variables of finite mean and variance , . For this is equivalent to convergence of to the standard normal distribution. For , every variable equals almost surely and the limit is the point mass at zero.
For the proof when , put . Its characteristic function has expansion . To justify this using only a second moment, subtract the first two Taylor terms of and use dominated convergence theorem, with the second-order remainder bounded by a constant times . Independence gives the characteristic function of the normalized sum as . The Lévy continuity theorem says that pointwise convergence of characteristic functions to a characteristic function continuous at zero implies weak convergence. Since is the characteristic function of , the result follows.
The nonparametric bootstrap sample is a sample of size drawn independently with replacement from the empirical distribution , conditional on the observed data. To simulate it, take independent uniform and set , assigning to the last index if it occurs in a finite-precision generator.
Let be the conditional cumulative distribution function of , and let . A basic bootstrap confidence interval is
In practice the conditional quantiles are estimated from many simulated bootstrap means; the asymptotic argument below describes exact bootstrap quantiles or a simulation count tending to infinity.
For the required uniform-convergence fact, given choose with and . By continuity, choose a finite mesh on with successive increases of less than . Pointwise convergence at the mesh points makes there for large . Monotonicity sandwiches both functions between their neighbouring mesh values, so throughout . The same monotonicity and the chosen tail bounds control the two exterior rays by . Hence .
The bootstrap consistency theorem for the sample mean states that, for iid observations with , the conditional law of converges weakly, in probability, to . By continuity of that limiting distribution and the preceding monotonicity argument, the convergence of conditional distribution functions is uniform in probability. Since the limit is strictly increasing, in probability for . The coverage event is
The central limit theorem, quantile convergence and Slutsky theorem therefore give .
Positive variance is needed for this exact coverage conclusion. If the finite variance allowed in the wording is zero, all observations equal almost surely and the interval collapses to , with coverage one. The bootstrap distribution is still consistent with the degenerate limit, but a nonrandomized usual interval cannot then have limiting coverage for .
For fixed , the central limit theorem gives
The weak law of large numbers gives , so Slutsky theorem permits replacing in the standard error by . With , an approximate 95% confidence interval is
The lower endpoint may be truncated at zero because the parameter is nonnegative. This is a large-sample normal approximation for fixed positive ; an all-zero or very sparse sample does not justify the plug-in normal approximation. At the degenerate parameter value zero, every observation is zero almost surely.
First, the absolute values in the printed limit are an error: the correct long-run variance of a stationary process is the signed sum of autocovariances. Directly,
so
Each coefficient tends to and has absolute value at most . Absolute summability and the dominated convergence theorem therefore give
The sum of absolute values is an upper bound, not the general limit. For a concrete counterexample to the printed assertion, take with unit-variance iid noise. Then , , and other covariances vanish. The absolute sum is , but , so .
For correlated data the central limit theorem can still hold under suitable strong mixing of a stationary process and moment conditions, but the limiting variance is the long-run variance of a stationary process, rather than the one-observation variance. When it is positive,
Positive serial dependence usually increases the standard error, while negative dependence can reduce it. The approximate effective sample size of a stationary sample is when that denominator is positive. A long-memory time series can require a different normalization or a different limit law. Absolute covariance summability alone does not prove a CLT: if with a common independent random scale taking values and with equal probabilities and iid with the standard normal distribution, the off-diagonal covariances are zero, yet has the nonnormal scale-mixture law . The example is not an ergodic stationary process. If the long-run variance of a stationary process is zero, the usual nondegenerate square-root- CLT is unavailable.
For the causal AR(1), and
The conditional distribution follows because the current innovation is independent of the past.
For a fixed known , condition on the observed and use the transitions . Their conditional maximum likelihood criterion is, up to constants,
Differentiating in yields
Since ,
Thus it is an unbiased estimator, even conditionally on , and
It has statistical consistency with mean-square convergence, and the iid-noise strong law of large numbers also gives almost-sure statistical consistency. Its conditional distribution is exactly normal with the displayed mean and variance. If is also observed and all transitions are used, replace by .
The fixed- qualification is necessary for the exact finite-sample claims. If is jointly estimated, conditional likelihood function is linear regression with an intercept: writing and , the unconstrained estimators are
This ratio is not generally an unbiased estimator and does not have the preceding finite-sample variance. Under the usual stationary regression conditions it has statistical consistency; its asymptotic variance is . Indeed, it differs from by , an asymptotically negligible endpoint term. Profiling an unknown innovation variance does not change the fixed- estimate of .
Let be iid with density , set , and put and . The finite-second-moment assumption gives, for ,
The sample variance consistently estimates . The central limit theorem and Slutsky theorem therefore give the asymptotic confidence interval
Its confidence probability is approximately , conventionally written ; the printed omits the factor . For , almost surely and the estimator has zero error. This interval concerns iid Monte Carlo estimators; correlated simulation output requires a long-run variance of a stationary process estimate instead of the iid sample variance.
The empirical characteristic function replaces the expected value in a characteristic function by the sample average:
Its centered fluctuation at the central limit theorem scale is the empirical characteristic process:
In particular, and .
The printed assertion is false as a supremum bound uniform over shrinking bandwidths. The supplied hint proves a pointwise stochastic order with constants uniform in . Taking the supremum inside the probability changes the problem: a growing number of spatial windows produces a logarithmic cost. We first establish the valid consequence of the hint, then give a counterexample satisfying the printed assumptions.
For , let , and . The Invariant distribution of an Itô diffusion has a probability density function bounded above and bounded away from zero on the required compact interval. Choosing therefore gives constants such that , uniformly for and .
For the centered function , . Outside , . The given second-moment estimate and the Chebyshev inequality yield
On the event , the drift coefficient contributes an average whose error is at most , by Hölder continuity. The Itô isometry and stationarity give . Another use of the Chebyshev inequality proves
This also accounts for the zero-denominator convention through the first exceptional event. The bound proves pointwise , uniformly in the location's tail probabilities. It supplies no bound for the probability of a supremum over all locations.
For an explicit counterexample, take and the bounded globally Lipschitz function
It has Lipschitz constant , exponent , and satisfies the inward-drift conditions with , . The stochastic differential equation has a unique strong solution of a stochastic differential equation. Its Invariant distribution of an Itô diffusion has density
The exponent is zero on , equals when , and equals outside . This verifies integrability, positivity and a constant density on the central interval. Start the Itô diffusion in this Invariant distribution of an Itô diffusion to obtain the required stationary process.
Set and choose windows with centers , . Their intervals are disjoint and lie in , where the drift is zero. Write
Then whenever . The same occupation bound as above gives for . With , a union bound and the Chebyshev inequality imply
The quadratic variations are , and the cross quadratic covariations vanish since the windows are disjoint. Each clock tends to infinity almost surely: for any fixed window, the occupation estimate at times , followed by the Borel-Cantelli lemmas, gives . The Knight theorem for orthogonal martingales therefore represents using independent standard Brownian motions . This theorem is applied to the finite collection for each ; no growing-dimensional central limit theorem is being assumed.
On the preceding clock event, compare each time-changed Brownian motion with its value at deterministic time . The Brownian reflection principle and a union bound show that, for every fixed ,
This bound does not require the Brownian motions to be independent of their clocks. In particular, in probability. The variables are independent random variables. Their Gaussian maximum exceeds with probability tending to one: for , integration of the normal density over gives , and hence
Since on the clock event, it follows that, for some ,
But for this bandwidth. Thus the error after subtraction of and multiplication by is not bounded in probability, contradicting the printed stochastic order. The valid pointwise bound above is provable; the uniform shrinking-bandwidth assertion is not. This counterexample shows why a uniform rate needs at least a enlargement of the noise scale. If is instead held fixed and constants may depend on , this counterexample does not contradict that different interpretation.
Let and use the floor function to choose
Interpret an empty integer interval as an empty sum. These bounds give exactly the event , where has the binomial distribution of parameters . Since , the central limit theorem for a sum of independent Bernoulli distribution variables gives convergence in distribution of that standardized count to the standard normal distribution. Its cumulative distribution function is continuous at both endpoints, so
The TeX's additional malformed inequality involving and is absent from the PDF and is not a condition on the requested integers.
The observations have finite mean and variance. The strong law of large numbers gives almost surely, so almost surely and therefore is a consistent estimator. The central limit theorem gives
Represent as a sum of independent variables. The central limit theorem gives
Since zero is a continuity point of the standard normal distribution,
Ignoring the multinomial coefficient, the likelihood is
The score equation is
and strict concavity of the log-likelihood gives
Using the variables from part (b), the central limit theorem gives
Therefore the allele-frequency estimator under Hardy-Weinberg equilibrium has limiting law