First, convergence in probability at gives almost surely, since every . For any finite set of times, the corresponding vectors converge in probability: the union bound controls the probability that any coordinate differs by more than a fixed tolerance. The same holds for their increment vectors, hence also for their convergence in distribution.
For , set and . The characteristic function of a random vector factors for the independent increments of each :
Pass to the limit using convergence in distribution and bounded continuous functions. The resulting factorization of the characteristic function of a random vector, with the uniqueness theorem for characteristic functions, proves independence of the . Similarly passes to the limit, proving stationary increments for .
It remains to prove stochastic continuity. For , the triangle inequality and the union bound imply, for every fixed ,
The second term vanishes by stochastic continuity of . Now let and use the additional near-zero approximation hypothesis. We obtain in probability as . The stationary increments transfer this to every time: both and have the law of for when defined. Thus has all the intrinsic Lévy process properties, proving closure of Lévy processes under locally controlled convergence in probability.
If one requires the supplied process itself to be càdlàg, the hypotheses justify a càdlàg modification, rather than that stronger pathwise assertion. To see the distinction, take , let have uniform distribution on , and put . At each fixed time , almost surely, so both approximation hypotheses hold with zero error probability. Nevertheless every path has an isolated spike at and is not right-continuous there. Its identically zero modification of a stochastic process is a Lévy process with càdlàg paths. The conclusion is exact under the intrinsic definition, and exact up to modification under the convention requiring càdlàg paths.
The familywise error rate is the probability of rejecting at least one true null:
A valid p-value is super-uniform under its null: for . The Bonferroni correction rejects if . The union bound gives
This controls the familywise error rate for every configuration of true and false nulls, without any independence assumption on the p-values.
For a nonempty index set , the intersection hypothesis asserts that every null indexed by holds. The closure of a family of statistical hypotheses consists of all these nonempty intersections, including the original hypotheses. For each intersection choose a local test of size at most under . Such tests always exist: for example, within use the Bonferroni correction, rejecting if . More powerful local intersection tests can be substituted whenever valid.
The closed testing procedure rejects an elementary hypothesis only when every local test with rejects its intersection hypothesis. If , the intersection is true. Rejecting any true requires rejection by its local test , so
If , there is no possible false rejection. This proves closed-testing control of the familywise error rate. The same argument applies if intersection hypotheses themselves are reported as rejected: requiring all their supersets to reject includes whenever the reported intersection is true.
Finally, consider the given hierarchical family as a laminar family of sets. Call a set true when , so its entire intersection hypothesis is true. Let be the inclusion-maximal true sets in . Distinct members of are disjoint: if they met, laminarity would make one contain the other, contradicting maximality. Consequently,
Every true set lies in a maximal true . If is rejected by the prescribed adjusted p-value rule, the maximum over its ancestors includes , hence
Thus the event of any false rejection is contained in the union of these events over the disjoint maximal true sets. Using validity of each under its true intersection and the union bound,
Equivalently, with probability at least every rejection is correct. This proves familywise error control for a laminar hypothesis family. It requires neither independence nor the presence of all possible intersections or singletons in . Empty index sets are excluded, as required by the denominator ; if there are no true sets the result is immediate. Adjusted values exceeding one can be truncated at one without changing decisions for .
The relevant fixed coordinate subspace is . Let be the first columns of and let
The Gaussian empirical Gram matrix is the empirical second moment with the known mean zero; no subtraction of an estimated mean is involved. For , the ratio under consideration is . Since is a real symmetric matrix, the finite-dimensional spectral theorem gives
Indeed, diagonalizing bounds every unit-vector quadratic form by the largest absolute eigenvalue, and a corresponding unit eigenvector attains the bound.
We first construct a unit sphere net from ball covering. Enlarge the numerical covering constant, if necessary, to . Cover the unit ball in with at most balls of radius at most . For each such ball meeting the unit sphere, choose a point of the sphere in it and discard the others. These selected points form a metric net of the unit sphere with radius : any two points in one covering ball have distance at most . This argument ensures that the net points have unit length even if the original covering centers did not.
Take and put , so . For unit vectors with ,
Taking a net point for every unit and then a supremum proves the quadratic form net bound
It follows that
Fix . The rows of are independent vectors of independent random variables with the standard normal distribution, and . Their scalar products with are therefore independent variables , so
Use the supplied chi-squared concentration inequality with . Its threshold is
Consequently . The union bound gives the stronger fixed-subspace estimate
This is Gaussian Gram matrix concentration on a fixed subspace.
Since , we have . Under ,
Choose the numerical constant . Then the parenthesis is at least one, so is a valid choice, and
The covering factor is only because the coordinate subspace is fixed. The ambient dimension enters through the assumed sample-size bound.
The Poisson thinning theorem, or its multinomial marking version, makes the bin counts at time independent Poisson variables with mean . Independence is more than is needed for the following union bound. Fix and put . Then
Since
the logarithm of the upper bound is . Thus . The estimate handles the noninteger threshold directly, since the supplied Poisson tail bound holds for real .
The Szemerédi theorem says that for every integer and every , there is such that, for , every with contains a nonconstant arithmetic progression
Equivalently, every subset of the positive integers with positive upper asymptotic density contains arithmetic progressions of every finite length. Length one is immediate.
The Furstenberg multiple recurrence theorem states that for every probability measure-preserving system, every measurable with , and every integer , there is with
Here means a preimage, so invertibility is unnecessary. The Furstenberg multiple recurrence theorem also does not assume an ergodic transformation.
We prove the implication to the finite Szemerédi theorem by constructing the Furstenberg correspondence principle explicitly. Suppose, to the contrary, that for fixed and there are and with , but with no length- arithmetic progression of positive common difference. In the binary full shift , encode as , taking all coordinates outside to be zero. Let be the left shift, , and set
The cylinder set is a clopen set, and . The binary full shift is a compact metric space, so compactness of probability measures on a compact metric space gives a subsequence of these empirical measures with weak convergence of probability measures to a Borel probability measure .
For every continuous on the full shift,
Passing to the weak limit shows that is an invariant measure for the continuous left shift. Thus is a probability measure-preserving system. Since the indicator function of is continuous, .
Apply the Furstenberg multiple recurrence theorem to . For some , the clopen set
has . Its continuous indicator function gives . For large , at least one in the defining empirical measure therefore belongs to . The choice of left shift implies
so lies in . This contradicts the assumed absence of arithmetic progressions and proves the finite Szemerédi theorem. Applying the finite Szemerédi theorem on intervals where an infinite set has density bounded below proves the stated upper asymptotic density formulation.
For multiple recurrence for circle rotations, write and , with normalized Lebesgue measure , which is the Haar measure of the circle group. Fix a measurable with and . If is rational, there is with the identity, and gives an intersection of measure .
For irrational , the pigeonhole principle applied to in equal arcs gives with . In particular there are arbitrarily small nonzero returns to zero for the irrational rotation of the circle.
We also need translation continuity in L1 on the circle. Given a measurable , approximate its indicator function in the L1 norm by a continuous on the circle group. Such approximation follows from regularity of Lebesgue measure, or approximation by finite unions of intervals. Translation invariance and uniform continuity give
where the approximation error is first made arbitrarily small. Equivalently, .
Choose a return time so small modulo one that for each ,
This is possible because multiplication by each fixed is continuous on the circle group and translation continuity in L1 on the circle applies to the finitely many translates. The union bound now gives
This proves the Furstenberg multiple recurrence theorem for every circle rotation with its normalized Lebesgue measure, including both rational and irrational angles.
Interpret as the length of a shortest Euclidean travelling salesman tour, and take the points to be independent random variables with the uniform distribution on the square. We assume ; a closed tour on one point has length zero, so the printed lower bound would be false for . For two points the closed tour traverses the joining segment twice.
For the deterministic upper bound, use the following precise geometric result, the squared edge bound for tours in the unit square: every finite set of points in admits a cyclic ordering such that
Here is a proof of that geometric result. First consider a right triangle with hypotenuse endpoints , hypotenuse length , and right-angle vertex . The quadratic path bound in a right triangle supplies a path from to through any finite set inside the triangle whose sum of squared edge lengths is at most . For an empty set use the edge . For a single point , use : the triangle lies in the disk with diameter , so and the law of cosines gives .
For several points, draw the altitude from to the hypotenuse. It splits the triangle into two smaller right triangles with hypotenuses and . Their squared hypotenuse lengths sum to by the Pythagorean theorem. Repeated altitude subdivision eventually makes every cell small enough to contain at most one of the given distinct points: each child is similar to the original triangle and its diameter contracts by at most the fixed factor . Construct the base-case paths and combine them from the bottom of this finite subdivision tree. The two child paths concatenate at . If is an auxiliary point, delete it by joining its two neighbours directly. Both neighbours lie in the right-angle sector of the parent triangle at , so their angle at is at most . The law of cosines now shows that this shortcut does not increase the sum of squared edge lengths. The combined path still has endpoints and squared cost at most .
One can first put the given points in generic positions, avoiding subdivision boundaries, and then pass to a limit. There are only finitely many possible visiting orders, so a subsequence keeps the same order and its squared cost converges; this also handles coincident locations. No assumption about a minimum separation remains in the result.
Split the square along a diagonal . Apply the triangle result in each half, following one path from to and the other back to . Each half contributes at most . Remove either diagonal endpoint if it was auxiliary. At a square corner all neighbours lie in a sector of angle , so the same squared-cost shortcut applies. This gives the asserted cyclic ordering with total squared cost at most four. It does not assert that the tour minimizing ordinary length itself has this squared-edge property. The Cauchy-Schwarz inequality applied to the tour supplied by the theorem proves
Thus the upper bound is deterministic, independently of the sampling law.
For the lower bound, put , the nearest neighbour distance at . Both edges incident to in any closed tour have length at least . Summing over vertices and then dividing by two gives . Conditional on , the union bound and the uniform distribution give
Boundary clipping only makes the ball smaller. Apply the layer-cake representation of the expected value, restricting the integral to :
Linearity of the expected value now yields
The unspecified sampling phrase in the paper must therefore be understood as independent uniform sampling: an arbitrary distribution concentrated in a tiny region cannot satisfy this lower bound.
Let count the copies of the complete graph in the binomial random graph . By linearity of the expected value and independence of distinct edges,
Throughout, is sufficiently large that . We have , and .
First, since ,
The first moment method proves .
For the existence of a -clique, put and . Since ,
This alone is insufficient: we must control the variance via the overlap formula for the variance of a clique count. Let indicate that a given -set spans a clique. If , the two copies share edges, so
For their edge sets are disjoint and the covariance vanishes, even when they share one vertex. Counting ordered pairs of -sets gives the exact formula
This includes the diagonal case .
To bound the overlap factor, regard it as the probability that a uniformly chosen -set intersects a fixed in exactly vertices. A union bound over the possible specified -subsets of yields
Here is a falling factorial, and the last bound holds for . Therefore
For , the concave quadratic is minimized at an endpoint. Its endpoint values are and , both at least . Thus every power of in the last sum is at most , and
because the logarithm of its numerator is . The second moment method, or Chebyshev's inequality directly, gives . Finally, every larger clique contains a -clique, so the absence of excludes all larger sizes. The clique number is exactly with high probability:
The event that infinitely many occur is . For every , the union bound and monotonicity of a probability measure give
The right-hand side tends to zero as the tail of a convergent series. Therefore the first Borel-Cantelli conclusion is
This proves the Borel-Cantelli first lemma without any independence assumption.
First, the Cramér model has infinitely many successes almost surely, so every is finite. Indeed, for each fixed , independence of the Bernoulli random variables gives
The sum diverges, for example because for . Continuity from above of a measure and a countable union bound exclude a final success.
Fix and put . Let be the event that the whole interval consists of failures. By independence and ,
Since , the exponent divided by tends to . Thus for all sufficiently large . The Borel-Cantelli first lemma shows that almost surely every sufficiently large such interval contains a success. Taking then gives for all sufficiently large .
For each fixed , the limit superior of the normalized gap is therefore at most almost surely. Intersect the probability-one events for , , to obtain the Cramér model prime-gap upper bound:
Use integer graph vertices in the boxes: , and set . Thus , , and for .
If , erase loops from an open graph path to obtain a self-avoiding walk. Let be its first graph vertex on . Split at . The prefix certifies , while a segment of the suffix certifies : the final graph vertex is at supremum norm distance at least from , so the suffix first hits that translated boundary. The two certificates use disjoint edges. Therefore the BK boundary-splitting estimate, the union bound, the van den Berg-Kesten inequality, and translation invariance give
The cases or follow directly from , so this proves the bound including the endpoints.
Here is an explicit way to remove the polynomial boundary factor. For put , . By symmetry in , assume . Then
Consequently is a subadditive sequence. The Fekete lemma states that any real subadditive sequence satisfies , possibly . In this case the direct horizontal open graph path gives , so this limit of a sequence is bounded below by . Since , its upper bound is zero. Finally,
has the same limit of a sequence. Thus the percolation one-arm decay rate exists and
For , every with is zero and . No exponential-decay theorem or assumption that is below the percolation critical probability is needed.
The union bound gives . Hence some boundary graph vertex has percolation two-point connection probability at least . The rotations and reflections of the square lattice let us choose such a graph vertex as , . Reflection in the vertical line through sends to and fixes . Therefore
The Harris-FKG inequality applied to these two increasing events proves the reflection lower bound for two-point percolation:
Every graph path from to reaches , so . Taking roots gives
Both outside expressions have limit of a sequence , proving the even case. For , the Harris-FKG inequality with the last horizontal edge gives , and also . The lower bound has root
The upper bound has the same limit of a sequence. At all positive-distance connection probabilities vanish. Thus for every .
Write and for the horizontal and vertical open-crossing increasing events of a rectangle in the rotated square lattice. At parameter , planar duality for rectangle crossings says that failure of is exactly a closed dual vertical crossing. Quarter-turn symmetry and the boundary convention of the rotated rectangles identify the two alternatives on a square. Thus its crossing probability is ; a rectangle obtained by a harmless one-step boundary adjustment has crossing probability at least . This is the finite-domain exact self-dual rectangle crossing probability, not an assumption about infinite percolation clusters.
We first prove a RSW reflection extension lemma. In coordinate units adapted to the rotated drawing, take , , and . Reveal the rightmost open vertical crossing of , when one exists, using only its edges and the region to its right. Reflect across the horizontal axis. The part of to the left of these two paths remains unexposed and has the independent parameter- law. A horizontal crossing of must reach their union. Its probability is at least . Reflection symmetry and the union bound give a probability at least of reaching the upper path through . Conditional opening of the edges on can only help. Since has probability at least , the increasing event that a vertical crossing of is connected inside to its left side has probability at least .
Reflect this construction in the vertical midline of to obtain an increasing event of the same probability, connecting a vertical crossing of to the right side of . On , the horizontal crossing of meets both vertical crossings, so all three graph paths join and give . The Harris-FKG inequality now yields
The exploration only conditions the exposed side of the extremal graph path; reflecting a drawn path does not assert that its reflected edges are open. This distinction is what makes the extension argument valid.
To pass from aspect ratio to , put four rectangles of width and height next to each other, with successive left boundaries separated by . Adjacent rectangles overlap in a square of side . Require horizontal crossings of the four rectangles and vertical crossings of the three overlap squares. Every consecutive pair of horizontal crossings meets the vertical crossing in its overlap; together they form a horizontal crossing of width . The Harris-FKG inequality gives a strictly positive bound, for these compatible scales, of
The construction works on the rotated square lattice with the boundary sites used in the source drawing. Integer roundings do not create a scale restriction: for an odd height use the largest smaller compatible even height, and use eight horizontal rectangles and seven overlap squares, whose union has auxiliary aspect ratio , so that its width exceeds the desired width for all sufficiently large . Truncate its horizontal crossing on first reaching the desired right side. The number of extra rectangles and overlap-square crossings is bounded independently of , and every factor is bounded below by the same positive constants. The finitely many smallest rectangles each have positive crossing probability, since a specified finite open graph path suffices. Therefore a constant works at every integer scale. Taking ensures the requested strict inequality:
This proves the required instance of the Russo-Seymour-Welsh theorem through reflection, exploration and gluing. The parameter in this calculation is .
First obtain a polynomial critical one-arm upper bound from part (a). Fix a sufficiently large integer radius . Use rotated-coordinate boxes for this geometric construction, in the axes of part (a). Surround by a square ring inside . It can be assembled from the four strips
The first two require horizontal dual crossings; the last two require vertical dual crossings. Their corner overlaps are squares, so the adjacent long crossings intersect there and their union contains a dual graph cycle surrounding the inner box. Translate the strips by the half-lattice displacement of the planar dual graph and adjust the endpoints by one lattice unit if needed. All aspect ratios remain bounded. Part (a) and the same overlap gluing give a uniform lower bound for each dual crossing at . Applying the Harris-FKG inequality to these decreasing events in the primal configuration gives a closed dual circuit with probability at least . We may replace by a smaller number in .
Use the independent annular barriers for percolation at radii . Their supporting edge sets are disjoint, so the circuit events are independent. In the original unrotated coordinates, lies inside and the ring still separates the origin from infinity. These fixed geometric comparisons let us bound the original . An open graph path from to distance must avoid every such closed dual circuit inside . Thus, for some constants and ,
where the first bound is used only when at least one of the indicated rings fits; increasing handles smaller .
Now let and use the monotone coupling of Bernoulli percolation on edges. The event only needs edges whose endpoints lie in , because a first boundary hit gives an internal graph path. There are exactly such edges. Each changes state between parameters and with probability . The union bound therefore gives the finite-box comparison for percolation parameters
For sufficiently small , choose , so that is at least half the unrounded value. Both terms then have order . In particular,
for a finite . Increase to cover the remaining compact range of parameters by . This near-critical percolation power upper bound requires only a positive crossing constant, not the exact value of a critical exponent. It also implies through the critical one-arm probability bound.
Fix the normalization
The Lasso penalty uses the L1 norm. All arguments below apply to every minimizer; uniqueness of the coefficient vector is not assumed.
The Karush-Kuhn-Tucker conditions are the subgradient optimality condition
These conditions are necessary and sufficient because the objective is a convex function. They use the subgradient of the absolute value, coordinate by coordinate.
Put . Centered columns imply , so the subtraction of in the model contributes nothing to the score. The Karush-Kuhn-Tucker conditions become
Multiply by . Since and , this gives the prediction inequality from Lasso stationarity:
This is the desired version of the Basic inequality for the Lasso. Using stationarity directly preserves the coefficient on the squared prediction norm.
For the Gaussian score event for the Lasso, write for column . The assumed Euclidean norm and the multivariate normal distribution of give
The may be correlated, which does not affect the union bound. Use the following sharp two-sided Gaussian tail bound, valid for with the standard normal distribution and every :
For completeness, the difference satisfies , , and as . It first increases and then decreases to zero, so it is nonnegative. This bound avoids introducing an unnecessary factor two.
Here is the standard normal distribution function. With , the union bound yields
Consequently
The score event uses the supremum norm of ; the centering term still vanishes because .
We next work deterministically on . Let
By Holder inequality, . Since , the triangle inequality gives
Substituting both inequalities into the Basic inequality for the Lasso produces
Because , this also proves the relevant Lasso cone condition, . The assumed Compatibility condition for the Lasso therefore applies to :
Set . Combining these inequalities gives
If , discarding the nonnegative term shows . If , compatibility gives , and the preceding inequality then gives . In either case , so
This is a fast prediction bound and an inactive-coordinate error bound on the same event. It is the fast-rate Lasso prediction bound under compatibility.
Finally, the same argument bounds the active-coordinate L1 norm by
If , then , and . When this implies ; when it implies . Thus the sign function obeys
This is Lasso sign recovery under compatibility. It concerns the sufficiently large nonzero coefficients; it does not assert that every estimated inactive coefficient is zero.
The printed assertion is false as a supremum bound uniform over shrinking bandwidths. The supplied hint proves a pointwise stochastic order with constants uniform in . Taking the supremum inside the probability changes the problem: a growing number of spatial windows produces a logarithmic cost. We first establish the valid consequence of the hint, then give a counterexample satisfying the printed assumptions.
For , let , and . The Invariant distribution of an Itô diffusion has a probability density function bounded above and bounded away from zero on the required compact interval. Choosing therefore gives constants such that , uniformly for and .
For the centered function , . Outside , . The given second-moment estimate and the Chebyshev inequality yield
On the event , the drift coefficient contributes an average whose error is at most , by Hölder continuity. The Itô isometry and stationarity give . Another use of the Chebyshev inequality proves
This also accounts for the zero-denominator convention through the first exceptional event. The bound proves pointwise , uniformly in the location's tail probabilities. It supplies no bound for the probability of a supremum over all locations.
For an explicit counterexample, take and the bounded globally Lipschitz function
It has Lipschitz constant , exponent , and satisfies the inward-drift conditions with , . The stochastic differential equation has a unique strong solution of a stochastic differential equation. Its Invariant distribution of an Itô diffusion has density
The exponent is zero on , equals when , and equals outside . This verifies integrability, positivity and a constant density on the central interval. Start the Itô diffusion in this Invariant distribution of an Itô diffusion to obtain the required stationary process.
Set and choose windows with centers , . Their intervals are disjoint and lie in , where the drift is zero. Write
Then whenever . The same occupation bound as above gives for . With , a union bound and the Chebyshev inequality imply
The quadratic variations are , and the cross quadratic covariations vanish since the windows are disjoint. Each clock tends to infinity almost surely: for any fixed window, the occupation estimate at times , followed by the Borel-Cantelli lemmas, gives . The Knight theorem for orthogonal martingales therefore represents using independent standard Brownian motions . This theorem is applied to the finite collection for each ; no growing-dimensional central limit theorem is being assumed.
On the preceding clock event, compare each time-changed Brownian motion with its value at deterministic time . The Brownian reflection principle and a union bound show that, for every fixed ,
This bound does not require the Brownian motions to be independent of their clocks. In particular, in probability. The variables are independent random variables. Their Gaussian maximum exceeds with probability tending to one: for , integration of the normal density over gives , and hence
Since on the clock event, it follows that, for some ,
But for this bandwidth. Thus the error after subtraction of and multiplication by is not bounded in probability, contradicting the printed stochastic order. The valid pointwise bound above is provable; the uniform shrinking-bandwidth assertion is not. This counterexample shows why a uniform rate needs at least a enlargement of the noise scale. If is instead held fixed and constants may depend on , this counterexample does not contradict that different interpretation.
Let and . The Lipschitz continuity of cosine and the Cauchy-Schwarz inequality imply
The centered expectation term contributes ; omitting it would leave the Lipschitz bound incomplete. In particular has continuous sample paths on the compact cube, so its maximum exists and is measurable.
Put
Choose a Cartesian finite net whose coordinate spacings are at most , including the endpoints. Every point of the cube is within Euclidean norm distance of , and
On the event , replacing any by a nearby grid point changes by at most . Since and , this is less than . Therefore
The Markov inequality bounds the first event by . At a fixed , the summands are centered, independent and identically distributed, and have absolute value at most . The supplied Hoeffding inequality, with , bounds each grid event by
A union bound now gives
The choice of balances the cost of a large random Lipschitz constant against the covering number of the cube: . Consequently works, with
This uses only the first moment and has a constant independent of . The finite net is deterministic even though the Lipschitz constant is random.