Taking logarithms of the product gives
By part (d)(i), in probability distribution, where has the exponential distribution of rate one. Thus and . The strong law of large numbers gives
If , choose . Eventually , so . If , choose ; eventually . Therefore
In particular, the second range cannot have almost sure convergence to zero. This is the almost-sure growth rate of independent products. At the logarithmic limit is zero, which by itself decides neither behavior; that boundary case is not requested.
The inverse transformation of a random variable is , with absolute derivative . The condition becomes . The change of variables for probability densities gives
Equivalently, has the exponential distribution of rate one. Applying a separate measurable transformation of a random variable to each independent preserves independence of random variables, so the are independent and identically distributed.
For , integration and independence of random variables give
By the fractional moment criterion for convergence in probability,
The parenthesized factor is less than one precisely when . This expression vanishes at and has derivative there. If , the derivative is negative, so some sufficiently small makes the factor strictly less than one. The bound then tends to zero geometrically, proving
If , then almost surely. Intersecting these events over all still gives an event of probability one. On it, , so the products have a finite nonnegative limit .
For every , the inclusion and part (c)(i) imply . Taking for positive integers proves almost surely. Thus
The monotonicity is the extra ingredient that upgrades convergence in probability to almost sure convergence here.
Direct integration of the uniform distribution yields and . The expectation of a product of independent random variables gives
Subtracting the square of the expected value gives the variance:
Since , Markov's inequality implies, for every ,
Hence The first moment suffices: the variance need not tend to zero throughout this range.
The restriction is a finite Markov chain that is an irreducible Markov chain. It is aperiodic, because its upper states have self-transition probability , and the period is constant on a communicating class. We now find its stationary distribution.
Every column of sums to one. Here is the full incoming-mass check, with each total measured in units of . For , the incoming contributions are from and from the self-transition. For , they are from and from the self-transition.
For , the upward predecessor lies in exactly when , contributing units. When , that predecessor is replaced by resets from all states of , again contributing units. Independently, the downward predecessor contributes units when ; when , resets from the states of contribute those units instead. Thus every column total is units.
Therefore is a doubly stochastic matrix, and the uniform distribution on is stationary:
The countable-state Markov chain convergence theorem, applied to the finite closed class , gives for every . Its hypotheses hold: is finite and irreducible, hence positive recurrent, and it is aperiodic.
If , the hitting time of has . If , the corresponding tail is . Thus almost surely from every exterior initial state. Conditioning on and , use convergence within after entrance and the bounded convergence theorem; equivalently, first restrict to and then let . This proves, for every ,
The limiting distribution is independent of .
Define
An interior jump cannot go below or above , and every exterior reset lands in . Thus is closed.
To prove that it is one communicating class, start anywhere in . From or , a reset can reach with positive probability. From any state of , repeated steps reach some state of , after staying in up to the last step. A reset from this state can reach every point of the consecutive block
Every integer has the form for some and an integer . Repeated steps from reach , with all departure states in until a possible last step into . This gives access to all of . Finally, each can be reached from . Every path described has strictly positive probability. Therefore every state in reaches every other state in .
Each state outside can only stay put or reset into , and no transition from returns to it. Different states outside cannot reach one another. Hence the complete list of communicating classes is
The finite class is the unique closed communicating class. The exterior singleton classes are transient communicating classes, since their self-transition probabilities are strictly less than one. Notice that this reachability proof does not require to be coprime.
First identify the recurrence type, rather than infer an occupation limit from a one-time probability. At time , return to zero requires exactly upward steps. The binomial distribution gives
where the last step is Stirling's approximation. At all other positive times the return probability is zero. Hence . The recurrence criterion by return probabilities proves the recurrent property; by the irreducible Markov chain property established in (i), every state is recurrent. The equivalence of positive recurrence and existence of a stationary distribution for an irreducible Markov chain on a countable state space, together with (iii), makes this chain null recurrent.
For completeness, the zero occupation proportion follows directly by treating returns as a renewal process. Let be successive strictly positive return-cycle lengths to zero. The Strong Markov property makes them independent and identically distributed, the recurrent property makes them finite almost surely, and the null recurrent property gives . For each positive integer , the strong law of large numbers applied to gives
Take a common event of probability one for these countably many . By the monotone convergence theorem, the right side increases to infinity. Thus the number of completed return cycles by time , divided by , tends to zero. Counting the initial visit changes this ratio by at most . Consequently,
The walk visits zero infinitely often, but the asymptotic fraction of time spent there is zero.
Suppose a stationary distribution exists. Its stationarity equations are
Since , its masses tend to zero as , and a positive maximum is attained. Both terms on the right are at most . Since and , equality forces . Applying the same argument repeatedly at gives
These are infinitely many distinct states, contradicting . Thus
This maximum principle proof uses neither a finite expected value of the state nor the coprimality assumption.
A return path with upward steps and downward steps satisfies . Since are coprime, this is equivalent to and for an integer . Its length is therefore .
Conversely, for each such , any ordering of upward and downward steps is an allowed positive-probability return path. The possible strictly positive return times are exactly the positive multiples of . By the definition of the period of a state in a Markov chain as their greatest common divisor,
In particular, none of the states is aperiodic.
Fix any two integers . By Bézout's identity, there are integers with . Replacing by leaves this identity unchanged. Choose large enough that both entries are nonnegative. A path with upward steps and downward steps then takes to , with strictly positive probability . There are no boundary restrictions on this state space.
This applies in both directions, so every pair of states communicates. Hence
It suffices that the moment-generating function be finite on some open interval containing zero:
Equivalently, some two-sided exponential moment exists: for some . For the forward implication, choose and use ; the converse follows from for .
Under this weaker hypothesis, all moments exist. For , dominated convergence justifies the Taylor series argument in (i). Vanishing odd moments gives near zero, and the local uniqueness theorem for moment-generating functions gives the symmetric distribution. The reverse implication follows directly from equality of the two probability distributions.
More generally, it suffices that all moments exist and the probability distribution have moment determinacy: and then have identical moments and hence identical probability distributions. Existence of all moments by itself does not provide that uniqueness.
Take a discrete probability distribution on three points:
The probabilities are positive and sum to one. Direct calculation gives
and
Nevertheless it is not a symmetric distribution, since while . Vanishing of just the first and third moments does not force all odd moments to vanish.
Let have the Pareto distribution with probability density function for , and zero otherwise. Its normalization of a probability distribution and first two moments follow from
Set . Then
The probability distribution of is not a symmetric distribution: almost surely, whereas and . For we have , so
Thus has every property required.
First justify that the moments being used exist. For every ,
The bound gives for all .
If has a symmetric distribution, then and have the same probability distribution, so for odd ,
which forces .
Conversely, suppose every odd moment vanishes. For fixed , the absolute values of the partial Taylor series for are bounded by , whose expected value is finite by the preceding inequality. The dominated convergence theorem therefore permits termwise expectation:
The uniqueness theorem for moment-generating functions implies equality of the probability distributions of and . Hence
The possible limiting correlation coefficients are
The direction of the dependence comes from inversion of the same counting process: extra arrivals produce a larger count but an earlier -th Poisson arrival time. Shared fluctuations therefore enter the two coordinates with opposite signs. Positive limiting correlation cannot arise; this can be formalized using negative quadrant dependence of a Poisson count and an arrival time.
At the same time scale, , part (iii) rules out every positive-positive quadrant. A bivariate normal distribution with standard normal marginal distributions and assigns positive probability to such a quadrant. Thus, under the assumed joint limit, this choice forces . At very different time scales, , part (iv) gives .
Intermediate time scales retain an intermediate fraction of the same arrival fluctuations. In particular, the Poisson count-arrival joint central limit theorem gives for with . These choices realize every , and supplies zero. This identifies the whole interval without requiring an additional limit calculation in this part.
The premise about a bivariate normal distribution is understood to apply when a joint limit exists. Merely requiring cannot guarantee one: taking for even and for odd gives different limits along the two subsequences just identified.
Separate a long future count from the early Poisson arrival time. Let be the natural filtration, and define
The truncated Poisson arrival time in is -measurable. The independent increments property makes independent of , and hence of .
The numerator of is a centered Poisson random variable of parameter . Apply the central limit theorem to the unit-time increments, then use and Slutsky's theorem. This proves . Also, Markov's inequality and give
Thus equals outside an event of vanishing probability, so part (i) and Slutsky's theorem give . Exact independence of random variables for each now gives the joint limit with independent standard normal random variables.
Finally, and , so Chebyshev's inequality gives in probability. The first coordinate in the question is . The second differs from only on , and so its difference tends to zero in probability. The vector version of Slutsky's theorem proves the required joint convergence in distribution. The boundary of has zero limiting probability, since both marginal distributions have continuous cumulative distribution functions. The Portmanteau theorem therefore yields
This is by independence of random variables.
There is a stronger conclusion than the requested limit. For , the event forces , because is an integer. In particular, at least arrivals have occurred by time , so the -th Poisson arrival time satisfies . This contradicts for . Thus the two events are disjoint:
Set and . The Poisson interarrival times are independent and identically distributed random variables with the rate-one exponential distribution. In particular, and , so the finite, positive variance hypothesis of the central limit theorem holds. Since ,

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact