Write , so . Each product has mean one, and its variance is
Adjacent products share one factor, giving covariance one by part (a)(iii). Products whose indices differ by at least two involve disjoint independent random variables, so their covariance is zero. There are adjacent pairs. By the variance of a sum,
Assume finite second moments and write . Expanding the square in the definition of variance gives
Recognizing the two variances and the covariance, we obtain
The products and share , so they are not independent. Using the definition of covariance and the independence of ,
By contrast, and depend on disjoint sets of independent random variables, so they are independent and have zero covariance. Hence
Starting from at time , the markov property and the time-independent transition rules give . Therefore
Write . The conditional probability becomes
The conditioning selects paths which have avoided the absorbing state up to time ; it is therefore quite different from the unconditioned probability , which tends to zero.
The characteristic equation of a linear recurrence is
Its distinct roots are and , so . The initial conditions are and , giving and . Hence , , and
Let . The law of total probability applied to the current markov chain state gives
The second equality holds because can only be reached from . Eliminating gives the linear recurrence relation
There are two paths from back to in two steps: and . By the markov property, their probabilities multiply along each path. Therefore
For a finite or countable partition of a set into events , the law of total probability states
The events are pairwise disjoint and have union , so countable additivity proves the formula. Terms with contribute zero and are omitted to avoid undefined conditional probabilities.
A partition of a set is a collection of nonempty subsets whose union is and which are pairwise disjoint:
For use with probabilities, the must also be events in the sample space.
For the geometric distribution, , so the probability generating function of the size-biased distribution is
If are independent and identically distributed with geometric distribution of parameter , the probability generating function of an independent sum gives
At zero, interpret the expression by its continuous extension. The probability generating functions agree, hence
One can also check the probability mass functions directly: for , there are positive integer pairs with sum , each having probability . Thus both sides assign probability to .
By the definition of a probability generating function,
Termwise differentiation of the power series is valid for . At , the equality extends by the finite mean assumption, and both sides equal one.
Since , its finite mean satisfies . Every is nonnegative, and
Thus is a probability mass function. It defines the size-biased distribution of : an outcome of size receives times its original relative weight.
The event occurs exactly when both and . By independence,
Thus
The new success probability is the chance that at least one of the two trials succeeds.
Using the geometric series, the probability generating function is
Differentiation gives
Put . Since takes positive integer values, . Taking differences of the given tail probabilities therefore yields, also for ,
This is the probability mass function of the geometric distribution on .
The finite geometric series identity gives, for each ,
For every fixed , the absolute value of this error tends to infinity as . Thus
and there is no uniform convergence on .

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact