Consider an irreducible Birth-death chain on . At zero let and . At , let and , with . DefineIn the recurrent case, is the expected number of visits to during a cycle started at zero, counting times . The initial visit gives . Each upward crossing of an edge before the return is paired with a downward crossing, giving and the product formula. Tonelli's theorem then gives . Consequently the recurrent chain is positive recurrent exactly when this sum is finite, and its Stationary distribution is .
The finiteness criterion also rules out transience without assuming recurrence in advance. Put and . Then . If , then , so and . The birth-death scale-function hitting formula therefore implies recurrence. This separates stationary occupation weights from the inverse-direction scale weights , which serve different purposes.
Articles by others on the same topic
There are currently no matching articles.