Residual lifetime Markov chain
ID: residual-lifetime-markov-chain
For a positive integer-valued lifetime , one discrete-time residual lifetime Markov chain uses states . From state it moves to . From zero it draws an independent new lifetime and moves to :The subtraction of one specifies the sampling convention: the next step has already consumed one unit of the new lifetime. With this convention, successive visits to zero are separated by exactly steps, not .
Its Stationary distribution is . The tail-sum identity normalizes these masses, and the balance equations verify them, with the obvious top-state equation. If deterministically, the chain cycles and its stationary law is uniform. It is periodic, so a Stationary distribution does not imply convergence from every initial state.
New to topics? Read the docs here!