When , an excursion after the jump from zero to one visits before its reset with probabilityThis tends to zero, so a catastrophe eventually occurs with probability one. Both the original chain and its jump chain are recurrent.
The expected number of jumps in a return cycle isThus the jump chain is null recurrent. But its holding time at has mean , and the initial holding time at zero has mean . The expected elapsed cycle time isThe continuous-time Markov chain is therefore positive recurrent. Its equilibrium distribution, computed as mean time in a state per mean cycle time, isThe entries sum to one by telescoping. The contrast is explained by progressively shorter holding times at the large states, not by a change in return probabilities.
Articles by others on the same topic
There are currently no matching articles.