Let be the probability of returning to after its first departure. Transience means ; in particular . By the Strong Markov property, the number of visits, including the initial visit, has the geometric distribution , . The holding times of these visits are independent variables and are independent of the jump-chain return decisions.
For the total occupation time of a continuous-time Markov chain and , summing over givesUniqueness of the Laplace transform identifiesStarting elsewhere adds an atom at zero if the state might never be hit; the purely exponential conclusion uses the specified initial state .
Articles by others on the same topic
There are currently no matching articles.