Outside a target set, first-step analysis for a Markov chain gives . Moving the holding term and dividing gives the displayed average over the next distinct state. Thus inserting or removing self-loops preserves eventual hitting probabilities, provided the state is not made absorbing and the relative probabilities of its exits are unchanged. Boundary values are one on the target and zero in closed classes unable to reach it. The waiting time changes, but the sequence of distinct visited states does not.
Articles by others on the same topic
There are currently no matching articles.