Markov chain return bridge

ID: markov-chain-return-bridge

For a time-homogeneous Markov chain started at , condition on a return to at a fixed later time , assuming that event has positive probability. The Markov property factors the probability of a visit to at time and a later return into the two transition probabilities in the numerator. Conditional probability then gives the formula. At the midpoint with and , it reduces to , where . If for , this midpoint return probability tends to even when unconditional returns tend to zero.

New to topics? Read the docs here!