Nonnegative superharmonic function for a Markov chain

ID: nonnegative-superharmonic-function-for-a-markov-chain

For a transition matrix , a finite-valued function on its state space is nonnegative superharmonic when . Thus and its expected value cannot increase after one step. Replacing transitions on a target set by identity rows preserves . Iterating this inequality gives , a useful bound for hitting probabilities without a separate optional-stopping theorem.

New to topics? Read the docs here!