Nonnegative superharmonic function for a Markov chain
ID: nonnegative-superharmonic-function-for-a-markov-chain
For a transition matrix , a finite-valued function on its state space is nonnegative superharmonic when . Thus and its expected value cannot increase after one step. Replacing transitions on a target set by identity rows preserves . Iterating this inequality gives , a useful bound for hitting probabilities without a separate optional-stopping theorem.
New to topics? Read the docs here!