For a real function on a finite state space, a state minimizing satisfies , so strictly negative drift cannot hold at every state. Equivalently, telescoping the expected value would give , contradicting boundedness of . Constant negative drift is useful before a target is reached; it must be restricted to the states outside that target.
Articles by others on the same topic
There are currently no matching articles.