Constant-drift hitting-time identity

ID: constant-drift-hitting-time-identity

For a finite Markov chain, let be the first hitting time of , assume almost surely, on and on its complement, with . The stopped martingale has mean . Boundedness of and bounded convergence theorem give ; monotone convergence then gives the stated finite expected hitting time. No drift condition is required after entry into .

New to topics? Read the docs here!