Constant-drift hitting-time identity
ID: constant-drift-hitting-time-identity
For a finite Markov chain, let be the first hitting time of , assume almost surely, on and on its complement, with . The stopped martingale has mean . Boundedness of and bounded convergence theorem give ; monotone convergence then gives the stated finite expected hitting time. No drift condition is required after entry into .
New to topics? Read the docs here!