Let be the expected time to complete the specified directed transition, starting at . This is a transition-completion time in a Markov chain, rather than merely a first visit to . First-step decomposition gives
The missing continuation in the middle equation represents successful completion, but its step is counted by the leading one. Substitution gives
Thus the requested expectation from is steps.