Let be the expected time to complete the specified directed transition, starting at . This is a transition-completion time in a Markov chain, rather than merely a first visit to . First-step decomposition givesThe missing continuation in the middle equation represents successful completion, but its step is counted by the leading one. Substitution givesThus the requested expectation from is steps.
Articles by others on the same topic
There are currently no matching articles.