At an almost surely finite stopping time, a Markov process restarts from its stopped state with the same transition law and independently of the history conditional on that state.
Let switch between at rate and be killed into zero at rate . To exceed a new level it must cross it in state . Restarting there by the Strong Markov property gives the multiplicative identity , hence an exponential tail. First-step conditioning gives and . Substituting the exponential determines its rate as .
Let and . Before returning to , the chain visits zero times with probability and, for , exactly times with probability
When , the expected number of visits is .

Ancestors (7)

  1. Markov chain
  2. Markov process
  3. Probability theory
  4. Probability and statistics
  5. Area of mathematics
  6. Mathematics
  7. Home

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (0)

There are currently no matching articles.