Jump chain of a discrete-time Markov chain

ID: jump-chain-of-a-discrete-time-markov-chain

For , observe a discrete-time Markov chain only when its state changes. The probability that its next different state is is . Its holding times are finite geometric waiting times. This construction deletes self-transitions and differs from the existing continuous-time jump-chain concept.

New to topics? Read the docs here!