A Lumped Markov chain records only a partition class of the original state. It is Markov when the Transition probability into every class is constant within each source class.
A function of the current state of a Markov chain can discard information needed to predict its next value. A sufficient condition preserving the Markov property is strong lumpability: all original states with the same recorded value must give the same transition probabilities to every recorded class.
For the two-column model in growth rate of two-column sticky deposition, the pair of column heights is Markov, but its maximum alone is not. Starting empty, the maximum-height histories and both end at height two. The former leaves unequal columns, so the next height increases with probability ; the latter leaves equal columns, so it increases with probability one. Each history has positive probability. Their different predictions at the same time and current value violate the Markov property. By contrast, the absolute height difference retains exactly the information needed for its own transitions.
For a triangular-lattice walk in a sixty-degree wedge with rate on interior edges and doubled outward boundary rates, the horizontal position is conditionally uniform on given its current vertical level and past levels. Within level , the reflecting horizontal generator is symmetric, while vertical killing has constant rate , so the uniform law survives any holding period. Each column of the upward or downward transition-rate block has sum for , yielding a uniform conditional law at the next level. The induced birth-death process has rates and . Its probability of ever hitting zero from level is , so it is transient.
Articles by others on the same topic
There are currently no matching articles.