The displayed identity requires a correction to the process construction in the source. In a piecewise-deterministic Markov process, the instantaneous hazard function is evaluated at the current flowing state , and the destination is sampled from . Keeping the jump times and destinations of the original Markov jump process instead evaluates both quantities at its last reset state , which generally differs from . The source PDF confirms that these original jump times and destinations were retained. Consequently its definition does not in general produce the asserted transition kernel, or even a Markov process in the state variable alone.
For an explicit counterexample, take , , , and let every be the standard normal distribution, independently of . These are smooth coefficients with bounded positive jump rate, so nonexplosion holds. In the literal construction, the first holding time has the exponential distribution of rate . Thus the probability distribution of has an atom of mass at . Paths with at least one jump contribute no atom there, because the reset has a normal density. The asserted identity instead assigns to this no-jump atom the masswhich differs for every .
Here is the full derivation for the intended piecewise-deterministic Markov process. Assume nonexplosion; smoothness alone does not guarantee it. Start at , let be the first jump after , and setOne precise construction draws an independent unit-rate exponential random variable and takes , with . This implements a hazard function along the flow of a vector field, rather than a fixed exponential holding time at the last reset. Its survival probability and jump-time probability density function areEquivalently, with . On , the terminal state is . Conditional on , draw the new state from and restart the same construction from . The Markov property and the tower property of conditional expectation therefore give the first-jump decomposition of a piecewise-deterministic Markov processThis proves the requested identity under the corrected construction, for every bounded Borel measurable function . The two contributions partition according to whether the first jump occurs before ; later jumps are already contained in .
For comparison, the literal construction does have a different renewal identity when started at a reset with . If denotes only these reset-start operators, the same conditional expectation argument givesThese need not be the transition operators conditional on at an arbitrary time: that observation does not specify the hidden reset state. This distinction explains exactly why replacing only the between-jump paths is insufficient.
Articles by others on the same topic
There are currently no matching articles.