At an almost surely finite Stopping time, a Markov process restarts from its stopped state with the same transition law and independently of the history conditional on that state.
Let X switch between ±1 at rate q and be killed into zero at rate λ. To exceed a new level it must cross it in state +1. Restarting there by the Strong Markov property gives the multiplicative identity ψ+(c+d)=ψ+(c)ψ+(d), hence an exponential tail. First-step conditioning gives ψ−(c)=∫0∞qe−(q+λ)uψ+(c+u)du and ψ+(c)=e−(q+λ)c+∫0cqe−(q+λ)uψ−(c−u)du. Substituting the exponential determines its rate as λ(2q+λ).
Let i=j belong to an irreducible recurrent Discrete-time Markov chain. Write Tk=inf{n≥0:Xn=k} and Tk+=inf{n≥1:Xn=k}. DefineThe positive return convention is essential: Ti itself is zero when starting at i. Let N count visits to j before the first positive return to i, including repeated holding visits at j. ThenWith Probability a the excursion reaches j. From each visit there, the Strong Markov property gives Probability b of hitting i before the next return to j. recurrence ensures there is no third possibility of escaping both states forever. Thus, conditional on reaching j, the visit count has a positive-support geometric distribution with mean 1/b.
a=Pi(Tj<Ti+),b=Pj(Ti<Tj+).
Pi(N=0)=1−a,Pi(N=k)=ab(1−b)k−1(k≥1),EiN=a/b.
Ancestors (7)
- Markov chain
- Markov process
- Probability theory
- Probability and statistics
- Area of mathematics
- Mathematics
- Home
Incoming links (138)
- Absorption-or-escape dichotomy for a chain with killing
- Brownian exit-time ball averaging identity
- Brownian exit-time skeleton
- Brownian first-passage subordinator
- Brownian first-passage time
- Brownian motion shifted at its finite-horizon maximum
- Brownian occupation time
- Brownian reflection at a stopping time
- Collision-path coupling for slotted ALOHA
- Directed edge occupation in a random-walk commute
- Divergence of a driftless Brownian exponential clock
- Divergence of a positive planar Brownian occupation integral
- Divergence of the conformal Brownian clock for an entire function
- Domain Markov property of a chordal Loewner chain
- Early exercise premium for a fixed barrier
- Embedded Markov chain at level exits
- Expected time to expand a random-walk range
- Finite exit from a conformal image of a bounded planar domain
- Fixed-level versus simultaneous Brownian passage-time equality
- Geometric return count before absorption
- Infinite occupation time of one-dimensional Brownian motion
- Kakutani solution of the Dirichlet problem
- Last-excursion direction law at a transient junction
- Last visited vertex of a simple random walk on a cycle
- Last visit to a bounded ball for three-dimensional Brownian motion
- Maximum of a killed telegraph integral
- Ordered-state visit times in a reversible chain
- Past exam of the continuous martingales and stochastic calculus course of the University of Oxford / 2023 / 3 / b / iii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2001 / iii / Paper 21 / 5 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2001 / iii / Paper 73 / 3 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2002 / iii / Paper 28 / 2 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2003 / iii / Paper 29 / 3 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2003 / iii / Paper 33 / 2 / c / iii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2004 / ib / Paper 1 / 11H / Solution
- Past exam of the mathematics course of the University of Cambridge / 2005 / ib / Paper 4 / 9D / Solution
- Past exam of the mathematics course of the University of Cambridge / 2005 / iii / Paper 34 / 5 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2006 / ib / Paper 1 / 19C / Solution
- Past exam of the mathematics course of the University of Cambridge / 2006 / ib / Paper 2 / 20C / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2006 / ib / Paper 2 / 20C / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2006 / iii / Paper 32 / 4 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2006 / ii / Paper 3 / 26J / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2007 / ib / Paper 4 / 9C / Solution
- Past exam of the mathematics course of the University of Cambridge / 2007 / iii / Paper 33 / 3 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2007 / iii / Paper 33 / 3 / d / Solution
- Past exam of the mathematics course of the University of Cambridge / 2007 / iii / Paper 33 / 4 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2007 / iii / Paper 35 / 3 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2008 / ib / Paper 1 / 19H / Solution
- Past exam of the mathematics course of the University of Cambridge / 2008 / ib / Paper 3 / 9H / Solution
- Past exam of the mathematics course of the University of Cambridge / 2008 / iii / Paper 34 / 6 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / ib / Paper 2 / 20H / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / iii / Paper 101 / 2 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / iii / Paper 101 / 4 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / iii / Paper 29 / 3 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / iii / Paper 31 / 5 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / ii / Paper 1 / 27J / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / ii / Paper 1 / 27J / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2009 / ii / Paper 1 / 27J / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2010 / iii / Paper 28 / 6 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2010 / iii / Paper 28 / 6 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2010 / iii / Paper 29 / 4 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2010 / iii / Paper 29 / 6 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2011 / ii / Paper 1 / 27J / ii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2011 / ii / Paper 1 / 27J / i / Solution
- Past exam of the mathematics course of the University of Cambridge / 2011 / ii / Paper 1 / 27J / v / Solution
- Past exam of the mathematics course of the University of Cambridge / 2012 / iii / Paper 33 / 6 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2013 / ib / Paper 1 / 20H / iii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2013 / ib / Paper 2 / 20H / iii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2013 / ib / Paper 2 / 20H / i / Solution
- Past exam of the mathematics course of the University of Cambridge / 2013 / iii / Paper 24 / 5 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2013 / iii / Paper 27 / 1 / ii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2014 / iii / Paper 26 / 3 / 2 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2014 / iii / Paper 26 / 3 / 3 / iii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2014 / iii / Paper 29 / 1 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2014 / iii / Paper 29 / 2 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2015 / iii / Paper 29 / 4 / ii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2016 / ib / Paper 3 / 9H / Solution
- Past exam of the mathematics course of the University of Cambridge / 2016 / iii / Paper 203 / 1 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / ia / Paper 2 / 12F / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / ib / Paper 4 / 9H / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 201 / 6 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 201 / 6 / d / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 202 / 4 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 202 / 6 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 214 / 3 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / ii / Paper 1 / 27K / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2017 / ii / Paper 1 / 27K / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2018 / iii / Paper 201 / 5 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2018 / iii / Paper 201 / 5 / d / Solution
- Past exam of the mathematics course of the University of Cambridge / 2018 / iii / Paper 214 / 3 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2018 / iii / Paper 310 / 2 / Solution
- Past exam of the mathematics course of the University of Cambridge / 2019 / ib / Paper 2 / 20H / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2019 / iii / Paper 201 / 4 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2019 / iii / Paper 201 / 5 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2019 / iii / Paper 201 / 5 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2019 / iii / Paper 215 / 4 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2019 / ii / Paper 2 / 27K / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2020 / ib / Paper 1 / 20H / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2020 / ib / Paper 1 / 20H / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2021 / ib / Paper 1 / 19H / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2021 / ib / Paper 1 / 19H / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2021 / iii / Paper 201 / 5 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2021 / iii / Paper 220 / 2 / c / i / Solution
- Past exam of the mathematics course of the University of Cambridge / 2021 / iii / Paper 220 / 3 / b / i / Solution
- Past exam of the mathematics course of the University of Cambridge / 2021 / iii / Paper 220 / 3 / d / iii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2022 / ib / Paper 1 / 19H / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2022 / ib / Paper 4 / 7H / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2022 / iii / Paper 201 / 5 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2022 / iii / Paper 215 / 1 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2023 / iii / Paper 201 / 2 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2023 / iii / Paper 201 / 6 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2023 / iii / Paper 201 / 6 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2023 / iii / Paper 203 / 1 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / ib / Paper 1 / 19H / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / ib / Paper 1 / 19H / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 201 / 3 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 201 / 4 / b / ii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 201 / 5 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 201 / 5 / d / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 202 / 4 / b / Solution
- Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 203 / 3 / c / Solution
- Past exam of the mathematics course of the University of Cambridge / 2025 / iii / Paper 201 / 2 / a / i / Solution
- Past exam of the mathematics course of the University of Cambridge / 2025 / iii / Paper 201 / 6 / d / ii / Solution
- Past exam of the mathematics course of the University of Cambridge / 2026 / ib / Paper 1 / 18H / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2026 / iii / Paper 226 / 1 / a / Solution
- Past exam of the mathematics course of the University of Cambridge / 2026 / iii / Paper 226 / 1 / b / i / Solution
- Past exam of the mathematics course of the University of Cambridge / 2026 / iii / Paper 226 / 2 / b / Solution
- Past exam of the probability course of the University of Oxford / 2021 / 3 / b / iv / Solution
- Past exam of the stochastic differential equations and Brownian motion in complex analysis course of the University of Oxford / 2007 / B / 5 / i / Solution
- Past exam of the stochastic differential equations and Brownian motion in complex analysis course of the University of Oxford / 2008 / B / 6 / ii / Solution
- Past exam of the stochastic differential equations and Brownian motion in complex analysis course of the University of Oxford / 2008 / B / 7 / Solution
- Past exam of the stochastic differential equations and Brownian motion in complex analysis course of the University of Oxford / 2009 / B / 4 / c / Solution
- Past exam of the stochastic differential equations and Brownian motion in complex analysis course of the University of Oxford / 2009 / B / 6 / b / Solution
- Recurrent Markov chain
- Reflection identity for Brownian exit from a half-disc
- Stationary cycle occupation formula
- Stopping time
- Two-state excursion visit law
- Winding at logarithmic radial passage levels
Discussion (0) New discussion
There are no discussions about this article yet.
Articles by others on the same topic (0)
There are currently no matching articles.