Use the standard infinite-population slotted ALOHA model with independent fresh arrivals with Poisson distribution , . Newly arrived packets attempt in the next slot. Given old backlogged packets, each independently attempts with fixed probability , so the retransmission count has binomial distribution , independent of and earlier random choices. Let record whether is zero, one, or at least two. A single transmission succeeds and departs; a collision makes every transmitted packet remain. Therefore
Only the present backlog determines the law of the next independent choices, so is a time-homogeneous Markov chain.
For , put and , with . Its nonzero transition probabilities are
For example, a single fresh arrival leaves the backlog unchanged only if no old packet transmits; if an old packet also transmits, that fresh arrival becomes a new backlogged packet. These cases explain the extra diagonal term and the suppressed one-step increase at . At the same formulas hold with , and for .
Here is an almost-sure proof of permanent collisions in constant-probability slotted ALOHA for , rather than just a positive-drift heuristic. For , the conditional exponential increment is
As this tends to a number strictly below one. Choose so the expression is at most one for . Stopping when the chain first enters gives a nonnegative supermartingale. Downward jumps have size at most one, so it hits at . Optional sampling theorem for a supermartingale, first at bounded times and then by a limit, yields the exponential-supermartingale escape bound
This is an irreducible Markov chain: every positive state can successively decrease to zero, and from zero Poisson batches reach every state at least two, with state one then reached from two. An irreducible recurrent Markov chain would hit that finite set with probability one from every state, contradicting the bound. Hence every state is a transient state, every finite set is visited only finitely often, and almost surely.
The conditional success probability is . The centered success indicators form a martingale difference sequence with bounded increments. The strong law for martingales with bounded increments gives
The conditional means have Cesàro average zero, while the strong law of large numbers gives . Therefore almost surely. Finally
decays exponentially along this linear backlog growth. Its sum over is almost surely finite. The Conditional Borel-Cantelli lemma then implies that only finitely many slots have zero or one transmission. Thus . At , a fresh batch of size at least two eventually occurs, after which at least two old packets retransmit in every slot, giving the same conclusion directly.
The qualification is essential: if , then depends only on the independent Poisson arrivals, and zero- or one-arrival slots occur infinitely often. Positive mean arrival rate alone, without the Poisson model or another assumption allowing collisions to develop, would also be insufficient: Bernoulli fresh arrivals and initial backlog zero never collide.
One alternative is binary exponential backoff: after collisions a packet selects a waiting time uniformly from and tries when its counter expires. Its attempt behavior depends on its collision history, rather than a common constant . Another possibility, if a backlog estimate is available, is to set the attempt probability near , keeping the offered retransmission count near one. These descriptions illustrate adaptive access rules; they do not assert that every backoff variant is stable at arbitrary load.
For a Markov chain invariant measure, , and hence . The irreducible Markov chain property supplies, for each , an with . Nonnegativity gives . Every coordinate of a nonzero invariant measure is positive.
Start the Markov chain at , and let be its first return time. Each product in the series is the probability of a path with no intermediate visit to . Thus
This is the expected number of visits to in an excursion, including the return endpoint and excluding the starting point. Because the chain is recurrent Markov chain, almost surely, and exactly one visit to is counted: . Counting the starting point instead of the return endpoint gives the equivalent usual excursion occupation measure.
For the lower bound, let , , and . The stationarity equations on , with , are . Iterating and using nonnegativity yields
The th coordinate on the right is precisely the partial excursion series for . Taking its increasing limit gives ; for equality follows from . The iteration is valid also on a countable state space because all summands are nonnegative.
For a finite graph , let , and let count connected components of the spanning open subgraph, including isolated graph vertices. The random-cluster model with and is
The partition function is the sum of these weights over all configurations, making the expression a probability measure.
For the lattice box, take all nearest-neighbor edges with both endpoints in . A random-cluster boundary condition is a partition of the boundary graph vertices. Vertices in one block are identified, or wired together, before counting components; the identifications do not add random edges. Let be the number of components of the resulting quotient open graph. Then
The free random-cluster boundary condition has singleton blocks, while the wired random-cluster boundary condition has one boundary block. Arbitrary partitions are allowed; no assumption that the partition itself has a planar realization is needed for the monotonicity statement.
Write if every block of is contained in a block of , so makes at least as many identifications. The precise boundary monotonicity of the random-cluster measure is
Equivalently, the expectation of every real-valued order-preserving function is larger under the more wired measure. This is stochastic domination of probability measures on the coordinatewise configuration order.
To prove it, condition on every edge except . If are already connected using those open edges and the boundary wiring, opening does not change , so its conditional open probability is . If they are not connected, opening it reduces by one. The ratio of the open weight to the closed weight is then . Thus the random-cluster single-edge conditional probability is
For the second number is at most the first. Adding open edges or making the boundary partition coarser can only turn a disconnected pair into a connected one. Therefore these conditional open probabilities are increasing in both the exterior configuration and the amount of wiring.
Run a heat-bath Markov chain for each boundary partition. At every step choose the same uniformly sampled edge in both chains, sample the same independent uniform variable , and set that edge open if is below its conditional open probability. Start both chains at the all-closed configuration. By the preceding inequality, the two configurations remain ordered at every update. Each marginal chain has its corresponding random-cluster measure as its stationary distribution: resampling one coordinate from its conditional distribution preserves that law. Because and , every update gives both possible states positive probability; the finite chain is an irreducible Markov chain with aperiodicity, and hence converges to its unique stationary distribution. Taking expectations of any order-preserving function and passing to the limit proves the claimed stochastic domination of probability measures. At the two conditional probabilities agree, and the boundary condition has no effect on the independent bond percolation law.
For the final identity fix a plane embedding of the finite planar graph, and include the unbounded face in its planar dual graph. In the dual configuration , a dual edge is open exactly when its crossed primal edge is closed. Let . The spanning open primal subgraph has graph vertices, edges, and components. The Euler formula for a connected planar graph, applied componentwise with the common exterior face accounted for, gives its number of faces as
Deleting a closed primal edge merges its incident original faces precisely when its dual edge joins distinct dual components. Consequently the faces of the open primal subgraph correspond exactly to components of the open complementary dual subgraph. This remains true for bridges and loops, with their dual loops and bridges, and for a disconnected primal graph. Thus the planar cluster-count identity is
At the self-dual parameter of the random-cluster model, put and
For fixed the factor is independent of . The weight is therefore proportional to
Absorbing the remaining graph-dependent factor into the normalization gives the symmetric cluster weight at the self-dual parameter:
Counting the outer dual face and all isolated primal graph vertices is essential for the constant in the Euler identity. No assumption that is self-dual is required for this proportionality.
Let be the transition kernel of the Markov chain. It is phi-irreducible if there is a nonzero sigma-finite measure such that, for every measurable and every starting state ,
Equivalently, there is positive probability of eventually reaching every set of positive reference measure. For a finite state space with counting measure, this becomes ordinary irreducible Markov chain accessibility. On a continuous space, requiring access to each individual point would usually be inappropriate; positive-measure sets play that role. Irreducibility requires positive probability, rather than probability one, and does not itself assert recurrence or a finite mean return time.
Fix any configurations and . List the sites where they differ and update those sites in turn to their target signs. Every specified site has positive probability of being selected. At every intermediate configuration, both values of its full conditional distribution have positive probability, since all weights are finite and strictly positive. The finite prescribed sequence therefore has positive probability and reaches .
Thus every configuration is accessible from every other configuration, so the sampler is an irreducible Markov chain, or equivalently phi-irreducible with counting measure. If , a single update that keeps its selected spin unchanged also has positive probability. This simultaneously proves positive self-transition probability and aperiodicity, including . The sign of finite does not alter the accessibility argument.
A finite irreducible Markov chain is positive recurrent. Its mean recurrence time to state , starting at and counting the first positive return, is . This identity comes from the long-run fraction of time spent at that state: successive return cycles each contain one visit at their start, so the fraction is the reciprocal of the mean cycle length. It remains valid for a periodic chain.
Here , hence
For the return is deterministically after two minutes, which checks the formula.
An open migration process is a continuous-time Markov chain recording the populations of finitely many colonies. Independent external Poisson processes bring individuals to colony at rate . When that colony contains individuals, a departure opportunity occurs at total rate , with . The departing individual moves to colony with probability , or leaves the system with probability . Routing choices and the clocks are independent. A return to the same colony does not change the state.
The word open means that the routing matrix is transient: every individual eventually leaves, or equivalently the spectral radius of is less than one. The traffic equations of an open migration process, with row-vector convention, give the total arrival rates:
These rates include migrations as well as external arrivals. On the active colonies assume and the usual irreducible Markov chain condition. Put
The product form and its normalization condition are
To establish the product-form stationary distribution of an open migration process, first use its unnormalized weight . Its ratios satisfy . The incoming external arrivals into , divided by , contribute . Incoming exits contribute . Incoming migrations from to contribute . Terms involving an empty destination are zero. Thus the full incoming rate divided by is
Here the traffic equations of an open migration process give the second equality, including . The right side is precisely the total outgoing rate. This proves global balance for a continuous-time Markov chain; pairwise detailed balance is not required for general routing.
For finite rates at each finite population, the continuous-time Markov chain is nonexplosive Markov chain: its total population is bounded over a finite time interval by the initial population plus the finitely many external arrivals, so it visits a finite set on which all jump rates are bounded. Consequently finite normalize the invariant weight to a stationary distribution. Under the stated irreducible Markov chain assumptions, this is the unique stationary distribution, and it is a positive recurrent Markov chain. Conversely, the unique invariant measure of an irreducible recurrent chain is proportional to , so a positive recurrent Markov chain requires its normalization to be finite. A sufficient condition is ; the series criterion itself is the exact condition. Colonies with have zero stationary population and can be removed from the active class.
For the single-server M-M-1 queue specialization, for , each stationary colony has the geometric distribution of an M-M-1 queue:
The traffic equations of an open migration process do not involve the service rates, so the remain fixed during this service-capacity allocation in an open migration process. Write , and . A stationary allocation requires , with and . The Cauchy-Schwarz inequality gives
Equality holds exactly when is proportional to . Hence, for positive arrival rates, the unique optimal service allocation and the minimum expected value of the total population are
If and some arrival rate is positive, no stable service allocation exists. Zero-arrival colonies need no service in their stationary empty class: allowing zero service there gives the same formula restricted to active colonies. If strictly positive service is demanded even at inactive colonies, the displayed minimum is an infimum approached as that unused allocation tends to zero. If all arrivals vanish, the stationary mean population is zero for every allocation that drains the initial population.
In a loss network with fixed routing, calls of type arrive as independent Poisson processes with rates . Every accepted call occupies units of resource throughout its holding time. The link-route incidence matrix has nonnegative integer entries, is the resource-capacity vector, counts calls currently present, and is the th coordinate unit vector. The feasible occupancy space is
The inequalities are coordinatewise. A call that would leave this space is rejected immediately, without queuing or changing . With independent unit-rate exponential distributions for holding times, the memoryless property makes a continuous-time Markov chain, whose nonzero off-diagonal transition rates are
There are independent clocks of rate one for the second transition. Rejected arrivals are not jumps and do not appear in the off-diagonal transition rates.
Let . For every feasible adjacent pair,
Thus detailed balance for a continuous-time Markov chain gives the product-form stationary distribution of a loss network:
In this convention is the reciprocal normalizing sum. If every route consumes some resource, finite capacities make finite. Even zero-resource routes cause no normalization difficulty: the sum is at most . With positive arrival rates the reachable feasible class is an irreducible Markov chain, since calls can depart to the empty state and any feasible occupancy can be built from it. The stationary distribution is therefore unique on that class.
The vector records the free units of each resource. Its probability distribution sums over all occupancies with the same free resources. The map from to generally loses information: different call mixtures may consume exactly the same resources.
For , the conditional expectation can be computed by removing one call. The factorial identity gives
Indeed, is a bijection from the occupancies in this sum with to occupancies using units. Conversely, adding one call to any such occupancy is feasible because its final resource use is . Consequently
and the conditional expectation is zero otherwise. Conditioning the identity and multiplying by now yields
Alternatively, multiply the preceding unnormalized factorial identity by and sum over directly; this proves the same formula even when , without dividing by a zero probability. This gives both the conditional expectation argument and the direct summation argument.
Use an ideal carrier-sense multiple access scheme on the interference graph. An active station finishes its transmission after an independent unit-rate exponential distribution waiting time. An inactive station has an independent attempt clock with an exponential distribution of rate ; an attempt succeeds only when all its neighbors are inactive. Attempts that are blocked do not change the state. Thus, on the independent sets represented by , the continuous-time Markov chain has transition rates
The empty independent set can be reached by successive deactivations, and any other independent set can be reached from it by successive activations. Hence this finite chain is an irreducible Markov chain. The weight satisfies
By detailed balance for a continuous-time Markov chain, its unique stationary law is
This is a finite exponential family. Its natural parameter of an exponential family is and its mean parameter of an exponential family is the vector of active fractions.
The throughput region of an interference graph is exactly . To see the possibly less immediate inclusion, suppose a random feasible schedule has mean . Retain each of its active vertices independently with probability , interpreting zero coordinates as always deleted. A subset of an independent set remains an independent set; the thinned schedule has mean exactly . Thus lies in the convex hull of . The opposite inclusion follows from the definition using equality. Moreover , so this convex hull has full dimension.
Now choose such that remains in the interior of . Use interior moment matching in a finite exponential family. Consider the convex function
There is a ball of radius around contained in . Maximizing a linear functional over the convex hull is the same as maximizing over its generating set, so, for every ,
The last inequality uses the point when . Hence is a coercive function and has a finite minimizer . Differentiating the finite normalizing sum gives
This covariance matrix is a positive-definite matrix: a linear functional constant on all states of positive weight must be constant on , so its coefficients vanish. Thus is a strictly convex function; its minimizer is unique. At that minimizer the desired strict service margins are
For a backlogged station that transmits at unit speed whenever active, the long-run throughput is , by the ergodic theorem for a finite continuous-time Markov chain. Therefore the ideal carrier-sense multiple access scheme can supply a strict service margin for every arrival vector in the interior of the throughput region of an interference graph. The local attempt rates can realize the whole interior capacity region in this sense. Boundary points may require parameters tending to infinity, and the argument gives no uniform delay or mixing-time bound near the boundary.
Every reachable state reaches zero deterministically in steps. For , choose a supported lifetime ; zero can jump to and then count down to . Thus the chain is an irreducible Markov chain on . Its positive-probability first return lengths are exactly the support of ; all other return lengths are sums of such lengths. Their greatest common divisor is therefore one by assumption, so the chain is an aperiodic Markov chain.
The equilibrium residual-life distribution is
It is a probability distribution because the tail-sum identity gives . With zero masses outside ,
so it is a stationary distribution. This also displays why finite mean is needed for normalization.
Use the countable-state Markov chain convergence theorem: an irreducible, aperiodic, positive recurrent discrete-time chain on a countable state space has a unique stationary distribution and for every pair of states. All hypotheses were verified, including positive recurrence in part (b). Since and ,
The finite-state convergence theorem alone would not suffice when the lifetimes are unbounded. The gcd hypothesis is also necessary for this ordinary limit: deterministic lifetime 2, for example, produces alternating renewal probabilities rather than convergence.
For the usual undirected graph with at least two vertices, a simple random walk chooses a neighbor uniformly at each step, so when and are adjacent and zero otherwise, where is the degree of a vertex. The handshaking lemma gives . Thus the stationary distribution of a graph random walk is
For adjacent , , and for nonadjacent pairs both sides vanish. By detailed balance, this is an invariant distribution and the walk started from it is a reversible Markov chain. Connectedness makes the finite walk an irreducible Markov chain, giving uniqueness of its invariant distribution. No aperiodicity assumption is needed for uniqueness, so a bipartite graph is allowed.
If the connected graph has a single isolated vertex, the usual neighbor-choice formula is undefined. With the natural absorbing convention , its unique invariant distribution is and it is reversible. The degree-normalization formula presupposes at least one edge.
For probability distributions on a finite set, the total variation distance is
The equality follows by taking : the positive and negative parts of have the same mass, since its total mass is zero.
Use the stationary distribution identity . For each initial state ,
The triangle inequality for total variation distance, followed by the definition of the pairwise mixing diameter, gives
Taking the maximum over proves . This particular inequality only needs a stationary distribution; it does not require an irreducible Markov chain or an aperiodic Markov chain.
For a finite irreducible Markov chain that is an aperiodic Markov chain, set
Here is its unique stationary distribution, and the distance is total variation distance. Applying a Markov kernel contracts total variation distance, so is nonincreasing and the minimum is finite.
Use the ratio definition of cutoff: a family has cutoff for Markov chains if, for every fixed ,
with the denominator positive eventually. Thus the transition between any two fixed distance levels takes negligible time compared with the mixing time scale. By monotonicity and squeezing, this also gives for any fixed .
Some definitions of cutoff for Markov chains additionally require the mixing time to diverge. That extra requirement cannot be built into the definition here: the final request in part (d) explicitly asks for a bounded-time counterexample. The ratio convention is the one consistent with that request.
Take the real inner product
The stationary distribution is strictly positive for an irreducible Markov chain. Detailed balance gives , so is a self-adjoint operator. Choose a real orthonormal eigenbasis , where , , , , and for .
For fixed , apply the spectral decomposition to . Its coefficient against is , whereas . Thus the spectral kernel expansion of a reversible chain is
This holds for all integers ; at each multiplier is one, including when . Negative eigenvalues are allowed, and retain their signs for odd .
Let be the number of states and put
The absolute L2 spectral gap of a reversible Markov chain is ; in this question the relaxation time means the absolute relaxation time. For a nonlazy reversible Markov chain, it may differ from the reciprocal of the ordinary spectral gap . For a finite irreducible Markov chain that is an aperiodic Markov chain, .
For , choose a real eigenfunction whose eigenvalue has modulus , and an initial state maximizing . It has , and the definition of total variation distance implies
This is the eigenvalue lower bound for total variation mixing, . At , for ,
The second inequality follows from , the supplied inequality with . Since ,
When the left side is zero, so no logarithm of zero is needed. For the left side is nonpositive and the conclusion is automatic. A one-state chain has mixing time zero; with the convention the bound is again trivial.
For a finite irreducible Markov chain satisfying detailed balance, define the directed-edge capacity . For every ordered pair choose a path from to using only positive-capacity edges; take the empty path for . Let count occurrences of the directed edge . The canonical paths Poincare bound says that
is a valid Poincare inequality for a reversible Markov chain constant. Simple paths give ; allowing repetitions requires the multiplicities shown.
To prove the theorem, expand the variance using two independent samples from :
Telescoping along and applying the Cauchy-Schwarz inequality gives
Interchange the finite sums, then use the definition of :
Consequently . All edges here are directed, so the in the Dirichlet form of a Markov chain is retained consistently.