Let be the rate of each individual flow on route , so its aggregate rate is . The feasible allocations satisfy . An allocation has proportional fairness if, for every feasible ,
Equivalently it maximizes over positive active-route rates. This is the first-order optimality condition for a concave objective on a convex set. Rates for absent flows can be set to zero.
For the linear flow network, put and . If , unused capacity on link could increase , so
When , write . For active local routes their aggregate rates are , and the objective, up to constants independent of , is
For , differentiation gives , hence ; when the maximizing endpoint is , giving the same answer. Thus the proportionally fair allocation on a linear flow network is
If and , this gives on every active local route, as expected. No departure occurs at the empty state.
Independent Poisson processes of flow arrivals and independent exponential distributions of document sizes make the count vector a continuous-time Markov chain. By the memoryless property, a surviving residual size with exponential distribution still has rate per unit of transferred data, so each route- flow completes at instantaneous rate . The transition intensities are
Hence the through-route departure rate is and each active local route's rate is .
To obtain the stationary law of a linear flow network, define
For a through departure ; for an active local departure . These are exactly the aggregate service rates, so the detailed balance identities hold. This also shows why the binomial coefficient is essential; a factor would not have the required ratios.
For fixed local counts with total , the negative binomial series gives
Sum the remaining independent geometric series to find
The given load conditions make every series converge. Setting proves
The chain has bounded total departure rate, finite arrival rate and no explosion. With positive arrival rates it is irreducible, and this normalized invariant law gives the positive recurrent Markov chain property; zero arrival rates restrict the stationary support to the corresponding reachable class.
Summing out shows local-count independence in a linear flow network: the local counts have independent geometric distributions on with ratios . Therefore
They are independent of one another under the stationary marginal, despite sharing the random through-flow population. The through count is generally dependent on them.
In a time-homogeneous continuous-time Markov chain, a state's holding time is exponential with rate equal to its total outgoing transition intensity. Converting the specified times to months gives
The exit-type probability follows by dividing its transition intensity by the total exit rate. Therefore
These are starting values for numerical estimation, rather than further observations or constraints on the final fitted rates.
A feasible per-flow allocation satisfies for each active route and . It has proportional fairness if every feasible competitor obeys
By the first-order inequality for the strictly concave logarithm, this is equivalent to maximizing weighted logarithmic utility over the feasible allocations. Inactive-route rates are immaterial; set them to zero as a convention.
Write , , , and . The capacity constraints are and . For , put . Each active local route uses its remaining capacity . Omitting constants, the utility is
Its maximum has ; when , the maximum is the endpoint . Hence for active routes
These formulas also give and when . When there is no allocated service. Equivalently, the aggregate route rates for are
This is the proportionally fair allocation on a two-resource linear network for a two-resource linear flow network.
For independent Poisson processes of documents and independent document sizes with exponential distribution of rate , the memorylessness of the exponential distribution makes the population a continuous-time Markov chain. Its transition intensities are
The departure intensity sums the independent completion hazards . There is no departure on an inactive route. Set , with .
To prove the proposed stationary distribution, define the balance function of a flow-level network
For an active local route, , while for the through route this ratio is . Thus . The weights
satisfy detailed balance on every arrival-departure pair:
Each total jump rate is bounded by , so the chain is a nonexplosive Markov chain; normalized detailed-balance weights therefore give its stationary distribution, the stationary law of a two-resource linear flow network.
Use the negative binomial series to sum first over :
The remaining two geometric series give
All summands are nonnegative. Consequently the sum is finite exactly under the stability conditions for a two-resource linear flow network
These say that the offered load on each unit-capacity resource is strictly below one. Equality is insufficient: at least one geometric series then diverges. If all arrival rates are positive, the chain is irreducible and the normalizable law is its unique equilibrium law.
Finally put , . Summing over yields
Thus the two local-route counts are independent, each with geometric distribution on the nonnegative integers. The conditional through-route count has negative binomial distribution
For positive traffic rates this depends on the local counts, so all three route counts are not independent. More quantitatively, , and likewise for . If zero arrival rates are allowed, the exceptional independent cases are , or , when the relevant counts are deterministic zero. This distinction is local-count independence with through-flow dependence.
Use three states of a continuous-time Markov chain: disease-free , pre-clinical , and clinical . The transition intensities are for onset and for progression. Clinical disease is an absorbing state. The mandatory pre-clinical phase excludes a direct jump, and this untreated progression model has no reverse transitions.
Figure 1.
Irreversible cancer progression from disease-free to pre-clinical to clinical states
.
With row-vector probabilities and state order , the generator matrix is
Its rows sum to zero, so only the two off-diagonal transition intensities are unknown. This is a continuous-time multi-state model with sequential irreversible progression.
For the stochastic SIR model, the state is a continuous-time Markov chain on nonnegative integer triples summing to , initially . Its only transitions are
Rates vanish when a proposed transition would leave the state space. Equivalently, with independent unit-rate Poisson processes , the Poisson time-change representation of a Markov chain is
The left limits describe the state immediately before each jump. In the Gillespie algorithm, wait an exponential distribution time with rate , then choose infection or recovery in proportion to these two rates.
An open migration process is a continuous-time Markov chain recording the populations of finitely many colonies. Independent external Poisson processes bring individuals to colony at rate . When that colony contains individuals, a departure opportunity occurs at total rate , with . The departing individual moves to colony with probability , or leaves the system with probability . Routing choices and the clocks are independent. A return to the same colony does not change the state.
The word open means that the routing matrix is transient: every individual eventually leaves, or equivalently the spectral radius of is less than one. The traffic equations of an open migration process, with row-vector convention, give the total arrival rates:
These rates include migrations as well as external arrivals. On the active colonies assume and the usual irreducible Markov chain condition. Put
The product form and its normalization condition are
To establish the product-form stationary distribution of an open migration process, first use its unnormalized weight . Its ratios satisfy . The incoming external arrivals into , divided by , contribute . Incoming exits contribute . Incoming migrations from to contribute . Terms involving an empty destination are zero. Thus the full incoming rate divided by is
Here the traffic equations of an open migration process give the second equality, including . The right side is precisely the total outgoing rate. This proves global balance for a continuous-time Markov chain; pairwise detailed balance is not required for general routing.
For finite rates at each finite population, the continuous-time Markov chain is nonexplosive Markov chain: its total population is bounded over a finite time interval by the initial population plus the finitely many external arrivals, so it visits a finite set on which all jump rates are bounded. Consequently finite normalize the invariant weight to a stationary distribution. Under the stated irreducible Markov chain assumptions, this is the unique stationary distribution, and it is a positive recurrent Markov chain. Conversely, the unique invariant measure of an irreducible recurrent chain is proportional to , so a positive recurrent Markov chain requires its normalization to be finite. A sufficient condition is ; the series criterion itself is the exact condition. Colonies with have zero stationary population and can be removed from the active class.
For the single-server M-M-1 queue specialization, for , each stationary colony has the geometric distribution of an M-M-1 queue:
The traffic equations of an open migration process do not involve the service rates, so the remain fixed during this service-capacity allocation in an open migration process. Write , and . A stationary allocation requires , with and . The Cauchy-Schwarz inequality gives
Equality holds exactly when is proportional to . Hence, for positive arrival rates, the unique optimal service allocation and the minimum expected value of the total population are
If and some arrival rate is positive, no stable service allocation exists. Zero-arrival colonies need no service in their stationary empty class: allowing zero service there gives the same formula restricted to active colonies. If strictly positive service is demanded even at inactive colonies, the displayed minimum is an infimum approached as that unused allocation tends to zero. If all arrivals vanish, the stationary mean population is zero for every allocation that drains the initial population.
In a loss network with fixed routing, calls of type arrive as independent Poisson processes with rates . Every accepted call occupies units of resource throughout its holding time. The link-route incidence matrix has nonnegative integer entries, is the resource-capacity vector, counts calls currently present, and is the th coordinate unit vector. The feasible occupancy space is
The inequalities are coordinatewise. A call that would leave this space is rejected immediately, without queuing or changing . With independent unit-rate exponential distributions for holding times, the memoryless property makes a continuous-time Markov chain, whose nonzero off-diagonal transition rates are
There are independent clocks of rate one for the second transition. Rejected arrivals are not jumps and do not appear in the off-diagonal transition rates.
Let . For every feasible adjacent pair,
Thus detailed balance for a continuous-time Markov chain gives the product-form stationary distribution of a loss network:
In this convention is the reciprocal normalizing sum. If every route consumes some resource, finite capacities make finite. Even zero-resource routes cause no normalization difficulty: the sum is at most . With positive arrival rates the reachable feasible class is an irreducible Markov chain, since calls can depart to the empty state and any feasible occupancy can be built from it. The stationary distribution is therefore unique on that class.
The vector records the free units of each resource. Its probability distribution sums over all occupancies with the same free resources. The map from to generally loses information: different call mixtures may consume exactly the same resources.
For , the conditional expectation can be computed by removing one call. The factorial identity gives
Indeed, is a bijection from the occupancies in this sum with to occupancies using units. Conversely, adding one call to any such occupancy is feasible because its final resource use is . Consequently
and the conditional expectation is zero otherwise. Conditioning the identity and multiplying by now yields
Alternatively, multiply the preceding unnormalized factorial identity by and sum over directly; this proves the same formula even when , without dividing by a zero probability. This gives both the conditional expectation argument and the direct summation argument.
Use an ideal carrier-sense multiple access scheme on the interference graph. An active station finishes its transmission after an independent unit-rate exponential distribution waiting time. An inactive station has an independent attempt clock with an exponential distribution of rate ; an attempt succeeds only when all its neighbors are inactive. Attempts that are blocked do not change the state. Thus, on the independent sets represented by , the continuous-time Markov chain has transition rates
The empty independent set can be reached by successive deactivations, and any other independent set can be reached from it by successive activations. Hence this finite chain is an irreducible Markov chain. The weight satisfies
By detailed balance for a continuous-time Markov chain, its unique stationary law is
This is a finite exponential family. Its natural parameter of an exponential family is and its mean parameter of an exponential family is the vector of active fractions.
The throughput region of an interference graph is exactly . To see the possibly less immediate inclusion, suppose a random feasible schedule has mean . Retain each of its active vertices independently with probability , interpreting zero coordinates as always deleted. A subset of an independent set remains an independent set; the thinned schedule has mean exactly . Thus lies in the convex hull of . The opposite inclusion follows from the definition using equality. Moreover , so this convex hull has full dimension.
Now choose such that remains in the interior of . Use interior moment matching in a finite exponential family. Consider the convex function
There is a ball of radius around contained in . Maximizing a linear functional over the convex hull is the same as maximizing over its generating set, so, for every ,
The last inequality uses the point when . Hence is a coercive function and has a finite minimizer . Differentiating the finite normalizing sum gives
This covariance matrix is a positive-definite matrix: a linear functional constant on all states of positive weight must be constant on , so its coefficients vanish. Thus is a strictly convex function; its minimizer is unique. At that minimizer the desired strict service margins are
For a backlogged station that transmits at unit speed whenever active, the long-run throughput is , by the ergodic theorem for a finite continuous-time Markov chain. Therefore the ideal carrier-sense multiple access scheme can supply a strict service margin for every arrival vector in the interior of the throughput region of an interference graph. The local attempt rates can realize the whole interior capacity region in this sense. Boundary points may require parameters tending to infinity, and the argument gives no uniform delay or mixing-time bound near the boundary.
Only routes with contribute to proportional fairness or to the weighted logarithmic utility; omit inactive routes from expressions with a rate in the denominator. Active routes have positive rates whenever a positive feasible allocation exists. For a feasible competitor , the elementary logarithm inequality gives
A zero competitor rate on an active route has utility and also cannot improve the objective. Therefore a proportionally fair allocation maximizes the logarithmic objective. Conversely, the feasible set is a convex set, and differentiating the objective along at shows that an optimizer satisfies the proportional fairness inequality. Strict concavity gives uniqueness on active coordinates; rates assigned to nonexistent flows are immaterial.
In the linear flow network, put and for active routes. A local route uses only resource . If and , increasing increases the objective without violating any other constraint. Thus each active local route saturates its resource:
Write and . For and , substitute into the objective. Apart from constants its dependence on is
Its derivative vanishes when , and its second derivative is negative. Hence the per-flow through-route rate is
If , the optimal through-route aggregate rate is one, so still holds. If , each active local route has , also given by the displayed local formula. When there are no flows and no departures. Inactive coordinates need not be assigned these undefined per-flow formulas.
Independent arrivals and exponential document sizes make this a flow-level network model. A document of type has residual-size hazard per unit of data transmitted; when its transmission speed is , its completion hazard per unit time is . Thus the continuous-time Markov chain of flow counts has transition intensities
For these departure intensities are for the through route and for an active local route. Total arrival intensity is constant and total departure intensity is bounded by , ensuring a nonexplosive Markov chain.
Set , the offered traffic, and define the balance function of a flow-level network
The binomial coefficients satisfy
These identities also cover states with only one kind of active route. They show that the weight satisfies
Thus detailed balance for a continuous-time Markov chain proves that this is a reversible Markov chain and reduces the stationary distribution calculation to normalization.
Sum over first. The negative binomial series gives, for fixed local counts and ,
All summands are nonnegative, so the Tonelli theorem permits exchanging the sums. The partition sum is therefore
It is finite exactly when for every , for . These are the resource-load conditions: resource receives the through-route offered traffic plus its local offered traffic. The normalized stationary distribution is
With positive arrival rates this is the unique stationary distribution of the irreducible feasible flow-count chain. Zero arrival rates restrict its closed class to the corresponding zero coordinates.
Summing out also shows that the local counts are independent, with geometric distributions on :
Hence their mean flow counts are
The binomial balance factor is essential: independent geometric counts for all routes would not give these departure rates or the correct resource-load normalization.
Dividing the expected occupation time of a continuous-time Markov chain by and letting gives
For this is also the almost-sure long-run time fraction, not just the limit of an expectation. The two-state continuous-time Markov chain is irreducible and positive recurrent. Alternatively, a regeneration cycle consists of a mean symptom-free holding time followed by a mean symptomatic holding time; the renewal-reward theorem gives . This agrees with the stationary distribution solving and .
Starting in state 1, if the fraction is zero; if and the patient eventually enters state 2 forever, and the fraction is one. If both rates vanish, the fraction remains zero from this initial state and the quotient is undefined.
For a treated patient the recovery transition intensity is per year. A symptoms spell is a holding time with an exponential distribution of rate , so
The treatment multiplier for onset affects how often symptoms begin, not the duration of a spell once the patient is in state 2, under this homogeneous continuous-time Markov chain.
Let be a coarse-grained configuration, with restricted partition function and free energy . Its Boltzmann distribution is . Microscopic reversibility pairs every equilibrium microscopic history with a history read backwards, including reversal of all time-odd variables. Summing this identity over the microscopic histories representing a given coarse-grained path preserves it; a Markov assumption is not needed for this argument.
Write for the probability density of a specified history conditional on its starting configuration , and for its physically reversed history conditional on starting at , where reverses time-odd variables. Equilibrium time-reversal symmetry gives
Since , the desired conditional path relation is
For a reversible Markov chain, this also follows by multiplying detailed balance ratios along the history: the intermediate equilibrium weights telescope.
The conditioning is essential. If the starting equilibrium weights are included in the path probabilities, the forward and reversed probabilities are equal, rather than differing by the displayed exponential. For example, a two-state continuous-time Markov chain with , , rates and has equal equilibrium-weighted probabilities for the two reversed single-jump histories. Their conditional rate ratio is instead . Normalized bridges conditioned on both endpoints also have a different normalization from the path weights used above. The PDF prints in the denominator while its explanatory text defines ; the latter is the intended notation. For the scalar order parameter used subsequently, .
A time-homogeneous continuous-time Markov chain on a countable state space is a stochastic process with the Markov property: conditional on the current state, the law of its future depends on neither its past nor the current time. In the usual conservative, nonexplosive setting its sample paths are right-continuous step functions. Its Q-matrix has for , , and infinitesimal transition probabilities for .
On entering , the holding time has distribution ; independently, the next state is with probability . The successive states form the jump chain, whose transition probabilities are
If , the state is absorbing, its holding time is infinite, and the jump-chain convention is . Nonexplosion ensures this construction defines the process for all finite times rather than accumulating infinitely many jumps in finite time.
In a neutral Moran model, a population has labelled individuals; reproduction copies one individual's type to a uniformly chosen other individual, keeping population size fixed. One convenient time convention puts independent rate- Poisson arrows on each ordered pair of distinct individuals. Backwards in time, two sampled ancestral lineages merge whenever one copies the other, at total rate per unordered pair. In the convention where each individual reproduces at rate , this pair rate is if the parent cannot replace itself, and time must be rescaled accordingly.
Kingman's coalescent on labels is the continuous-time Markov chain on partitions of , initially all singleton blocks, in which each pair of distinct blocks merges at rate . With blocks, the waiting time is exponential of rate , and the merging pair is uniform. Kingman's infinite coalescent is the consistent partition process on whose restriction to each finite label set has this law; consistency and the extension theorem construct it. These time conventions are part of the definition.
Let be the number of blocks in the first labels. The expected time to reach at most blocks is
Markov inequality gives . As increases these counts increase to the total number of infinite-coalescent blocks, so the same bound holds for that number. Letting shows it is finite almost surely for each . Apply this simultaneously to positive rational times; monotonicity of the block count then covers every positive real time. Hence Kingman's infinite coalescent comes down from infinity almost surely.