A closed migration process is a continuous-time Markov chain with state , conserved population , and transition rates
Here , for , and is a fixed stochastic routing matrix. Take for convenience; self-routing can instead be omitted from the actual jumps. Assume irreducible routing. Let positive traffic weights satisfy . Define , . The product-form stationary distribution of a closed migration process is
To prove it, an incoming transition to comes from , and is possible only if . The weight ratio gives
Summing over and using the traffic equations gives . Summing then over equals , the outgoing probability flux, proving global balance for a continuous-time Markov chain. The state space is finite and irreducible, so this normalized stationary distribution is unique. Detailed balance is not required; a directed routing cycle, for example, is not reversible.
For the switchboard, make each of the lines one circulating individual. Use colonies for free lines, calls waiting for or receiving the operator's connection service, and already connected calls. The transitions form the cycle , with departure rates
The first rate is , not : incoming calls form one external Poisson process, not one per free line. An arrival when changes no state and is counted as lost. Exponential connection and conversation times make this the required continuous-time Markov chain; only one call receives the operator's service at a time, whereas every connected call independently completes at rate .
The cyclic traffic weights can all be chosen equal to one. Multiplying all unnormalized weights by the same gives, for ,
If is the number of occupied lines, sum over the possibilities for the connected-call count:
Thus the normalizer is and the full-state probability is . By Poisson arrivals see time averages, this is also the long-run fraction of attempted calls rejected:
One can also see the arrival-rate argument directly: the lost-call counting process has conditional intensity , so its equilibrium rate is ; dividing by the total attempted-call rate gives the same fraction. As an independent check, stationary flow conservation in a finite-line switchboard gives .
Use one particle for each telephone line, including unused lines. Let be the number of free lines, the number of callers waiting for or being checked by an operator, and the number using automated service. Then . These are the three colonies of a closed migration process, with directed cycle and departure rates
Rejected attempted calls leave the state unchanged. They must not be represented as extra customers in the waiting stage.
Equivalently the state is with . Its transitions are
The directed cycle has equal traffic weights; choosing each weight to be gives the unnormalized product-form stationary distribution of a closed migration process
We can verify global balance for a continuous-time Markov chain directly. Weighted incoming transitions from , and contribute, respectively,
Their sum equals the weight times the outgoing rate. This proves stationarity after normalization, without falsely asserting reversibility of the directed migration cycle.
For occupied lines, summing over the automated population gives
The normalizing constant is . The attempted calls form an independent Poisson process, so Poisson arrivals see time averages: the rate of attempted arrivals seeing a full state is times its stationary probability, and division by the total attempted-arrival rate gives the loss proportion. Consequently
The numerator is essential; the PDF contains it even though the converted TeX loses it.
With two independent operators, the total check-completion rate is . In particular it is only when one caller is present. Define
The human-stage weight becomes , while the free and automated weights are unchanged. The same global-balance calculation applies using these departure rates. Thus
This is the blocking probability in a finite-line sequential-service network with two operators. It remains valid for , when every attempted call is lost; for it coincides with the single-operator answer.
Use finitely many colonies and let be the population of colony . An open migration process has independent external Poisson processes of rates , local total departure rates , and fixed routing probabilities to other colonies and out of the system. Here , for , and . The continuous-time Markov chain has intensities
Require the routing matrix to be transient: every individual eventually exits. For finitely many colonies this is equivalent to every colony having a directed path to an exit. Restrict to colonies reachable from external arrivals, so their traffic rates are positive and the relevant chain is irreducible. The total population cannot exceed its initial value plus the number of external arrivals, so on any finite time interval it is bounded by a finite random number. There are only finitely many states below that bound and finite rates in each, proving nonexplosion even when the departure functions grow rapidly.
The traffic equations of an open migration process, in row-vector form, are
Transience makes the inverse finite. Define
Provided every is finite, the candidate product-form stationary distribution of an open migration process is
The normalizability condition is exactly for every active colony. For example, constant total service for requires and gives a geometric distribution; independent individual departures give a Poisson distribution of mean . In the irreducible case the normalizable invariant law is the unique equilibrium. If the weights cannot be normalized, no stationary probability law exists, by uniqueness up to scale of invariant measures for an irreducible recurrent chain.
We establish both stationarity and the time reversal of an open migration process assertion by adjacent-weight calculations. Define
The identity gives
Thus the proposed time reversal of an open migration process retains the local service functions and has
The traffic equation for colony implies . Summing all traffic equations also gives . Therefore the total outgoing rate from every state is the same for and :
Consequently , proving global balance for a continuous-time Markov chain. The same weight recurrence gives , so the stationary mean total jump rate is finite. The candidate is a stationary distribution, and the displayed intensities are indeed its stationary time reversal of a continuous-time Markov chain. Reverse routing is also open: reverse an original arrival-to-colony path to obtain a path to a colony with .
For the last request, let be all colonies reachable by routing from , including itself. The no-return-path hypothesis gives . By construction no routing edge leads from to its complement . The populations in therefore evolve autonomously as an open migration process, with moves into treated as exits. Its stationary marginal is the corresponding product of the factors above. Retain the original destination as a mark on each such exit.
In this autonomous process, a marked exit has intensity . The same reversed-weight calculation makes its reverse a marked external immigration channel of constant rate . External immigration channels can be constructed as independent Poisson processes. Stationary reversal of a two-sided Poisson process preserves its law, so reversing this immigration channel gives
This Poisson migration stream without a return path argument is needed because a general internal migration stream in a network with feedback is not automatically Poisson. A zero routing probability gives the empty Poisson stream of rate zero.
Assume and regard each line as an individual circulating through three colonies. Then is a closed migration process on . With the coordinate vectors, its nonzero transition intensities are
The memoryless property of the exponential distributions and the independent Poisson process make these counts a continuous-time Markov chain. In particular, the accepted-arrival rate is , not : free lines are availability tokens, not independent callers. An attempted arrival when is lost and causes no state change, so it does not enter the off-diagonal generator.
For the cyclic routing , take equal traffic weights at all colonies. The product-form stationary distribution of a closed migration process gives weights
Here is a direct global balance for a continuous-time Markov chain verification. Set , , , with cyclic subscripts. The predecessor for a transition is , allowed when . The product weights obey
Summing these incoming weights over the three edges gives , precisely the outgoing weight. Thus is stationary. The finite state space is irreducible, so this stationary distribution is unique.
Let be the occupied-line count. Summing over its automated-service count gives
so . The external Poisson process sees the stationary state probabilities by Poisson arrivals see time averages. A call is lost exactly when , equivalently . Therefore
For two independent identical operators, the middle transition rate becomes : one call receives one operator's service, while two or more calls keep both operators busy. Define and for . The same global balance for a continuous-time Markov chain calculation applies to
Consequently the blocking probability in a finite-line sequential-service network is
The subtraction corrects the term, for which rather than . In particular , and when replacing one operator by two does not change blocking.
An open migration process has finitely many colonies and state . External arrivals to colony form independent Poisson processes with rates . When , individuals leave that colony at total rate , with . A departing individual moves to with probability or exits with probability . The routing choices and all arrival and service randomness are independent. The routing matrix is substochastic and transient: every individual eventually exits, equivalently its spectral radius is less than one. Self-routing is allowed, but creates no state change.
The traffic equations of an open migration process, using row vectors, are
The inverse matrix exists because converges; its entry counts expected visits to by an individual entering at . Thus includes both external arrivals and internal migrations. Restrict first to the accessible colonies with .
Set
If each , the candidate product-form stationary distribution of an open migration process is
Here is a global balance for a continuous-time Markov chain proof, which does not incorrectly assume that the routing is reversible. The weight ratio is . After dividing the incoming balance equation at by , external arrivals contribute , exits contribute , and migrations from to contribute . Combining the first and third contributions using the traffic equations of an open migration process yields . Summing those same traffic equations of an open migration process gives . The incoming rate is therefore exactly the outgoing rate
This proves stationarity. With finite arrival rates, finite service rates in each state and transient routing, the process is nonexplosive: only finitely many individuals enter in a finite interval, and each makes finitely many routing transitions before exit, almost surely. On the accessible irreducible Markov chain, a finite normalizer gives the unique stationary distribution and positive recurrence. Colonies with zero effective arrivals are empty in this equilibrium. For a nonempty accessible colony, a divergent prevents normalization of the equilibrium weights.
For the single-server specialization, for . Each colony has the stationary distribution of an M-M-1 queue:
requiring on every colony with positive traffic. The service rates do not change the traffic equations of an open migration process.
For positive , write and . A stable allocation requires and , with . The Cauchy-Schwarz inequality gives
Equality holds precisely when is proportional to . Hence the unique optimal service-capacity allocation in an open migration process and its mean population are
There is no stable allocation when and some traffic is positive. If some , those empty colonies contribute no population; allocate the spare capacity to the positive-traffic colonies by the same rule. Allowing zero capacity at an unused colony attains this optimum. If strictly positive are required even there, the displayed value is only an infimum, approached as their capacities tend to zero. If every , the equilibrium is empty and any admissible allocation minimizes its mean population at zero.
Let denote the clock position and the queue population, including any customer in service. By the memoryless property of the exponential distribution, the nonzero transition rates are
Set . We claim that
where is the clock's stationary distribution from part (a). To check global balance for a continuous-time Markov chain, divide the incoming probability flux by . The clockwise contribution is . The arrival contribution, present only for , is . The service contribution is . Their sum is the outgoing rate .
The proposed probability distribution is normalized, so it is the equilibrium law. In particular, the clock position and queue population are independent random variables at any fixed equilibrium time, and the population has the geometric distribution of a stable M/M/1 queue. Independence of these two random variables does not assert independence of the two entire processes.
A multiclass queue must specify its service discipline as well as its arrival and service rates. Here is an ordered-queue model that includes the usual class-independent exponential single-server queue. Let class- arrivals be independent Poisson processes of rates , and let a class- service requirement have the exponential distribution of rate . A state is a finite word of customer classes.
Choose service fractions with , and insertion probabilities with . The customer at position departs at rate ; a class- arrival is inserted at position at rate . All rates leading to the same word are added. For class-dependent , impose the symmetric service discipline . If all , arbitrary class-independent are permitted, including first come first served with insertion at the tail and service at the head.
Put and . For , the equilibrium word law is
For the symmetric service discipline, insertion and deletion satisfy detailed balance for a continuous-time Markov chain because
For the common-service-rate case, use time reversal of a continuous-time Markov chain instead: the reversed queue inserts with probabilities and serves with fractions . A forward insertion gives a reverse deletion rate , and a forward deletion gives a reverse insertion rate . Forward and reverse total rates both equal , proving global balance for a continuous-time Markov chain.
Summing the weights of all words of length gives , so the law is normalized. If counts class- customers and , the multinomial coefficient counting class orderings gives
For processor sharing, , the class-count vector itself is a Markov chain, with arrival rate and departure rate . Under first come first served, the ordered word is generally necessary. Class-dependent service rates combined with first come first served do not in general have the displayed simple equilibrium law; the discipline assumption matters.
Index the queue-class pairs by . Let be the external Poisson process arrival rate, let be the routing probability after class completes service, and put for the exit probability. An open network has a transient routing matrix , equivalently spectral radius less than one. The effective throughputs solve the traffic equations for a multiclass queueing network:
At each queue use the ordered multiclass single-server queue model of part (a), with parameters . An external class- customer is inserted at position with rate . A customer of class in position completes at rate : it exits with probability or changes to class and is inserted at its destination with probability . Here is the destination population after the origin deletion, so this also defines routes returning to the same queue. At each node, either service rates are common to its classes or insertion and service fractions form a symmetric service discipline.
Let . The product-form stationary distribution of a multiclass queueing network is
To prove it by time reversal of a continuous-time Markov chain, interchange each node's insertion and service fractions, and use
Pairs with can be deleted. The traffic equations for a multiclass queueing network ensure . The ratio of the product weights for an insertion is ; for a deletion it is its reciprocal. Consequently every routing, entrance, and exit transition satisfies . The symmetric or common-rate hypothesis makes each node's total service rate identical forward and backward. Summing the traffic equations for a multiclass queueing network also gives . Thus the total transition rates match, proving global balance for a continuous-time Markov chain; each factor is normalized by part (a).
For the class counts the equilibrium law is
Under processor sharing these counts have explicit transition rates for , for , and for . Under a closed network, remove external entrances and exits and normalize the same product weights on the conserved customer populations, using a positive solution of the homogeneous traffic equations for a multiclass queueing network. That finite-state normalization does not require the open-network conditions .
An open migration process is a continuous-time Markov chain recording the populations of finitely many colonies. Independent external Poisson processes bring individuals to colony at rate . When that colony contains individuals, a departure opportunity occurs at total rate , with . The departing individual moves to colony with probability , or leaves the system with probability . Routing choices and the clocks are independent. A return to the same colony does not change the state.
The word open means that the routing matrix is transient: every individual eventually leaves, or equivalently the spectral radius of is less than one. The traffic equations of an open migration process, with row-vector convention, give the total arrival rates:
These rates include migrations as well as external arrivals. On the active colonies assume and the usual irreducible Markov chain condition. Put
The product form and its normalization condition are
To establish the product-form stationary distribution of an open migration process, first use its unnormalized weight . Its ratios satisfy . The incoming external arrivals into , divided by , contribute . Incoming exits contribute . Incoming migrations from to contribute . Terms involving an empty destination are zero. Thus the full incoming rate divided by is
Here the traffic equations of an open migration process give the second equality, including . The right side is precisely the total outgoing rate. This proves global balance for a continuous-time Markov chain; pairwise detailed balance is not required for general routing.
For finite rates at each finite population, the continuous-time Markov chain is nonexplosive Markov chain: its total population is bounded over a finite time interval by the initial population plus the finitely many external arrivals, so it visits a finite set on which all jump rates are bounded. Consequently finite normalize the invariant weight to a stationary distribution. Under the stated irreducible Markov chain assumptions, this is the unique stationary distribution, and it is a positive recurrent Markov chain. Conversely, the unique invariant measure of an irreducible recurrent chain is proportional to , so a positive recurrent Markov chain requires its normalization to be finite. A sufficient condition is ; the series criterion itself is the exact condition. Colonies with have zero stationary population and can be removed from the active class.
For the single-server M/M/1 queue specialization, for , each stationary colony has the geometric distribution of an M/M/1 queue:
The traffic equations of an open migration process do not involve the service rates, so the remain fixed during this service-capacity allocation in an open migration process. Write , and . A stationary allocation requires , with and . The Cauchy-Schwarz inequality gives
Equality holds exactly when is proportional to . Hence, for positive arrival rates, the unique optimal service allocation and the minimum expected value of the total population are
If and some arrival rate is positive, no stable service allocation exists. Zero-arrival colonies need no service in their stationary empty class: allowing zero service there gives the same formula restricted to active colonies. If strictly positive service is demanded even at inactive colonies, the displayed minimum is an infimum approached as that unused allocation tends to zero. If all arrivals vanish, the stationary mean population is zero for every allocation that drains the initial population.
For an irreducible closed migration process with finite population , positive departure rates and routing matrix , choose positive traffic weights satisfying . On , its stationary distribution has the displayed form. For a predecessor , its weighted transition into is . Summing over gives by the traffic equation, and summing over proves global balance for a continuous-time Markov chain. The distribution need not satisfy detailed balance.
For an open migration process, colony with population has total departure rate . Its stationary weight is . The colony weights factor independently and normalize when for every colony. Global balance for a continuous-time Markov chain proves the formula even when routing is not reversible.