Global balance for a continuous-time Markov chain Created 2026-10-06 Updated 2026-10-14
Global balance equates total stationary incoming and outgoing transition intensities at each state. Detailed balance for a continuous-time Markov chain is sufficient but stronger: it equates each pair separately.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 35 4 Solution Created 2026-10-03 Updated 2026-10-14
Only routes with need a per-flow rate: absent flows contribute no utility and have no completion events. Interpret the proportional-change sum and the logarithmic objective on these active routes. With positive capacities and finitely many nonempty routes, a strictly positive feasible active-rate vector exists. Define its weighted logarithmic utility by , with value if an active rate is zero.
For positive feasible , the elementary concavity inequality givesThe last sum is nonpositive by proportional fairness. Feasible competitors with a zero active rate have utility , so they cannot improve it either. Thus a proportionally fair allocation maximizes weighted logarithmic utility. Conversely, if maximizes this utility, the feasible line segment has nonpositive right derivative at , giving precisely . This also covers a competitor with zero coordinates, since stays positive for sufficiently small . The strictly concave function makes the active-rate optimizer unique.
For the linear flow network, put and . If and resource is not saturated, its local per-flow rate could be increased without affecting any other resource. This would strictly increase weighted logarithmic utility. HenceIf and , substitute on all active local routes into the utility. The terms depending on areIts derivative vanishes when , so . Its second derivative is negative, giving the unique maximizer. If , utility increases up to the capacity endpoint . If , each active local route uses its entire local resource. Altogether the proportionally fair allocation on a linear flow network isAbsent-route rates may be set to zero, and departures are zero at the empty state . Notice that these are per-flow rates: the aggregate through service is , while each active local route gets aggregate service .
In the document-transfer flow-level network model, let be the unit vector for route . Independent Poisson processes of flow arrivals give transitions at rate . An active document on route receives service at rate and has an exponential distribution of size with parameter . By the memoryless property, its instantaneous completion rate is . Summing over the active documents gives the continuous-time Markov chain intensitiesThus through-route departures have rate , and active local departures have rate . All other off-diagonal intensities vanish. The diagonal intensity is the negative of the sum of the outgoing intensities. Each route's aggregate service is at most one, so the total jump rate is bounded by ; the process is a nonexplosive continuous-time Markov chain.
Set , assume , and define the balance function of a flow-level network byThe adjacent-state ratios of this binomial coefficient areThey equal the aggregate service rates just obtained. Therefore, with ,These are the detailed balance for a continuous-time Markov chain equations on every adjacent pair. Summing incoming and outgoing pairs proves stationarity whenever the weights can be normalized. Hence the stationary law of a linear flow network isThe coefficient here is a binomial coefficient, not merely the total number of flows. Both it and the denominator in are visible in the original PDF but missing from the converted TeX.
We can also determine exactly when the normalizing constant is finite. For , summing first over with local counts fixed and applying the negative binomial series givesThe remaining sums are independent geometric series. Thusprovided for every . These inequalities are also necessary: if , the states with every local count zero already give a divergent sum; otherwise any local ratio at least one makes its geometric series diverge. Thus the stationary formula requires strict offered load below capacity at every resource. With positive arrival rates, the process is irreducible, and these normalizable detailed balance weights give its unique stationary distribution. Outside these inequalities, the displayed weights are not a probability distribution. Zero arrival rates can be handled on the reachable class by setting the corresponding population to zero.
Past exam of the mathematics course of the University of Cambridge 2008 iii Paper 35 2 Solution Created 2026-10-03 Updated 2026-10-14
Take Poisson process arrivals of rate , independent holding times with the exponential distribution of parameter , unit resource requirement per call, no waiting room, and integer capacity . The occupancy is a birth-death process on with birth rate below and death rate at occupancy . Writing for offered traffic, detailed balance for a continuous-time Markov chain givesAn arrival is lost exactly in state , so Poisson arrivals see time averages proves the Erlang loss formulaThis derivation assumes exponential holding times; the insensitivity of loss networks extends the same formula to independent general holding times with the same mean. For completeness, ; for , set .
A loss network with fixed routing has finitely many resources, capacities , and call types indexed by nonempty subsets of resources. A call of type uses one unit of every resource in for its entire holding time and is accepted only if all are available. Let be the link-route incidence matrix and the type's offered traffic, arrival rate times mean holding time. Different types have independent Poisson processes and independent holding times.
In the reduced-load approximation, availability at distinct resources is treated as independent, and screening at the resources other than is modeled as independent Poisson thinning. The load offered to after that screening isApplying the Erlang loss formula to this isolated-resource load gives the Erlang fixed point approximation, . These equations are an approximation because simultaneous admission induces dependence between resource occupancies, and the screened arrival process need not actually be Poisson.
Here is a proof of existence and uniqueness for positive capacities. Write . Its truncated-Poisson mean is the carried load of an Erlang loss resource,For , differentiating its stationary probabilities givesThe variance is positive and because every state has positive probability. Moreover increases continuously from zero to one, and increases from zero to . Thus has a continuous inverse on .
Use acceptance coordinates and defineHere is strictly increasing, continuous, and tends to as . The convex potential for the Erlang fixed point isEach exponential term is convex, and each integral is a strictly convex function of its coordinate because its derivative is strictly increasing. Hence is strictly convex on the nonnegative orthant. It is also a coercive function: for sufficiently large , , so each integral tends at least linearly to infinity. Therefore attains a unique minimum .
Its partial derivative isAt an interior minimum this derivative is zero. Since , this is exactly . At a boundary coordinate , the one-sided minimizing condition is , whereas the displayed derivative is . Thus and there as well. Conversely every solution of the Erlang fixed point approximation has these derivative conditions and hence minimizes the convex potential. No solution has at positive capacity, since every is finite and for finite . The coordinates therefore give a bijection between solutions and minima, provingIf a capacity is zero, its blocking probability is forced to one. Routes using it contribute zero reduced load to every other resource. Delete those routes and the zero-capacity resources and apply the proof to the remaining network; unused positive-capacity resources have blocking probability zero. This establishes existence and uniqueness also with zero capacities, allowing precisely at those resources.
Past exam of the mathematics course of the University of Cambridge 2008 iii Paper 35 5 Solution Created 2026-10-03 Updated 2026-10-14
For a network with link-route incidence matrix , a per-flow rate vector is feasible when and for every resource. A proportionally fair allocation has strictly positive rates on active routes and satisfiesfor every feasible competing allocation . Equivalently it maximizes the weighted logarithmic utility subject to the capacity constraints. The equivalence follows from the first-order condition for this concave objective; strict concavity gives uniqueness on active routes. Rates on absent routes have no operational effect and may be set to zero.
Use labels for the routes , and put , , , , . The two-resource linear flow network has constraintsWhen and , write for aggregate through service. Every active local route uses the remainder of its resource, since increasing its rate increases utility. Up to additive constants, the objective becomes . Its derivative is , so its unique maximum is . This argument remains valid if only one local route is active: the unused local resource adds only the constraint . The resulting proportionally fair allocation on a two-resource linear network isIf , each active local route receives its resource equally, or , as the same formulas prescribe. If , only the through route is active and . At all rates may be set to zero. In particular no displayed expression is applied to an absent route with a zero denominator.
For independent Poisson processes of flow arrivals and independent exponential document sizes of parameters , the memoryless property makes a continuous-time Markov chain. Each active flow completes with instantaneous rate , so the flow-level network model has transitionsThus for the aggregate service rates areThey vanish at the empty state. The total transition rate is bounded by , so the process is nonexplosive.
Put and define the balance function of a flow-level networkThe elementary binomial coefficient ratios areHence whenever that departure is possible. Weights satisfy detailed balance for a continuous-time Markov chain, sinceWhen summable they therefore give the stationary law of a two-resource linear flow network,
It remains to determine exactly when these weights normalize. First, summing only the terms requires . For such , the negative binomial series, or the supplied identity with parameter , givesAll weights are nonnegative, so the Tonelli theorem permits this order of summation. The normalizing sum is thenThe two geometric series converge precisely under the stability conditions for a two-resource linear flow network, and evaluating them yieldsThese are exactly the strict offered-load constraints on the two unit-capacity resources; equality already makes a geometric sum diverge. For positive arrival rates the chain is irreducible, so the normalized law is its unique stationary probability and the chain is positive recurrent. Nonnegative arrival rates are also allowed with in the weights: a zero-arrival route is absent in the closed stationary class, and the same normalization conditions and formula remain valid there.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 30 2 a Solution Created 2026-10-03 Updated 2026-10-14
A multiclass queue must specify its service discipline as well as its arrival and service rates. Here is an ordered-queue model that includes the usual class-independent exponential single-server queue. Let class- arrivals be independent Poisson processes of rates , and let a class- service requirement have the exponential distribution of rate . A state is a finite word of customer classes.
Choose service fractions with , and insertion probabilities with . The customer at position departs at rate ; a class- arrival is inserted at position at rate . All rates leading to the same word are added. For class-dependent , impose the symmetric service discipline . If all , arbitrary class-independent are permitted, including first come first served with insertion at the tail and service at the head.
Put and . For , the equilibrium word law isFor the symmetric service discipline, insertion and deletion satisfy detailed balance for a continuous-time Markov chain becauseFor the common-service-rate case, use time reversal of a continuous-time Markov chain instead: the reversed queue inserts with probabilities and serves with fractions . A forward insertion gives a reverse deletion rate , and a forward deletion gives a reverse insertion rate . Forward and reverse total rates both equal , proving global balance for a continuous-time Markov chain.
Summing the weights of all words of length gives , so the law is normalized. If counts class- customers and , the multinomial coefficient counting class orderings givesFor processor sharing, , the class-count vector itself is a Markov chain, with arrival rate and departure rate . Under first come first served, the ordered word is generally necessary. Class-dependent service rates combined with first come first served do not in general have the displayed simple equilibrium law; the discipline assumption matters.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 213 2 Solution Created 2026-10-03 Updated 2026-10-06
In a loss network with fixed routing, calls of type arrive as independent Poisson processes with rates . Every accepted call occupies units of resource throughout its holding time. The link-route incidence matrix has nonnegative integer entries, is the resource-capacity vector, counts calls currently present, and is the th coordinate unit vector. The feasible occupancy space isThe inequalities are coordinatewise. A call that would leave this space is rejected immediately, without queuing or changing . With independent unit-rate exponential distributions for holding times, the memoryless property makes a continuous-time Markov chain, whose nonzero off-diagonal transition rates areThere are independent clocks of rate one for the second transition. Rejected arrivals are not jumps and do not appear in the off-diagonal transition rates.
Let . For every feasible adjacent pair,Thus detailed balance for a continuous-time Markov chain gives the product-form stationary distribution of a loss network:In this convention is the reciprocal normalizing sum. If every route consumes some resource, finite capacities make finite. Even zero-resource routes cause no normalization difficulty: the sum is at most . With positive arrival rates the reachable feasible class is an irreducible Markov chain, since calls can depart to the empty state and any feasible occupancy can be built from it. The stationary distribution is therefore unique on that class.
The vector records the free units of each resource. Its probability distribution sums over all occupancies with the same free resources. The map from to generally loses information: different call mixtures may consume exactly the same resources.
For , the conditional expectation can be computed by removing one call. The factorial identity givesIndeed, is a bijection from the occupancies in this sum with to occupancies using units. Conversely, adding one call to any such occupancy is feasible because its final resource use is . Consequentlyand the conditional expectation is zero otherwise. Conditioning the identity and multiplying by now yieldsAlternatively, multiply the preceding unnormalized factorial identity by and sum over directly; this proves the same formula even when , without dividing by a zero probability. This gives both the conditional expectation argument and the direct summation argument.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 213 3 Solution Created 2026-10-03 Updated 2026-10-06
Use an ideal carrier-sense multiple access scheme on the interference graph. An active station finishes its transmission after an independent unit-rate exponential distribution waiting time. An inactive station has an independent attempt clock with an exponential distribution of rate ; an attempt succeeds only when all its neighbors are inactive. Attempts that are blocked do not change the state. Thus, on the independent sets represented by , the continuous-time Markov chain has transition ratesThe empty independent set can be reached by successive deactivations, and any other independent set can be reached from it by successive activations. Hence this finite chain is an irreducible Markov chain. The weight satisfiesBy detailed balance for a continuous-time Markov chain, its unique stationary law isThis is a finite exponential family. Its natural parameter of an exponential family is and its mean parameter of an exponential family is the vector of active fractions.
The throughput region of an interference graph is exactly . To see the possibly less immediate inclusion, suppose a random feasible schedule has mean . Retain each of its active vertices independently with probability , interpreting zero coordinates as always deleted. A subset of an independent set remains an independent set; the thinned schedule has mean exactly . Thus lies in the convex hull of . The opposite inclusion follows from the definition using equality. Moreover , so this convex hull has full dimension.
Now choose such that remains in the interior of . Use interior moment matching in a finite exponential family. Consider the convex functionThere is a ball of radius around contained in . Maximizing a linear functional over the convex hull is the same as maximizing over its generating set, so, for every ,The last inequality uses the point when . Hence is a coercive function and has a finite minimizer . Differentiating the finite normalizing sum givesThis covariance matrix is a positive-definite matrix: a linear functional constant on all states of positive weight must be constant on , so its coefficients vanish. Thus is a strictly convex function; its minimizer is unique. At that minimizer the desired strict service margins areFor a backlogged station that transmits at unit speed whenever active, the long-run throughput is , by the ergodic theorem for a finite continuous-time Markov chain. Therefore the ideal carrier-sense multiple access scheme can supply a strict service margin for every arrival vector in the interior of the throughput region of an interference graph. The local attempt rates can realize the whole interior capacity region in this sense. Boundary points may require parameters tending to infinity, and the argument gives no uniform delay or mixing-time bound near the boundary.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 213 5 Solution Created 2026-10-03 Updated 2026-10-06
Only routes with contribute to proportional fairness or to the weighted logarithmic utility; omit inactive routes from expressions with a rate in the denominator. Active routes have positive rates whenever a positive feasible allocation exists. For a feasible competitor , the elementary logarithm inequality givesA zero competitor rate on an active route has utility and also cannot improve the objective. Therefore a proportionally fair allocation maximizes the logarithmic objective. Conversely, the feasible set is a convex set, and differentiating the objective along at shows that an optimizer satisfies the proportional fairness inequality. Strict concavity gives uniqueness on active coordinates; rates assigned to nonexistent flows are immaterial.
In the linear flow network, put and for active routes. A local route uses only resource . If and , increasing increases the objective without violating any other constraint. Thus each active local route saturates its resource:Write and . For and , substitute into the objective. Apart from constants its dependence on isIts derivative vanishes when , and its second derivative is negative. Hence the per-flow through-route rate isIf , the optimal through-route aggregate rate is one, so still holds. If , each active local route has , also given by the displayed local formula. When there are no flows and no departures. Inactive coordinates need not be assigned these undefined per-flow formulas.
Independent arrivals and exponential document sizes make this a flow-level network model. A document of type has residual-size hazard per unit of data transmitted; when its transmission speed is , its completion hazard per unit time is . Thus the continuous-time Markov chain of flow counts has transition intensitiesFor these departure intensities are for the through route and for an active local route. Total arrival intensity is constant and total departure intensity is bounded by , ensuring a nonexplosive Markov chain.
Set , the offered traffic, and define the balance function of a flow-level networkThe binomial coefficients satisfyThese identities also cover states with only one kind of active route. They show that the weight satisfiesThus detailed balance for a continuous-time Markov chain proves that this is a reversible Markov chain and reduces the stationary distribution calculation to normalization.
Sum over first. The negative binomial series gives, for fixed local counts and ,All summands are nonnegative, so the Tonelli theorem permits exchanging the sums. The partition sum is thereforeIt is finite exactly when for every , for . These are the resource-load conditions: resource receives the through-route offered traffic plus its local offered traffic. The normalized stationary distribution isWith positive arrival rates this is the unique stationary distribution of the irreducible feasible flow-count chain. Zero arrival rates restrict its closed class to the corresponding zero coordinates.
Summing out also shows that the local counts are independent, with geometric distributions on :Hence their mean flow counts areThe binomial balance factor is essential: independent geometric counts for all routes would not give these departure rates or the correct resource-load normalization.
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 213 1 i Solution Created 2026-10-03 Updated 2026-10-05
A loss network models calls that require several resources simultaneously and are rejected if any required capacity is unavailable; rejected calls do not queue. For fixed routing, let be the number of units of resource used by a call of type , and let be its capacity. Independent Poisson processes supply type- calls at rate , with independent holding times having an exponential distribution of mean . Write for the offered traffic, andAssume finitely many resources and call types, with every call using a resource, so this set is finite. The occupancy continuous-time Markov chain has ratesIts stationary distribution isIndeed, for each feasible upward transition,which is detailed balance for a continuous-time Markov chain. Thus this is a reversible Markov chain. With positive arrival rates it is irreducible on : departures reach the empty state, and any feasible state can be assembled by arrivals. Its stationary distribution is consequently unique.
The formula is a product-form stationary distribution of a loss network: equivalently, independent Poisson random variables of means conditioned on . The conditioning couples the occupancies, so the resources are generally not independent. By Poisson arrivals see time averages, the acceptance probability for a type- arrival isbecause the prearrival state must leave free units at each resource. Set the numerator to zero if its capacity vector has a negative entry. This exact formula is often expensive to evaluate, which motivates the Erlang fixed point approximation.
The same occupancy stationary distribution extends to independent general holding-time distributions with these means by insensitivity of loss networks; the exponential assumption above makes the occupancy process itself a continuous-time Markov chain and permits the direct detailed balance proof.
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 213 4 Solution Created 2026-10-03 Updated 2026-10-05
For a fixed occupancy , let be the per-flow rate on every active route, so feasibility means . A proportionally fair allocation is a feasible allocation satisfying, for every other feasible ,The sum counts the proportional changes over individual flows. By the first-order condition for a concave function, it is exactly the allocation solvingThis is weighted logarithmic utility optimization, and its negative objective is a strictly convex function, which gives unique rates on active routes. Routes with have no per-flow rate to determine.
Index the four routes by , , , , and let be each route's total service. WriteThe four capacity constraints say , , , and . Equivalently,For fixed maxima , every active route in the first group optimally takes total service , and every active route in the second takes , because its logarithmic objective is increasing. Up to the constant , the objective therefore becomes with . Its maximizer is , when , with the evident endpoint choices when one group is empty. Hence the proportionally fair allocation on a four-cycle isSet on inactive routes. If , all service totals are zero. In particular, for , , as required. Two disjoint active routes in the same group can each receive the same total service; service totals need not sum to one over the entire network.
With independent document arrivals given by Poisson processes of rates and independent unit-mean exponential distributions for document sizes, each of the active documents has completion rate . The flow-level network model is consequently a continuous-time Markov chain withAt all downward rates are zero. The total departure rate is at most four, so the bounded total jump rate ensures no explosion.
The original PDF's displayed factor is a binomial coefficient, not the plain quotient produced by the TeX extraction. The candidate stationary distribution for this reversible four-cycle flow model isUse . For and ,so . For the corresponding ratio is . Thus detailed balance for a continuous-time Markov chain holds for every adjacent pair, proving the displayed stationary distribution whenever .
For completeness, its existence condition can be made explicit. Put and . At fixed ,Therefore the sum over states with is at most , using the binomial theorem. This is summable if . Conversely, restricting to the single maximizing route in each group leaves the series , which diverges if . HenceThese are exactly the four strict resource-load inequalities. With positive arrival rates the Markov chain is irreducible, so the normalized stationary distribution is unique.
Past exam of the mathematics course of the University of Cambridge 2019 ii Paper 3 27K a Solution Created 2026-09-24 Updated 2026-10-03
A continuous-time Markov chain is a reversible Markov chain in equilibrium if, when started in a stationary distribution , the process has the same finite-dimensional distributions as for every .
For transition rates , the detailed balance for a continuous-time Markov chain equations areThey imply invariance directly. For each state ,because . Thus , so is an invariant distribution of a continuous-time Markov chain.
For a loss network with feasible occupancies , its stationary distribution is proportional to . It is the law of independent Poisson random variables conditioned on the resource constraints. With exponential holding times, detailed balance for a continuous-time Markov chain proves the formula directly.