Original solutions to past examinations of the probability, measure and martingales course of the University of Oxford.
Solutions to every part of all three questions of the probability, measure and martingales course of the University of Oxford Part B examination, sat on 5 June 2023. Source: original released PDF, bundle pages 288–291; paper pages 1–4. The native PDF confirms the endpoint defect in Question 2: its slope formula evaluates outside when . We specify values on that null set below. Question 1(b)'s literal measurability assertion uses everywhere sign-valued random variables; for arbitrary versions with the stated probability distributions, it holds up to null sets, as explained in the solution.
Fix and define
This is a Dynkin system: it contains ; taking complements preserves the equality because ; and countable additivity preserves it under disjoint unions. The hypothesis says that contains the pi-system . Hence Dynkin lemma gives .
Now fix any and put
The same complement and disjoint-union calculations make this a Dynkin system. The first step shows that it contains , so Dynkin lemma gives . Thus
This is precisely the definition of independent sigma-algebras, and proves independence extended from generating pi-systems.
For , fix signs . The constraints leave exactly two choices for the signs : choose freely, then set and for . Each input tuple has probability by independence. Consequently
Every finite subfamily is a marginal distribution of one such initial segment, so the entire sequence is independent, with fair sign probability distributions.
Using the usual everywhere sign-valued representatives, for every we have
The right side is measurable with respect to . Therefore is measurable with respect to their intersection .
Write . The Kolmogorov zero-one law applies to the independent random variables , so every event has probability zero or one. Also is independent of : this follows first for finite intersections of sign events from the given independence, then for their generated sigma-algebra by part (a).
The sets with and form a pi-system generating . If , the event has probability zero and is independent of every event in . If , it differs from by a null set, so the same independence follows from that of and . Another application of part (a) proves
In particular cannot contain the nontrivial event , whereas does. Thus adjoining a sigma-algebra need not commute with a decreasing intersection.
There is a small version qualification if the assumptions specify only the probability distributions, allowing exceptional values other than signs. Put when the denominator is nonzero, and otherwise. For , is measurable with respect to . The limit superior of , after scalar clipping to , is therefore -measurable and equals almost surely. Literal measurability of an arbitrary version of need not follow without choosing sign-valued representatives or adjoining the ambient null sets. All the independence conclusions are unaffected.
The first entrance time is a stopping time, because . Before this time ; at entrance, the bounded increments give . Thus the stopped martingale
is a nonnegative martingale. Here the stopped process is a martingale since its increment is , whose conditional expectation given is zero.
The martingale convergence theorem states that a nonnegative martingale converges almost surely to a finite integrable random variable; indeed its expectations are constant, giving the required bound in the L1 norm. Apply this theorem to . On the stopped process equals the original one at every time. Hence
The overshoot bound is why the assumption of bounded increments matters.
Apply part (i) for every positive integer and discard the countable union of its exceptional null sets. A sample path bounded below never reaches for some such , and must therefore converge to a finite limit of a sequence.
Apply the same argument to the martingale . Outside one more null set, every sample path bounded above also converges finitely. Thus a sample path which does not converge finitely must be unbounded in both directions. Each finite initial segment has finite values, so removing any such segment preserves unboundedness. It follows that the limit superior is and the limit inferior is . Consequently
This proves the bounded-increment martingale convergence-or-oscillation dichotomy; in particular one-sided divergence to infinity is impossible with positive probability.
Choose versions
The stochastic process is increasing, and its th increment is -measurable, so it is predictable. The Doob decomposition theorem therefore gives
To check the martingale property directly, each summand is integrable and has zero conditional expectation given . The sums are an adapted process for the given filtration. Thus . Its bounded increments satisfy .
Both and are increasing, so each has a limit of a sequence in . Apply part (c)(ii) to the martingale , whose bounded increments were verified in part (i).
On we would have . On we would have . Both events have probability zero by the convergence-or-oscillation conclusion. Hence the two divergence events agree up to a null set. Since means precisely that infinitely many occur,
Taking probabilities proves the displayed equality in the question. This stronger agreement of events is the Conditional Borel-Cantelli lemma.
Suppose the events are mutually independent events. Then is independent of , first by factorization against finite intersections of previous events and then by part (a). Therefore
If , the sum in part (ii) is infinite almost surely, and consequently
This is the Second Borel-Cantelli lemma. In fact part (ii) also yields probability zero in the convergent case for these independent events.
The sigma-algebra generated by a random variable is the smallest sigma-algebra on making a measurable function into . Equivalently, it is the intersection of all sigma-algebras containing the inverse images of Borel sets .
Let . This collection is already a sigma-algebra: ,
The right-hand sets are in , since the Borel sigma-algebra is closed under the indicated operations. Any sigma-algebra making measurable must contain every member of . Conversely makes measurable by definition. Hence
This equality holds exactly as a collection of sets, without completing the sigma-algebra.
We prove the Doob-Dynkin lemma here by simple function approximation. Choose such that everywhere, and let
Each is a finite-valued -measurable function and pointwise. Write its level sets as , with associated values . By part (i), choose Borel sets with . Define the Borel measurable functions
Although the chosen need not partition all of , their inverse images do partition , so exactly.
Apply scalar clipping to each with bounds , preserving this equality, and define . A bounded limit superior of Borel measurable functions is a finite Borel measurable function. At every the limit of a sequence exists and gives
Thus the factorization is exact for a bounded, exactly -measurable function. If hypotheses are instead given only up to null sets, the corresponding conclusion is a factorization holding almost surely after choosing a representative.
For this part and part (c), take to be -valued everywhere. The uniform distribution gives , but the paper's expression for is undefined there because . Define on . Keep exactly as printed, including on that null set; this preserves the exact sigma-algebra equality in part (ii). Every slope formula below is asserted on , hence almost surely.
The floor function gives the deterministic bound
for every outcome, including . Thus all three convergence assertions hold: there is pointwise, and hence almost sure convergence, as well as convergence in probability and convergence in L2. In detail, for the probability is zero as soon as ; also
The uniform distribution even gives the exact second moment of the error by integrating over the dyadic partition:
Every is a Borel measurable function of , by the formula involving the floor function. Thus
Conversely, part (i) gives the everywhere identity . For fixed , this is the pointwise limit of random variables measurable with respect to . Such a limit of a sequence is measurable, so . Consequently
These are increasing-precision observations even when the first finitely many are discarded; they do not behave like the independent random variables whose tail sigma-algebra appears in Question 1(b).
A family of integrable random variables is uniformly integrable when
The Lipschitz condition gives, on ,
Our chosen zero value on satisfies the same bound. Hence the random variables are integrable, and for every tail expectation in the definition vanishes. Therefore the family is uniformly integrable.
For , repeated use of the floor function identity gives
Thus the filtration satisfies . Each positive-probability atom of a sigma-algebra here has the form
with probability ; is a possible additional null set atom. Averaging over each dyadic interval gives a version
For a globally defined version of the right side, assign any value, for example zero, on .
Indeed, the displayed random variable is -measurable and bounded by . On each its integral is
by the uniform distribution. Every member of is a union of the displayed sets and the possible zero-probability atom. Summing these identities therefore verifies the defining conditional expectation property on all of .
Each is a bounded Borel measurable function of , including the specified value at . Therefore is an adapted process for and consists of integrable random variables.
Fix an atom of a sigma-algebra in with positive probability, corresponding to the dyadic interval , with . By the uniform distribution, each half has conditional probability . The conditional expectation of on that atom is therefore
The middle values cancel. On the zero-probability atom the conditional expectation can be chosen as zero, agreeing with our version of . Hence
so is a martingale. This is the dyadic slope martingale associated with the Lipschitz function .
The uniformly integrable martingale convergence theorem states that a uniformly integrable martingale has an integrable terminal random variable such that almost surely and in the L1 norm, and
The last identity follows by passing to the limit of a sequence in for and , using convergence in L1.
Part (b)(iii) verifies uniform integrability for , so
Moreover almost surely. In this particular problem the common bound also yields convergence in Lp for every finite , including convergence in L2: the dominated convergence theorem applies to . General uniform integrability alone does not assert these higher-power conclusions.
Choose as the pointwise limit of a sequence of where it exists, and as zero otherwise. The convergence event and every are -measurable, so this is an exactly -measurable version, bounded by . Part (a)(ii), the Doob-Dynkin lemma, supplies a Borel measurable function on such that . Applying scalar clipping to with bounds preserves that equality and ensures everywhere.
Part (c)(ii) and the conditional expectation formula from part (b)(iv) now give
Since the indices form a countable family, these identities may be taken on one common full-probability event.
For fixed , both the slope and the displayed average are constant on the atom , whose probability is . An equality holding almost surely of these constants forces the deterministic equality
Sum over . The telescoping sum gives
Thus the desired identity holds at every dyadic endpoint, including , without evaluating the undefined slope at .
Finally, given , take dyadic endpoints . The Lipschitz condition implies , and the bound on the Borel measurable function gives
Passing to the limit of a sequence proves
This is a martingale proof of the integral representation of a Lipschitz function. It constructs a bounded Lebesgue integrable function representing the increments of , and in particular proves absolute continuity of . No prior assumption that has a derivative is needed.
Write for the conserved total number of tokens. The main case has positive integer initial holdings. If an initial holding is zero, take ; the formulas below still hold when . If , the stochastic process is constant and .
A discrete-time stopping time for a filtration is a random variable taking values in such that for every . It means that whether stopping has occurred by time can be determined from the information available then.
For the first elimination time,
Each event in this finite union belongs to , by the definition of the natural filtration. Therefore is a stopping time. This verification does not require first knowing whether is finite almost surely.
Put . Before , all three players are active. Each unordered pair is selected with probability , and each direction of transfer then has conditional probability . Given the current holdings , a transfer within the first pair has mean product
For transfers within the other two pairs the analogous values are and . Averaging over pairs gives
At and after elimination the product is zero, since an eliminated player never re-enters. In particular the stopped process has increment
The indicator function is -measurable, and the expression in parentheses has zero conditional expectation on its support. The stopped process is adapted and integrable: at fixed , its absolute value is bounded by . Hence
This is the product martingale for three-player token exchange.
After , the token product remains zero, whereas the deterministic term continues to increase. Combining this with the pre-elimination calculation in part (ii),
The stochastic process is adapted and integrable at each fixed time, and the displayed conditional expectation is nonnegative. Thus is a submartingale.
For it is neither a martingale nor a supermartingale. If , there is positive probability that the first player transfers a token to the second in each of the next rounds. Until the last such round all three remain active, so this event has probability and entails . At time the displayed conditional expectation is therefore strictly positive on an event of positive probability, ruling out both the zero drift required of a martingale and the nonpositive drift required of a supermartingale. If an initial holding is zero, and the same conclusion follows immediately. The degenerate case gives a constant martingale.
The bounded-time optional sampling theorem says that for an integrable discrete-time martingale and a bounded stopping time , . It requires no assumption about an eventual unbounded stopping time.
Apply this theorem with , or simply take the expectation of the stopped martingale in part (ii). For we obtain
Since ,
The monotone convergence theorem now yields . In particular almost surely, which has been established without assuming that optional stopping is valid at .
For each sample path with finite , eventually equals . Also . The dominated convergence theorem gives . Taking the limit of a sequence in the earlier identity therefore proves
For example, initial holdings give expectation one, as the first transfer must eliminate its giver. This computes the first elimination time, rather than the later time when one player owns all tokens.
Assume is square-integrable. Since and have the same probability distribution, is also square-integrable and . The product is integrable by the Cauchy-Schwarz inequality.
We use the defining test-function identity for conditional expectation: for bounded -measurable , . Take and let . The dominated convergence theorem, with bounds and , gives
This is the extension of the conditional expectation pull-out identity to this square-integrable multiplier. Consequently
A nonnegative random variable with zero expectation is zero almost surely. Hence
Geometrically, this is the equality case in the L2 space orthogonal projection interpretation of conditional expectation.
The function is a concave function, and is integrable since . The concave form of the conditional Jensen inequality gives
The random variables and have the same probability distribution, so . Using the law of total expectation, the nonnegative difference between the right and left sides of the inequality has zero expectation. It must vanish almost surely. Therefore
The equality comes from the distributional assumption as well as the conditional Jensen inequality.
We first establish the lower truncation identity as well. The pair has the same hypotheses as , because conditional expectation is linear and negation preserves equality of probability distributions. Apply part (ii) to this pair and multiply by to get
For every real ,
Using this identity, part (ii), the lower truncation identity, and linearity of conditional expectation gives
In particular the argument does not assume that a function obtained by scalar clipping is a convex function or a concave function.
Write . The bounded random variables and have the same probability distribution, and the displayed identity identifies the latter as the conditional expectation of the former. They are square-integrable, so part (i) gives almost surely. Take and discard the countable union of exceptional null sets. At every remaining outcome, let to obtain
Thus conditional expectation preserving a distribution forces equality even when only integrability is assumed.
Let . Inverse images commute with complements and countable unions, so this is a sub-sigma-algebra of . The random variable is -measurable.
The assumption says that is a measure-preserving transformation. Consequently has the same probability distribution as and is integrable. It also implies for every integrable random variable , first for indicator functions, then for simple functions, and then by positive and negative approximation.
To identify a conditional expectation, take any . The assumed identity with the bounded random variable gives
Every member of has the displayed form , so this verifies all defining conditional expectation identities. Therefore
Apply part (iii), since this conditional expectation has the same probability distribution as . We conclude
This is invariance from integral duality for a measure-preserving transformation; neither invertibility of nor a second moment of is required.
Put . Both and its indicator function are measurable, and . Thus is an integrable random variable. Monotonicity of conditional expectation gives
The measurable-factor property of conditional expectation says that a bounded -measurable function satisfies for every integrable random variable . Here the factor need not be bounded. Apply that property first to and , then use monotone convergence on the nonnegative products, including the conditional version, to obtain
All the left-hand conditional expectations are well defined; the final one is finite almost surely because is an integrable random variable. Since almost surely, division now yields
This proves the conditional Markov inequality with a measurable threshold without assuming that is an integrable random variable. The measurable-factor rule, with its product-integrability condition, is also stated in the standard conditional expectation theory.[ref]
Write and . The two conditional expectation identities supply a -measurable version of and a -measurable version of . Work with those versions, which do not change any almost sure equality. Both lie in L2 space, and the Cauchy-Schwarz inequality makes their product an integrable random variable.
Testing the first conditional expectation identity against , and the second against , gives
For completeness, these tests with unbounded multipliers are valid by first using the bounded truncations and , then passing to the limit with the Cauchy-Schwarz inequality and convergence in L2. Consequently,
A nonnegative random variable with zero expected value vanishes almost surely. Therefore almost surely. This is mutual conditional expectation rigidity in L2; it also follows from the equality case for conditional second moments.
For a counterexample to equality of the original random variables, let give probability to each of , set , and use the nonconstant function . Then takes both values and . It is measurable with respect to both generated sigma-algebras, so both required conditional expectation identities hold. Symmetry gives , while neither random variable can be zero. Thus
For every , is a sigma-algebra contained in , and including one more random variable among its generators can only enlarge it. Hence ; the trivial is contained in every sigma-algebra. These are exactly the requirements for a filtration.
The constant is -measurable. Suppose is -measurable. The pair is then -measurable, and the event is -measurable because comparison of two real coordinates defines a Borel set. Define its indicator function by . The recursion becomes
It is a measurable function of that pair. Mathematical induction proves is -measurable for every , so is an adapted process. The same recursion also proves at every finite time, a useful bound for the later integrability arguments.
Retain the binary random variables . Iterating the recursion gives
Each binary history determines the full vector , so its sigma-algebra is finite by the sigma-algebra of a finite-valued random vector. Conversely, because , the integer uniquely determines the digits ; also . Thus
All binary histories have positive probability. By independence of the driving uniform random variables, along a fixed finite history every intermediate state is in , so each subsequent conditional branch probability, either or , is strictly positive. It follows that has nonempty fibres, each an atom of a sigma-algebra, and exactly elements.
Adaptedness from the preceding part gives . For , however, contains the events for every . They have distinct probabilities , so there are infinitely many distinct such events. Consequently the finite sigma-algebra cannot equal . The inclusion is strict for every .
The adapted process is bounded by , so every is an integrable random variable, indeed a square-integrable random variable. Independence of from and its continuous uniform distribution give
This calculation with a random threshold is justified by conditioning on the -measurable value of : for a fixed , the Lebesgue integral equals . More formally, independence integrates the bounded Borel measurable function over its second coordinate. Therefore
which verifies the martingale property for this filtration.
Since , the conditional expectation of the squared martingale difference is
The law of total expectation yields . In particular, for every .
The L2-bounded martingale convergence theorem states that a martingale with converges both almost surely and with convergence in L2 to a square-integrable random variable. Its hypotheses hold because . Thus there is almost surely with both kinds of convergence. Alternatively, the martingale convergence theorem gives the almost sure convergence, and the bound gives convergence in L2 by the dominated convergence theorem.[ref]
The calculation of the conditional expectation of the square is especially informative. The martingale property makes the cross term vanish in the square expansion, so
Subtracting this from gives
Taking expected values and iterating proves
By bounded convergence theorem, . The random variable inside this expected value is nonnegative, so it is zero almost surely; on this forces . Again by bounded convergence theorem, . Hence
This is the Bernoulli polarization martingale with update size . It also has an exact mean squared error: the terminal representation and the equality case for conditional second moments give
Let . First, lies in the open interval . For example, if has a finite lower endpoint , then almost surely, and its expected value is strictly positive; hence . The corresponding argument at a finite upper endpoint gives the other strict inequality. Integrability ensures is finite when either endpoint is infinite.
The tangent affine function at gives the supporting inequality for a differentiable convex function. Under the stipulated condition , contact with that tangent occurs only at : define
Then , and for every . One direct proof uses : is strictly increasing, so decreases towards on the left and increases away from on the right. Therefore
with equality exactly when almost surely, equivalently when almost surely. Conversely, an almost surely constant plainly gives equality. This proves the strict Jensen equality criterion.
No extra assumption that is an integrable random variable is needed to interpret this argument. Its negative part is bounded by the absolute value of the integrable random variable , since . Thus its expected value is defined in ; if it equals the finite number , then and the required integrability follows automatically. Equality holds if and only if almost surely.
For each , put . Closure of a sigma-algebra under countable unions and countable intersections gives
The events decrease to . Continuity of probability from above applies because . Also, whenever , so
Letting proves
This reverse Fatou inequality for events requires no independence.
Write . If occurs, the running maximum at time exceeds , so and .
For the reverse inclusion, fix an outcome for which only finitely many occur. Choose such that for every . The finite prefix has a finite maximum when ; there is no prefix to check when . Since , for every sufficiently large that prefix satisfies . For the remaining indices , the nondecreasing thresholds give
Thus for every sufficiently large , so only finitely many occur. Taking the contrapositive proves the reverse inclusion, and hence the pointwise event equality
This exceedance equivalence for increasing thresholds is deterministic. Its proof uses both monotonicity of and divergence to ; it does not require independence or identical probability distributions.
The tail sigma-algebra of this sequence is
For each fixed , the preceding event equality gives
Every event on the right is determined by coordinates with index at least . Therefore for every , and . The random variables are independent, so Kolmogorov's zero–one law applies: every tail event has probability zero or one. Hence .
The role of independence can also be seen directly. A tail event is independent of each finite initial sigma-algebra . The Monotone class theorem extends this independence to ; since itself lies there, it is independent of itself. Thus .[ref]
For , the definition of the common cumulative distribution function gives
The strict exceedance matters here: an atom of a measure at belongs to , so it is already included in . The events are mutually independent events, since each depends on a separate member of the independent random variables .
If , countable subadditivity gives, for every ,
Continuity of probability then gives . This is the First Borel-Cantelli lemma and does not need independence.
If the series diverges, independence and give, for every fixed ,
Taking shows that the probability of no exceedance after is zero. A countable union over shows that finitely many exceedances has probability zero. This is the Second Borel-Cantelli lemma. Together with the preceding event equality, it proves
The conditions on the cumulative distribution function imply almost surely. With , adjoin and the trivial . The random variables are nonnegative, adapted, and bounded by at each fixed time. Independence and give
Thus this is the product martingale from independent mean-one factors, with . The almost sure supermartingale convergence theorem states that a nonnegative supermartingale converges almost surely to a finite integrable random variable. Applied to this nonnegative martingale, it shows almost surely. Every convergent real sequence is bounded, so almost surely.
The printed maximum can in fact be taken literally here. If almost surely, all products equal . Otherwise the strict Jensen equality criterion, applied to the strictly convex function on , gives . Independence yields . By Markov's inequality, for every . The First Borel-Cantelli lemma and the countable choices give almost surely. Since , a sequence with this limit attains its positive supremum among finitely many initial terms. This is an instance of fractional moment decay of independent mean-one products.
Use the nonnegative martingale and filtration established above. Fix a finite and let
For , is the union of the threshold-crossing events up to , so is a bounded stopping time. The optional stopping theorem for a martingale at a bounded stopping time gives . On one has ; on its complement one still has . Therefore
Only a bounded stopping time has been used, so no extra uniform integrability assumption at an unbounded hitting time is implicit. This is also the Doob maximal inequality for a nonnegative submartingale specialized to a mean-one martingale.
For , the bound ensures the finite moment . By Jensen's inequality, . The process is an adapted, nonnegative integrable random variable at each time, and independence gives
Thus is a submartingale, and . The Doob maximal inequality for a nonnegative submartingale states that for . Apply it with . Since the power function is increasing on ,
Combining this with the preceding bound gives
The result is a bound on the running maximum, which is why a maximal inequality for a submartingale, rather than an estimate of the single terminal random variable, is needed.[ref]
For each integer , let
If had distinct members, finite additivity on their disjoint singleton Borel sets would give total measure at least , contradicting . Thus .
Every positive singleton measure is at least for some sufficiently large . Consequently the set of point atoms of a measure is
A countable union of finite sets is at most countable. This proves the claim, including the possibility that the set is empty. The same argument gives the countability of point atoms of a finite measure, with in place of .
Articles were limited to the first 100 out of 112 total.

Articles by others on the same topic (0)

There are currently no matching articles.