Original solutions to past examinations of the probability, measure and martingales course of the University of Oxford.
Solutions to every part of all three questions of the probability, measure and martingales course of the University of Oxford Part B examination, sat on 5 June 2023. Source: original released PDF, bundle pages 288–291; paper pages 1–4. The native PDF confirms the endpoint defect in Question 2: its slope formula evaluates outside when . We specify values on that null set below. Question 1(b)'s literal measurability assertion uses everywhere sign-valued random variables; for arbitrary versions with the stated probability distributions, it holds up to null sets, as explained in the solution.
Fix and defineThis is a Dynkin system: it contains ; taking complements preserves the equality because ; and countable additivity preserves it under disjoint unions. The hypothesis says that contains the pi-system . Hence Dynkin lemma gives .
Now fix any and putThe same complement and disjoint-union calculations make this a Dynkin system. The first step shows that it contains , so Dynkin lemma gives . ThusThis is precisely the definition of independent sigma-algebras, and proves independence extended from generating pi-systems.
For , fix signs . The constraints leave exactly two choices for the signs : choose freely, then set and for . Each input tuple has probability by independence. ConsequentlyEvery finite subfamily is a marginal distribution of one such initial segment, so the entire sequence is independent, with fair sign probability distributions.
Using the usual everywhere sign-valued representatives, for every we haveThe right side is measurable with respect to . Therefore is measurable with respect to their intersection .
Write . The Kolmogorov zero-one law applies to the independent random variables , so every event has probability zero or one. Also is independent of : this follows first for finite intersections of sign events from the given independence, then for their generated sigma-algebra by part (a).
The sets with and form a pi-system generating . If , the event has probability zero and is independent of every event in . If , it differs from by a null set, so the same independence follows from that of and . Another application of part (a) provesIn particular cannot contain the nontrivial event , whereas does. Thus adjoining a sigma-algebra need not commute with a decreasing intersection.
There is a small version qualification if the assumptions specify only the probability distributions, allowing exceptional values other than signs. Put when the denominator is nonzero, and otherwise. For , is measurable with respect to . The limit superior of , after scalar clipping to , is therefore -measurable and equals almost surely. Literal measurability of an arbitrary version of need not follow without choosing sign-valued representatives or adjoining the ambient null sets. All the independence conclusions are unaffected.
The first entrance time is a stopping time, because . Before this time ; at entrance, the bounded increments give . Thus the stopped martingaleis a nonnegative martingale. Here the stopped process is a martingale since its increment is , whose conditional expectation given is zero.
The martingale convergence theorem states that a nonnegative martingale converges almost surely to a finite integrable random variable; indeed its expectations are constant, giving the required bound in the L1 norm. Apply this theorem to . On the stopped process equals the original one at every time. HenceThe overshoot bound is why the assumption of bounded increments matters.
Apply part (i) for every positive integer and discard the countable union of its exceptional null sets. A sample path bounded below never reaches for some such , and must therefore converge to a finite limit of a sequence.
Apply the same argument to the martingale . Outside one more null set, every sample path bounded above also converges finitely. Thus a sample path which does not converge finitely must be unbounded in both directions. Each finite initial segment has finite values, so removing any such segment preserves unboundedness. It follows that the limit superior is and the limit inferior is . ConsequentlyThis proves the bounded-increment martingale convergence-or-oscillation dichotomy; in particular one-sided divergence to infinity is impossible with positive probability.
Choose versionsThe stochastic process is increasing, and its th increment is -measurable, so it is predictable. The Doob decomposition theorem therefore givesTo check the martingale property directly, each summand is integrable and has zero conditional expectation given . The sums are an adapted process for the given filtration. Thus . Its bounded increments satisfy .
Both and are increasing, so each has a limit of a sequence in . Apply part (c)(ii) to the martingale , whose bounded increments were verified in part (i).
On we would have . On we would have . Both events have probability zero by the convergence-or-oscillation conclusion. Hence the two divergence events agree up to a null set. Since means precisely that infinitely many occur,Taking probabilities proves the displayed equality in the question. This stronger agreement of events is the Conditional Borel-Cantelli lemma.
Suppose the events are mutually independent events. Then is independent of , first by factorization against finite intersections of previous events and then by part (a). ThereforeIf , the sum in part (ii) is infinite almost surely, and consequentlyThis is the Second Borel-Cantelli lemma. In fact part (ii) also yields probability zero in the convergent case for these independent events.
The sigma-algebra generated by a random variable is the smallest sigma-algebra on making a measurable function into . Equivalently, it is the intersection of all sigma-algebras containing the inverse images of Borel sets .
Let . This collection is already a sigma-algebra: ,The right-hand sets are in , since the Borel sigma-algebra is closed under the indicated operations. Any sigma-algebra making measurable must contain every member of . Conversely makes measurable by definition. HenceThis equality holds exactly as a collection of sets, without completing the sigma-algebra.
We prove the Doob-Dynkin lemma here by simple function approximation. Choose such that everywhere, and letEach is a finite-valued -measurable function and pointwise. Write its level sets as , with associated values . By part (i), choose Borel sets with . Define the Borel measurable functionsAlthough the chosen need not partition all of , their inverse images do partition , so exactly.
Apply scalar clipping to each with bounds , preserving this equality, and define . A bounded limit superior of Borel measurable functions is a finite Borel measurable function. At every the limit of a sequence exists and givesThus the factorization is exact for a bounded, exactly -measurable function. If hypotheses are instead given only up to null sets, the corresponding conclusion is a factorization holding almost surely after choosing a representative.
For this part and part (c), take to be -valued everywhere. The uniform distribution gives , but the paper's expression for is undefined there because . Define on . Keep exactly as printed, including on that null set; this preserves the exact sigma-algebra equality in part (ii). Every slope formula below is asserted on , hence almost surely.
The floor function gives the deterministic boundfor every outcome, including . Thus all three convergence assertions hold: there is pointwise, and hence almost sure convergence, as well as convergence in probability and convergence in L2. In detail, for the probability is zero as soon as ; alsoThe uniform distribution even gives the exact second moment of the error by integrating over the dyadic partition:
Every is a Borel measurable function of , by the formula involving the floor function. ThusConversely, part (i) gives the everywhere identity . For fixed , this is the pointwise limit of random variables measurable with respect to . Such a limit of a sequence is measurable, so . ConsequentlyThese are increasing-precision observations even when the first finitely many are discarded; they do not behave like the independent random variables whose tail sigma-algebra appears in Question 1(b).
A family of integrable random variables is uniformly integrable whenThe Lipschitz condition gives, on ,Our chosen zero value on satisfies the same bound. Hence the random variables are integrable, and for every tail expectation in the definition vanishes. Therefore the family is uniformly integrable.
For , repeated use of the floor function identity givesThus the filtration satisfies . Each positive-probability atom of a sigma-algebra here has the formwith probability ; is a possible additional null set atom. Averaging over each dyadic interval gives a versionFor a globally defined version of the right side, assign any value, for example zero, on .
Indeed, the displayed random variable is -measurable and bounded by . On each its integral isby the uniform distribution. Every member of is a union of the displayed sets and the possible zero-probability atom. Summing these identities therefore verifies the defining conditional expectation property on all of .
Each is a bounded Borel measurable function of , including the specified value at . Therefore is an adapted process for and consists of integrable random variables.
Fix an atom of a sigma-algebra in with positive probability, corresponding to the dyadic interval , with . By the uniform distribution, each half has conditional probability . The conditional expectation of on that atom is thereforeThe middle values cancel. On the zero-probability atom the conditional expectation can be chosen as zero, agreeing with our version of . Henceso is a martingale. This is the dyadic slope martingale associated with the Lipschitz function .
The uniformly integrable martingale convergence theorem states that a uniformly integrable martingale has an integrable terminal random variable such that almost surely and in the L1 norm, andThe last identity follows by passing to the limit of a sequence in for and , using convergence in L1.
Part (b)(iii) verifies uniform integrability for , soMoreover almost surely. In this particular problem the common bound also yields convergence in Lp for every finite , including convergence in L2: the dominated convergence theorem applies to . General uniform integrability alone does not assert these higher-power conclusions.
Choose as the pointwise limit of a sequence of where it exists, and as zero otherwise. The convergence event and every are -measurable, so this is an exactly -measurable version, bounded by . Part (a)(ii), the Doob-Dynkin lemma, supplies a Borel measurable function on such that . Applying scalar clipping to with bounds preserves that equality and ensures everywhere.
Part (c)(ii) and the conditional expectation formula from part (b)(iv) now giveSince the indices form a countable family, these identities may be taken on one common full-probability event.
For fixed , both the slope and the displayed average are constant on the atom , whose probability is . An equality holding almost surely of these constants forces the deterministic equalitySum over . The telescoping sum givesThus the desired identity holds at every dyadic endpoint, including , without evaluating the undefined slope at .
Finally, given , take dyadic endpoints . The Lipschitz condition implies , and the bound on the Borel measurable function givesPassing to the limit of a sequence provesThis is a martingale proof of the integral representation of a Lipschitz function. It constructs a bounded Lebesgue integrable function representing the increments of , and in particular proves absolute continuity of . No prior assumption that has a derivative is needed.
Write for the conserved total number of tokens. The main case has positive integer initial holdings. If an initial holding is zero, take ; the formulas below still hold when . If , the stochastic process is constant and .
A discrete-time stopping time for a filtration is a random variable taking values in such that for every . It means that whether stopping has occurred by time can be determined from the information available then.
For the first elimination time,Each event in this finite union belongs to , by the definition of the natural filtration. Therefore is a stopping time. This verification does not require first knowing whether is finite almost surely.
Put . Before , all three players are active. Each unordered pair is selected with probability , and each direction of transfer then has conditional probability . Given the current holdings , a transfer within the first pair has mean productFor transfers within the other two pairs the analogous values are and . Averaging over pairs givesAt and after elimination the product is zero, since an eliminated player never re-enters. In particular the stopped process has incrementThe indicator function is -measurable, and the expression in parentheses has zero conditional expectation on its support. The stopped process is adapted and integrable: at fixed , its absolute value is bounded by . HenceThis is the product martingale for three-player token exchange.
After , the token product remains zero, whereas the deterministic term continues to increase. Combining this with the pre-elimination calculation in part (ii),The stochastic process is adapted and integrable at each fixed time, and the displayed conditional expectation is nonnegative. Thus is a submartingale.
For it is neither a martingale nor a supermartingale. If , there is positive probability that the first player transfers a token to the second in each of the next rounds. Until the last such round all three remain active, so this event has probability and entails . At time the displayed conditional expectation is therefore strictly positive on an event of positive probability, ruling out both the zero drift required of a martingale and the nonpositive drift required of a supermartingale. If an initial holding is zero, and the same conclusion follows immediately. The degenerate case gives a constant martingale.
The bounded-time optional sampling theorem says that for an integrable discrete-time martingale and a bounded stopping time , . It requires no assumption about an eventual unbounded stopping time.
Apply this theorem with , or simply take the expectation of the stopped martingale in part (ii). For we obtainSince ,The monotone convergence theorem now yields . In particular almost surely, which has been established without assuming that optional stopping is valid at .
For each sample path with finite , eventually equals . Also . The dominated convergence theorem gives . Taking the limit of a sequence in the earlier identity therefore provesFor example, initial holdings give expectation one, as the first transfer must eliminate its giver. This computes the first elimination time, rather than the later time when one player owns all tokens.
Assume is square-integrable. Since and have the same probability distribution, is also square-integrable and . The product is integrable by the Cauchy-Schwarz inequality.
We use the defining test-function identity for conditional expectation: for bounded -measurable , . Take and let . The dominated convergence theorem, with bounds and , givesThis is the extension of the conditional expectation pull-out identity to this square-integrable multiplier. ConsequentlyA nonnegative random variable with zero expectation is zero almost surely. HenceGeometrically, this is the equality case in the L2 space orthogonal projection interpretation of conditional expectation.
The function is a concave function, and is integrable since . The concave form of the conditional Jensen inequality givesThe random variables and have the same probability distribution, so . Using the law of total expectation, the nonnegative difference between the right and left sides of the inequality has zero expectation. It must vanish almost surely. ThereforeThe equality comes from the distributional assumption as well as the conditional Jensen inequality.
We first establish the lower truncation identity as well. The pair has the same hypotheses as , because conditional expectation is linear and negation preserves equality of probability distributions. Apply part (ii) to this pair and multiply by to getFor every real ,Using this identity, part (ii), the lower truncation identity, and linearity of conditional expectation givesIn particular the argument does not assume that a function obtained by scalar clipping is a convex function or a concave function.
Write . The bounded random variables and have the same probability distribution, and the displayed identity identifies the latter as the conditional expectation of the former. They are square-integrable, so part (i) gives almost surely. Take and discard the countable union of exceptional null sets. At every remaining outcome, let to obtainThus conditional expectation preserving a distribution forces equality even when only integrability is assumed.
Let . Inverse images commute with complements and countable unions, so this is a sub-sigma-algebra of . The random variable is -measurable.
The assumption says that is a measure-preserving transformation. Consequently has the same probability distribution as and is integrable. It also implies for every integrable random variable , first for indicator functions, then for simple functions, and then by positive and negative approximation.
To identify a conditional expectation, take any . The assumed identity with the bounded random variable givesEvery member of has the displayed form , so this verifies all defining conditional expectation identities. ThereforeApply part (iii), since this conditional expectation has the same probability distribution as . We concludeThis is invariance from integral duality for a measure-preserving transformation; neither invertibility of nor a second moment of is required.
Source paper: released examination archive.
Put . Both and its indicator function are measurable, and . Thus is an integrable random variable. Monotonicity of conditional expectation givesThe measurable-factor property of conditional expectation says that a bounded -measurable function satisfies for every integrable random variable . Here the factor need not be bounded. Apply that property first to and , then use monotone convergence on the nonnegative products, including the conditional version, to obtainAll the left-hand conditional expectations are well defined; the final one is finite almost surely because is an integrable random variable. Since almost surely, division now yieldsThis proves the conditional Markov inequality with a measurable threshold without assuming that is an integrable random variable. The measurable-factor rule, with its product-integrability condition, is also stated in the standard conditional expectation theory.[ref]
Write and . The two conditional expectation identities supply a -measurable version of and a -measurable version of . Work with those versions, which do not change any almost sure equality. Both lie in L2 space, and the Cauchy-Schwarz inequality makes their product an integrable random variable.
Testing the first conditional expectation identity against , and the second against , givesFor completeness, these tests with unbounded multipliers are valid by first using the bounded truncations and , then passing to the limit with the Cauchy-Schwarz inequality and convergence in L2. Consequently,A nonnegative random variable with zero expected value vanishes almost surely. Therefore almost surely. This is mutual conditional expectation rigidity in L2; it also follows from the equality case for conditional second moments.
For a counterexample to equality of the original random variables, let give probability to each of , set , and use the nonconstant function . Then takes both values and . It is measurable with respect to both generated sigma-algebras, so both required conditional expectation identities hold. Symmetry gives , while neither random variable can be zero. Thus
For every , is a sigma-algebra contained in , and including one more random variable among its generators can only enlarge it. Hence ; the trivial is contained in every sigma-algebra. These are exactly the requirements for a filtration.
The constant is -measurable. Suppose is -measurable. The pair is then -measurable, and the event is -measurable because comparison of two real coordinates defines a Borel set. Define its indicator function by . The recursion becomesIt is a measurable function of that pair. Mathematical induction proves is -measurable for every , so is an adapted process. The same recursion also proves at every finite time, a useful bound for the later integrability arguments.
Retain the binary random variables . Iterating the recursion givesEach binary history determines the full vector , so its sigma-algebra is finite by the sigma-algebra of a finite-valued random vector. Conversely, because , the integer uniquely determines the digits ; also . ThusAll binary histories have positive probability. By independence of the driving uniform random variables, along a fixed finite history every intermediate state is in , so each subsequent conditional branch probability, either or , is strictly positive. It follows that has nonempty fibres, each an atom of a sigma-algebra, and exactly elements.
Adaptedness from the preceding part gives . For , however, contains the events for every . They have distinct probabilities , so there are infinitely many distinct such events. Consequently the finite sigma-algebra cannot equal . The inclusion is strict for every .
The adapted process is bounded by , so every is an integrable random variable, indeed a square-integrable random variable. Independence of from and its continuous uniform distribution giveThis calculation with a random threshold is justified by conditioning on the -measurable value of : for a fixed , the Lebesgue integral equals . More formally, independence integrates the bounded Borel measurable function over its second coordinate. Thereforewhich verifies the martingale property for this filtration.
Since , the conditional expectation of the squared martingale difference isThe law of total expectation yields . In particular, for every .
The L2-bounded martingale convergence theorem states that a martingale with converges both almost surely and with convergence in L2 to a square-integrable random variable. Its hypotheses hold because . Thus there is almost surely with both kinds of convergence. Alternatively, the martingale convergence theorem gives the almost sure convergence, and the bound gives convergence in L2 by the dominated convergence theorem.[ref]
Probability: Theory and Examples (fifth edition) by Rick Durrett. §4.4, Theorem 4.4.6, printed p. 237: the Lp martingale convergence theorem
The calculation of the conditional expectation of the square is especially informative. The martingale property makes the cross term vanish in the square expansion, soSubtracting this from givesTaking expected values and iterating provesBy bounded convergence theorem, . The random variable inside this expected value is nonnegative, so it is zero almost surely; on this forces . Again by bounded convergence theorem, . HenceThis is the Bernoulli polarization martingale with update size . It also has an exact mean squared error: the terminal representation and the equality case for conditional second moments give
Let . First, lies in the open interval . For example, if has a finite lower endpoint , then almost surely, and its expected value is strictly positive; hence . The corresponding argument at a finite upper endpoint gives the other strict inequality. Integrability ensures is finite when either endpoint is infinite.
The tangent affine function at gives the supporting inequality for a differentiable convex function. Under the stipulated condition , contact with that tangent occurs only at : defineThen , and for every . One direct proof uses : is strictly increasing, so decreases towards on the left and increases away from on the right. Thereforewith equality exactly when almost surely, equivalently when almost surely. Conversely, an almost surely constant plainly gives equality. This proves the strict Jensen equality criterion.
No extra assumption that is an integrable random variable is needed to interpret this argument. Its negative part is bounded by the absolute value of the integrable random variable , since . Thus its expected value is defined in ; if it equals the finite number , then and the required integrability follows automatically. Equality holds if and only if almost surely.
For each , put . Closure of a sigma-algebra under countable unions and countable intersections givesThe events decrease to . Continuity of probability from above applies because . Also, whenever , soLetting provesThis reverse Fatou inequality for events requires no independence.
For the reverse inclusion, fix an outcome for which only finitely many occur. Choose such that for every . The finite prefix has a finite maximum when ; there is no prefix to check when . Since , for every sufficiently large that prefix satisfies . For the remaining indices , the nondecreasing thresholds giveThus for every sufficiently large , so only finitely many occur. Taking the contrapositive proves the reverse inclusion, and hence the pointwise event equalityThis exceedance equivalence for increasing thresholds is deterministic. Its proof uses both monotonicity of and divergence to ; it does not require independence or identical probability distributions.
The tail sigma-algebra of this sequence isFor each fixed , the preceding event equality givesEvery event on the right is determined by coordinates with index at least . Therefore for every , and . The random variables are independent, so Kolmogorov's zero–one law applies: every tail event has probability zero or one. Hence .
The role of independence can also be seen directly. A tail event is independent of each finite initial sigma-algebra . The Monotone class theorem extends this independence to ; since itself lies there, it is independent of itself. Thus .[ref]
Probability: Theory and Examples (fifth edition) by Rick Durrett. §2.5, Theorem 2.5.3, printed pp. 81–82: the tail sigma-field zero–one law
For , the definition of the common cumulative distribution function givesThe strict exceedance matters here: an atom of a measure at belongs to , so it is already included in . The events are mutually independent events, since each depends on a separate member of the independent random variables .
If , countable subadditivity gives, for every ,Continuity of probability then gives . This is the First Borel-Cantelli lemma and does not need independence.
If the series diverges, independence and give, for every fixed ,Taking shows that the probability of no exceedance after is zero. A countable union over shows that finitely many exceedances has probability zero. This is the Second Borel-Cantelli lemma. Together with the preceding event equality, it proves
The conditions on the cumulative distribution function imply almost surely. With , adjoin and the trivial . The random variables are nonnegative, adapted, and bounded by at each fixed time. Independence and giveThus this is the product martingale from independent mean-one factors, with . The almost sure supermartingale convergence theorem states that a nonnegative supermartingale converges almost surely to a finite integrable random variable. Applied to this nonnegative martingale, it shows almost surely. Every convergent real sequence is bounded, so almost surely.
The printed maximum can in fact be taken literally here. If almost surely, all products equal . Otherwise the strict Jensen equality criterion, applied to the strictly convex function on , gives . Independence yields . By Markov's inequality, for every . The First Borel-Cantelli lemma and the countable choices give almost surely. Since , a sequence with this limit attains its positive supremum among finitely many initial terms. This is an instance of fractional moment decay of independent mean-one products.
Use the nonnegative martingale and filtration established above. Fix a finite and letFor , is the union of the threshold-crossing events up to , so is a bounded stopping time. The optional stopping theorem for a martingale at a bounded stopping time gives . On one has ; on its complement one still has . ThereforeOnly a bounded stopping time has been used, so no extra uniform integrability assumption at an unbounded hitting time is implicit. This is also the Doob maximal inequality for a nonnegative submartingale specialized to a mean-one martingale.
For , the bound ensures the finite moment . By Jensen's inequality, . The process is an adapted, nonnegative integrable random variable at each time, and independence givesThus is a submartingale, and . The Doob maximal inequality for a nonnegative submartingale states that for . Apply it with . Since the power function is increasing on ,Combining this with the preceding bound givesThe result is a bound on the running maximum, which is why a maximal inequality for a submartingale, rather than an estimate of the single terminal random variable, is needed.[ref]
Probability: Theory and Examples (fifth edition) by Rick Durrett. §4.4, Theorem 4.4.2, printed p. 235: the submartingale maximal inequality
For each integer , letIf had distinct members, finite additivity on their disjoint singleton Borel sets would give total measure at least , contradicting . Thus .
Every positive singleton measure is at least for some sufficiently large . Consequently the set of point atoms of a measure isA countable union of finite sets is at most countable. This proves the claim, including the possibility that the set is empty. The same argument gives the countability of point atoms of a finite measure, with in place of .
Articles were limited to the first 100 out of 112 total.
Articles by others on the same topic
There are currently no matching articles.