Average the conditional probability in (i) over :This is exactly the acceptance mass for an unnormalized rejection envelope. In normalized form the envelope is , giving the same acceptance probability. Here bounds the ratio of the unnormalized functions, so its value need not equal the envelope constant for the normalized probability density functions.
The squeeze changes the number of expensive target evaluations, while preserving the per-proposal acceptance probability. The expected number of proposals per accepted draw is .
Conditioning on the observed time. The native PDF defines as the first production time and then conditions on that production occurring at . If the intended information is its numerical value , the answer depends on . We first compute this conditional probability using a conditional probability density; conditioning on an exact value of a continuous random variable means a density ratio, since .
Before , no molecules of the second chemical species are present, so the joint-removal chemical reaction cannot occur. Molecules of the first chemical species arrive as a rate- Poisson process, and each independently starts a clock with a rate- exponential distribution for producing the first molecule of the second chemical species. Define the unnormalized probability mass functionThe chemical master equation before the first production, with production treated as killing, isMultiplying by and summing gives a partial differential equation for the probability generating function:Its solution, verifiable by direct differentiation, isThus , the survival function is , and the conditional distribution of given survival to is a Poisson distribution of mean .
Production in from Markov chain state has joint probability . Therefore the probability density function of isThe first production leaves unchanged. Taking the density ratio gives a size-biased distribution of the surviving count:In particular, under this reading the requested conditional probability isThe shift by one matters: an observation made exactly when production occurs preferentially selects larger counts, since their production reaction propensity function is larger.
Without observing the numerical time. If the conditioning merely repeats the definition of , the requested probability is instead the unconditional count at that stopping time. Before production, increases by one at rate , while production occurs at rate in Markov chain state . The competing exponential clocks implyThe first factor requires a second arrival before production from count one; the second requires production before a third arrival. The first arrival itself is certain. Production eventually occurs with probability one, as is also clear from . As a consistency check, averaging the time-conditioned answer against givesThese are two distinct, explicitly specified interpretations of the printed conditioning.
The partition theorem is the law of total probability. If form a finite or countable partition of a sample space into pairwise disjoint events with positive probabilities, then for any event ,Indeed, is the disjoint union of the events , so countable additivity gives the formula after applying the definition of conditional probability. Zero-probability members can be omitted.
For events with , the conditional probability isIt measures the probability of after restricting the sample space to and renormalizing. This quotient does not define conditional probability given an event of zero probability.
Let be the event that wins, and the event that his first toss is a tail. For a nontrivial starting state , a first tail has probability and changes his holding to . By the chain rule for probabilities,Since , the definition of conditional probability givesIn particular, when , losing the first coin would end the game in defeat, so the conditional answer is zero. At conditioning on victory is undefined, while at the game has already ended and no first toss occurs.
The events and are disjoint and their union is . Additivity of probability givesBoth conditioning events have positive probability because . Apply the definition of conditional probability to each term to obtain the law of total probability:
The conditional probability rescales the probability of the part of lying in by the probability of :The denominator makes itself have conditional probability one.
Let count the red balls among the added balls. By independence of random variables, has a binomial distribution with parameters . The total red count is , and the box has balls. Conditional on , sampling without replacement giveswhere denote red first and second draws. Averaging these conditional probabilities and taking their ratio givesThe binomial distribution moments give and . ConsequentlyTherefore the red-ball prediction with one certain red ball isIt reduces to at and approaches as the number of randomly coloured extra balls grows. Taking an unweighted average of the remaining red fractions would miss the change in weights caused by taking a conditional probability given the first red draw.
The two definitions of conditional probability giveSubstitution proves Bayes' theorem:The positive probabilities assumed in the question make both conditional expressions defined.
Let be a finite or countable partition of a sample space into events of positive probability. The events are disjoint and their union is . Countable additivity and the definition of conditional probability therefore give the law of total probabilityCells of zero probability contribute zero through and can be omitted rather than assigning an undefined conditional probability.
Let identify the selected coin and let be the event of two heads. The prior coin probabilities are equal, and the conditional probabilities of are . By Bayes' theorem,The full posterior distribution over the three biases is .
Since the form a partition of a set of the sample space, the events are pairwise disjoint and their set union is . By countable additivity of probability, followed by the definition of conditional probability,Every ratio is legitimate because each . This proves the countable law of total probability.
For events with , the conditional probability isThis renormalizes the probability of within . The elementary ratio definition does not assign a value when .
Put . By the law of total probability,For , termwise differentiation of the geometric series, valid inside its radius of convergence, givesTaking therefore yieldsSince , this is the zero-based geometric distribution with parameterThis illustrates Bernoulli thinning of a geometric count. Here , as .
For the reverse conditional distribution, Bayes' theorem gives, for ,ThusFor the conditional probability is zero. The conditional distribution of is the failure-count form of a negative binomial distribution, with successes and success parameter : the geometric-binomial posterior is shifted negative binomial.
Because the partition the sample space, the events are disjoint and their union is . Finite additivity and the definition of conditional probability give the law of total probabilityThe assumption ensures that each conditional probability is defined.
Let be the number of days up to and including the first breakdown, and the event of a morning first breakdown. For , conditional probability givesThusThis geometric distribution counts the day on which the first breakdown occurs. Its parameter is the probability of at least one breakdown during a day, rather than the morning breakdown probability alone.
For a finite or countable measurable partition, the law of total probability isIndeed, is the disjoint union of , and the conditional probability formula gives each positive-probability term. Zero-probability cells contribute zero; their conditionals need not be defined by a ratio. If all cells have positive probability, the sum simply runs over every .
The Markov property and time homogeneity giveSince , conditional probability yields the Markov chain return bridge expressionThe explicit formula gives , soThe conditioning event has positive probability at each finite time even though those return probabilities tend to zero. Taking an undefined conditional on an infinite-time zero-probability event is not needed.
The all-red event is a subset of the same-colour event . Its probability is , while the three disjoint monochromatic cases giveThus the conditional probability isThe monochromatic outcomes are not equally likely, so counting colours alone would give the wrong conditional answer.
